2024-09-12T02:19:01.438 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:19:01.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:19:01.584 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901626' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjdCu+n2yZouRnEWdS5sSCWs4rPwAU+YoSV5h066ck8KRSJKLpMcjxoSUKByDTBN7wmiPGupjaogowC2pni6hM= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGWdt85WYid4F02mpPpEDgXZWvPi8Jsf80d+5wUNM6AqNHeBxUt4p/fN+4ii3p5jiGVaIHeKIGo+Y6CjtJE3V0Y= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+I+xVy+S/Ul8nSgdAj5mCccomSmiijsYEqDGzvisyv95jU5/Kivb+AjoiHnVlwgSwa1ZPP/cE+sVKRQE/6bpI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:19:01.585 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:19:01.585 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:19:01.586 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:19:01.587 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:19:01.614 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:19:01.614 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:19:01.614 INFO:teuthology.packaging:ref: None 2024-09-12T02:19:01.614 INFO:teuthology.packaging:tag: None 2024-09-12T02:19:01.615 INFO:teuthology.packaging:branch: squid 2024-09-12T02:19:01.615 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:19:01.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:19:01.849 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:19:01.850 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:19:01.875 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:19:01.876 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:19:01.881 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:19:01.904 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:19:01.911 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:19:01.934 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:13:47.850426', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjdCu+n2yZouRnEWdS5sSCWs4rPwAU+YoSV5h066ck8KRSJKLpMcjxoSUKByDTBN7wmiPGupjaogowC2pni6hM='} 2024-09-12T02:19:01.958 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:13:47.851413', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGWdt85WYid4F02mpPpEDgXZWvPi8Jsf80d+5wUNM6AqNHeBxUt4p/fN+4ii3p5jiGVaIHeKIGo+Y6CjtJE3V0Y='} 2024-09-12T02:19:01.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:13:47.852205', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+I+xVy+S/Ul8nSgdAj5mCccomSmiijsYEqDGzvisyv95jU5/Kivb+AjoiHnVlwgSwa1ZPP/cE+sVKRQE/6bpI='} 2024-09-12T02:19:01.982 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:19:01.989 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T02:19:01.989 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T02:19:01.989 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T02:19:01.990 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:19:02.077 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c3228bbe0>, signals=[15]) 2024-09-12T02:19:02.077 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:19:02.083 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:19:02.084 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:19:02.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:19:02.162 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T02:19:02.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:19:02.237 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-12T02:19:02.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:19:02.312 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:19:02.318 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-12T02:19:02.337 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-12T02:19:02.337 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-12T02:19:02.397 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-12T02:19:02.397 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:19:02.398 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:19:02.399 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:19:02.399 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:19:02.399 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:19:02.399 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-12T02:19:02.422 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-12T02:19:02.441 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-12T02:19:02.441 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-12T02:19:02.501 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-12T02:19:02.501 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-12T02:19:02.501 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-12T02:19:02.501 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:19:02.501 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-12T02:19:02.504 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:19:02.504 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:19:02.504 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-12T02:19:02.504 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:19:02.504 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:19:02.504 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:19:02.504 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:19:02.505 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:19:02.505 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:19:02.505 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-12T02:19:02.538 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-12T02:19:02.557 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-12T02:19:02.558 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-12T02:19:02.617 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-12T02:19:02.617 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:19:02.618 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:19:02.619 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:19:02.619 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-12T02:19:02.638 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:19:03.544 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:19:04.074 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:19:04.074 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:19:04.077 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:19:04.080 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:19:04.097 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:19:04.186 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:19:04.187 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:19:04.189 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:19:04.192 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:19:04.282 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:19:04.363 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:19:04.377 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:19:04.377 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T02:19:04.377 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T02:19:04.377 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:19:04.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:19:04.395 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-12T02:19:04.453 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:19:04.453 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-503.el9.x86_64 2024-09-12T02:19:04.453 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-09-12T02:19:07.270 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.2 MB 00:01 2024-09-12T02:19:10.288 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-12T02:19:17.055 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:02 2024-09-12T02:19:18.605 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 19 kB 00:00 2024-09-12T02:19:19.535 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T02:19:24.949 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-12T02:19:26.955 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:19:26.955 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:19:27.049 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-12T02:19:27.056 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-12T02:19:27.057 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-12T02:19:27.058 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:19:27.058 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 79 M 2024-09-12T02:19:27.058 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 126 M 2024-09-12T02:19:27.058 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-12T02:19:27.150 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 316 kB/s | 23 kB 00:00 2024-09-12T02:19:27.734 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-12T02:19:29.242 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-12T02:19:29.559 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-09-12T02:19:29.559 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:19:29.560 INFO:teuthology.orchestra.run.smithi100.stdout:Total 31 MB/s | 79 MB 00:02 2024-09-12T02:19:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-12T02:19:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-12T02:19:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-12T02:19:31.552 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-12T02:19:31.552 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-12T02:19:33.992 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-12T02:19:34.625 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:19:34.710 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:19:37.484 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:19:37.614 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:19:42.422 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:19:42.531 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:47.378 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:20:25.721 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:20:25.761 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:20:26.106 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:20:26.107 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:20:26.107 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:20:26.107 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:20:26.989 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:20:26.989 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:20:26.989 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-12T02:20:26.990 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:20:26.990 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:20:26.990 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:20:26.990 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:20:26.990 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:20:26.990 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-12T02:20:27.342 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:20:27.436 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:20:27.436 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:20:27.436 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:20:27.436 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:20:27.436 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:20:27.437 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T02:20:27.437 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:20:27.437 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:20:27.495 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:20:27.495 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:20:27.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-12T02:20:27.528 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-12T02:20:27.528 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-12T02:20:27.528 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-12T02:20:27.528 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-12T02:20:27.528 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-12T02:20:27.528 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:20:27.528 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-12T02:20:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:20:27.530 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:20:27.530 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:20:27.530 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:20:27.530 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-12T02:20:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:20:27.530 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:20:27.531 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:20:27.531 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:20:27.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:20:28.227 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-12T02:20:29.575 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:20:29.607 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-12T02:20:29.609 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-12T02:20:29.625 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.nl1XIcUd0d 2024-09-12T02:20:29.625 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nl1XIcUd0d 2024-09-12T02:20:29.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.nl1XIcUd0d 2024-09-12T02:20:29.843 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.nl1XIcUd0d is 6KB 2024-09-12T02:20:29.894 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.nl1XIcUd0d 2024-09-12T02:20:29.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:20:29.972 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:20:29.972 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:20:29.972 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:20:29.973 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:20:29.974 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:20:30.139 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-12T02:21:00.143 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T02:21:00.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T02:21:00.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:21:18.529 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-12T02:21:27.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T02:21:27.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:21:30.593 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-12T02:21:42.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T02:21:42.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:22:01.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-12T02:22:16.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T02:22:16.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:22:16.517 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-12T02:22:16.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T02:22:16.943 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:22:16.944 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-12T02:22:16.958 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:22:16.958 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:22:16.958 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:22:16.958 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:22:17.959 DEBUG:teuthology.parallel:result is None 2024-09-12T02:22:17.959 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:22:17.967 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:22:17.967 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:22:17.970 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:22:17.972 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:22:17.991 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:22:17.998 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:22:18.004 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:22:18.004 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:22:18.024 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:22:18.031 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:22:18.159 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:22:18.166 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:22:18.167 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:22:18.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:22:18.185 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:22:18.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:22:18.203 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:22:18.205 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:22:18.227 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:22:18.262 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:22:18.278 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:22:18.278 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:22:18.298 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:22:18.316 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:22:18.318 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:22:18.320 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:22:18.327 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:22:18.328 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:22:18.330 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:22:18.332 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:22:18.360 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:22:18.370 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:22:18.370 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:22:18.392 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:22:18.400 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:22:18.418 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:22:18.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:22:18.577 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:22:18.619 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:22:18.657 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:22:18.657 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:22:18.718 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:22:18.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:22:18.814 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:22:18.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:22:18.943 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:22:18.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:22:19.011 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:22:19.058 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:22:19.109 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:22:19.196 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:22:19.236 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:22:19.236 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:22:19.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-12T02:22:19.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-12T02:22:19.310 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-12T02:22:19.344 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:22:19.378 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:22:19.402 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:22:19.808 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:22:19.816 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:22:19.817 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:22:19.859 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:22:19.909 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:22:19.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-12T02:22:20.012 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-12T02:22:20.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-12T02:22:20.060 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-12T02:22:20.063 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-12T02:22:20.126 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-12T02:22:20.128 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:22:20.128 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-12T02:22:20.156 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-12T02:22:20.157 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-12T02:22:20.178 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-12T02:22:20.178 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-12T02:22:20.202 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-12T02:22:20.202 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:22:20.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:22:20.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:22:20.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:22:20.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:22:20.257 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:22:20.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:22:20.286 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:22:20.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:22:20.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:22:20.459 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:22:20.497 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:22:20.510 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:22:20.523 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:22:20.524 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi117.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:26:19.845 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-12T02:26:19.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T02:26:19.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:19.926 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-12T02:26:20.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T02:26:20.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T02:26:20.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:20.088 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-12T02:26:20.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T02:26:20.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-12T02:26:20.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:26:20.298 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-12T02:26:20.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-12T02:26:20.385 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:26:20.396 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:26:20.396 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:26:20.397 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:26:20.399 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:26:20.399 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:26:20.402 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:26:20.402 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:26:20.429 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:26:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:26:20.444 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:26:20.444 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:26:20.450 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:26:20.464 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:26:20.469 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-12T02:26:20.470 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-12T02:26:20.479 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-12T02:26:20.481 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-12T02:26:20.489 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-12T02:26:20.493 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:26:20.495 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:26:20.500 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-12T02:26:20.508 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:26:20.509 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:26:20.515 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:26:20.528 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:26:20.569 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:26:20.571 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:26:20.576 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:26:20.576 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-12T02:26:20.576 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.576 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.576 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.577 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.577 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:26:20.578 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T02:26:20.578 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.578 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.578 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.578 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.593 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:26:20.596 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:26:20.596 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-12T02:26:20.596 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.596 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.596 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.597 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:26:20.597 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:26:20.606 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:26:20.606 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:26:20.606 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:26:20.606 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:26:20.611 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:26:20.611 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:26:20.612 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:26:20.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:26:20.614 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:26:20.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:26:20.615 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:26:20.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:26:20.760 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:26:20.760 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:26:20.763 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:26:20.764 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:26:20.768 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:26:20.769 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:26:20.873 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:26:20.873 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:26:20.873 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:26:20.882 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:26:20.882 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:26:20.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:26:20.888 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:26:20.888 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:26:20.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:26:20.899 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:26:20.900 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:26:20.908 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:26:20.908 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:26:20.914 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:26:20.914 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:26:20.965 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:26:20.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:26:20.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:26:21.039 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:26:21.048 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:26:21.055 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:26:21.104 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-12T02:26:21.105 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-12T02:26:21.112 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-12T02:26:21.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-12T02:26:21.119 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-12T02:26:21.120 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-12T02:26:21.329 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-12T02:26:21.336 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-12T02:26:21.349 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-12T02:26:21.356 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:26:21.363 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:26:21.375 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:26:21.905 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-12T02:26:21.998 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 247 kB/s | 84 kB 00:00 2024-09-12T02:26:22.189 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:26:22.282 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:26:22.465 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T02:26:22.557 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T02:26:23.032 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-12T02:26:24.100 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 34 kB/s | 84 kB 00:02 2024-09-12T02:26:24.190 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-12T02:26:24.392 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T02:26:24.667 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T02:26:24.692 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 37 MB/s | 20 MB 00:00 2024-09-12T02:26:25.209 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-12T02:26:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-12T02:26:31.109 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-12T02:26:32.560 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-12T02:26:32.920 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.5 MB 00:00 2024-09-12T02:26:33.298 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-12T02:26:34.379 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-12T02:26:35.466 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-12T02:26:38.620 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-12T02:26:40.997 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:26:40.997 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:26:41.009 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:26:41.010 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:26:41.011 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:26:41.012 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:26:41.013 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:26:41.016 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:26:41.016 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:26:41.030 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:26:41.079 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:26:41.105 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:26:41.106 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:26:41.107 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:26:41.108 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:26:41.109 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:26:41.110 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:26:41.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-12T02:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-12T02:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T02:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-09-12T02:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-12T02:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-09-12T02:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-12T02:26:41.488 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T02:26:41.688 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.4 MB/s | 897 kB 00:00 2024-09-12T02:26:41.789 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 5.4 MB 00:00 2024-09-12T02:26:41.814 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.1 MB/s | 145 kB 00:00 2024-09-12T02:26:41.914 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 2.4 MB 00:00 2024-09-12T02:26:42.048 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-12T02:26:42.140 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 21 MB/s | 4.7 MB 00:00 2024-09-12T02:26:42.590 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T02:26:42.632 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 609 kB/s | 25 kB 00:00 2024-09-12T02:26:42.752 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 17 MB/s | 11 MB 00:00 2024-09-12T02:26:42.816 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-12T02:26:42.874 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 464 kB/s | 27 kB 00:00 2024-09-12T02:26:42.925 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-12T02:26:43.009 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-12T02:26:43.076 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T02:26:43.134 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T02:26:43.209 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-12T02:26:43.366 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:26:43.367 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:26:43.378 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:26:43.379 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:26:43.380 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:26:43.381 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:26:43.382 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:26:43.385 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:26:43.386 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:26:43.448 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:26:43.464 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:26:43.465 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:26:43.466 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:26:43.467 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:26:43.468 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:26:43.469 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:26:43.470 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:26:43.471 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:26:43.472 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:26:43.473 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:26:43.474 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:26:43.475 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:26:43.476 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout:Install 148 Packages 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-12T02:26:43.477 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:26:43.478 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 226 M 2024-09-12T02:26:43.478 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-12T02:26:43.510 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 17 MB 00:01 2024-09-12T02:26:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-12T02:26:43.543 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 1.3 MB/s | 45 kB 00:00 2024-09-12T02:26:43.618 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-12T02:26:43.644 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 1.3 MB/s | 136 kB 00:00 2024-09-12T02:26:43.669 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.1 MB/s | 162 kB 00:00 2024-09-12T02:26:43.703 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T02:26:43.737 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T02:26:43.762 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-12T02:26:43.787 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:26:43.837 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T02:26:43.904 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 479 kB/s | 32 kB 00:00 2024-09-12T02:26:43.971 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.1 MB/s | 146 kB 00:00 2024-09-12T02:26:44.030 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-12T02:26:44.073 INFO:teuthology.orchestra.run.smithi189.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 45 kB/s | 6.5 kB 00:00 2024-09-12T02:26:44.231 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 14 MB/s | 3.6 MB 00:00 2024-09-12T02:26:44.306 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-12T02:26:44.507 INFO:teuthology.orchestra.run.smithi189.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.0 MB/s | 897 kB 00:00 2024-09-12T02:26:44.582 INFO:teuthology.orchestra.run.smithi189.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T02:26:44.766 INFO:teuthology.orchestra.run.smithi189.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.5 MB/s | 5.4 MB 00:00 2024-09-12T02:26:44.789 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 23 MB/s | 49 MB 00:02 2024-09-12T02:26:44.815 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 97 kB/s | 49 kB 00:00 2024-09-12T02:26:44.840 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 330 kB/s | 16 kB 00:00 2024-09-12T02:26:44.899 INFO:teuthology.orchestra.run.smithi189.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-12T02:26:44.957 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 8.0 MB/s | 7.4 MB 00:00 2024-09-12T02:26:44.982 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 285 kB 00:00 2024-09-12T02:26:45.024 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-12T02:26:45.049 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 199 kB/s | 18 kB 00:00 2024-09-12T02:26:45.074 INFO:teuthology.orchestra.run.smithi189.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.8 MB/s | 2.4 MB 00:00 2024-09-12T02:26:45.125 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-12T02:26:45.192 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-12T02:26:45.217 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-12T02:26:45.267 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-12T02:26:45.291 INFO:teuthology.orchestra.run.smithi189.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-12T02:26:45.292 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T02:26:45.318 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T02:26:45.343 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T02:26:45.368 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T02:26:45.402 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-12T02:26:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 21 MB 00:01 2024-09-12T02:26:45.527 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 856 kB/s | 107 kB 00:00 2024-09-12T02:26:45.553 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-12T02:26:45.559 INFO:teuthology.orchestra.run.smithi189.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 433 kB/s | 25 kB 00:00 2024-09-12T02:26:45.594 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-12T02:26:45.636 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-12T02:26:45.678 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-12T02:26:45.721 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-12T02:26:45.754 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-12T02:26:45.796 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-12T02:26:45.846 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-12T02:26:45.880 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-12T02:26:45.884 INFO:teuthology.orchestra.run.smithi189.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 18 MB/s | 11 MB 00:00 2024-09-12T02:26:45.914 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 385 kB/s | 45 kB 00:00 2024-09-12T02:26:45.947 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-12T02:26:45.959 INFO:teuthology.orchestra.run.smithi189.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.0 MB/s | 228 kB 00:00 2024-09-12T02:26:45.973 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 6.1 MB/s | 581 kB 00:00 2024-09-12T02:26:45.998 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-12T02:26:46.023 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-12T02:26:46.026 INFO:teuthology.orchestra.run.smithi189.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 407 kB/s | 27 kB 00:00 2024-09-12T02:26:46.048 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T02:26:46.085 INFO:teuthology.orchestra.run.smithi189.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 544 kB/s | 32 kB 00:00 2024-09-12T02:26:46.090 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-12T02:26:46.116 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 417 kB/s | 38 kB 00:00 2024-09-12T02:26:46.177 INFO:teuthology.orchestra.run.smithi189.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.0 MB/s | 752 kB 00:00 2024-09-12T02:26:46.216 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-12T02:26:46.258 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-12T02:26:46.277 INFO:teuthology.orchestra.run.smithi189.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.6 MB/s | 163 kB 00:00 2024-09-12T02:26:46.291 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-12T02:26:46.325 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T02:26:46.353 INFO:teuthology.orchestra.run.smithi189.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 127 kB 00:00 2024-09-12T02:26:46.442 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-09-12T02:26:46.461 INFO:teuthology.orchestra.run.smithi189.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.6 MB/s | 506 kB 00:00 2024-09-12T02:26:46.484 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-09-12T02:26:46.551 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-09-12T02:26:46.577 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 655 kB/s | 87 kB 00:00 2024-09-12T02:26:46.627 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 816 kB/s | 61 kB 00:00 2024-09-12T02:26:46.652 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-12T02:26:46.736 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-09-12T02:26:46.761 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-12T02:26:46.786 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-12T02:26:46.811 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-12T02:26:46.837 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-12T02:26:46.844 INFO:teuthology.orchestra.run.smithi189.stdout:(18/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.5 MB/s | 17 MB 00:01 2024-09-12T02:26:46.854 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-09-12T02:26:46.904 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-12T02:26:46.928 INFO:teuthology.orchestra.run.smithi189.stdout:(19/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-12T02:26:46.945 INFO:teuthology.orchestra.run.smithi189.stdout:(20/156): python3-ceph-argparse-19.1.1-298.gb53 451 kB/s | 45 kB 00:00 2024-09-12T02:26:46.954 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-12T02:26:46.979 INFO:teuthology.orchestra.run.smithi189.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 2.7 MB/s | 136 kB 00:00 2024-09-12T02:26:46.979 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-12T02:26:47.004 INFO:teuthology.orchestra.run.smithi189.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-12T02:26:47.029 INFO:teuthology.orchestra.run.smithi189.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.2 MB/s | 321 kB 00:00 2024-09-12T02:26:47.055 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-09-12T02:26:47.063 INFO:teuthology.orchestra.run.smithi189.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T02:26:47.088 INFO:teuthology.orchestra.run.smithi189.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-12T02:26:47.089 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 315 kB/s | 42 kB 00:00 2024-09-12T02:26:47.114 INFO:teuthology.orchestra.run.smithi189.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:26:47.114 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-12T02:26:47.139 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-09-12T02:26:47.173 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-12T02:26:47.180 INFO:teuthology.orchestra.run.smithi189.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-12T02:26:47.198 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-12T02:26:47.223 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 640 kB/s | 54 kB 00:00 2024-09-12T02:26:47.272 INFO:teuthology.orchestra.run.smithi189.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-12T02:26:47.273 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-12T02:26:47.297 INFO:teuthology.orchestra.run.smithi189.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 273 kB/s | 32 kB 00:00 2024-09-12T02:26:47.322 INFO:teuthology.orchestra.run.smithi189.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T02:26:47.332 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-12T02:26:47.357 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-12T02:26:47.399 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-12T02:26:47.433 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-12T02:26:47.467 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-12T02:26:47.509 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-09-12T02:26:47.542 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-12T02:26:47.576 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-12T02:26:47.609 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-12T02:26:47.685 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-12T02:26:47.765 INFO:teuthology.orchestra.run.smithi189.stdout:(31/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 22 MB/s | 49 MB 00:02 2024-09-12T02:26:47.768 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-12T02:26:47.802 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T02:26:47.827 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-12T02:26:47.840 INFO:teuthology.orchestra.run.smithi189.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.6 MB/s | 3.6 MB 00:00 2024-09-12T02:26:47.852 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-12T02:26:47.873 INFO:teuthology.orchestra.run.smithi189.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.2 MB/s | 249 kB 00:00 2024-09-12T02:26:47.898 INFO:teuthology.orchestra.run.smithi189.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 849 kB/s | 49 kB 00:00 2024-09-12T02:26:47.924 INFO:teuthology.orchestra.run.smithi189.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 329 kB/s | 16 kB 00:00 2024-09-12T02:26:47.949 INFO:teuthology.orchestra.run.smithi189.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-12T02:26:48.036 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-12T02:26:48.049 INFO:teuthology.orchestra.run.smithi189.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 10 MB/s | 7.4 MB 00:00 2024-09-12T02:26:48.061 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 124 kB/s | 26 kB 00:00 2024-09-12T02:26:48.074 INFO:teuthology.orchestra.run.smithi189.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 146 kB/s | 18 kB 00:00 2024-09-12T02:26:48.100 INFO:teuthology.orchestra.run.smithi189.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-12T02:26:48.103 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T02:26:48.137 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-09-12T02:26:48.162 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-12T02:26:48.221 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-12T02:26:48.225 INFO:teuthology.orchestra.run.smithi189.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-12T02:26:48.250 INFO:teuthology.orchestra.run.smithi189.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-12T02:26:48.254 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-12T02:26:48.279 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 745 kB/s | 43 kB 00:00 2024-09-12T02:26:48.292 INFO:teuthology.orchestra.run.smithi189.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-12T02:26:48.305 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-12T02:26:48.334 INFO:teuthology.orchestra.run.smithi189.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-12T02:26:48.338 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-09-12T02:26:48.364 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T02:26:48.376 INFO:teuthology.orchestra.run.smithi189.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-12T02:26:48.398 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T02:26:48.419 INFO:teuthology.orchestra.run.smithi189.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-12T02:26:48.423 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T02:26:48.443 INFO:teuthology.orchestra.run.smithi189.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-12T02:26:48.448 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:26:48.455 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.5 MB 00:01 2024-09-12T02:26:48.469 INFO:teuthology.orchestra.run.smithi189.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-12T02:26:48.473 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T02:26:48.494 INFO:teuthology.orchestra.run.smithi189.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T02:26:48.549 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-12T02:26:48.574 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-09-12T02:26:48.599 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T02:26:48.625 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-12T02:26:48.650 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T02:26:48.675 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T02:26:48.700 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:26:48.703 INFO:teuthology.orchestra.run.smithi189.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 513 kB/s | 107 kB 00:00 2024-09-12T02:26:48.726 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:26:48.736 INFO:teuthology.orchestra.run.smithi189.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-12T02:26:48.751 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:26:48.762 INFO:teuthology.orchestra.run.smithi189.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-12T02:26:48.785 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:26:48.787 INFO:teuthology.orchestra.run.smithi189.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-12T02:26:48.810 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-12T02:26:48.812 INFO:teuthology.orchestra.run.smithi189.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-12T02:26:48.838 INFO:teuthology.orchestra.run.smithi189.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-12T02:26:48.843 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T02:26:48.854 INFO:teuthology.orchestra.run.smithi189.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-12T02:26:48.869 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-12T02:26:48.879 INFO:teuthology.orchestra.run.smithi189.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-12T02:26:48.913 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 410 kB/s | 28 kB 00:00 2024-09-12T02:26:48.929 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 510 kB/s | 31 kB 00:00 2024-09-12T02:26:48.930 INFO:teuthology.orchestra.run.smithi189.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-12T02:26:48.946 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-12T02:26:48.955 INFO:teuthology.orchestra.run.smithi189.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-12T02:26:48.963 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-12T02:26:48.989 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:26:49.014 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T02:26:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T02:26:49.064 INFO:teuthology.orchestra.run.smithi189.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-12T02:26:49.064 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T02:26:49.089 INFO:teuthology.orchestra.run.smithi189.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.3 MB/s | 581 kB 00:00 2024-09-12T02:26:49.107 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-09-12T02:26:49.114 INFO:teuthology.orchestra.run.smithi189.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-12T02:26:49.132 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-09-12T02:26:49.139 INFO:teuthology.orchestra.run.smithi189.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-12T02:26:49.157 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:26:49.182 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T02:26:49.206 INFO:teuthology.orchestra.run.smithi189.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.1 MB/s | 3.0 MB 00:00 2024-09-12T02:26:49.232 INFO:teuthology.orchestra.run.smithi189.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-12T02:26:49.233 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:26:49.257 INFO:teuthology.orchestra.run.smithi189.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-12T02:26:49.282 INFO:teuthology.orchestra.run.smithi189.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-12T02:26:49.433 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-12T02:26:49.441 INFO:teuthology.orchestra.run.smithi189.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-12T02:26:49.483 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-12T02:26:49.534 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-12T02:26:49.541 INFO:teuthology.orchestra.run.smithi189.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-12T02:26:49.559 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 542 kB/s | 41 kB 00:00 2024-09-12T02:26:49.584 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-12T02:26:49.625 INFO:teuthology.orchestra.run.smithi189.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-12T02:26:49.643 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 6.9 MB/s | 3.2 MB 00:00 2024-09-12T02:26:49.693 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-12T02:26:49.735 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-12T02:26:49.741 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:26:49.741 INFO:teuthology.orchestra.run.smithi100.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-12T02:26:49.750 INFO:teuthology.orchestra.run.smithi189.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-09-12T02:26:49.817 INFO:teuthology.orchestra.run.smithi189.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 8.4 MB/s | 4.9 MB 00:00 2024-09-12T02:26:49.875 INFO:teuthology.orchestra.run.smithi189.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T02:26:49.897 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-12T02:26:49.909 INFO:teuthology.orchestra.run.smithi189.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-09-12T02:26:49.968 INFO:teuthology.orchestra.run.smithi189.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T02:26:50.035 INFO:teuthology.orchestra.run.smithi189.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-12T02:26:50.110 INFO:teuthology.orchestra.run.smithi189.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-09-12T02:26:50.135 INFO:teuthology.orchestra.run.smithi189.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-12T02:26:50.161 INFO:teuthology.orchestra.run.smithi189.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-12T02:26:50.194 INFO:teuthology.orchestra.run.smithi189.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-12T02:26:50.220 INFO:teuthology.orchestra.run.smithi189.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T02:26:50.253 INFO:teuthology.orchestra.run.smithi189.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-12T02:26:50.320 INFO:teuthology.orchestra.run.smithi189.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-12T02:26:50.404 INFO:teuthology.orchestra.run.smithi189.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-12T02:26:50.429 INFO:teuthology.orchestra.run.smithi189.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-12T02:26:50.462 INFO:teuthology.orchestra.run.smithi189.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T02:26:50.488 INFO:teuthology.orchestra.run.smithi189.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-12T02:26:50.521 INFO:teuthology.orchestra.run.smithi189.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T02:26:50.597 INFO:teuthology.orchestra.run.smithi189.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-12T02:26:50.622 INFO:teuthology.orchestra.run.smithi189.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-12T02:26:50.647 INFO:teuthology.orchestra.run.smithi189.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-12T02:26:50.668 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T02:26:50.672 INFO:teuthology.orchestra.run.smithi189.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-12T02:26:50.698 INFO:teuthology.orchestra.run.smithi189.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-12T02:26:50.723 INFO:teuthology.orchestra.run.smithi189.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-12T02:26:50.757 INFO:teuthology.orchestra.run.smithi189.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-12T02:26:50.782 INFO:teuthology.orchestra.run.smithi189.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T02:26:50.807 INFO:teuthology.orchestra.run.smithi189.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-12T02:26:50.841 INFO:teuthology.orchestra.run.smithi189.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-12T02:26:50.866 INFO:teuthology.orchestra.run.smithi189.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T02:26:50.891 INFO:teuthology.orchestra.run.smithi189.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:26:50.933 INFO:teuthology.orchestra.run.smithi189.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T02:26:50.951 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-12T02:26:50.958 INFO:teuthology.orchestra.run.smithi189.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-12T02:26:50.983 INFO:teuthology.orchestra.run.smithi189.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-12T02:26:51.050 INFO:teuthology.orchestra.run.smithi189.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-12T02:26:51.100 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-12T02:26:51.100 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-12T02:26:51.101 INFO:teuthology.orchestra.run.smithi189.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T02:26:51.134 INFO:teuthology.orchestra.run.smithi189.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T02:26:51.151 INFO:teuthology.orchestra.run.smithi189.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-12T02:26:51.227 INFO:teuthology.orchestra.run.smithi189.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-12T02:26:51.302 INFO:teuthology.orchestra.run.smithi189.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-12T02:26:51.327 INFO:teuthology.orchestra.run.smithi189.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-12T02:26:51.353 INFO:teuthology.orchestra.run.smithi189.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-09-12T02:26:51.378 INFO:teuthology.orchestra.run.smithi189.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T02:26:51.403 INFO:teuthology.orchestra.run.smithi189.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T02:26:51.437 INFO:teuthology.orchestra.run.smithi189.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T02:26:51.462 INFO:teuthology.orchestra.run.smithi189.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:26:51.487 INFO:teuthology.orchestra.run.smithi189.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-12T02:26:51.513 INFO:teuthology.orchestra.run.smithi189.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-12T02:26:51.538 INFO:teuthology.orchestra.run.smithi189.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-12T02:26:51.705 INFO:teuthology.orchestra.run.smithi189.stdout:(118/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-12T02:26:51.739 INFO:teuthology.orchestra.run.smithi189.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 761 kB/s | 172 kB 00:00 2024-09-12T02:26:51.781 INFO:teuthology.orchestra.run.smithi189.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-09-12T02:26:51.814 INFO:teuthology.orchestra.run.smithi189.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-12T02:26:51.848 INFO:teuthology.orchestra.run.smithi189.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T02:26:51.873 INFO:teuthology.orchestra.run.smithi189.stdout:(123/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2024-09-12T02:26:51.898 INFO:teuthology.orchestra.run.smithi189.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T02:26:51.924 INFO:teuthology.orchestra.run.smithi189.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T02:26:51.949 INFO:teuthology.orchestra.run.smithi189.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T02:26:51.974 INFO:teuthology.orchestra.run.smithi189.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-12T02:26:51.999 INFO:teuthology.orchestra.run.smithi189.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T02:26:52.025 INFO:teuthology.orchestra.run.smithi189.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:26:52.050 INFO:teuthology.orchestra.run.smithi189.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:26:52.075 INFO:teuthology.orchestra.run.smithi189.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:26:52.109 INFO:teuthology.orchestra.run.smithi189.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:26:52.134 INFO:teuthology.orchestra.run.smithi189.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-12T02:26:52.159 INFO:teuthology.orchestra.run.smithi189.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:26:52.193 INFO:teuthology.orchestra.run.smithi189.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-12T02:26:52.227 INFO:teuthology.orchestra.run.smithi189.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-09-12T02:26:52.252 INFO:teuthology.orchestra.run.smithi189.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 522 kB/s | 31 kB 00:00 2024-09-12T02:26:52.277 INFO:teuthology.orchestra.run.smithi189.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:26:52.319 INFO:teuthology.orchestra.run.smithi189.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-12T02:26:52.345 INFO:teuthology.orchestra.run.smithi189.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-09-12T02:26:52.370 INFO:teuthology.orchestra.run.smithi189.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-12T02:26:52.395 INFO:teuthology.orchestra.run.smithi189.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-12T02:26:52.420 INFO:teuthology.orchestra.run.smithi189.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:26:52.446 INFO:teuthology.orchestra.run.smithi189.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T02:26:52.471 INFO:teuthology.orchestra.run.smithi189.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-12T02:26:52.496 INFO:teuthology.orchestra.run.smithi189.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:26:52.521 INFO:teuthology.orchestra.run.smithi189.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T02:26:52.563 INFO:teuthology.orchestra.run.smithi189.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T02:26:52.697 INFO:teuthology.orchestra.run.smithi189.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 18 MB/s | 2.3 MB 00:00 2024-09-12T02:26:52.772 INFO:teuthology.orchestra.run.smithi189.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:26:52.814 INFO:teuthology.orchestra.run.smithi189.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 15 MB/s | 1.8 MB 00:00 2024-09-12T02:26:52.839 INFO:teuthology.orchestra.run.smithi189.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 612 kB/s | 41 kB 00:00 2024-09-12T02:26:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.6 MB/s | 249 kB 00:00 2024-09-12T02:26:52.965 INFO:teuthology.orchestra.run.smithi189.stdout:(154/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-12T02:26:53.007 INFO:teuthology.orchestra.run.smithi189.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-12T02:26:53.057 INFO:teuthology.orchestra.run.smithi189.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-12T02:26:53.063 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:26:53.063 INFO:teuthology.orchestra.run.smithi189.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-12T02:26:53.353 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-12T02:26:53.353 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-12T02:26:54.265 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-12T02:26:54.415 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-12T02:26:54.416 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-12T02:26:56.082 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:26:56.207 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-12T02:26:56.207 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-12T02:26:58.361 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:26:58.362 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:26:58.376 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:26:58.377 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:26:58.378 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:26:58.379 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:26:58.381 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:26:58.384 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:26:58.385 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:26:58.448 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:26:58.465 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:26:58.466 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:26:58.467 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:26:58.468 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:26:58.469 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:26:58.470 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:26:58.471 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:26:58.472 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:26:58.473 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:26:58.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:26:58.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:26:58.476 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout:Install 148 Packages 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 8 Packages 2024-09-12T02:26:58.477 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:26:58.478 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 226 M 2024-09-12T02:26:58.478 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-12T02:26:59.075 INFO:teuthology.orchestra.run.smithi117.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-12T02:26:59.267 INFO:teuthology.orchestra.run.smithi117.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 897 kB 00:00 2024-09-12T02:26:59.359 INFO:teuthology.orchestra.run.smithi117.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T02:26:59.426 INFO:teuthology.orchestra.run.smithi117.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T02:26:59.534 INFO:teuthology.orchestra.run.smithi117.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 1.5 MB 00:00 2024-09-12T02:26:59.618 INFO:teuthology.orchestra.run.smithi117.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 9.2 MB/s | 2.4 MB 00:00 2024-09-12T02:26:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-12T02:26:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:26:59.852 INFO:teuthology.orchestra.run.smithi117.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 4.7 MB 00:00 2024-09-12T02:26:59.868 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:27:00.061 INFO:teuthology.orchestra.run.smithi117.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 21 MB 00:01 2024-09-12T02:27:00.089 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:27:00.119 INFO:teuthology.orchestra.run.smithi117.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 433 kB/s | 25 kB 00:00 2024-09-12T02:27:00.139 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:27:00.165 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:27:00.216 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:27:00.561 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:27:00.666 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:00.789 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:00.794 INFO:teuthology.orchestra.run.smithi117.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 17 MB 00:01 2024-09-12T02:27:00.817 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:00.844 INFO:teuthology.orchestra.run.smithi117.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:27:00.909 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:00.911 INFO:teuthology.orchestra.run.smithi117.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 406 kB/s | 27 kB 00:00 2024-09-12T02:27:00.938 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:27:00.978 INFO:teuthology.orchestra.run.smithi117.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 476 kB/s | 32 kB 00:00 2024-09-12T02:27:01.103 INFO:teuthology.orchestra.run.smithi117.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 5.9 MB/s | 752 kB 00:00 2024-09-12T02:27:01.121 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:27:01.168 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:27:01.196 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:01.237 INFO:teuthology.orchestra.run.smithi117.stdout:(15/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 7.7 MB/s | 11 MB 00:01 2024-09-12T02:27:01.262 INFO:teuthology.orchestra.run.smithi117.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.0 MB/s | 163 kB 00:00 2024-09-12T02:27:01.287 INFO:teuthology.orchestra.run.smithi117.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T02:27:01.301 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:01.321 INFO:teuthology.orchestra.run.smithi117.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.5 MB/s | 506 kB 00:00 2024-09-12T02:27:01.331 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:27:01.371 INFO:teuthology.orchestra.run.smithi117.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 905 kB/s | 45 kB 00:00 2024-09-12T02:27:01.394 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:27:01.423 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:27:01.448 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:27:01.463 INFO:teuthology.orchestra.run.smithi117.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-12T02:27:01.530 INFO:teuthology.orchestra.run.smithi117.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-12T02:27:01.642 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:27:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:27:01.963 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:27:02.001 INFO:teuthology.orchestra.run.smithi117.stdout:(22/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 26 MB/s | 49 MB 00:01 2024-09-12T02:27:02.047 INFO:teuthology.orchestra.run.smithi117.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 621 kB/s | 321 kB 00:00 2024-09-12T02:27:02.082 INFO:teuthology.orchestra.run.smithi117.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 301 kB 00:00 2024-09-12T02:27:02.097 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:02.116 INFO:teuthology.orchestra.run.smithi117.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.4 MB/s | 100 kB 00:00 2024-09-12T02:27:02.141 INFO:teuthology.orchestra.run.smithi117.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T02:27:02.165 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:02.225 INFO:teuthology.orchestra.run.smithi117.stdout:(27/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 5.7 MB/s | 5.3 MB 00:00 2024-09-12T02:27:02.250 INFO:teuthology.orchestra.run.smithi117.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.5 MB/s | 171 kB 00:00 2024-09-12T02:27:02.276 INFO:teuthology.orchestra.run.smithi117.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 636 kB/s | 32 kB 00:00 2024-09-12T02:27:02.301 INFO:teuthology.orchestra.run.smithi117.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T02:27:02.359 INFO:teuthology.orchestra.run.smithi117.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-12T02:27:02.382 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:02.443 INFO:teuthology.orchestra.run.smithi117.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T02:27:02.491 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:27:02.510 INFO:teuthology.orchestra.run.smithi117.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 743 kB/s | 49 kB 00:00 2024-09-12T02:27:02.557 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-12T02:27:02.583 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:27:02.610 INFO:teuthology.orchestra.run.smithi117.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 24 MB/s | 7.4 MB 00:00 2024-09-12T02:27:02.612 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:27:02.636 INFO:teuthology.orchestra.run.smithi117.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 131 kB/s | 16 kB 00:00 2024-09-12T02:27:02.655 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:27:02.669 INFO:teuthology.orchestra.run.smithi117.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-12T02:27:02.694 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:27:02.703 INFO:teuthology.orchestra.run.smithi117.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-12T02:27:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:27:02.728 INFO:teuthology.orchestra.run.smithi117.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-12T02:27:02.732 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:27:02.764 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:27:02.787 INFO:teuthology.orchestra.run.smithi117.stdout:(39/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.0 MB/s | 3.6 MB 00:00 2024-09-12T02:27:02.794 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:27:02.796 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:27:02.828 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:27:02.840 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:27:02.853 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:27:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:27:02.896 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:27:02.900 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:27:02.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:27:03.022 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:27:03.054 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:27:03.097 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:27:03.104 INFO:teuthology.orchestra.run.smithi117.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 199 kB/s | 80 kB 00:00 2024-09-12T02:27:03.181 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:27:03.216 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:27:03.221 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:27:03.259 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:27:03.288 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:27:03.321 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:03.337 INFO:teuthology.orchestra.run.smithi117.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-12T02:27:03.357 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:27:03.396 INFO:teuthology.orchestra.run.smithi117.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 867 kB/s | 253 kB 00:00 2024-09-12T02:27:03.402 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:27:03.443 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:03.472 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:03.477 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:27:03.521 INFO:teuthology.orchestra.run.smithi117.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 853 kB/s | 106 kB 00:00 2024-09-12T02:27:03.562 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:03.593 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:27:03.608 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:27:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T02:27:03.663 INFO:teuthology.orchestra.run.smithi117.stdout:(45/156): libgfortran-11.5.0-2.el9.x86_64.rpm 857 kB/s | 801 kB 00:00 2024-09-12T02:27:03.670 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:27:03.742 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:27:03.747 INFO:teuthology.orchestra.run.smithi117.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-12T02:27:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-12T02:27:03.798 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:27:03.826 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:03.831 INFO:teuthology.orchestra.run.smithi117.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-12T02:27:03.921 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:03.944 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:27:03.989 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:27:04.006 INFO:teuthology.orchestra.run.smithi117.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-12T02:27:04.011 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:27:04.032 INFO:teuthology.orchestra.run.smithi117.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-12T02:27:04.037 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:27:04.057 INFO:teuthology.orchestra.run.smithi117.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-12T02:27:04.099 INFO:teuthology.orchestra.run.smithi117.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-12T02:27:04.124 INFO:teuthology.orchestra.run.smithi117.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-09-12T02:27:04.158 INFO:teuthology.orchestra.run.smithi117.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-12T02:27:04.183 INFO:teuthology.orchestra.run.smithi117.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-12T02:27:04.193 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:27:04.217 INFO:teuthology.orchestra.run.smithi117.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-12T02:27:04.230 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:27:04.242 INFO:teuthology.orchestra.run.smithi117.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T02:27:04.274 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:27:04.276 INFO:teuthology.orchestra.run.smithi117.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-12T02:27:04.321 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:27:04.357 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:27:04.359 INFO:teuthology.orchestra.run.smithi117.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-12T02:27:04.364 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:27:04.402 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:27:04.426 INFO:teuthology.orchestra.run.smithi117.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-12T02:27:04.445 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:27:04.451 INFO:teuthology.orchestra.run.smithi117.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-09-12T02:27:04.502 INFO:teuthology.orchestra.run.smithi117.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-09-12T02:27:04.514 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:27:04.527 INFO:teuthology.orchestra.run.smithi117.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-09-12T02:27:04.552 INFO:teuthology.orchestra.run.smithi117.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T02:27:04.577 INFO:teuthology.orchestra.run.smithi117.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T02:27:04.603 INFO:teuthology.orchestra.run.smithi117.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-12T02:27:04.605 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:27:04.613 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:04.680 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:27:04.694 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:04.734 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:27:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:27:04.820 INFO:teuthology.orchestra.run.smithi117.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-09-12T02:27:04.840 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:27:04.876 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:27:04.922 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:27:04.925 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:04.953 INFO:teuthology.orchestra.run.smithi117.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T02:27:04.958 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:27:04.995 INFO:teuthology.orchestra.run.smithi117.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-12T02:27:05.001 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:27:05.021 INFO:teuthology.orchestra.run.smithi117.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T02:27:05.043 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:27:05.046 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:27:05.087 INFO:teuthology.orchestra.run.smithi117.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 9.2 MB/s | 4.9 MB 00:00 2024-09-12T02:27:05.140 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:27:05.146 INFO:teuthology.orchestra.run.smithi117.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T02:27:05.177 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:27:05.180 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:27:05.180 INFO:teuthology.orchestra.run.smithi117.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-09-12T02:27:05.220 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:27:05.221 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:27:05.262 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:27:05.288 INFO:teuthology.orchestra.run.smithi117.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-12T02:27:05.294 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:27:05.338 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:27:05.347 INFO:teuthology.orchestra.run.smithi117.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-12T02:27:05.365 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:27:05.370 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:27:05.414 INFO:teuthology.orchestra.run.smithi117.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-12T02:27:05.414 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:27:05.446 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:27:05.472 INFO:teuthology.orchestra.run.smithi117.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-09-12T02:27:05.474 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:27:05.543 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:27:05.548 INFO:teuthology.orchestra.run.smithi117.stdout:(78/156): postgresql-server-13.16-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-09-12T02:27:05.573 INFO:teuthology.orchestra.run.smithi117.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-09-12T02:27:05.604 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:27:05.643 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:27:05.657 INFO:teuthology.orchestra.run.smithi117.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-12T02:27:05.682 INFO:teuthology.orchestra.run.smithi117.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-12T02:27:05.687 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:27:05.708 INFO:teuthology.orchestra.run.smithi117.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-12T02:27:05.720 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:27:05.741 INFO:teuthology.orchestra.run.smithi117.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-12T02:27:05.763 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:27:05.775 INFO:teuthology.orchestra.run.smithi117.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-12T02:27:05.797 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:27:05.800 INFO:teuthology.orchestra.run.smithi117.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T02:27:05.833 INFO:teuthology.orchestra.run.smithi117.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-09-12T02:27:05.841 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:27:05.859 INFO:teuthology.orchestra.run.smithi117.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T02:27:05.869 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:27:05.872 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:27:05.901 INFO:teuthology.orchestra.run.smithi117.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-12T02:27:05.926 INFO:teuthology.orchestra.run.smithi117.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-12T02:27:05.939 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:27:05.982 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:27:05.985 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:27:05.993 INFO:teuthology.orchestra.run.smithi117.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-12T02:27:06.006 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:27:06.018 INFO:teuthology.orchestra.run.smithi117.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-09-12T02:27:06.044 INFO:teuthology.orchestra.run.smithi117.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-09-12T02:27:06.058 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:27:06.102 INFO:teuthology.orchestra.run.smithi117.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 718 kB/s | 42 kB 00:00 2024-09-12T02:27:06.114 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:27:06.128 INFO:teuthology.orchestra.run.smithi117.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 530 kB/s | 44 kB 00:00 2024-09-12T02:27:06.200 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:27:06.203 INFO:teuthology.orchestra.run.smithi117.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-09-12T02:27:06.228 INFO:teuthology.orchestra.run.smithi117.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-09-12T02:27:06.242 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:27:06.253 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:27:06.261 INFO:teuthology.orchestra.run.smithi117.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-12T02:27:06.280 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:27:06.295 INFO:teuthology.orchestra.run.smithi117.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-12T02:27:06.308 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:27:06.321 INFO:teuthology.orchestra.run.smithi117.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-12T02:27:06.349 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:27:06.362 INFO:teuthology.orchestra.run.smithi117.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T02:27:06.388 INFO:teuthology.orchestra.run.smithi117.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-12T02:27:06.389 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:27:06.421 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:27:06.421 INFO:teuthology.orchestra.run.smithi117.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-09-12T02:27:06.451 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:27:06.472 INFO:teuthology.orchestra.run.smithi117.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-12T02:27:06.485 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:27:06.519 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:27:06.522 INFO:teuthology.orchestra.run.smithi117.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T02:27:06.552 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:27:06.564 INFO:teuthology.orchestra.run.smithi117.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-12T02:27:06.586 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:27:06.589 INFO:teuthology.orchestra.run.smithi117.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-12T02:27:06.672 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:27:06.717 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:27:06.748 INFO:teuthology.orchestra.run.smithi117.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-12T02:27:06.748 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:27:06.777 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:27:06.790 INFO:teuthology.orchestra.run.smithi117.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-12T02:27:06.823 INFO:teuthology.orchestra.run.smithi117.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-09-12T02:27:06.849 INFO:teuthology.orchestra.run.smithi117.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 860 kB/s | 49 kB 00:00 2024-09-12T02:27:06.851 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:27:06.865 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:27:06.874 INFO:teuthology.orchestra.run.smithi117.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-12T02:27:06.900 INFO:teuthology.orchestra.run.smithi117.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T02:27:06.903 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:27:06.907 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:27:06.958 INFO:teuthology.orchestra.run.smithi117.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-12T02:27:06.984 INFO:teuthology.orchestra.run.smithi117.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:27:06.984 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:27:07.017 INFO:teuthology.orchestra.run.smithi117.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-12T02:27:07.025 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:27:07.042 INFO:teuthology.orchestra.run.smithi117.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-12T02:27:07.068 INFO:teuthology.orchestra.run.smithi117.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T02:27:07.093 INFO:teuthology.orchestra.run.smithi117.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:27:07.127 INFO:teuthology.orchestra.run.smithi117.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T02:27:07.152 INFO:teuthology.orchestra.run.smithi117.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi117.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:27:07.211 INFO:teuthology.orchestra.run.smithi117.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T02:27:07.236 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:27:07.278 INFO:teuthology.orchestra.run.smithi117.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-12T02:27:07.290 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:27:07.311 INFO:teuthology.orchestra.run.smithi117.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-09-12T02:27:07.337 INFO:teuthology.orchestra.run.smithi117.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2024-09-12T02:27:07.362 INFO:teuthology.orchestra.run.smithi117.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T02:27:07.365 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:27:07.387 INFO:teuthology.orchestra.run.smithi117.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T02:27:07.403 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:27:07.412 INFO:teuthology.orchestra.run.smithi117.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T02:27:07.438 INFO:teuthology.orchestra.run.smithi117.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:27:07.439 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:27:07.463 INFO:teuthology.orchestra.run.smithi117.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:27:07.480 INFO:teuthology.orchestra.run.smithi117.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T02:27:07.486 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:27:07.513 INFO:teuthology.orchestra.run.smithi117.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:27:07.522 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:27:07.530 INFO:teuthology.orchestra.run.smithi117.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 995 kB/s | 16 kB 00:00 2024-09-12T02:27:07.556 INFO:teuthology.orchestra.run.smithi117.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:27:07.565 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:27:07.598 INFO:teuthology.orchestra.run.smithi117.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-12T02:27:07.607 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:27:07.615 INFO:teuthology.orchestra.run.smithi117.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-12T02:27:07.617 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:27:07.632 INFO:teuthology.orchestra.run.smithi117.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 919 kB/s | 31 kB 00:00 2024-09-12T02:27:07.648 INFO:teuthology.orchestra.run.smithi117.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-12T02:27:07.665 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:27:07.682 INFO:teuthology.orchestra.run.smithi117.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-12T02:27:07.699 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:27:07.699 INFO:teuthology.orchestra.run.smithi117.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-12T02:27:07.733 INFO:teuthology.orchestra.run.smithi117.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-12T02:27:07.741 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:27:07.784 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:27:07.800 INFO:teuthology.orchestra.run.smithi117.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-12T02:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:27:07.833 INFO:teuthology.orchestra.run.smithi117.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 895 kB/s | 90 kB 00:00 2024-09-12T02:27:07.834 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:27:07.853 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:27:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-09-12T02:27:07.884 INFO:teuthology.orchestra.run.smithi117.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T02:27:07.907 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:27:07.909 INFO:teuthology.orchestra.run.smithi117.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:27:07.943 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:27:07.943 INFO:teuthology.orchestra.run.smithi117.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T02:27:07.983 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:27:07.993 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:27:07.993 INFO:teuthology.orchestra.run.smithi117.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T02:27:08.023 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:27:08.026 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:27:08.049 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:27:08.074 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:27:08.149 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:27:08.210 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:27:08.235 INFO:teuthology.orchestra.run.smithi117.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-12T02:27:08.240 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:27:08.318 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:27:08.358 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:27:08.369 INFO:teuthology.orchestra.run.smithi117.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.4 MB/s | 3.2 MB 00:00 2024-09-12T02:27:08.456 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:27:08.484 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:27:08.518 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:27:08.557 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:27:08.589 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:27:08.619 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:27:08.654 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:27:08.660 INFO:teuthology.orchestra.run.smithi117.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 140 kB/s | 41 kB 00:00 2024-09-12T02:27:08.686 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:27:08.737 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:27:08.779 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:27:08.867 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:27:08.910 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:27:08.941 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:27:08.968 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:27:09.044 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:27:09.045 INFO:teuthology.orchestra.run.smithi117.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-12T02:27:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:27:09.100 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:27:09.169 INFO:teuthology.orchestra.run.smithi117.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 489 kB/s | 249 kB 00:00 2024-09-12T02:27:09.212 INFO:teuthology.orchestra.run.smithi117.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-12T02:27:09.253 INFO:teuthology.orchestra.run.smithi117.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-09-12T02:27:09.670 INFO:teuthology.orchestra.run.smithi117.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 2.4 MB 00:00 2024-09-12T02:27:09.676 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:27:09.676 INFO:teuthology.orchestra.run.smithi117.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-12T02:27:09.818 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:27:09.864 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:27:09.898 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:27:09.997 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:27:10.061 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:27:10.106 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:27:10.194 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:27:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:27:10.411 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:27:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:27:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:27:10.441 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:27:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:27:10.519 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:27:10.781 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:27:10.827 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:27:10.899 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-12T02:27:10.909 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:27:10.940 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:27:10.977 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:27:11.052 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-12T02:27:11.052 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-12T02:27:11.159 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:27:11.272 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:27:11.491 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:27:11.521 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:27:11.593 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:27:11.623 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:27:12.493 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:27:12.578 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:27:12.614 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:27:12.656 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:27:12.838 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-12T02:27:12.838 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-12T02:27:12.967 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:27:13.010 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:27:13.101 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:27:13.132 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:27:13.168 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:27:13.644 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:27:13.671 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:27:13.743 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:27:13.773 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:27:13.912 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:13.947 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:27:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:27:14.642 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:27:14.642 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:27:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:27:16.623 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:16.661 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:17.210 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:17.248 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:17.358 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:27:19.075 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-12T02:27:19.165 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:27:19.287 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:27:19.458 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:27:19.509 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:27:19.533 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:27:19.577 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:27:19.929 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:27:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:20.166 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:20.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:27:20.475 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:27:20.537 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:27:20.564 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:27:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:27:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:27:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:27:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:27:21.119 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:27:21.256 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:27:21.359 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:21.436 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:21.641 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:27:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:27:21.855 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:27:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:27:21.926 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:27:21.998 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:27:22.043 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:27:22.075 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:27:22.119 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:27:22.160 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:27:22.197 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:27:22.265 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:27:22.318 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:27:22.349 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:27:22.385 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:27:22.460 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:27:22.496 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:27:22.557 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:27:22.584 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:27:22.654 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:27:22.708 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:27:22.939 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:27:22.993 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:27:23.520 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:27:23.605 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:27:23.644 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:27:23.687 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:27:23.725 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:27:23.766 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:27:23.931 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:27:23.987 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:27:24.041 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:27:24.114 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:27:24.154 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:27:24.190 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:27:24.237 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:27:24.273 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:27:24.317 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:27:24.358 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:27:24.495 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:27:24.535 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:27:24.645 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:27:24.882 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:27:24.927 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:27:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:27:25.003 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:27:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:27:25.103 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:27:25.237 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:27:25.277 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:27:25.304 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:27:25.339 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:27:25.378 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:27:25.410 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:27:25.440 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:27:25.474 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:27:25.516 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:27:25.566 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:27:25.600 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:27:25.686 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:27:25.731 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:27:25.762 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:27:25.865 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:27:25.929 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:27:26.656 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:27:26.725 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:27:26.725 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-12T02:27:26.726 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-12T02:27:26.726 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-12T02:27:26.726 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-12T02:27:26.726 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-12T02:27:26.727 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-12T02:27:26.727 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-12T02:27:26.727 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:26.898 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:27:26.914 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:27:26.915 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:26.915 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:27:26.915 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:26.949 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:27:27.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:27:27.187 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:27:27.232 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:27:27.277 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:27:27.372 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:27:27.421 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:27:27.606 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:27:27.636 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:27:27.713 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:27:28.359 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:27:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:27:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:27:28.436 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:28.436 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:27:28.436 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:27:28.436 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:27:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:28.475 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:27:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:27:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:27:28.691 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:28.691 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:27:28.691 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:27:28.692 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:27:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:29.029 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:27:29.029 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-12T02:27:29.030 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-12T02:27:29.030 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-12T02:27:29.030 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-12T02:27:29.030 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-12T02:27:29.030 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-12T02:27:29.030 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-12T02:27:29.030 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:29.127 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:27:29.151 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:27:29.151 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:29.151 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:27:29.151 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:27:29.151 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:27:29.151 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:29.200 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:27:29.215 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:27:29.216 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:29.216 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:27:29.216 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:29.274 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:27:29.331 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:27:29.386 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:27:29.580 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:27:29.628 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:27:29.701 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:27:29.705 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:27:29.781 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:27:29.794 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:27:29.808 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:27:29.842 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:27:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:27:29.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:27:30.001 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:27:30.029 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:27:30.153 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:27:30.271 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:27:30.380 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:27:30.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:27:30.421 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:27:30.453 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:27:30.454 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:27:30.484 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:27:30.547 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:27:30.576 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:27:30.702 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:27:30.729 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:27:30.729 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:30.729 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:27:30.729 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:27:30.730 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:27:30.730 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:30.938 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:27:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:27:30.975 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:27:30.985 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:27:30.985 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:30.985 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:27:30.985 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:27:30.985 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:27:30.985 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:27:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:27:31.447 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:27:31.471 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:27:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:27:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:27:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:27:31.471 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:31.585 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:27:31.620 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:27:31.642 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:27:31.653 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:27:31.697 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:27:31.883 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:27:31.939 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:27:32.017 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:27:32.105 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:27:32.253 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:27:32.298 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:27:32.329 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:27:32.357 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:27:32.612 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:27:32.636 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:27:32.738 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:27:32.799 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:27:32.831 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:27:32.853 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:27:32.889 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:27:32.908 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:27:32.925 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:27:32.937 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:27:32.949 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:27:32.949 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:32.949 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:27:32.949 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:27:32.949 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:27:32.949 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:32.989 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:27:33.001 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:27:33.098 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:27:33.153 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:27:33.372 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:33.414 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:33.956 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:27:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:27:33.993 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:27:34.013 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:27:34.085 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:27:34.085 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:27:34.085 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:27:34.085 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:34.085 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:27:34.117 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:27:34.119 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:27:34.141 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:27:34.142 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:34.142 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:27:34.142 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:27:34.142 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:27:34.142 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:27:34.208 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:27:34.208 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:34.208 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:27:34.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:34.260 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:27:34.284 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:27:34.284 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:34.284 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:27:34.284 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:27:34.284 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:27:34.284 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:34.586 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:27:34.609 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:27:34.609 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:34.609 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:27:34.610 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:27:34.610 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:27:34.610 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:34.985 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:27:35.022 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:27:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:27:35.284 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:27:35.308 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:27:35.331 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:27:35.332 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:35.332 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:27:35.332 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:27:35.332 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:27:35.332 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:35.375 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:27:35.386 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:27:35.476 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:27:35.523 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:27:36.449 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:27:36.477 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:27:36.501 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:27:36.501 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:36.501 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:27:36.501 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:27:36.501 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:27:36.502 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:36.545 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:27:36.567 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:27:36.567 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:36.567 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:27:36.567 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:36.612 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:27:36.635 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:27:36.635 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:36.636 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:27:36.636 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:27:36.636 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:27:36.636 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:36.938 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:27:36.961 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:27:36.962 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:36.962 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:27:36.962 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:27:36.962 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:27:36.962 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:39.164 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:27:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:27:39.246 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:27:39.279 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:27:39.306 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:27:39.505 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:27:39.544 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:27:39.574 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:27:39.604 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:27:39.642 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:27:40.257 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:40.290 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:40.311 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:41.141 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:27:41.229 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:27:41.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:27:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:27:41.415 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:27:41.441 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:27:41.475 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:27:41.475 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:27:41.525 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:27:41.565 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:27:41.567 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:27:41.567 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:27:41.606 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:27:41.634 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:27:41.638 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:27:41.659 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:27:41.666 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:27:41.666 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:41.666 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:41.845 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:41.845 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:27:41.847 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:27:41.887 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:27:41.929 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:27:41.942 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:27:41.972 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:27:42.003 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:42.018 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:27:42.633 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:42.666 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:42.686 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:43.519 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:27:43.620 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:27:43.661 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:27:43.741 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:27:43.815 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:27:43.840 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:27:43.866 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:27:43.866 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:27:43.942 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:27:43.942 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:27:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:27:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:27:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:44.236 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:44.236 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:27:44.303 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:27:44.366 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:45.593 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:27:45.593 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-12T02:27:45.594 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-12T02:27:45.594 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-12T02:27:45.594 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-12T02:27:45.594 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-12T02:27:45.594 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-12T02:27:45.594 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-12T02:27:45.594 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:45.780 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:27:45.797 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:27:45.797 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:45.797 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:27:45.797 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:47.258 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:27:47.285 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:27:47.285 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:47.285 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:27:47.285 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:27:47.285 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:27:47.285 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:47.517 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:27:47.540 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:27:47.540 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:47.540 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:27:47.540 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:27:47.540 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:27:47.540 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:27:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:27:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:27:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:27:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:27:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:27:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:27:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:27:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:27:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:27:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:27:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:27:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:27:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:27:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:27:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:27:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:27:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:27:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:27:47.984 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:27:48.008 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:27:48.008 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:48.008 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:27:48.008 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:27:48.008 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:27:48.008 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:48.122 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:27:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:27:48.234 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:27:48.421 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:27:48.468 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:27:48.546 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:27:48.635 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:27:48.776 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:27:48.819 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:27:48.850 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:27:48.878 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:27:49.287 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:27:49.318 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:27:49.350 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:27:49.412 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:27:49.441 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:27:50.115 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:50.115 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:27:50.115 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:27:50.115 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:27:50.115 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:27:50.115 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:27:50.116 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:27:50.117 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:27:50.129 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:27:50.129 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:27:50.129 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:27:50.129 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:27:50.130 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:27:50.131 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:27:50.132 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:27:50.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:27:50.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:27:50.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:27:50.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:27:50.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:27:50.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:27:50.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:27:50.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:27:50.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:27:50.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:27:50.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:27:50.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:27:50.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:27:50.487 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:27:50.527 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:50.594 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.595 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.596 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:27:50.597 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:27:50.598 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:27:50.599 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:27:50.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:27:50.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:27:50.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:27:50.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:27:50.604 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:27:50.605 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:27:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:27:50.607 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:27:50.607 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-12T02:27:51.015 DEBUG:teuthology.parallel:result is None 2024-09-12T02:27:51.494 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:27:51.518 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:27:51.620 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:27:51.789 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:27:51.821 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:27:51.845 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:27:51.845 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:51.845 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:27:51.845 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:27:51.845 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:27:51.845 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:51.896 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:27:51.908 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:27:52.005 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:27:52.053 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:27:52.708 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:52.708 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:52.708 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-12T02:27:52.708 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:27:52.709 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.710 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:27:52.711 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:27:52.712 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:27:52.713 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:27:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:27:52.715 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:27:52.716 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:27:52.717 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:27:52.718 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:27:52.719 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:27:52.720 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:27:52.721 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:27:52.721 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-12T02:27:52.975 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:27:53.007 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:27:53.032 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:27:53.032 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:53.032 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:27:53.032 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:27:53.032 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:27:53.032 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:53.075 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:27:53.098 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:27:53.098 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:53.098 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:27:53.098 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:53.124 DEBUG:teuthology.parallel:result is None 2024-09-12T02:27:53.150 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:27:53.173 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:27:53.174 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:53.174 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:27:53.174 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:27:53.174 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:27:53.174 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:53.476 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:27:53.499 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:27:53.499 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:27:53.499 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:27:53.500 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:27:53.500 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:27:53.500 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:27:58.029 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:27:58.070 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:27:58.120 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:27:58.152 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:27:58.179 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:27:58.357 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:27:58.401 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:27:58.431 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:27:58.460 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:27:58.515 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:27:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:59.155 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:59.175 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:28:00.007 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:28:00.085 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:28:00.125 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:28:00.207 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:28:00.246 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:28:00.271 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:28:00.306 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:28:00.306 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:28:00.390 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:28:00.390 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:28:00.474 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:28:00.507 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:28:00.513 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:28:00.513 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:28:00.692 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:28:00.693 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:28:00.785 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:28:00.848 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:28:06.565 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:28:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:28:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:28:06.568 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:28:06.568 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:28:06.568 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:28:06.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:28:06.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:28:06.580 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:28:06.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:28:06.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:28:06.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:28:06.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:28:06.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:28:06.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:28:06.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:28:06.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:28:06.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:28:06.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:28:06.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:28:06.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:28:06.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:28:06.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:28:09.382 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:28:09.382 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:28:09.382 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-12T02:28:09.382 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:28:09.383 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.384 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:28:09.386 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:28:09.387 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:28:09.388 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:28:09.389 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.390 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:28:09.391 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:28:09.392 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:28:09.393 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:28:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:28:09.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:28:09.396 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:28:09.397 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:28:09.398 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:28:09.398 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:28:09.398 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-12T02:28:09.813 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:09.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:28:09.963 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:28:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:28:09.990 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:28:09.990 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:28:09.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:28:10.135 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:28:10.159 INFO:teuthology.orchestra.run.smithi117.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:28:10.159 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:28:10.159 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:28:10.161 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:28:10.301 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:28:10.327 INFO:teuthology.orchestra.run.smithi189.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:28:10.328 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:28:10.328 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:28:10.329 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:28:10.329 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:28:10.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:28:10.362 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:28:10.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:28:10.390 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:28:10.390 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:28:10.422 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:28:10.423 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:28:10.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:28:10.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:28:10.518 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:28:10.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:28:10.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:28:10.612 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:28:10.613 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:28:10.646 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:28:10.714 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:28:10.715 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:28:10.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:28:10.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:28:10.804 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:28:10.804 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:28:10.832 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:28:10.899 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:28:10.899 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:28:10.924 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:28:10.989 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:28:10.989 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:28:10.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:28:11.014 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:28:11.080 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:28:11.080 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:28:11.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:28:11.176 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:28:11.176 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:28:11.201 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:28:11.266 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T02:28:11.363 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T02:28:11.363 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:28:11.363 INFO:tasks.cephadm:Cluster fsid is a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:11.363 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T02:28:11.364 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.100', 'mon.b': '172.21.15.117', 'mon.c': '172.21.15.189'} 2024-09-12T02:28:11.364 INFO:tasks.cephadm:First mon is mon.a on smithi100 2024-09-12T02:28:11.364 INFO:tasks.cephadm:First mgr is x 2024-09-12T02:28:11.364 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T02:28:11.364 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-09-12T02:28:11.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname $(hostname -s) 2024-09-12T02:28:11.418 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-12T02:28:11.443 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T02:28:11.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:28:11.592 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T02:28:11.730 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:28:11.732 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:28:11.732 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:28:11.732 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.144 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:28 /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.144 DEBUG:teuthology.orchestra.run.smithi117:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:28 /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.541 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.919 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:28 /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.920 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.938 DEBUG:teuthology.orchestra.run.smithi117:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.958 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:28:12.992 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T02:28:12.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:28:12.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:28:13.000 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:28:14.431 INFO:teuthology.orchestra.run.smithi117.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:28:14.566 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:28:14.606 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:28:41.747 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:28:41.747 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:28:41.747 INFO:teuthology.orchestra.run.smithi117.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:28:41.747 INFO:teuthology.orchestra.run.smithi117.stdout: "repo_digests": [ 2024-09-12T02:28:41.747 INFO:teuthology.orchestra.run.smithi117.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:28:41.747 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-09-12T02:28:41.747 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:28:45.089 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:28:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:28:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:28:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-09-12T02:28:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:28:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:28:45.090 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:28:54.274 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:28:54.275 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:28:54.275 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:28:54.275 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-12T02:28:54.275 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:28:54.275 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-12T02:28:54.275 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:28:54.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-09-12T02:28:54.338 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph 2024-09-12T02:28:54.372 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-12T02:28:54.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-09-12T02:28:54.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /etc/ceph 2024-09-12T02:28:54.458 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-12T02:28:54.485 INFO:tasks.cephadm:Writing seed config... 2024-09-12T02:28:54.486 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T02:28:54.486 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T02:28:54.486 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T02:28:54.486 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T02:28:54.486 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T02:28:54.486 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T02:28:54.486 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T02:28:54.487 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-12T02:28:54.488 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T02:28:54.489 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T02:28:54.490 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:28:54.490 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T02:28:54.508 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a7cd2c8a-70ae-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T02:28:54.508 DEBUG:teuthology.orchestra.run.smithi100:mon.a> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T02:28:54.550 DEBUG:teuthology.orchestra.run.smithi100:mgr.x> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T02:28:54.593 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T02:28:54.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.100 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:54.798 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:28:54.798 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'a7cd2c8a-70ae-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.100', '--skip-admin-label'] 2024-09-12T02:28:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T02:28:54.799 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying podman|docker is present... 2024-09-12T02:28:54.822 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:28:54.822 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying lvm2 is present... 2024-09-12T02:28:54.822 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying time synchronization is in place... 2024-09-12T02:28:54.830 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:28:54.830 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:28:54.836 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:28:54.836 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T02:28:54.843 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-09-12T02:28:54.849 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-09-12T02:28:54.849 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:28:54.849 INFO:teuthology.orchestra.run.smithi100.stdout:Repeating the final host check... 2024-09-12T02:28:54.871 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:28:54.872 INFO:teuthology.orchestra.run.smithi100.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T02:28:54.872 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl is present 2024-09-12T02:28:54.872 INFO:teuthology.orchestra.run.smithi100.stdout:lvcreate is present 2024-09-12T02:28:54.878 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:28:54.878 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:28:54.884 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:28:54.884 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T02:28:54.891 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-09-12T02:28:54.897 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-09-12T02:28:54.897 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:28:54.897 INFO:teuthology.orchestra.run.smithi100.stdout:Host looks OK 2024-09-12T02:28:54.897 INFO:teuthology.orchestra.run.smithi100.stdout:Cluster fsid: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:54.897 INFO:teuthology.orchestra.run.smithi100.stdout:Acquiring lock 140300886955008 on /run/cephadm/a7cd2c8a-70ae-11ef-bcea-c7b262605968.lock 2024-09-12T02:28:54.897 INFO:teuthology.orchestra.run.smithi100.stdout:Lock 140300886955008 acquired on /run/cephadm/a7cd2c8a-70ae-11ef-bcea-c7b262605968.lock 2024-09-12T02:28:54.898 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 3300 ... 2024-09-12T02:28:54.898 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 6789 ... 2024-09-12T02:28:54.898 INFO:teuthology.orchestra.run.smithi100.stdout:Base mon IP(s) is [172.21.15.100:3300, 172.21.15.100:6789], mon addrv is [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-12T02:28:54.901 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.100 metric 100 2024-09-12T02:28:54.901 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.100 metric 100 2024-09-12T02:28:54.904 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T02:28:54.904 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T02:28:54.904 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T02:28:54.906 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T02:28:54.906 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T02:28:54.906 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:28:54.906 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T02:28:54.906 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-12T02:28:54.907 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:28:54.907 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-09-12T02:28:54.907 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-09-12T02:28:54.907 INFO:teuthology.orchestra.run.smithi100.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T02:28:54.908 INFO:teuthology.orchestra.run.smithi100.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T02:28:54.908 INFO:teuthology.orchestra.run.smithi100.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:28:55.448 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:28:55.449 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:28:55.449 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T02:28:55.449 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T02:28:55.449 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T02:28:55.449 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:28:55.449 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T02:28:56.387 INFO:teuthology.orchestra.run.smithi100.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:28:56.388 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:28:56.388 INFO:teuthology.orchestra.run.smithi100.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T02:29:00.226 INFO:teuthology.orchestra.run.smithi100.stdout:stat: stdout 167 167 2024-09-12T02:29:00.226 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial keys... 2024-09-12T02:29:03.610 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQDuUeJmafWDOxAAF/gi6vq5rZ23hfaGuh91Tw== 2024-09-12T02:29:04.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQDvUeJmJA+7ORAA7oDB/8dV/3RPsYGmW2dHyg== 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQDwUeJmEjsfNRAAUOWxBaCP9u7qpm8OtOzjBw== 2024-09-12T02:29:05.531 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial monmap... 2024-09-12T02:29:06.762 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:29:06.762 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T02:29:06.762 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:06.762 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:29:06.762 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool for a [v2:172.21.15.100:3300,v1:172.21.15.100:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:29:06.762 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-09-12T02:29:06.762 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: set fsid to a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:06.763 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:29:06.763 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:29:06.763 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mon... 2024-09-12T02:29:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:create mon.a on 2024-09-12T02:29:08.206 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T02:29:08.361 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T02:29:08.531 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968.target. 2024-09-12T02:29:08.531 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968.target. 2024-09-12T02:29:08.796 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:29:08.796 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T02:29:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968.target.wants/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@.service. 2024-09-12T02:29:09.533 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:29:09.533 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T02:29:09.540 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:29:09.541 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T02:29:09.541 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T02:29:09.541 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:29:09.541 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon to start... 2024-09-12T02:29:09.541 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon... 2024-09-12T02:29:09.564 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:09 smithi100 systemd[1]: Started Ceph mon.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:29:10.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:29:10.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: monmap epoch 1 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: last_changed 2024-09-12T02:29:06.153104+0000 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: created 2024-09-12T02:29:06.153104+0000 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: min_mon_release 19 (squid) 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: election_strategy: 1 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: fsmap 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: mgrmap e1: no daemons active 2024-09-12T02:29:10.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:10 smithi100 ceph-mon[31023]: from='client.? 172.21.15.100:0/3579044733' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T02:29:10.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T02:29:10.668 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout id: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:10.668 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T02:29:10.668 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:10.668 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout services: 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.58952s) 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout data: 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.965+0000 7fad83ee1640 1 Processor -- start 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.965+0000 7fad83ee1640 1 -- start start 2024-09-12T02:29:10.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.966+0000 7fad83ee1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.966+0000 7fad83ee1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c106f50 con 0x7fad7c106580 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.966+0000 7fad81c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.966+0000 7fad81c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44624/0 (socket says 172.21.15.100:44624) 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.966+0000 7fad81c7d640 1 -- 172.21.15.100:0/4094240689 learned_addr learned my addr 172.21.15.100:0/4094240689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.966+0000 7fad81c7d640 1 -- 172.21.15.100:0/4094240689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c107780 con 0x7fad7c106580 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.968+0000 7fad81c7d640 1 --2- 172.21.15.100:0/4094240689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c106980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e80 tx=0x7fad6c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a42b4d2d9e9cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.968+0000 7fad80c7b640 1 -- 172.21.15.100:0/4094240689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c036070 con 0x7fad7c106580 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.968+0000 7fad80c7b640 1 -- 172.21.15.100:0/4094240689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c031400 con 0x7fad7c106580 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.968+0000 7fad80c7b640 1 -- 172.21.15.100:0/4094240689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c031700 con 0x7fad7c106580 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 -- 172.21.15.100:0/4094240689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 msgr2=0x7fad7c106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 --2- 172.21.15.100:0/4094240689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c106980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e80 tx=0x7fad6c02a7a0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 -- 172.21.15.100:0/4094240689 shutdown_connections 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 --2- 172.21.15.100:0/4094240689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c106980 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 -- 172.21.15.100:0/4094240689 >> 172.21.15.100:0/4094240689 conn(0x7fad7c101d10 msgr2=0x7fad7c104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 -- 172.21.15.100:0/4094240689 shutdown_connections 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 -- 172.21.15.100:0/4094240689 wait complete. 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.969+0000 7fad83ee1640 1 Processor -- start 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad83ee1640 1 -- start start 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad83ee1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c1904f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad83ee1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c107d20 con 0x7fad7c106580 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad81c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c1904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad81c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c1904f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44632/0 (socket says 172.21.15.100:44632) 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad81c7d640 1 -- 172.21.15.100:0/3579044733 learned_addr learned my addr 172.21.15.100:0/3579044733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad81c7d640 1 -- 172.21.15.100:0/3579044733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c190a30 con 0x7fad7c106580 2024-09-12T02:29:10.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad81c7d640 1 --2- 172.21.15.100:0/3579044733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c1904f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fad6c034040 tx=0x7fad6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad7affd640 1 -- 172.21.15.100:0/3579044733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c041070 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad7affd640 1 -- 172.21.15.100:0/3579044733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c03c650 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c18ec20 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad7affd640 1 -- 172.21.15.100:0/3579044733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c036040 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.970+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c18f160 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.971+0000 7fad7affd640 1 -- 172.21.15.100:0/3579044733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fad6c044070 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.971+0000 7fad7affd640 1 -- 172.21.15.100:0/3579044733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fad6c046c10 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.971+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c108370 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:09.974+0000 7fad7affd640 1 -- 172.21.15.100:0/3579044733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fad6c03c950 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.032+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fad7c194160 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.033+0000 7fad7affd640 1 -- 172.21.15.100:0/3579044733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7fad6c03cb30 con 0x7fad7c106580 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.033+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 msgr2=0x7fad7c1904f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.033+0000 7fad83ee1640 1 --2- 172.21.15.100:0/3579044733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c1904f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fad6c034040 tx=0x7fad6c004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:10.673 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.033+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 shutdown_connections 2024-09-12T02:29:10.673 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.033+0000 7fad83ee1640 1 --2- 172.21.15.100:0/3579044733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad7c106580 0x7fad7c1904f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.673 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.033+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 >> 172.21.15.100:0/3579044733 conn(0x7fad7c101d10 msgr2=0x7fad7c18df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.673 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.034+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 shutdown_connections 2024-09-12T02:29:10.673 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:10.034+0000 7fad83ee1640 1 -- 172.21.15.100:0/3579044733 wait complete. 2024-09-12T02:29:10.673 INFO:teuthology.orchestra.run.smithi100.stdout:mon is available 2024-09-12T02:29:10.673 INFO:teuthology.orchestra.run.smithi100.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T02:29:11.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:11 smithi100 ceph-mon[31023]: from='client.? 172.21.15.100:0/3214653303' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:29:11.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:11 smithi100 ceph-mon[31023]: from='client.? 172.21.15.100:0/3214653303' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T02:29:11.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:11.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.097+0000 7f28d8a95640 1 Processor -- start 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.097+0000 7f28d8a95640 1 -- start start 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.097+0000 7f28d8a95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d4106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.097+0000 7f28d8a95640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28d4106f50 con 0x7f28d4106580 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.098+0000 7f28d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d4106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.098+0000 7f28d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d4106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44644/0 (socket says 172.21.15.100:44644) 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.098+0000 7f28d259c640 1 -- 172.21.15.100:0/156509737 learned_addr learned my addr 172.21.15.100:0/156509737 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.098+0000 7f28d259c640 1 -- 172.21.15.100:0/156509737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d4107780 con 0x7f28d4106580 2024-09-12T02:29:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d259c640 1 --2- 172.21.15.100:0/156509737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d4106980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009e80 tx=0x7f28c402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5155533a2dc7e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d159a640 1 -- 172.21.15.100:0/156509737 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4036070 con 0x7f28d4106580 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d159a640 1 -- 172.21.15.100:0/156509737 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c4031400 con 0x7f28d4106580 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d159a640 1 -- 172.21.15.100:0/156509737 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4031700 con 0x7f28d4106580 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d8a95640 1 -- 172.21.15.100:0/156509737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 msgr2=0x7f28d4106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d8a95640 1 --2- 172.21.15.100:0/156509737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d4106980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009e80 tx=0x7f28c402a7a0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d8a95640 1 -- 172.21.15.100:0/156509737 shutdown_connections 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d8a95640 1 --2- 172.21.15.100:0/156509737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d4106980 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d8a95640 1 -- 172.21.15.100:0/156509737 >> 172.21.15.100:0/156509737 conn(0x7f28d4101d10 msgr2=0x7f28d4104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.099+0000 7f28d8a95640 1 -- 172.21.15.100:0/156509737 shutdown_connections 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.100+0000 7f28d8a95640 1 -- 172.21.15.100:0/156509737 wait complete. 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.100+0000 7f28d8a95640 1 Processor -- start 2024-09-12T02:29:11.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.100+0000 7f28d8a95640 1 -- start start 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.100+0000 7f28d8a95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.100+0000 7f28d8a95640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28d4107d20 con 0x7f28d4106580 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d419ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44650/0 (socket says 172.21.15.100:44650) 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28d259c640 1 -- 172.21.15.100:0/3214653303 learned_addr learned my addr 172.21.15.100:0/3214653303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28d259c640 1 -- 172.21.15.100:0/3214653303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d419b3c0 con 0x7f28d4106580 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28d259c640 1 --2- 172.21.15.100:0/3214653303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d419ae80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f28c4034040 tx=0x7f28c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4041070 con 0x7f28d4106580 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c403c650 con 0x7f28d4106580 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d419b650 con 0x7f28d4106580 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28c4036040 con 0x7f28d4106580 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d419e340 con 0x7f28d4106580 2024-09-12T02:29:11.813 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f28c4044070 con 0x7f28d4106580 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.101+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f28c4046c10 con 0x7f28d4106580 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.102+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d4108370 con 0x7f28d4106580 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.104+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f28c403c950 con 0x7f28d4106580 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.161+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f28d419fa60 con 0x7f28d4106580 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.164+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f28c403cb30 con 0x7f28d4106580 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.164+0000 7f28cb7fe640 1 -- 172.21.15.100:0/3214653303 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28c4056070 con 0x7f28d4106580 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.165+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 msgr2=0x7f28d419ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.165+0000 7f28d8a95640 1 --2- 172.21.15.100:0/3214653303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d419ae80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f28c4034040 tx=0x7f28c4004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.165+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 shutdown_connections 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.165+0000 7f28d8a95640 1 --2- 172.21.15.100:0/3214653303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d4106580 0x7f28d419ae80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.165+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 >> 172.21.15.100:0/3214653303 conn(0x7f28d4101d10 msgr2=0x7f28d407b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.165+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 shutdown_connections 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:11.165+0000 7f28d8a95640 1 -- 172.21.15.100:0/3214653303 wait complete. 2024-09-12T02:29:11.814 INFO:teuthology.orchestra.run.smithi100.stdout:Generating new minimal ceph.conf... 2024-09-12T02:29:12.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:12 smithi100 ceph-mon[31023]: from='client.? 172.21.15.100:0/1050213359' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f640af99640 1 Processor -- start 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f640af99640 1 -- start start 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f640af99640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f640410a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f640af99640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f640407be90 con 0x7f6404108180 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f6408d35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f640410a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f6408d35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f640410a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44662/0 (socket says 172.21.15.100:44662) 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f6408d35640 1 -- 172.21.15.100:0/1859087436 learned_addr learned my addr 172.21.15.100:0/1859087436 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.267+0000 7f6408d35640 1 -- 172.21.15.100:0/1859087436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640410aab0 con 0x7f6404108180 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.268+0000 7f6408d35640 1 --2- 172.21.15.100:0/1859087436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f640410a570 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009820 tx=0x7f63f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86cda6c633f62d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.268+0000 7f64037fe640 1 -- 172.21.15.100:0/1859087436 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8037070 con 0x7f6404108180 2024-09-12T02:29:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.268+0000 7f64037fe640 1 -- 172.21.15.100:0/1859087436 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63f8032900 con 0x7f6404108180 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.268+0000 7f64037fe640 1 -- 172.21.15.100:0/1859087436 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8030850 con 0x7f6404108180 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.269+0000 7f640af99640 1 -- 172.21.15.100:0/1859087436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 msgr2=0x7f640410a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.269+0000 7f640af99640 1 --2- 172.21.15.100:0/1859087436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f640410a570 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009820 tx=0x7f63f802a270 comp rx=0 tx=0).stop 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.269+0000 7f640af99640 1 -- 172.21.15.100:0/1859087436 shutdown_connections 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.269+0000 7f640af99640 1 --2- 172.21.15.100:0/1859087436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f640410a570 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.269+0000 7f640af99640 1 -- 172.21.15.100:0/1859087436 >> 172.21.15.100:0/1859087436 conn(0x7f6404101da0 msgr2=0x7f64041041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.269+0000 7f640af99640 1 -- 172.21.15.100:0/1859087436 shutdown_connections 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.269+0000 7f640af99640 1 -- 172.21.15.100:0/1859087436 wait complete. 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f640af99640 1 Processor -- start 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f640af99640 1 -- start start 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f640af99640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f6404107a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f640af99640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f640410baf0 con 0x7f6404108180 2024-09-12T02:29:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f6408d35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f6404107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f6408d35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f6404107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44674/0 (socket says 172.21.15.100:44674) 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f6408d35640 1 -- 172.21.15.100:0/1050213359 learned_addr learned my addr 172.21.15.100:0/1050213359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f6408d35640 1 -- 172.21.15.100:0/1050213359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6404107f40 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.270+0000 7f6408d35640 1 --2- 172.21.15.100:0/1050213359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f6404107a00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f63f8032ce0 tx=0x7f63f8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.271+0000 7f6401ffb640 1 -- 172.21.15.100:0/1050213359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8042070 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.271+0000 7f6401ffb640 1 -- 172.21.15.100:0/1050213359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63f80308c0 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.271+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6404106130 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.271+0000 7f6401ffb640 1 -- 172.21.15.100:0/1050213359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8037040 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.271+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6404106670 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.271+0000 7f6401ffb640 1 -- 172.21.15.100:0/1050213359 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63f8045070 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.271+0000 7f6401ffb640 1 -- 172.21.15.100:0/1050213359 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f63f8047bd0 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.272+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64041085e0 con 0x7f6404108180 2024-09-12T02:29:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.274+0000 7f6401ffb640 1 -- 172.21.15.100:0/1050213359 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f63f803c830 con 0x7f6404108180 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.332+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6404106ba0 con 0x7f6404108180 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.333+0000 7f6401ffb640 1 -- 172.21.15.100:0/1050213359 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f63f803ca10 con 0x7f6404108180 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.334+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 msgr2=0x7f6404107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.334+0000 7f640af99640 1 --2- 172.21.15.100:0/1050213359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f6404107a00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f63f8032ce0 tx=0x7f63f8032d10 comp rx=0 tx=0).stop 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.334+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 shutdown_connections 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.334+0000 7f640af99640 1 --2- 172.21.15.100:0/1050213359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6404108180 0x7f6404107a00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.334+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 >> 172.21.15.100:0/1050213359 conn(0x7f6404101da0 msgr2=0x7f6404102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.334+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 shutdown_connections 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:12.334+0000 7f640af99640 1 -- 172.21.15.100:0/1050213359 wait complete. 2024-09-12T02:29:12.990 INFO:teuthology.orchestra.run.smithi100.stdout:Restarting the monitor... 2024-09-12T02:29:13.276 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:13 smithi100 systemd[1]: Stopping Ceph mon.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:29:13.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a[31019]: 2024-09-12T02:29:13.274+0000 7f2c6c721640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:29:13.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a[31019]: 2024-09-12T02:29:13.274+0000 7f2c6c721640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T02:29:13.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:13 smithi100 podman[31266]: 2024-09-12 02:29:13.32691013 +0000 UTC m=+0.182416229 container died 334f61381d3de276b510637d8ab758d022539bd95a11377f160c71b73d3c83a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:29:14.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:13 smithi100 podman[31266]: 2024-09-12 02:29:13.900394017 +0000 UTC m=+0.755900181 container cleanup 334f61381d3de276b510637d8ab758d022539bd95a11377f160c71b73d3c83a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:29:14.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:13 smithi100 bash[31266]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:29:14.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 podman[31281]: 2024-09-12 02:29:14.126101896 +0000 UTC m=+0.794015083 container remove 334f61381d3de276b510637d8ab758d022539bd95a11377f160c71b73d3c83a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:29:14.452 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 systemd[1]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T02:29:14.452 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 systemd[1]: Stopped Ceph mon.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:29:14.452 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 systemd[1]: Starting Ceph mon.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:29:14.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 podman[31371]: 2024-09-12 02:29:14.3544456 +0000 UTC m=+0.015701002 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:29:14.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 podman[31371]: 2024-09-12 02:29:14.502173578 +0000 UTC m=+0.163429046 container create 91e9c64e6d8312893d876e758495a6cd94fe0ff382fb42454697ddb137b5b8a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:29:14.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 podman[31371]: 2024-09-12 02:29:14.720985718 +0000 UTC m=+0.382241127 container init 91e9c64e6d8312893d876e758495a6cd94fe0ff382fb42454697ddb137b5b8a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T02:29:14.816 INFO:teuthology.orchestra.run.smithi100.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T02:29:15.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 podman[31371]: 2024-09-12 02:29:14.724238689 +0000 UTC m=+0.385494094 container start 91e9c64e6d8312893d876e758495a6cd94fe0ff382fb42454697ddb137b5b8a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: pidfile_write: ignore empty --pid-file 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: load: jerasure load: lrc 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Git sha 0 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: DB SUMMARY 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: DB Session ID: 6Z9P4VYH8YD9LDTV5DYO 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:29:15.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106000 ; 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.env: 0x55593c607940 2024-09-12T02:29:15.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.info_log: 0x55593dd536e0 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.statistics: (nil) 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.use_fsync: 0 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:29:15.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:29:15.063 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.db_log_dir: 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.wal_dir: 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:29:15.064 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.write_buffer_manager: 0x55593dd62dc0 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:29:15.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.unordered_write: 0 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.row_cache: None 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.wal_filter: None 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.wal_compression: 0 2024-09-12T02:29:15.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:29:15.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_open_files: -1 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:29:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Compression algorithms supported: 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kZSTD supported: 0 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:29:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.merge_operator: 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_filter: None 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55593dd53320) 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:29:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_type: 0 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: data_block_index_type: 0 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_shortening: 1 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: checksum: 4 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: no_block_cache: 0 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache: 0x55593dd471f0 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_options: 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: capacity : 536870912 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: num_shard_bits : 4 2024-09-12T02:29:15.071 INFO:journalctl@ceph.mon.a.smithi100.stdout: strict_capacity_limit : 0 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_compressed: (nil) 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: persistent_cache: (nil) 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_size: 4096 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_size_deviation: 10 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_restart_interval: 16 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_block_restart_interval: 1 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: metadata_block_size: 4096 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: partition_filters: 0 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: use_delta_encoding: 1 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: filter_policy: bloomfilter 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: whole_key_filtering: 1 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: verify_compression: 0 2024-09-12T02:29:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout: format_version: 5 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout: enable_index_compression: 1 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_align: 0 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout: max_auto_readahead_size: 262144 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout: prepopulate_block_cache: 0 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression: NoCompression 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.num_levels: 7 2024-09-12T02:29:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:29:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:29:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:29:15.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:29:15.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.ttl: 2592000 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:29:15.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b57fa682-e015-4e6e-a10d-c3eb1033ad00 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108154749534, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108154750586, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101015, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98900, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14453, "raw_average_key_size": 50, "raw_value_size": 91072, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726108154, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b57fa682-e015-4e6e-a10d-c3eb1033ad00", "db_session_id": "6Z9P4VYH8YD9LDTV5DYO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108154750686, "job": 1, "event": "recovery_finished"} 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T02:29:15.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55593dd74e00 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: DB pointer 0x55593de70000 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** DB Stats ** 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T02:29:15.080 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: L0 2/0 100.51 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: Sum 2/0 100.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T02:29:15.081 INFO:journalctl@ceph.mon.a.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative compaction: 0.00 GB write, 30.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval compaction: 0.00 GB write, 30.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: Block cache BinnedLRUCache@0x55593dd471f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: starting mon.a rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???) e1 preinit fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:15.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???).mds e1 new map 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???).mds e1 print_map 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout: e1 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout: btime 2024-09-12T02:29:09:444586+0000 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout: legacy client fscid: -1 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout: No filesystems configured 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 bash[31371]: 91e9c64e6d8312893d876e758495a6cd94fe0ff382fb42454697ddb137b5b8a5 2024-09-12T02:29:15.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: monmap epoch 1 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: last_changed 2024-09-12T02:29:06.153104+0000 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: created 2024-09-12T02:29:06.153104+0000 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: min_mon_release 19 (squid) 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: election_strategy: 1 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: fsmap 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 ceph-mon[31390]: mgrmap e1: no daemons active 2024-09-12T02:29:15.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:14 smithi100 systemd[1]: Started Ceph mon.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:29:15.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.286+0000 7f464a8c3640 1 Processor -- start 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.286+0000 7f464a8c3640 1 -- start start 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.287+0000 7f464a8c3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464410a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.287+0000 7f464a8c3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f464407bed0 con 0x7f4644108140 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.287+0000 7f4643fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464410a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.287+0000 7f4643fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464410a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44372/0 (socket says 172.21.15.100:44372) 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.287+0000 7f4643fff640 1 -- 172.21.15.100:0/3193865688 learned_addr learned my addr 172.21.15.100:0/3193865688 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.287+0000 7f4643fff640 1 -- 172.21.15.100:0/3193865688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464410aa70 con 0x7f4644108140 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.289+0000 7f4643fff640 1 --2- 172.21.15.100:0/3193865688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464410a530 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4634009820 tx=0x7f463402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7d76812deba99c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.289+0000 7f46437fe640 1 -- 172.21.15.100:0/3193865688 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4634037070 con 0x7f4644108140 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.289+0000 7f46437fe640 1 -- 172.21.15.100:0/3193865688 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4634032900 con 0x7f4644108140 2024-09-12T02:29:15.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.289+0000 7f46437fe640 1 -- 172.21.15.100:0/3193865688 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4634030850 con 0x7f4644108140 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 -- 172.21.15.100:0/3193865688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 msgr2=0x7f464410a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 --2- 172.21.15.100:0/3193865688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464410a530 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4634009820 tx=0x7f463402a270 comp rx=0 tx=0).stop 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 -- 172.21.15.100:0/3193865688 shutdown_connections 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 --2- 172.21.15.100:0/3193865688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464410a530 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 -- 172.21.15.100:0/3193865688 >> 172.21.15.100:0/3193865688 conn(0x7f4644101da0 msgr2=0x7f46441041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 -- 172.21.15.100:0/3193865688 shutdown_connections 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 -- 172.21.15.100:0/3193865688 wait complete. 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 Processor -- start 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.290+0000 7f464a8c3640 1 -- start start 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f464a8c3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f464a8c3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f464410bb10 con 0x7f4644108140 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4643fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4643fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44376/0 (socket says 172.21.15.100:44376) 2024-09-12T02:29:15.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4643fff640 1 -- 172.21.15.100:0/1723432644 learned_addr learned my addr 172.21.15.100:0/1723432644 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4643fff640 1 -- 172.21.15.100:0/1723432644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464419bc20 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4643fff640 1 --2- 172.21.15.100:0/1723432644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464419b6e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4634032ce0 tx=0x7f4634032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4641ffb640 1 -- 172.21.15.100:0/1723432644 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4634042070 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f464419beb0 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4641ffb640 1 -- 172.21.15.100:0/1723432644 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46340308c0 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f4641ffb640 1 -- 172.21.15.100:0/1723432644 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4634037040 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.291+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f464419eba0 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.292+0000 7f4641ffb640 1 -- 172.21.15.100:0/1723432644 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4634045070 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.292+0000 7f4641ffb640 1 -- 172.21.15.100:0/1723432644 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4634047bd0 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.292+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46441085a0 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.295+0000 7f4641ffb640 1 -- 172.21.15.100:0/1723432644 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f463403c830 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.351+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f464419ed70 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.352+0000 7f4641ffb640 1 -- 172.21.15.100:0/1723432644 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f463403ca10 con 0x7f4644108140 2024-09-12T02:29:15.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.353+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 msgr2=0x7f464419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.353+0000 7f464a8c3640 1 --2- 172.21.15.100:0/1723432644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464419b6e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4634032ce0 tx=0x7f4634032d10 comp rx=0 tx=0).stop 2024-09-12T02:29:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.353+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 shutdown_connections 2024-09-12T02:29:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.353+0000 7f464a8c3640 1 --2- 172.21.15.100:0/1723432644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4644108140 0x7f464419b6e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.353+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 >> 172.21.15.100:0/1723432644 conn(0x7f4644101da0 msgr2=0x7f4644102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.354+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 shutdown_connections 2024-09-12T02:29:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:15.354+0000 7f464a8c3640 1 -- 172.21.15.100:0/1723432644 wait complete. 2024-09-12T02:29:15.912 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T02:29:15.934 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:29:15.935 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mgr... 2024-09-12T02:29:15.935 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T02:29:15.935 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T02:29:16.188 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:29:16.188 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T02:29:16.340 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968.target.wants/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@.service. 2024-09-12T02:29:16.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:16 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1723432644' entity='client.admin' 2024-09-12T02:29:16.572 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 systemd[1]: Starting Ceph mgr.x for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:29:16.848 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 podman[31603]: 2024-09-12 02:29:16.47443677 +0000 UTC m=+0.015566567 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:29:16.848 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 podman[31603]: 2024-09-12 02:29:16.603945521 +0000 UTC m=+0.145075309 container create 4b275610bea7b23887e03520d7ef12fe9656bc174a720f280cba16481366b3de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:29:16.848 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 podman[31603]: 2024-09-12 02:29:16.789835982 +0000 UTC m=+0.330965771 container init 4b275610bea7b23887e03520d7ef12fe9656bc174a720f280cba16481366b3de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T02:29:16.848 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 podman[31603]: 2024-09-12 02:29:16.792597187 +0000 UTC m=+0.333726985 container start 4b275610bea7b23887e03520d7ef12fe9656bc174a720f280cba16481366b3de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:29:16.849 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 bash[31603]: 4b275610bea7b23887e03520d7ef12fe9656bc174a720f280cba16481366b3de 2024-09-12T02:29:16.864 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:29:16.864 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T02:29:16.873 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:29:16.873 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T02:29:16.873 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T02:29:16.873 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:29:16.883 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:29:16.883 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T02:29:16.892 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:29:16.892 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T02:29:16.892 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T02:29:16.892 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T02:29:16.892 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr to start... 2024-09-12T02:29:16.893 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr... 2024-09-12T02:29:17.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 systemd[1]: Started Ceph mgr.x for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:29:17.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:16.934+0000 7f4b77313040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:29:17.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:16.990+0000 7f4b77313040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:29:17.407 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:17.146+0000 7f4b77313040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:29:17.407 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:17.213+0000 7f4b77313040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:29:17.407 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:17.368+0000 7f4b77313040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:29:17.786 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:17 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/311811415' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:29:17.786 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:17.515+0000 7f4b77313040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:29:18.062 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:17.839+0000 7f4b77313040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:29:18.062 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:17.899+0000 7f4b77313040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:29:18.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:18.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:18.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:29:09:444586+0000", 2024-09-12T02:29:18.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:18.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:29:09.445218+0000", 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.336+0000 7ff11d310640 1 Processor -- start 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.336+0000 7ff11d310640 1 -- start start 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.337+0000 7ff11d310640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff118105d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.337+0000 7ff11d310640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff118106340 con 0x7ff118105970 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.337+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff118105d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.337+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff118105d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44416/0 (socket says 172.21.15.100:44416) 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.337+0000 7ff116ffd640 1 -- 172.21.15.100:0/151033749 learned_addr learned my addr 172.21.15.100:0/151033749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.337+0000 7ff116ffd640 1 -- 172.21.15.100:0/151033749 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff118108950 con 0x7ff118105970 2024-09-12T02:29:18.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.338+0000 7ff116ffd640 1 --2- 172.21.15.100:0/151033749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff118105d70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff108009820 tx=0x7ff10802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150d11dbc5ece07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.338+0000 7ff115ffb640 1 -- 172.21.15.100:0/151033749 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108037070 con 0x7ff118105970 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.338+0000 7ff115ffb640 1 -- 172.21.15.100:0/151033749 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff108032900 con 0x7ff118105970 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.338+0000 7ff115ffb640 1 -- 172.21.15.100:0/151033749 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108030850 con 0x7ff118105970 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.339+0000 7ff11d310640 1 -- 172.21.15.100:0/151033749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 msgr2=0x7ff118105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.339+0000 7ff11d310640 1 --2- 172.21.15.100:0/151033749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff118105d70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff108009820 tx=0x7ff10802a270 comp rx=0 tx=0).stop 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.339+0000 7ff11d310640 1 -- 172.21.15.100:0/151033749 shutdown_connections 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.339+0000 7ff11d310640 1 --2- 172.21.15.100:0/151033749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff118105d70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.339+0000 7ff11d310640 1 -- 172.21.15.100:0/151033749 >> 172.21.15.100:0/151033749 conn(0x7ff118101500 msgr2=0x7ff118103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.339+0000 7ff11d310640 1 -- 172.21.15.100:0/151033749 shutdown_connections 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.339+0000 7ff11d310640 1 -- 172.21.15.100:0/151033749 wait complete. 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff11d310640 1 Processor -- start 2024-09-12T02:29:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff11d310640 1 -- start start 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff11d310640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff11819d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff11d310640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff11810bb80 con 0x7ff118105970 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff11819d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff11819d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44432/0 (socket says 172.21.15.100:44432) 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff116ffd640 1 -- 172.21.15.100:0/311811415 learned_addr learned my addr 172.21.15.100:0/311811415 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff116ffd640 1 -- 172.21.15.100:0/311811415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11819de30 con 0x7ff118105970 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.340+0000 7ff116ffd640 1 --2- 172.21.15.100:0/311811415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff11819d8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff108009940 tx=0x7ff108032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.341+0000 7ff10ffff640 1 -- 172.21.15.100:0/311811415 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108042070 con 0x7ff118105970 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.341+0000 7ff10ffff640 1 -- 172.21.15.100:0/311811415 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1080308c0 con 0x7ff118105970 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.341+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11819e0c0 con 0x7ff118105970 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.341+0000 7ff10ffff640 1 -- 172.21.15.100:0/311811415 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108037040 con 0x7ff118105970 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.341+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1181a0db0 con 0x7ff118105970 2024-09-12T02:29:18.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.341+0000 7ff10ffff640 1 -- 172.21.15.100:0/311811415 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff108045070 con 0x7ff118105970 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.341+0000 7ff10ffff640 1 -- 172.21.15.100:0/311811415 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff108047bb0 con 0x7ff118105970 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.342+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff118105df0 con 0x7ff118105970 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.344+0000 7ff10ffff640 1 -- 172.21.15.100:0/311811415 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff1080327b0 con 0x7ff118105970 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.406+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff1181a0f80 con 0x7ff118105970 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.406+0000 7ff10ffff640 1 -- 172.21.15.100:0/311811415 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ff10803c760 con 0x7ff118105970 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.407+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 msgr2=0x7ff11819d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.407+0000 7ff11d310640 1 --2- 172.21.15.100:0/311811415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff11819d8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff108009940 tx=0x7ff108032ce0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.407+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 shutdown_connections 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.407+0000 7ff11d310640 1 --2- 172.21.15.100:0/311811415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff118105970 0x7ff11819d8f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.407+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 >> 172.21.15.100:0/311811415 conn(0x7ff118101500 msgr2=0x7ff118102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.408+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 shutdown_connections 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:17.408+0000 7ff11d310640 1 -- 172.21.15.100:0/311811415 wait complete. 2024-09-12T02:29:18.083 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (1/15)... 2024-09-12T02:29:18.371 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:18 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:18.086+0000 7f4b77313040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:29:19.371 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:18 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:18.962+0000 7f4b77313040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:29:19.371 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:19.030+0000 7f4b77313040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:29:19.995 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:19.740+0000 7f4b77313040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:29:19.995 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:19.854+0000 7f4b77313040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:29:19.995 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:19.993+0000 7f4b77313040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:29:20.277 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.054+0000 7f4b77313040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:29:20.277 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.208+0000 7f4b77313040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:29:20.277 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.276+0000 7f4b77313040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:29:20.572 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.342+0000 7f4b77313040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:29:20.572 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.503+0000 7f4b77313040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:29:20.572 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.570+0000 7f4b77313040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:29:20.851 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3363808415' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:29:20.852 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.649+0000 7f4b77313040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:29:20.852 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.731+0000 7f4b77313040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:29:20.852 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.789+0000 7f4b77313040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:29:20.852 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:20.850+0000 7f4b77313040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:21.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:29:21.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:29:09:444586+0000", 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:29:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:29:09.445218+0000", 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:29:21.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.515+0000 7f1ff6421640 1 Processor -- start 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.515+0000 7f1ff6421640 1 -- start start 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.516+0000 7f1ff6421640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff010a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.516+0000 7f1ff6421640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff007be90 con 0x7f1ff0108130 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.516+0000 7f1feffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff010a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.516+0000 7f1feffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff010a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44448/0 (socket says 172.21.15.100:44448) 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.516+0000 7f1feffff640 1 -- 172.21.15.100:0/560905638 learned_addr learned my addr 172.21.15.100:0/560905638 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.516+0000 7f1feffff640 1 -- 172.21.15.100:0/560905638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff010aa60 con 0x7f1ff0108130 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.517+0000 7f1feffff640 1 --2- 172.21.15.100:0/560905638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff010a520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009820 tx=0x7f1fe002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ef33329e58f26e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.517+0000 7f1fef7fe640 1 -- 172.21.15.100:0/560905638 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe0037070 con 0x7f1ff0108130 2024-09-12T02:29:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.517+0000 7f1fef7fe640 1 -- 172.21.15.100:0/560905638 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1fe0032900 con 0x7f1ff0108130 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.517+0000 7f1fef7fe640 1 -- 172.21.15.100:0/560905638 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe0030850 con 0x7f1ff0108130 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 -- 172.21.15.100:0/560905638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 msgr2=0x7f1ff010a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 --2- 172.21.15.100:0/560905638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff010a520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009820 tx=0x7f1fe002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 -- 172.21.15.100:0/560905638 shutdown_connections 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 --2- 172.21.15.100:0/560905638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff010a520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 -- 172.21.15.100:0/560905638 >> 172.21.15.100:0/560905638 conn(0x7f1ff0101d10 msgr2=0x7f1ff0104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 -- 172.21.15.100:0/560905638 shutdown_connections 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 -- 172.21.15.100:0/560905638 wait complete. 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 Processor -- start 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.518+0000 7f1ff6421640 1 -- start start 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1ff6421640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff01079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1ff6421640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff010baa0 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1feffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff01079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1feffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff01079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44458/0 (socket says 172.21.15.100:44458) 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1feffff640 1 -- 172.21.15.100:0/3363808415 learned_addr learned my addr 172.21.15.100:0/3363808415 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1feffff640 1 -- 172.21.15.100:0/3363808415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff0107ef0 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1feffff640 1 --2- 172.21.15.100:0/3363808415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff01079b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00097f0 tx=0x7f1fe0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1fedffb640 1 -- 172.21.15.100:0/3363808415 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe0037040 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1fedffb640 1 -- 172.21.15.100:0/3363808415 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1fe0040070 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff01060e0 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1fedffb640 1 -- 172.21.15.100:0/3363808415 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe003a390 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.519+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff01065c0 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.520+0000 7f1fedffb640 1 -- 172.21.15.100:0/3363808415 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1fe003a630 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.520+0000 7f1fedffb640 1 -- 172.21.15.100:0/3363808415 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1fe00459a0 con 0x7f1ff0108130 2024-09-12T02:29:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.521+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff0108590 con 0x7f1ff0108130 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.523+0000 7f1fedffb640 1 -- 172.21.15.100:0/3363808415 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1fe0045460 con 0x7f1ff0108130 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.584+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1ff0106900 con 0x7f1ff0108130 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.584+0000 7f1fedffb640 1 -- 172.21.15.100:0/3363808415 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f1fe003b430 con 0x7f1ff0108130 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.585+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 msgr2=0x7f1ff01079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.585+0000 7f1ff6421640 1 --2- 172.21.15.100:0/3363808415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff01079b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00097f0 tx=0x7f1fe0030d80 comp rx=0 tx=0).stop 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.585+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 shutdown_connections 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.585+0000 7f1ff6421640 1 --2- 172.21.15.100:0/3363808415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff0108130 0x7f1ff01079b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.585+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 >> 172.21.15.100:0/3363808415 conn(0x7f1ff0101d10 msgr2=0x7f1ff0102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.585+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 shutdown_connections 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:20.585+0000 7f1ff6421640 1 -- 172.21.15.100:0/3363808415 wait complete. 2024-09-12T02:29:21.432 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (2/15)... 2024-09-12T02:29:21.696 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:21.641+0000 7f4b77313040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:29:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: Activating manager daemon x 2024-09-12T02:29:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: mgrmap e2: x(active, starting, since 0.00308901s) 2024-09-12T02:29:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: Manager daemon x is now available 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' 2024-09-12T02:29:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:21 smithi100 ceph-mon[31390]: from='mgr.14100 172.21.15.100:0/1555385629' entity='mgr.x' 2024-09-12T02:29:23.868 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:23 smithi100 ceph-mon[31390]: mgrmap e3: x(active, since 1.00753s) 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:29:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:29:24.714 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:29:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:29:09:444586+0000", 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:29:24.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:29:09.445218+0000", 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.867+0000 7fbcc97fe640 1 Processor -- start 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.867+0000 7fbcc97fe640 1 -- start start 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.867+0000 7fbcc97fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc410a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.867+0000 7fbcc97fe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc407bed0 con 0x7fbcc41080f0 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.867+0000 7fbcc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc410a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.867+0000 7fbcc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc410a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44524/0 (socket says 172.21.15.100:44524) 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.867+0000 7fbcc2ffd640 1 -- 172.21.15.100:0/4279374977 learned_addr learned my addr 172.21.15.100:0/4279374977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.868+0000 7fbcc2ffd640 1 -- 172.21.15.100:0/4279374977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc410aa20 con 0x7fbcc41080f0 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.868+0000 7fbcc2ffd640 1 --2- 172.21.15.100:0/4279374977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc410a4e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009e80 tx=0x7fbcb402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29823604a14898ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.868+0000 7fbcc1ffb640 1 -- 172.21.15.100:0/4279374977 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4036070 con 0x7fbcc41080f0 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc1ffb640 1 -- 172.21.15.100:0/4279374977 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcb40318c0 con 0x7fbcc41080f0 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc1ffb640 1 -- 172.21.15.100:0/4279374977 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4007ab0 con 0x7fbcc41080f0 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc97fe640 1 -- 172.21.15.100:0/4279374977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 msgr2=0x7fbcc410a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc97fe640 1 --2- 172.21.15.100:0/4279374977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc410a4e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009e80 tx=0x7fbcb402a7a0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc97fe640 1 -- 172.21.15.100:0/4279374977 shutdown_connections 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc97fe640 1 --2- 172.21.15.100:0/4279374977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc410a4e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc97fe640 1 -- 172.21.15.100:0/4279374977 >> 172.21.15.100:0/4279374977 conn(0x7fbcc4101d10 msgr2=0x7fbcc4104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc97fe640 1 -- 172.21.15.100:0/4279374977 shutdown_connections 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.869+0000 7fbcc97fe640 1 -- 172.21.15.100:0/4279374977 wait complete. 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc97fe640 1 Processor -- start 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc97fe640 1 -- start start 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc97fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc4107970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc97fe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc410bac0 con 0x7fbcc41080f0 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc4107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc4107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44526/0 (socket says 172.21.15.100:44526) 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc2ffd640 1 -- 172.21.15.100:0/477136594 learned_addr learned my addr 172.21.15.100:0/477136594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.870+0000 7fbcc2ffd640 1 -- 172.21.15.100:0/477136594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4107eb0 con 0x7fbcc41080f0 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.871+0000 7fbcc2ffd640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc4107970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbcb402acc0 tx=0x7fbcb4031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.871+0000 7fbcbbfff640 1 -- 172.21.15.100:0/477136594 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4036050 con 0x7fbcc41080f0 2024-09-12T02:29:24.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.871+0000 7fbcbbfff640 1 -- 172.21.15.100:0/477136594 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcb4037040 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.871+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc41060a0 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.871+0000 7fbcbbfff640 1 -- 172.21.15.100:0/477136594 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb403d850 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.871+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc41065e0 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.872+0000 7fbcbbfff640 1 -- 172.21.15.100:0/477136594 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fbcb4044020 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.872+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc4108550 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.872+0000 7fbcbbfff640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7fbcb0038f20 0x7fbcb003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.872+0000 7fbcbbfff640 1 -- 172.21.15.100:0/477136594 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbcb4042020 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.872+0000 7fbcc27fc640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7fbcb0038f20 0x7fbcb003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.872+0000 7fbcc27fc640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7fbcb0038f20 0x7fbcb003b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0098c0 tx=0x7fbcac006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:23.877+0000 7fbcbbfff640 1 -- 172.21.15.100:0/477136594 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbcb404b020 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.103+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbcc4106ec0 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.103+0000 7fbcbbfff640 1 -- 172.21.15.100:0/477136594 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fbcb406c370 con 0x7fbcc41080f0 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7fbcb0038f20 msgr2=0x7fbcb003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.727 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7fbcb0038f20 0x7fbcb003b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0098c0 tx=0x7fbcac006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 msgr2=0x7fbcc4107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc4107970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbcb402acc0 tx=0x7fbcb4031ca0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 shutdown_connections 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7fbcb0038f20 0x7fbcb003b3e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 --2- 172.21.15.100:0/477136594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc41080f0 0x7fbcc4107970 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.105+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 >> 172.21.15.100:0/477136594 conn(0x7fbcc4101d10 msgr2=0x7fbcc41028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.106+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 shutdown_connections 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:24.106+0000 7fbcc97fe640 1 -- 172.21.15.100:0/477136594 wait complete. 2024-09-12T02:29:24.728 INFO:teuthology.orchestra.run.smithi100.stdout:mgr is available 2024-09-12T02:29:24.953 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:24 smithi100 ceph-mon[31390]: mgrmap e4: x(active, since 2s) 2024-09-12T02:29:24.953 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:24 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/477136594' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:29:25.915 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:25 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3476716541' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:29:25.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.135+0000 7f565726f640 1 Processor -- start 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.136+0000 7f565726f640 1 -- start start 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.136+0000 7f565726f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f5650107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.136+0000 7f565726f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56501080b0 con 0x7f56501076e0 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.136+0000 7f565500b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f5650107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:25.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.136+0000 7f565500b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f5650107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34412/0 (socket says 172.21.15.100:34412) 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.136+0000 7f565500b640 1 -- 172.21.15.100:0/661649091 learned_addr learned my addr 172.21.15.100:0/661649091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.136+0000 7f565500b640 1 -- 172.21.15.100:0/661649091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56501088e0 con 0x7f56501076e0 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.137+0000 7f565500b640 1 --2- 172.21.15.100:0/661649091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f5650107ae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f564c009820 tx=0x7f564c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1492fce12a0ee2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.137+0000 7f5647fff640 1 -- 172.21.15.100:0/661649091 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f564c037070 con 0x7f56501076e0 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.137+0000 7f5647fff640 1 -- 172.21.15.100:0/661649091 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f564c032900 con 0x7f56501076e0 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.137+0000 7f5647fff640 1 -- 172.21.15.100:0/661649091 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f564c030850 con 0x7f56501076e0 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 -- 172.21.15.100:0/661649091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 msgr2=0x7f5650107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 --2- 172.21.15.100:0/661649091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f5650107ae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f564c009820 tx=0x7f564c02a270 comp rx=0 tx=0).stop 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 -- 172.21.15.100:0/661649091 shutdown_connections 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 --2- 172.21.15.100:0/661649091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f5650107ae0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 -- 172.21.15.100:0/661649091 >> 172.21.15.100:0/661649091 conn(0x7f5650102e90 msgr2=0x7f56501052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 -- 172.21.15.100:0/661649091 shutdown_connections 2024-09-12T02:29:25.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 -- 172.21.15.100:0/661649091 wait complete. 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 Processor -- start 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.138+0000 7f565726f640 1 -- start start 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565726f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f565019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565726f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f565010bc90 con 0x7f56501076e0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565500b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f565019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565500b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f565019b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34416/0 (socket says 172.21.15.100:34416) 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565500b640 1 -- 172.21.15.100:0/3476716541 learned_addr learned my addr 172.21.15.100:0/3476716541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565500b640 1 -- 172.21.15.100:0/3476716541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565019bc70 con 0x7f56501076e0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565500b640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f565019b730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f564c0097f0 tx=0x7f564c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f56467fc640 1 -- 172.21.15.100:0/3476716541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f564c042070 con 0x7f56501076e0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f56467fc640 1 -- 172.21.15.100:0/3476716541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f564c032ca0 con 0x7f56501076e0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f56467fc640 1 -- 172.21.15.100:0/3476716541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f564c037040 con 0x7f56501076e0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565019bf00 con 0x7f56501076e0 2024-09-12T02:29:25.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.139+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f565019ebf0 con 0x7f56501076e0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.140+0000 7f56467fc640 1 -- 172.21.15.100:0/3476716541 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f564c045070 con 0x7f56501076e0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.140+0000 7f56467fc640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f563c038f20 0x7f563c03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.140+0000 7f56467fc640 1 -- 172.21.15.100:0/3476716541 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f564c06be80 con 0x7f56501076e0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.140+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565010be10 con 0x7f56501076e0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.140+0000 7f565480a640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f563c038f20 0x7f563c03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.141+0000 7f565480a640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f563c038f20 0x7f563c03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56400098c0 tx=0x7f5640006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.145+0000 7f56467fc640 1 -- 172.21.15.100:0/3476716541 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f564c06b8a0 con 0x7f56501076e0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.312+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f5650107b60 con 0x7f56501076e0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.312+0000 7f56467fc640 1 -- 172.21.15.100:0/3476716541 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f564c03d430 con 0x7f56501076e0 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f563c038f20 msgr2=0x7f563c03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f563c038f20 0x7f563c03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56400098c0 tx=0x7f5640006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 msgr2=0x7f565019b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f565019b730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f564c0097f0 tx=0x7f564c030ec0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 shutdown_connections 2024-09-12T02:29:25.931 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f563c038f20 0x7f563c03b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.931 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 --2- 172.21.15.100:0/3476716541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56501076e0 0x7f565019b730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.931 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 >> 172.21.15.100:0/3476716541 conn(0x7f5650102e90 msgr2=0x7f5650103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:25.931 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 shutdown_connections 2024-09-12T02:29:25.931 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:25.315+0000 7f565726f640 1 -- 172.21.15.100:0/3476716541 wait complete. 2024-09-12T02:29:25.931 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling cephadm module... 2024-09-12T02:29:26.858 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1021722725' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T02:29:26.858 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: ignoring --setuser ceph since I am not root 2024-09-12T02:29:26.858 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: ignoring --setgroup ceph since I am not root 2024-09-12T02:29:26.858 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:26.801+0000 7f1d12083040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:29:26.859 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:26.857+0000 7f1d12083040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:29:27.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:27.006+0000 7f1d12083040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:29:27.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:27.072+0000 7f1d12083040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:29:27.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f380de86640 1 Processor -- start 2024-09-12T02:29:27.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f380de86640 1 -- start start 2024-09-12T02:29:27.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f380de86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380810a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f380de86640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f380807be90 con 0x7f3808108130 2024-09-12T02:29:27.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f38077fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380810a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f38077fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380810a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34428/0 (socket says 172.21.15.100:34428) 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f38077fe640 1 -- 172.21.15.100:0/2982817463 learned_addr learned my addr 172.21.15.100:0/2982817463 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.338+0000 7f38077fe640 1 -- 172.21.15.100:0/2982817463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380810aa60 con 0x7f3808108130 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.339+0000 7f38077fe640 1 --2- 172.21.15.100:0/2982817463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380810a520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009820 tx=0x7f37f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7526fb01cfb854fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.339+0000 7f3806ffd640 1 -- 172.21.15.100:0/2982817463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f8037070 con 0x7f3808108130 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.339+0000 7f3806ffd640 1 -- 172.21.15.100:0/2982817463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37f8032900 con 0x7f3808108130 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.339+0000 7f3806ffd640 1 -- 172.21.15.100:0/2982817463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f8030850 con 0x7f3808108130 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 -- 172.21.15.100:0/2982817463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 msgr2=0x7f380810a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 --2- 172.21.15.100:0/2982817463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380810a520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009820 tx=0x7f37f802a270 comp rx=0 tx=0).stop 2024-09-12T02:29:27.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 -- 172.21.15.100:0/2982817463 shutdown_connections 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 --2- 172.21.15.100:0/2982817463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380810a520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 -- 172.21.15.100:0/2982817463 >> 172.21.15.100:0/2982817463 conn(0x7f3808101d10 msgr2=0x7f3808104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 -- 172.21.15.100:0/2982817463 shutdown_connections 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 -- 172.21.15.100:0/2982817463 wait complete. 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.340+0000 7f380de86640 1 Processor -- start 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f380de86640 1 -- start start 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f380de86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f380de86640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f380810baa0 con 0x7f3808108130 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38077fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38077fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34438/0 (socket says 172.21.15.100:34438) 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38077fe640 1 -- 172.21.15.100:0/1021722725 learned_addr learned my addr 172.21.15.100:0/1021722725 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38077fe640 1 -- 172.21.15.100:0/1021722725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380819bbc0 con 0x7f3808108130 2024-09-12T02:29:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38077fe640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380819b680 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f37f80097f0 tx=0x7f37f8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f8037040 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37f8040070 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380819be50 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f803a390 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.341+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380819eb40 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.342+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f37f803a5e0 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.342+0000 7f38057fa640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f37f4038f70 0x7f37f403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.342+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3808108590 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.342+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f37f806c1e0 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.342+0000 7f37fffff640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f37f4038f70 0x7f37f403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.343+0000 7f37fffff640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f37f4038f70 0x7f37f403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37f00098c0 tx=0x7f37f0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.347+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37f803b430 con 0x7f3808108130 2024-09-12T02:29:27.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.558+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f380819ed10 con 0x7f3808108130 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.653+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f37f806bf40 con 0x7f3808108130 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.655+0000 7f38057fa640 1 -- 172.21.15.100:0/1021722725 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f37f8045460 con 0x7f3808108130 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f37f4038f70 msgr2=0x7f37f403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f37f4038f70 0x7f37f403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37f00098c0 tx=0x7f37f0006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 msgr2=0x7f380819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380819b680 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f37f80097f0 tx=0x7f37f8030d80 comp rx=0 tx=0).stop 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 shutdown_connections 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7f37f4038f70 0x7f37f403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 --2- 172.21.15.100:0/1021722725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3808108130 0x7f380819b680 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 >> 172.21.15.100:0/1021722725 conn(0x7f3808101d10 msgr2=0x7f3808102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 shutdown_connections 2024-09-12T02:29:27.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:26.656+0000 7f380de86640 1 -- 172.21.15.100:0/1021722725 wait complete. 2024-09-12T02:29:27.481 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:27.218+0000 7f1d12083040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:29:27.482 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:27.371+0000 7f1d12083040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:29:27.757 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1021722725' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T02:29:27.757 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-mon[31390]: mgrmap e5: x(active, since 5s) 2024-09-12T02:29:27.758 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:27.695+0000 7f1d12083040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:29:28.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:27.756+0000 7f1d12083040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:29:28.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:27 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:27.946+0000 7f1d12083040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.657+0000 7effdf983640 1 Processor -- start 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.657+0000 7effdf983640 1 -- start start 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.657+0000 7effdf983640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd807c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.657+0000 7effdf983640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effd807c8f0 con 0x7effd807dec0 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.658+0000 7effdd71f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd807c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.658+0000 7effdd71f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd807c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34466/0 (socket says 172.21.15.100:34466) 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.658+0000 7effdd71f640 1 -- 172.21.15.100:0/4255513045 learned_addr learned my addr 172.21.15.100:0/4255513045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.658+0000 7effdd71f640 1 -- 172.21.15.100:0/4255513045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd807ca70 con 0x7effd807dec0 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdd71f640 1 --2- 172.21.15.100:0/4255513045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd807c320 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7effc8009820 tx=0x7effc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62756039062ca8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effcffff640 1 -- 172.21.15.100:0/4255513045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc8037070 con 0x7effd807dec0 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effcffff640 1 -- 172.21.15.100:0/4255513045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effc8032900 con 0x7effd807dec0 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effcffff640 1 -- 172.21.15.100:0/4255513045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc8030850 con 0x7effd807dec0 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdf983640 1 -- 172.21.15.100:0/4255513045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 msgr2=0x7effd807c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdf983640 1 --2- 172.21.15.100:0/4255513045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd807c320 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7effc8009820 tx=0x7effc802a270 comp rx=0 tx=0).stop 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdf983640 1 -- 172.21.15.100:0/4255513045 shutdown_connections 2024-09-12T02:29:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdf983640 1 --2- 172.21.15.100:0/4255513045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd807c320 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdf983640 1 -- 172.21.15.100:0/4255513045 >> 172.21.15.100:0/4255513045 conn(0x7effd8102e40 msgr2=0x7effd8105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdf983640 1 -- 172.21.15.100:0/4255513045 shutdown_connections 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.659+0000 7effdf983640 1 -- 172.21.15.100:0/4255513045 wait complete. 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdf983640 1 Processor -- start 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdf983640 1 -- start start 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdf983640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdf983640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effd810dd20 con 0x7effd807dec0 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdd71f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdd71f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd819d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34470/0 (socket says 172.21.15.100:34470) 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdd71f640 1 -- 172.21.15.100:0/2588954679 learned_addr learned my addr 172.21.15.100:0/2588954679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.660+0000 7effdd71f640 1 -- 172.21.15.100:0/2588954679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd819de00 con 0x7effd807dec0 2024-09-12T02:29:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.661+0000 7effdd71f640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd819d8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7effc8032ce0 tx=0x7effc8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.661+0000 7effce7fc640 1 -- 172.21.15.100:0/2588954679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc8042070 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.661+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd819e090 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.661+0000 7effce7fc640 1 -- 172.21.15.100:0/2588954679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effc80308c0 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.661+0000 7effce7fc640 1 -- 172.21.15.100:0/2588954679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc8037040 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.661+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd81a0d80 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.662+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd807c3a0 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.662+0000 7effce7fc640 1 -- 172.21.15.100:0/2588954679 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7effc8045070 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.662+0000 7effce7fc640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 0x7effc403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.662+0000 7effce7fc640 1 -- 172.21.15.100:0/2588954679 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7effc806c0b0 con 0x7effd807dec0 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.662+0000 7effdcf1e640 1 -- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 msgr2=0x7effc403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3636516515 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.662+0000 7effdcf1e640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 0x7effc403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:28.481 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.667+0000 7effce7fc640 1 -- 172.21.15.100:0/2588954679 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7effc803cd00 con 0x7effd807dec0 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.863+0000 7effdcf1e640 1 -- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 msgr2=0x7effc403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3636516515 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.863+0000 7effdcf1e640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 0x7effc403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.879+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7effd81a1400 con 0x7effd807dec0 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.879+0000 7effce7fc640 1 -- 172.21.15.100:0/2588954679 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7effc803c830 con 0x7effd807dec0 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 msgr2=0x7effc403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 0x7effc403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 msgr2=0x7effd819d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd819d8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7effc8032ce0 tx=0x7effc8032d10 comp rx=0 tx=0).stop 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 shutdown_connections 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7effc4038f70 0x7effc403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 --2- 172.21.15.100:0/2588954679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effd807dec0 0x7effd819d8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.882+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 >> 172.21.15.100:0/2588954679 conn(0x7effd8102e40 msgr2=0x7effd8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.482 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.883+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 shutdown_connections 2024-09-12T02:29:28.483 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:27.883+0000 7effdf983640 1 -- 172.21.15.100:0/2588954679 wait complete. 2024-09-12T02:29:28.483 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-09-12T02:29:28.483 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 5... 2024-09-12T02:29:28.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:28 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2588954679' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:29:29.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:28.832+0000 7f1d12083040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:29:29.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:28.903+0000 7f1d12083040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:29:29.853 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:29.600+0000 7f1d12083040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:29:29.853 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:29.713+0000 7f1d12083040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:29:30.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:29.853+0000 7f1d12083040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:29:30.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:29.913+0000 7f1d12083040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:29:30.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.058+0000 7f1d12083040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:29:30.404 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.125+0000 7f1d12083040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:29:30.404 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.184+0000 7f1d12083040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:29:30.404 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.340+0000 7f1d12083040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:29:30.405 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.404+0000 7f1d12083040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:29:30.666 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.469+0000 7f1d12083040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:29:30.666 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.549+0000 7f1d12083040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:29:30.666 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.607+0000 7f1d12083040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:29:30.666 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:30.665+0000 7f1d12083040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:29:31.871 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:31.441+0000 7f1d12083040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: Active manager daemon x restarted 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: Activating manager daemon x 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: mgrmap e6: x(active, starting, since 0.003369s) 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:29:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:29:31.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: Manager daemon x is now available 2024-09-12T02:29:31.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:31.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:31.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:31.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:31.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:29:31.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:31 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:29:32.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-mon[31390]: Found migration_current of "None". Setting to last migration. 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-mon[31390]: mgrmap e7: x(active, since 1.00567s) 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:32.574+0000 7f1c7ebe8640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:29:32] ENGINE Error in HTTPServer.serve 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: Traceback (most recent call last): 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self._connections.run(self.expiration_interval) 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:29:32.814 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self._run(expiration_interval) 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: s = self.context.wrap_socket( 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: return self.sslsocket_class._create( 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self.do_handshake() 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self._sslobj.do_handshake() 2024-09-12T02:29:32.815 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:29:32.816 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.916+0000 7ff0beabd640 1 Processor -- start 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.917+0000 7ff0beabd640 1 -- start start 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.917+0000 7ff0beabd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b807bd10 0x7ff0b810a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.917+0000 7ff0beabd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b810a840 con 0x7ff0b807bd10 2024-09-12T02:29:33.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.917+0000 7ff0bc859640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b807bd10 0x7ff0b810a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.917+0000 7ff0bc859640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b807bd10 0x7ff0b810a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34476/0 (socket says 172.21.15.100:34476) 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.917+0000 7ff0bc859640 1 -- 172.21.15.100:0/3156255780 learned_addr learned my addr 172.21.15.100:0/3156255780 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.917+0000 7ff0bc859640 1 -- 172.21.15.100:0/3156255780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b810a9c0 con 0x7ff0b807bd10 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.918+0000 7ff0bc859640 1 --2- 172.21.15.100:0/3156255780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b807bd10 0x7ff0b810a270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009820 tx=0x7ff0ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e7dfcfd48f7cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.918+0000 7ff0b77fe640 1 -- 172.21.15.100:0/3156255780 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac037070 con 0x7ff0b807bd10 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.918+0000 7ff0b77fe640 1 -- 172.21.15.100:0/3156255780 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0ac032900 con 0x7ff0b807bd10 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.918+0000 7ff0b77fe640 1 -- 172.21.15.100:0/3156255780 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac030850 con 0x7ff0b807bd10 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 -- 172.21.15.100:0/3156255780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b807bd10 msgr2=0x7ff0b810a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 --2- 172.21.15.100:0/3156255780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b807bd10 0x7ff0b810a270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009820 tx=0x7ff0ac02a270 comp rx=0 tx=0).stop 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 -- 172.21.15.100:0/3156255780 shutdown_connections 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 --2- 172.21.15.100:0/3156255780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b807bd10 0x7ff0b810a270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 -- 172.21.15.100:0/3156255780 >> 172.21.15.100:0/3156255780 conn(0x7ff0b8101da0 msgr2=0x7ff0b81041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 -- 172.21.15.100:0/3156255780 shutdown_connections 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 -- 172.21.15.100:0/3156255780 wait complete. 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 Processor -- start 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 -- start start 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b8107aa0 0x7ff0b8106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.919+0000 7ff0beabd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b810bac0 con 0x7ff0b8107aa0 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0bc859640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b8107aa0 0x7ff0b8106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0bc859640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b8107aa0 0x7ff0b8106210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34480/0 (socket says 172.21.15.100:34480) 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0bc859640 1 -- 172.21.15.100:0/320230561 learned_addr learned my addr 172.21.15.100:0/320230561 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0bc859640 1 -- 172.21.15.100:0/320230561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b8107ec0 con 0x7ff0b8107aa0 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0bc859640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b8107aa0 0x7ff0b8106210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0097f0 tx=0x7ff0ac030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac042070 con 0x7ff0b8107aa0 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b8106750 con 0x7ff0b8107aa0 2024-09-12T02:29:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0ac032ca0 con 0x7ff0b8107aa0 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac037040 con 0x7ff0b8107aa0 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.920+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b8106c30 con 0x7ff0b8107aa0 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.921+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7ff0ac045070 con 0x7ff0b8107aa0 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.921+0000 7ff0b5ffb640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 0x7ff0a803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.921+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 --> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff0b81082e0 con 0x7ff0a8038f70 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.922+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff0ac06bf80 con 0x7ff0b8107aa0 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.922+0000 7ff0b7fff640 1 -- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 msgr2=0x7ff0a803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3636516515 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:28.922+0000 7ff0b7fff640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 0x7ff0a803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:29.123+0000 7ff0b7fff640 1 -- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 msgr2=0x7ff0a803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3636516515 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:29.123+0000 7ff0b7fff640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 0x7ff0a803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:29.524+0000 7ff0b7fff640 1 -- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 msgr2=0x7ff0a803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3636516515 2024-09-12T02:29:33.082 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:29.524+0000 7ff0b7fff640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 0x7ff0a803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:30.325+0000 7ff0b7fff640 1 -- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 msgr2=0x7ff0a803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3636516515 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:30.325+0000 7ff0b7fff640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 0x7ff0a803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:31.445+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7ff0ac06aa40 con 0x7ff0b8107aa0 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:31.445+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 msgr2=0x7ff0a803b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:31.445+0000 7ff0b5ffb640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 0x7ff0a803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.446+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7ff0ac03cd10 con 0x7ff0b8107aa0 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.446+0000 7ff0b5ffb640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7ff0a803c6b0 0x7ff0a803eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.446+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff0b81082e0 con 0x7ff0a803c6b0 2024-09-12T02:29:33.083 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.446+0000 7ff0b7fff640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7ff0a803c6b0 0x7ff0a803eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.447+0000 7ff0b7fff640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7ff0a803c6b0 0x7ff0a803eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4003980 tx=0x7ff0a4006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.448+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff0b81082e0 con 0x7ff0a803c6b0 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.461+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff0b8106eb0 con 0x7ff0a803c6b0 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.461+0000 7ff0b5ffb640 1 -- 172.21.15.100:0/320230561 <== mgr.14118 v2:172.21.15.100:6800/3548885308 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff0b8106eb0 con 0x7ff0a803c6b0 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7ff0a803c6b0 msgr2=0x7ff0a803eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7ff0a803c6b0 0x7ff0a803eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4003980 tx=0x7ff0a4006e10 comp rx=0 tx=0).stop 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b8107aa0 msgr2=0x7ff0b8106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b8107aa0 0x7ff0b8106210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0097f0 tx=0x7ff0ac030ec0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 shutdown_connections 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7ff0a803c6b0 0x7ff0a803eaa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:6800/3636516515,v1:172.21.15.100:6801/3636516515] conn(0x7ff0a8038f70 0x7ff0a803b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 --2- 172.21.15.100:0/320230561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b8107aa0 0x7ff0b8106210 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.084 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 >> 172.21.15.100:0/320230561 conn(0x7ff0b8101da0 msgr2=0x7ff0b81029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.085 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 shutdown_connections 2024-09-12T02:29:33.085 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:32.462+0000 7ff0beabd640 1 -- 172.21.15.100:0/320230561 wait complete. 2024-09-12T02:29:33.085 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 5 is available 2024-09-12T02:29:33.085 INFO:teuthology.orchestra.run.smithi100.stdout:Setting orchestrator backend to cephadm... 2024-09-12T02:29:33.658 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:32] ENGINE Bus STARTING 2024-09-12T02:29:33.658 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T02:29:33.658 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:32] ENGINE Serving on https://172.21.15.100:7150 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:32] ENGINE Error in HTTPServer.serve 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: Traceback (most recent call last): 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._run(expiration_interval) 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:29:33.659 INFO:journalctl@ceph.mon.a.smithi100.stdout: s = self.context.wrap_socket( 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout: return self.sslsocket_class._create( 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout: self.do_handshake() 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._sslobj.do_handshake() 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:32] ENGINE Serving on http://172.21.15.100:8765 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:32] ENGINE Bus STARTED 2024-09-12T02:29:33.660 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:33 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:34.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f4781e93640 1 Processor -- start 2024-09-12T02:29:34.248 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f4781e93640 1 -- start start 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f4781e93640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c10a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f4781e93640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f477c07be70 con 0x7f477c108150 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c10a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c10a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34576/0 (socket says 172.21.15.100:34576) 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f477b7fe640 1 -- 172.21.15.100:0/229098449 learned_addr learned my addr 172.21.15.100:0/229098449 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.470+0000 7f477b7fe640 1 -- 172.21.15.100:0/229098449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c10aa80 con 0x7f477c108150 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.471+0000 7f477b7fe640 1 --2- 172.21.15.100:0/229098449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c10a540 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f476c009820 tx=0x7f476c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa1f84046dc8f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.471+0000 7f477a7fc640 1 -- 172.21.15.100:0/229098449 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f476c037070 con 0x7f477c108150 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.471+0000 7f477a7fc640 1 -- 172.21.15.100:0/229098449 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f476c032900 con 0x7f477c108150 2024-09-12T02:29:34.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.471+0000 7f477a7fc640 1 -- 172.21.15.100:0/229098449 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f476c030850 con 0x7f477c108150 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 -- 172.21.15.100:0/229098449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 msgr2=0x7f477c10a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 --2- 172.21.15.100:0/229098449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c10a540 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f476c009820 tx=0x7f476c02a270 comp rx=0 tx=0).stop 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 -- 172.21.15.100:0/229098449 shutdown_connections 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 --2- 172.21.15.100:0/229098449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c10a540 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 -- 172.21.15.100:0/229098449 >> 172.21.15.100:0/229098449 conn(0x7f477c101d10 msgr2=0x7f477c104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 -- 172.21.15.100:0/229098449 shutdown_connections 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 -- 172.21.15.100:0/229098449 wait complete. 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.472+0000 7f4781e93640 1 Processor -- start 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f4781e93640 1 -- start start 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f4781e93640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c1079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:34.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f4781e93640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f477c10bac0 con 0x7f477c108150 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c1079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c1079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34592/0 (socket says 172.21.15.100:34592) 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f477b7fe640 1 -- 172.21.15.100:0/1225310126 learned_addr learned my addr 172.21.15.100:0/1225310126 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f477b7fe640 1 -- 172.21.15.100:0/1225310126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c107f10 con 0x7f477c108150 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f477b7fe640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c1079d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f476c032ce0 tx=0x7f476c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.473+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f476c042070 con 0x7f477c108150 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.474+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c106100 con 0x7f477c108150 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.474+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f476c0308c0 con 0x7f477c108150 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.474+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f476c037040 con 0x7f477c108150 2024-09-12T02:29:34.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.474+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c106640 con 0x7f477c108150 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.474+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f476c045070 con 0x7f477c108150 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.474+0000 7f4778ff9640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f4764038e60 0x7f476403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.474+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c1085b0 con 0x7f477c108150 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.475+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f476c06bf20 con 0x7f477c108150 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.475+0000 7f477affd640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f4764038e60 0x7f476403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.475+0000 7f477affd640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f4764038e60 0x7f476403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f47700098c0 tx=0x7f4770006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.479+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f476c045520 con 0x7f477c108150 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.500+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f476c03cd00 con 0x7f477c108150 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.658+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f477c106f60 con 0x7f4764038e60 2024-09-12T02:29:34.252 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.662+0000 7f4778ff9640 1 -- 172.21.15.100:0/1225310126 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f477c106f60 con 0x7f4764038e60 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.664+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f4764038e60 msgr2=0x7f476403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.664+0000 7f4781e93640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f4764038e60 0x7f476403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f47700098c0 tx=0x7f4770006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.664+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 msgr2=0x7f477c1079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.664+0000 7f4781e93640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c1079d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f476c032ce0 tx=0x7f476c032d10 comp rx=0 tx=0).stop 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.665+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 shutdown_connections 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.665+0000 7f4781e93640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f4764038e60 0x7f476403b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.665+0000 7f4781e93640 1 --2- 172.21.15.100:0/1225310126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f477c108150 0x7f477c1079d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.665+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 >> 172.21.15.100:0/1225310126 conn(0x7f477c101d10 msgr2=0x7f477c1028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.665+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 shutdown_connections 2024-09-12T02:29:34.253 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:33.665+0000 7f4781e93640 1 -- 172.21.15.100:0/1225310126 wait complete. 2024-09-12T02:29:34.857 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:34 smithi100 ceph-mon[31390]: mgrmap e8: x(active, since 2s) 2024-09-12T02:29:34.857 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:34 smithi100 ceph-mon[31390]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:34.857 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:34 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:34.857 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:34 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:35.470 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.678+0000 7f02c9c36640 1 Processor -- start 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.678+0000 7f02c9c36640 1 -- start start 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.678+0000 7f02c9c36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c4107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.678+0000 7f02c9c36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02c41080f0 con 0x7f02c4107720 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.678+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c4107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.678+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c4107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58770/0 (socket says 172.21.15.100:58770) 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.678+0000 7f02c37fe640 1 -- 172.21.15.100:0/2601975679 learned_addr learned my addr 172.21.15.100:0/2601975679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.679+0000 7f02c37fe640 1 -- 172.21.15.100:0/2601975679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c41088d0 con 0x7f02c4107720 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.679+0000 7f02c37fe640 1 --2- 172.21.15.100:0/2601975679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c4107b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009820 tx=0x7f02b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09c2c1057b39e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c27fc640 1 -- 172.21.15.100:0/2601975679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4037070 con 0x7f02c4107720 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c27fc640 1 -- 172.21.15.100:0/2601975679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02b4032900 con 0x7f02c4107720 2024-09-12T02:29:35.471 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c27fc640 1 -- 172.21.15.100:0/2601975679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4030850 con 0x7f02c4107720 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c9c36640 1 -- 172.21.15.100:0/2601975679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 msgr2=0x7f02c4107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c9c36640 1 --2- 172.21.15.100:0/2601975679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c4107b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009820 tx=0x7f02b402a270 comp rx=0 tx=0).stop 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c9c36640 1 -- 172.21.15.100:0/2601975679 shutdown_connections 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c9c36640 1 --2- 172.21.15.100:0/2601975679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c4107b20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c9c36640 1 -- 172.21.15.100:0/2601975679 >> 172.21.15.100:0/2601975679 conn(0x7f02c4102e90 msgr2=0x7f02c41052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c9c36640 1 -- 172.21.15.100:0/2601975679 shutdown_connections 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.680+0000 7f02c9c36640 1 -- 172.21.15.100:0/2601975679 wait complete. 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c9c36640 1 Processor -- start 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c9c36640 1 -- start start 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c9c36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.472 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c9c36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02c410bc80 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c419b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58786/0 (socket says 172.21.15.100:58786) 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c37fe640 1 -- 172.21.15.100:0/2592381031 learned_addr learned my addr 172.21.15.100:0/2592381031 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.681+0000 7f02c37fe640 1 -- 172.21.15.100:0/2592381031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c419bc80 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.682+0000 7f02c37fe640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c419b740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097f0 tx=0x7f02b4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.682+0000 7f02c0ff9640 1 -- 172.21.15.100:0/2592381031 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4042070 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.682+0000 7f02c0ff9640 1 -- 172.21.15.100:0/2592381031 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02b4032ca0 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.682+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c419bf10 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.682+0000 7f02c0ff9640 1 -- 172.21.15.100:0/2592381031 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4037040 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.682+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c419ec00 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.683+0000 7f02c0ff9640 1 -- 172.21.15.100:0/2592381031 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f02b4045070 con 0x7f02c4107720 2024-09-12T02:29:35.473 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.683+0000 7f02c0ff9640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f02ac038f70 0x7f02ac03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.683+0000 7f02c0ff9640 1 -- 172.21.15.100:0/2592381031 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f02b406c0a0 con 0x7f02c4107720 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.683+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c410be00 con 0x7f02c4107720 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.683+0000 7f02c2ffd640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f02ac038f70 0x7f02ac03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.683+0000 7f02c2ffd640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f02ac038f70 0x7f02ac03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098c0 tx=0x7f02b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.688+0000 7f02c0ff9640 1 -- 172.21.15.100:0/2592381031 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02b4045520 con 0x7f02c4107720 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.856+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f02c41041d0 con 0x7f02ac038f70 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.857+0000 7f02c0ff9640 1 -- 172.21.15.100:0/2592381031 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f02c41041d0 con 0x7f02ac038f70 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f02ac038f70 msgr2=0x7f02ac03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f02ac038f70 0x7f02ac03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098c0 tx=0x7f02b8006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 msgr2=0x7f02c419b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c419b740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097f0 tx=0x7f02b4030ec0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.474 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 shutdown_connections 2024-09-12T02:29:35.475 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f02ac038f70 0x7f02ac03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.475 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 --2- 172.21.15.100:0/2592381031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c4107720 0x7f02c419b740 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.475 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.859+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 >> 172.21.15.100:0/2592381031 conn(0x7f02c4102e90 msgr2=0x7f02c4103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.475 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.860+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 shutdown_connections 2024-09-12T02:29:35.475 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:34.860+0000 7f02c9c36640 1 -- 172.21.15.100:0/2592381031 wait complete. 2024-09-12T02:29:35.475 INFO:teuthology.orchestra.run.smithi100.stdout:Generating ssh key... 2024-09-12T02:29:36.037 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:35 smithi100 ceph-mon[31390]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: Generating public/private rsa key pair. 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: Your identification has been saved in /tmp/tmp1q2xmt4r/key 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: Your public key has been saved in /tmp/tmp1q2xmt4r/key.pub 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: The key fingerprint is: 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: SHA256:J1R0bwumSgS76TfGFLlepcohc+bjEo2EcUk2JVuKqvQ ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: The key's randomart image is: 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: +---[RSA 3072]----+ 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: | .*oo.o . | 2024-09-12T02:29:36.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: | .ooO o . . | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: | .++ = + o | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: | .. .= o = o . | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: | .. .=oS = . | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: |... .o%.B | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: |. E ..% | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: | .+ o | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: | .. | 2024-09-12T02:29:36.373 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: +----[SHA256]-----+ 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.860+0000 7f0f30119640 1 Processor -- start 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.860+0000 7f0f30119640 1 -- start start 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.861+0000 7f0f30119640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f28106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.861+0000 7f0f30119640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f28106f50 con 0x7f0f28106580 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.861+0000 7f0f2deb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f28106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.861+0000 7f0f2deb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f28106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58792/0 (socket says 172.21.15.100:58792) 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.861+0000 7f0f2deb5640 1 -- 172.21.15.100:0/3444612752 learned_addr learned my addr 172.21.15.100:0/3444612752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.861+0000 7f0f2deb5640 1 -- 172.21.15.100:0/3444612752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f28107780 con 0x7f0f28106580 2024-09-12T02:29:36.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f2deb5640 1 --2- 172.21.15.100:0/3444612752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f28106980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009820 tx=0x7f0f1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cf6e3b7b60a89a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f2ceb3640 1 -- 172.21.15.100:0/3444612752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f18037070 con 0x7f0f28106580 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f2ceb3640 1 -- 172.21.15.100:0/3444612752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f18032900 con 0x7f0f28106580 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f2ceb3640 1 -- 172.21.15.100:0/3444612752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f18030850 con 0x7f0f28106580 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f30119640 1 -- 172.21.15.100:0/3444612752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 msgr2=0x7f0f28106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f30119640 1 --2- 172.21.15.100:0/3444612752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f28106980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009820 tx=0x7f0f1802a270 comp rx=0 tx=0).stop 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f30119640 1 -- 172.21.15.100:0/3444612752 shutdown_connections 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f30119640 1 --2- 172.21.15.100:0/3444612752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f28106980 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.862+0000 7f0f30119640 1 -- 172.21.15.100:0/3444612752 >> 172.21.15.100:0/3444612752 conn(0x7f0f28101d10 msgr2=0x7f0f28104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f30119640 1 -- 172.21.15.100:0/3444612752 shutdown_connections 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f30119640 1 -- 172.21.15.100:0/3444612752 wait complete. 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f30119640 1 Processor -- start 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f30119640 1 -- start start 2024-09-12T02:29:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f30119640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f2819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f30119640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2810ab30 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f2deb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f2819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f2deb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f2819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58796/0 (socket says 172.21.15.100:58796) 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.863+0000 7f0f2deb5640 1 -- 172.21.15.100:0/2100239556 learned_addr learned my addr 172.21.15.100:0/2100239556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.864+0000 7f0f2deb5640 1 -- 172.21.15.100:0/2100239556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2819aae0 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.864+0000 7f0f2deb5640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f2819a5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0f180097f0 tx=0x7f0f18030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.864+0000 7f0f1effd640 1 -- 172.21.15.100:0/2100239556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f18037040 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.864+0000 7f0f1effd640 1 -- 172.21.15.100:0/2100239556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f18040070 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.864+0000 7f0f1effd640 1 -- 172.21.15.100:0/2100239556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f1803a390 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.864+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2819ad70 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.864+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2819da60 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.865+0000 7f0f1effd640 1 -- 172.21.15.100:0/2100239556 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0f1803b430 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.865+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f28106a00 con 0x7f0f28106580 2024-09-12T02:29:36.829 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.865+0000 7f0f1effd640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0f14038f70 0x7f0f1403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.865+0000 7f0f1effd640 1 -- 172.21.15.100:0/2100239556 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0f1806c460 con 0x7f0f28106580 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.865+0000 7f0f2d6b4640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0f14038f70 0x7f0f1403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.865+0000 7f0f2d6b4640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0f14038f70 0x7f0f1403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f240098c0 tx=0x7f0f24006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:35.870+0000 7f0f1effd640 1 -- 172.21.15.100:0/2100239556 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f18032900 con 0x7f0f28106580 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.037+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f0f28102fc0 con 0x7f0f14038f70 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.190+0000 7f0f1effd640 1 -- 172.21.15.100:0/2100239556 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f28102fc0 con 0x7f0f14038f70 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0f14038f70 msgr2=0x7f0f1403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0f14038f70 0x7f0f1403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f240098c0 tx=0x7f0f24006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 msgr2=0x7f0f2819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f2819a5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0f180097f0 tx=0x7f0f18030d80 comp rx=0 tx=0).stop 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 shutdown_connections 2024-09-12T02:29:36.830 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0f14038f70 0x7f0f1403b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.831 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 --2- 172.21.15.100:0/2100239556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f28106580 0x7f0f2819a5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.831 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 >> 172.21.15.100:0/2100239556 conn(0x7f0f28101d10 msgr2=0x7f0f281028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:36.831 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 shutdown_connections 2024-09-12T02:29:36.831 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:36.193+0000 7f0f30119640 1 -- 172.21.15.100:0/2100239556 wait complete. 2024-09-12T02:29:37.406 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:37 smithi100 ceph-mon[31390]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:37.407 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:37 smithi100 ceph-mon[31390]: Generating ssh key... 2024-09-12T02:29:37.407 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:37 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:37.407 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:37 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC11D6AUAwRHDO2DF9rxkuJc9fe20K/4mTCIRBuNfupdar3W6JcybC/hlmTG6YkeYUpYMb28NoNi4CSMyQmlpQOXIbnFIkKt4PKzxYBuJlLzLhwhS8hU6AOs85aWbmLy6VPgIBD7PjQLph5Z4x3AV0eYWPqTcxtBahAYtBC7YcU+N4djaSDwOp+WC4IgQAoMmCc0cLNHro1jYCI//ReGWzo8/l+nk9MHbMNmL+6V8k+d+47pOvvAF6shp3FYyTmvAlGprI67w95hWW3+pPY5Y2/Rsobk/yhGcdH+EuBlEKzs9hmGlQFkq6bMUutHMcPBp3J/fS6L6PRg3Y247gCTljXS0Fhfzoonxm9K7jZe+mEmwHp4l1IskwsZwp9FfNTDAmFK2uz5MO4hiIvY2cvdELvkZn19KITFxmL/Das/k/uG1xMzwJlB3ZW4jtxaOas6IWIFIF1My096VOcjPZYwl5fHCijjEwuvYYzawG0MiGOfVgDbryrLVu16/tfHuR7qbc= ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.232+0000 7f040b240640 1 Processor -- start 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.232+0000 7f040b240640 1 -- start start 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.232+0000 7f040b240640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f04041069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.232+0000 7f040b240640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0404106fa0 con 0x7f04041065d0 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.232+0000 7f0408fdc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f04041069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.232+0000 7f0408fdc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f04041069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58808/0 (socket says 172.21.15.100:58808) 2024-09-12T02:29:38.000 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.232+0000 7f0408fdc640 1 -- 172.21.15.100:0/1072365227 learned_addr learned my addr 172.21.15.100:0/1072365227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.233+0000 7f0408fdc640 1 -- 172.21.15.100:0/1072365227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04041077d0 con 0x7f04041065d0 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.233+0000 7f0408fdc640 1 --2- 172.21.15.100:0/1072365227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f04041069d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009820 tx=0x7f03f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4594d720c71d1edd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.233+0000 7f04037fe640 1 -- 172.21.15.100:0/1072365227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8037070 con 0x7f04041065d0 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.233+0000 7f04037fe640 1 -- 172.21.15.100:0/1072365227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03f8032900 con 0x7f04041065d0 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.233+0000 7f04037fe640 1 -- 172.21.15.100:0/1072365227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8030850 con 0x7f04041065d0 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.234+0000 7f040b240640 1 -- 172.21.15.100:0/1072365227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 msgr2=0x7f04041069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.234+0000 7f040b240640 1 --2- 172.21.15.100:0/1072365227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f04041069d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009820 tx=0x7f03f802a270 comp rx=0 tx=0).stop 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.234+0000 7f040b240640 1 -- 172.21.15.100:0/1072365227 shutdown_connections 2024-09-12T02:29:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.234+0000 7f040b240640 1 --2- 172.21.15.100:0/1072365227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f04041069d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.234+0000 7f040b240640 1 -- 172.21.15.100:0/1072365227 >> 172.21.15.100:0/1072365227 conn(0x7f0404101da0 msgr2=0x7f04041041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.234+0000 7f040b240640 1 -- 172.21.15.100:0/1072365227 shutdown_connections 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.234+0000 7f040b240640 1 -- 172.21.15.100:0/1072365227 wait complete. 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f040b240640 1 Processor -- start 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f040b240640 1 -- start start 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f040b240640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f040419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f040b240640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f040410ab80 con 0x7f04041065d0 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0408fdc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f040419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0408fdc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f040419b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58824/0 (socket says 172.21.15.100:58824) 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0408fdc640 1 -- 172.21.15.100:0/1221591125 learned_addr learned my addr 172.21.15.100:0/1221591125 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:38.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0408fdc640 1 -- 172.21.15.100:0/1221591125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040419bc50 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0408fdc640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f040419b710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009940 tx=0x7f03f8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0401ffb640 1 -- 172.21.15.100:0/1221591125 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8042070 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0401ffb640 1 -- 172.21.15.100:0/1221591125 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03f80308c0 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040419bee0 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.235+0000 7f0401ffb640 1 -- 172.21.15.100:0/1221591125 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f8037040 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.236+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040419ebd0 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.236+0000 7f0401ffb640 1 -- 172.21.15.100:0/1221591125 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f03f8045070 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.236+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040410ad00 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.236+0000 7f0401ffb640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f03f4038fc0 0x7f03f403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.237+0000 7f0401ffb640 1 -- 172.21.15.100:0/1221591125 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f03f806c170 con 0x7f04041065d0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.237+0000 7f0403fff640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f03f4038fc0 0x7f03f403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.237+0000 7f0403fff640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f03f4038fc0 0x7f03f403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f03f00098c0 tx=0x7f03f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:38.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.241+0000 7f0401ffb640 1 -- 172.21.15.100:0/1221591125 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03f803ce20 con 0x7f04041065d0 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.406+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f04040008d0 con 0x7f03f4038fc0 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.407+0000 7f0401ffb640 1 -- 172.21.15.100:0/1221591125 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f04040008d0 con 0x7f03f4038fc0 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f03f4038fc0 msgr2=0x7f03f403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f03f4038fc0 0x7f03f403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f03f00098c0 tx=0x7f03f0006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 msgr2=0x7f040419b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f040419b710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009940 tx=0x7f03f8032ce0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 shutdown_connections 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f03f4038fc0 0x7f03f403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 --2- 172.21.15.100:0/1221591125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04041065d0 0x7f040419b710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 >> 172.21.15.100:0/1221591125 conn(0x7f0404101da0 msgr2=0x7f0404102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 shutdown_connections 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:37.409+0000 7f040b240640 1 -- 172.21.15.100:0/1221591125 wait complete. 2024-09-12T02:29:38.004 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:29:38.005 INFO:teuthology.orchestra.run.smithi100.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T02:29:38.005 INFO:teuthology.orchestra.run.smithi100.stdout:Adding host smithi100... 2024-09-12T02:29:38.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:38 smithi100 ceph-mon[31390]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:39.353 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:39 smithi100 ceph-mon[31390]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:40.296 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:40 smithi100 ceph-mon[31390]: Deploying cephadm binary to smithi100 2024-09-12T02:29:42.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Added host 'smithi100' with addr '172.21.15.100' 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f27549ee640 1 Processor -- start 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f27549ee640 1 -- start start 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f27549ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f2750107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f27549ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f27501080f0 con 0x7f2750107720 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f274e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f2750107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f274e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f2750107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58836/0 (socket says 172.21.15.100:58836) 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f274e59c640 1 -- 172.21.15.100:0/2663620486 learned_addr learned my addr 172.21.15.100:0/2663620486 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.399+0000 7f274e59c640 1 -- 172.21.15.100:0/2663620486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2750108920 con 0x7f2750107720 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.400+0000 7f274e59c640 1 --2- 172.21.15.100:0/2663620486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f2750107b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2740009820 tx=0x7f274002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4457c2caaa37077 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.400+0000 7f274dd9b640 1 -- 172.21.15.100:0/2663620486 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2740037070 con 0x7f2750107720 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.400+0000 7f274dd9b640 1 -- 172.21.15.100:0/2663620486 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2740032900 con 0x7f2750107720 2024-09-12T02:29:42.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.400+0000 7f274dd9b640 1 -- 172.21.15.100:0/2663620486 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2740030850 con 0x7f2750107720 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.401+0000 7f27549ee640 1 -- 172.21.15.100:0/2663620486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 msgr2=0x7f2750107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.401+0000 7f27549ee640 1 --2- 172.21.15.100:0/2663620486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f2750107b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2740009820 tx=0x7f274002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.401+0000 7f27549ee640 1 -- 172.21.15.100:0/2663620486 shutdown_connections 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.401+0000 7f27549ee640 1 --2- 172.21.15.100:0/2663620486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f2750107b20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.401+0000 7f27549ee640 1 -- 172.21.15.100:0/2663620486 >> 172.21.15.100:0/2663620486 conn(0x7f2750102ed0 msgr2=0x7f27501052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.401+0000 7f27549ee640 1 -- 172.21.15.100:0/2663620486 shutdown_connections 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.401+0000 7f27549ee640 1 -- 172.21.15.100:0/2663620486 wait complete. 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f27549ee640 1 Processor -- start 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f27549ee640 1 -- start start 2024-09-12T02:29:42.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f27549ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f275019b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f27549ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f275010bcd0 con 0x7f2750107720 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f274e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f275019b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f274e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f275019b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58838/0 (socket says 172.21.15.100:58838) 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f274e59c640 1 -- 172.21.15.100:0/563725261 learned_addr learned my addr 172.21.15.100:0/563725261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f274e59c640 1 -- 172.21.15.100:0/563725261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275019bc40 con 0x7f2750107720 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.402+0000 7f274e59c640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f275019b700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27400097f0 tx=0x7f2740030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.403+0000 7f27477fe640 1 -- 172.21.15.100:0/563725261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2740042070 con 0x7f2750107720 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.403+0000 7f27477fe640 1 -- 172.21.15.100:0/563725261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2740032ca0 con 0x7f2750107720 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.403+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275019bed0 con 0x7f2750107720 2024-09-12T02:29:42.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.403+0000 7f27477fe640 1 -- 172.21.15.100:0/563725261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2740037040 con 0x7f2750107720 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.403+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275019ebc0 con 0x7f2750107720 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.404+0000 7f27477fe640 1 -- 172.21.15.100:0/563725261 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2740045070 con 0x7f2750107720 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.404+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2750107ba0 con 0x7f2750107720 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.404+0000 7f27477fe640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f273c038fc0 0x7f273c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.404+0000 7f27477fe640 1 -- 172.21.15.100:0/563725261 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f274006c060 con 0x7f2750107720 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.404+0000 7f2747fff640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f273c038fc0 0x7f273c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.404+0000 7f2747fff640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f273c038fc0 0x7f273c03b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27380098c0 tx=0x7f2738006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.408+0000 7f27477fe640 1 -- 172.21.15.100:0/563725261 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2740045360 con 0x7f2750107720 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:38.578+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}) -- 0x7f27501041a0 con 0x7f273c038fc0 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.735+0000 7f27477fe640 1 -- 172.21.15.100:0/563725261 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f27501041a0 con 0x7f273c038fc0 2024-09-12T02:29:42.355 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f273c038fc0 msgr2=0x7f273c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f273c038fc0 0x7f273c03b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27380098c0 tx=0x7f2738006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 msgr2=0x7f275019b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f275019b700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27400097f0 tx=0x7f2740030ec0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 shutdown_connections 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f273c038fc0 0x7f273c03b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 --2- 172.21.15.100:0/563725261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2750107720 0x7f275019b700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 >> 172.21.15.100:0/563725261 conn(0x7f2750102ed0 msgr2=0x7f2750103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 shutdown_connections 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:41.738+0000 7f27549ee640 1 -- 172.21.15.100:0/563725261 wait complete. 2024-09-12T02:29:42.356 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying unmanaged mon service... 2024-09-12T02:29:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:42 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:42 smithi100 ceph-mon[31390]: Added host smithi100 2024-09-12T02:29:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:42 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:43.802 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.799+0000 7f7ef5186640 1 Processor -- start 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.799+0000 7f7ef5186640 1 -- start start 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.799+0000 7f7ef5186640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef0106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.799+0000 7f7ef5186640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef0106f50 con 0x7f7ef0106580 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.800+0000 7f7eeed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef0106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.800+0000 7f7eeed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef0106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58850/0 (socket says 172.21.15.100:58850) 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.800+0000 7f7eeed9d640 1 -- 172.21.15.100:0/1298600026 learned_addr learned my addr 172.21.15.100:0/1298600026 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.800+0000 7f7eeed9d640 1 -- 172.21.15.100:0/1298600026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef0107780 con 0x7f7ef0106580 2024-09-12T02:29:43.803 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.800+0000 7f7eeed9d640 1 --2- 172.21.15.100:0/1298600026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef0106980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009820 tx=0x7f7ee002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ae42b1e482b42c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7eedd9b640 1 -- 172.21.15.100:0/1298600026 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee0037070 con 0x7f7ef0106580 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7eedd9b640 1 -- 172.21.15.100:0/1298600026 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ee0032900 con 0x7f7ef0106580 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7eedd9b640 1 -- 172.21.15.100:0/1298600026 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee0030850 con 0x7f7ef0106580 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7ef5186640 1 -- 172.21.15.100:0/1298600026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 msgr2=0x7f7ef0106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7ef5186640 1 --2- 172.21.15.100:0/1298600026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef0106980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009820 tx=0x7f7ee002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7ef5186640 1 -- 172.21.15.100:0/1298600026 shutdown_connections 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7ef5186640 1 --2- 172.21.15.100:0/1298600026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef0106980 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7ef5186640 1 -- 172.21.15.100:0/1298600026 >> 172.21.15.100:0/1298600026 conn(0x7f7ef0101d10 msgr2=0x7f7ef0104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7ef5186640 1 -- 172.21.15.100:0/1298600026 shutdown_connections 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.801+0000 7f7ef5186640 1 -- 172.21.15.100:0/1298600026 wait complete. 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.802+0000 7f7ef5186640 1 Processor -- start 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.802+0000 7f7ef5186640 1 -- start start 2024-09-12T02:29:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.802+0000 7f7ef5186640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.802+0000 7f7ef5186640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef010ab30 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7eeed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7eeed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58856/0 (socket says 172.21.15.100:58856) 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7eeed9d640 1 -- 172.21.15.100:0/622462420 learned_addr learned my addr 172.21.15.100:0/622462420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7eeed9d640 1 -- 172.21.15.100:0/622462420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef019aae0 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7eeed9d640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef019a5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00097f0 tx=0x7f7ee0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7ed7fff640 1 -- 172.21.15.100:0/622462420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee0037040 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7ed7fff640 1 -- 172.21.15.100:0/622462420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ee0040070 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef019ad70 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7ed7fff640 1 -- 172.21.15.100:0/622462420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee003a390 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.803+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef019da60 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.804+0000 7f7ed7fff640 1 -- 172.21.15.100:0/622462420 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7ee003a690 con 0x7f7ef0106580 2024-09-12T02:29:43.805 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.804+0000 7f7ed7fff640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f7ed8038f70 0x7f7ed803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.804+0000 7f7ed7fff640 1 -- 172.21.15.100:0/622462420 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7ee006d540 con 0x7f7ef0106580 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.804+0000 7f7eee59c640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f7ed8038f70 0x7f7ed803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.804+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef010acb0 con 0x7f7ef0106580 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.805+0000 7f7eee59c640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f7ed8038f70 0x7f7ed803b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40098c0 tx=0x7f7ee4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:42.809+0000 7f7ed7fff640 1 -- 172.21.15.100:0/622462420 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ee0042e30 con 0x7f7ef0106580 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.005+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7ef0102f80 con 0x7f7ed8038f70 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.010+0000 7f7ed7fff640 1 -- 172.21.15.100:0/622462420 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7ef0102f80 con 0x7f7ed8038f70 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f7ed8038f70 msgr2=0x7f7ed803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f7ed8038f70 0x7f7ed803b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40098c0 tx=0x7f7ee4006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.806 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 msgr2=0x7f7ef019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef019a5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00097f0 tx=0x7f7ee0030d80 comp rx=0 tx=0).stop 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 shutdown_connections 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f7ed8038f70 0x7f7ed803b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 --2- 172.21.15.100:0/622462420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ef0106580 0x7f7ef019a5a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.012+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 >> 172.21.15.100:0/622462420 conn(0x7f7ef0101d10 msgr2=0x7f7ef0102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.013+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 shutdown_connections 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:43.013+0000 7f7ef5186640 1 -- 172.21.15.100:0/622462420 wait complete. 2024-09-12T02:29:43.807 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying unmanaged mgr service... 2024-09-12T02:29:44.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:44 smithi100 ceph-mon[31390]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:44.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:44 smithi100 ceph-mon[31390]: Saving service mon spec with placement count:5 2024-09-12T02:29:44.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:44 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:45.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:45 smithi100 ceph-mon[31390]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:45.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:45 smithi100 ceph-mon[31390]: Saving service mgr spec with placement count:2 2024-09-12T02:29:45.868 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:45 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:45.868 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:45 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.395+0000 7f20b2ee1640 1 Processor -- start 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.395+0000 7f20b2ee1640 1 -- start start 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.395+0000 7f20b2ee1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.395+0000 7f20b2ee1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac07bed0 con 0x7f20ac1080e0 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.396+0000 7f20b0c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.396+0000 7f20b0c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35732/0 (socket says 172.21.15.100:35732) 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.396+0000 7f20b0c7d640 1 -- 172.21.15.100:0/1674924387 learned_addr learned my addr 172.21.15.100:0/1674924387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.396+0000 7f20b0c7d640 1 -- 172.21.15.100:0/1674924387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac10aa10 con 0x7f20ac1080e0 2024-09-12T02:29:45.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b0c7d640 1 --2- 172.21.15.100:0/1674924387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f209c009820 tx=0x7f209c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580e016e1ec914b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20ab7fe640 1 -- 172.21.15.100:0/1674924387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c037070 con 0x7f20ac1080e0 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20ab7fe640 1 -- 172.21.15.100:0/1674924387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f209c032900 con 0x7f20ac1080e0 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20ab7fe640 1 -- 172.21.15.100:0/1674924387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c030850 con 0x7f20ac1080e0 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1674924387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 msgr2=0x7f20ac10a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b2ee1640 1 --2- 172.21.15.100:0/1674924387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f209c009820 tx=0x7f209c02a270 comp rx=0 tx=0).stop 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1674924387 shutdown_connections 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b2ee1640 1 --2- 172.21.15.100:0/1674924387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1674924387 >> 172.21.15.100:0/1674924387 conn(0x7f20ac101d60 msgr2=0x7f20ac104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1674924387 shutdown_connections 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.397+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1674924387 wait complete. 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b2ee1640 1 Processor -- start 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b2ee1640 1 -- start start 2024-09-12T02:29:45.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b2ee1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b2ee1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac10bab0 con 0x7f20ac1080e0 2024-09-12T02:29:45.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b0c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b0c7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35746/0 (socket says 172.21.15.100:35746) 2024-09-12T02:29:45.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b0c7d640 1 -- 172.21.15.100:0/1722746330 learned_addr learned my addr 172.21.15.100:0/1722746330 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.398+0000 7f20b0c7d640 1 -- 172.21.15.100:0/1722746330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac19bba0 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.399+0000 7f20b0c7d640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac19b660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097f0 tx=0x7f209c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.399+0000 7f20a9ffb640 1 -- 172.21.15.100:0/1722746330 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c037040 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.399+0000 7f20a9ffb640 1 -- 172.21.15.100:0/1722746330 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f209c040070 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.399+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac19be30 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.399+0000 7f20a9ffb640 1 -- 172.21.15.100:0/1722746330 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c03a390 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.399+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac19eb20 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.400+0000 7f20a9ffb640 1 -- 172.21.15.100:0/1722746330 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f209c03a5e0 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.400+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac108540 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.400+0000 7f20a9ffb640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f2094038fc0 0x7f209403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.400+0000 7f20a9ffb640 1 -- 172.21.15.100:0/1722746330 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f209c06c470 con 0x7f20ac1080e0 2024-09-12T02:29:45.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.400+0000 7f20abfff640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f2094038fc0 0x7f209403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.400+0000 7f20abfff640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f2094038fc0 0x7f209403b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20a00098c0 tx=0x7f20a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.405+0000 7f20a9ffb640 1 -- 172.21.15.100:0/1722746330 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f209c043760 con 0x7f20ac1080e0 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.582+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f20ac103010 con 0x7f2094038fc0 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.587+0000 7f20a9ffb640 1 -- 172.21.15.100:0/1722746330 <== mgr.14118 v2:172.21.15.100:6800/3548885308 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f20ac103010 con 0x7f2094038fc0 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f2094038fc0 msgr2=0x7f209403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f2094038fc0 0x7f209403b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20a00098c0 tx=0x7f20a0006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 msgr2=0x7f20ac19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac19b660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097f0 tx=0x7f209c030d80 comp rx=0 tx=0).stop 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 shutdown_connections 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f2094038fc0 0x7f209403b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 --2- 172.21.15.100:0/1722746330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20ac1080e0 0x7f20ac19b660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 >> 172.21.15.100:0/1722746330 conn(0x7f20ac101d60 msgr2=0x7f20ac102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:45.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 shutdown_connections 2024-09-12T02:29:45.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:44.589+0000 7f20b2ee1640 1 -- 172.21.15.100:0/1722746330 wait complete. 2024-09-12T02:29:47.552 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:47 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:47.552 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:47 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3948236119' entity='client.admin' 2024-09-12T02:29:47.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.364+0000 7fd815831640 1 Processor -- start 2024-09-12T02:29:47.836 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.364+0000 7fd815831640 1 -- start start 2024-09-12T02:29:47.836 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.364+0000 7fd815831640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd810107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.836 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.364+0000 7fd815831640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd810108080 con 0x7fd8101076b0 2024-09-12T02:29:47.836 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.364+0000 7fd80effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd810107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.836 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.364+0000 7fd80effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd810107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35750/0 (socket says 172.21.15.100:35750) 2024-09-12T02:29:47.836 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.364+0000 7fd80effd640 1 -- 172.21.15.100:0/1593056806 learned_addr learned my addr 172.21.15.100:0/1593056806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.365+0000 7fd80effd640 1 -- 172.21.15.100:0/1593056806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8101088b0 con 0x7fd8101076b0 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.365+0000 7fd80effd640 1 --2- 172.21.15.100:0/1593056806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd810107ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd800009820 tx=0x7fd80002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db0ef9e3fc3cfd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.365+0000 7fd80dffb640 1 -- 172.21.15.100:0/1593056806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd800037070 con 0x7fd8101076b0 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd80dffb640 1 -- 172.21.15.100:0/1593056806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd800032920 con 0x7fd8101076b0 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd80dffb640 1 -- 172.21.15.100:0/1593056806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd800030810 con 0x7fd8101076b0 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd815831640 1 -- 172.21.15.100:0/1593056806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 msgr2=0x7fd810107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd815831640 1 --2- 172.21.15.100:0/1593056806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd810107ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd800009820 tx=0x7fd80002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd815831640 1 -- 172.21.15.100:0/1593056806 shutdown_connections 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd815831640 1 --2- 172.21.15.100:0/1593056806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd810107ab0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd815831640 1 -- 172.21.15.100:0/1593056806 >> 172.21.15.100:0/1593056806 conn(0x7fd810102e40 msgr2=0x7fd810105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd815831640 1 -- 172.21.15.100:0/1593056806 shutdown_connections 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.366+0000 7fd815831640 1 -- 172.21.15.100:0/1593056806 wait complete. 2024-09-12T02:29:47.837 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.367+0000 7fd815831640 1 Processor -- start 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.367+0000 7fd815831640 1 -- start start 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.367+0000 7fd815831640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd81019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.367+0000 7fd815831640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd81010bc60 con 0x7fd8101076b0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.367+0000 7fd80effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd81019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.367+0000 7fd80effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd81019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35760/0 (socket says 172.21.15.100:35760) 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.367+0000 7fd80effd640 1 -- 172.21.15.100:0/3948236119 learned_addr learned my addr 172.21.15.100:0/3948236119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.368+0000 7fd80effd640 1 -- 172.21.15.100:0/3948236119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81019de20 con 0x7fd8101076b0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.368+0000 7fd80effd640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd81019d8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd800030560 tx=0x7fd800032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.368+0000 7fd81482f640 1 -- 172.21.15.100:0/3948236119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd800037040 con 0x7fd8101076b0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.368+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81019e0b0 con 0x7fd8101076b0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.368+0000 7fd81482f640 1 -- 172.21.15.100:0/3948236119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd800040070 con 0x7fd8101076b0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.368+0000 7fd81482f640 1 -- 172.21.15.100:0/3948236119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80003a740 con 0x7fd8101076b0 2024-09-12T02:29:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.368+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8101a0da0 con 0x7fd8101076b0 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.369+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd81010bde0 con 0x7fd8101076b0 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.370+0000 7fd81482f640 1 -- 172.21.15.100:0/3948236119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd80003bb90 con 0x7fd8101076b0 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.370+0000 7fd81482f640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7f8038fc0 0x7fd7f803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.370+0000 7fd81482f640 1 -- 172.21.15.100:0/3948236119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd80006c540 con 0x7fd8101076b0 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.370+0000 7fd80e7fc640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7f8038fc0 0x7fd7f803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.370+0000 7fd80e7fc640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7f8038fc0 0x7fd7f803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd8040098c0 tx=0x7fd804006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.379+0000 7fd81482f640 1 -- 172.21.15.100:0/3948236119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd80004a200 con 0x7fd8101076b0 2024-09-12T02:29:47.839 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.570+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fd810107b30 con 0x7fd8101076b0 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.575+0000 7fd81482f640 1 -- 172.21.15.100:0/3948236119 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fd800031e80 con 0x7fd8101076b0 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7f8038fc0 msgr2=0x7fd7f803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7f8038fc0 0x7fd7f803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd8040098c0 tx=0x7fd804006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 msgr2=0x7fd81019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd81019d8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd800030560 tx=0x7fd800032670 comp rx=0 tx=0).stop 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 shutdown_connections 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7f8038fc0 0x7fd7f803b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 --2- 172.21.15.100:0/3948236119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8101076b0 0x7fd81019d8e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.577+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 >> 172.21.15.100:0/3948236119 conn(0x7fd810102e40 msgr2=0x7fd810103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.578+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 shutdown_connections 2024-09-12T02:29:47.840 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:46.578+0000 7fd815831640 1 -- 172.21.15.100:0/3948236119 wait complete. 2024-09-12T02:29:48.750 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:48 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:48.750 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3787623697' entity='client.admin' 2024-09-12T02:29:49.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.230+0000 7fd7d4d1d640 1 Processor -- start 2024-09-12T02:29:49.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.230+0000 7fd7d4d1d640 1 -- start start 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.230+0000 7fd7d4d1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d0107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.230+0000 7fd7d4d1d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01080f0 con 0x7fd7d0107720 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.230+0000 7fd7ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d0107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.230+0000 7fd7ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d0107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35776/0 (socket says 172.21.15.100:35776) 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.230+0000 7fd7ce59c640 1 -- 172.21.15.100:0/1207191722 learned_addr learned my addr 172.21.15.100:0/1207191722 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.231+0000 7fd7ce59c640 1 -- 172.21.15.100:0/1207191722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d0108920 con 0x7fd7d0107720 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.231+0000 7fd7ce59c640 1 --2- 172.21.15.100:0/1207191722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d0107b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009820 tx=0x7fd7c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee1a56104dd319d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.231+0000 7fd7cdd9b640 1 -- 172.21.15.100:0/1207191722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c0037070 con 0x7fd7d0107720 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.231+0000 7fd7cdd9b640 1 -- 172.21.15.100:0/1207191722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c0032920 con 0x7fd7d0107720 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.231+0000 7fd7cdd9b640 1 -- 172.21.15.100:0/1207191722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c0030810 con 0x7fd7d0107720 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.232+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/1207191722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 msgr2=0x7fd7d0107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.232+0000 7fd7d4d1d640 1 --2- 172.21.15.100:0/1207191722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d0107b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009820 tx=0x7fd7c002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.232+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/1207191722 shutdown_connections 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.232+0000 7fd7d4d1d640 1 --2- 172.21.15.100:0/1207191722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d0107b20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.232+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/1207191722 >> 172.21.15.100:0/1207191722 conn(0x7fd7d0102ed0 msgr2=0x7fd7d01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.232+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/1207191722 shutdown_connections 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.232+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/1207191722 wait complete. 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7d4d1d640 1 Processor -- start 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7d4d1d640 1 -- start start 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7d4d1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7d4d1d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010bcd0 con 0x7fd7d0107720 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35780/0 (socket says 172.21.15.100:35780) 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7ce59c640 1 -- 172.21.15.100:0/3787623697 learned_addr learned my addr 172.21.15.100:0/3787623697 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7ce59c640 1 -- 172.21.15.100:0/3787623697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d007e0d0 con 0x7fd7d0107720 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.233+0000 7fd7ce59c640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d007db90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097f0 tx=0x7fd7c00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.234+0000 7fd7c77fe640 1 -- 172.21.15.100:0/3787623697 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c0037040 con 0x7fd7d0107720 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.234+0000 7fd7c77fe640 1 -- 172.21.15.100:0/3787623697 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c0030c40 con 0x7fd7d0107720 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.234+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d007c2c0 con 0x7fd7d0107720 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.234+0000 7fd7c77fe640 1 -- 172.21.15.100:0/3787623697 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c003a5b0 con 0x7fd7d0107720 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.234+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d007c800 con 0x7fd7d0107720 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.234+0000 7fd7c77fe640 1 -- 172.21.15.100:0/3787623697 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd7c003a7a0 con 0x7fd7d0107720 2024-09-12T02:29:49.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.235+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d0107ba0 con 0x7fd7d0107720 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.235+0000 7fd7c77fe640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7bc038fc0 0x7fd7bc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.235+0000 7fd7c77fe640 1 -- 172.21.15.100:0/3787623697 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd7c006c4a0 con 0x7fd7d0107720 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.235+0000 7fd7c7fff640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7bc038fc0 0x7fd7bc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.235+0000 7fd7c7fff640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7bc038fc0 0x7fd7bc03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80098c0 tx=0x7fd7b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.239+0000 7fd7c77fe640 1 -- 172.21.15.100:0/3787623697 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7c00392f0 con 0x7fd7d0107720 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.407+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fd7d007d150 con 0x7fd7d0107720 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.410+0000 7fd7c77fe640 1 -- 172.21.15.100:0/3787623697 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fd7d007d150 con 0x7fd7d0107720 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7bc038fc0 msgr2=0x7fd7bc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7bc038fc0 0x7fd7bc03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80098c0 tx=0x7fd7b8006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 msgr2=0x7fd7d007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d007db90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097f0 tx=0x7fd7c00327b0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 shutdown_connections 2024-09-12T02:29:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7fd7bc038fc0 0x7fd7bc03b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 --2- 172.21.15.100:0/3787623697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0107720 0x7fd7d007db90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 >> 172.21.15.100:0/3787623697 conn(0x7fd7d0102ed0 msgr2=0x7fd7d0103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:49.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 shutdown_connections 2024-09-12T02:29:49.080 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:48.412+0000 7fd7d4d1d640 1 -- 172.21.15.100:0/3787623697 wait complete. 2024-09-12T02:29:49.080 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling the dashboard module... 2024-09-12T02:29:50.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:50 smithi100 ceph-mon[31390]: from='mgr.14118 172.21.15.100:0/2417909014' entity='mgr.x' 2024-09-12T02:29:50.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:50 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2573073796' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T02:29:50.873 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: ignoring --setuser ceph since I am not root 2024-09-12T02:29:50.873 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: ignoring --setgroup ceph since I am not root 2024-09-12T02:29:50.873 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:50.736+0000 7fe6385bc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:29:50.873 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:50.792+0000 7fe6385bc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:29:51.308 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:50.940+0000 7fe6385bc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:29:51.308 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:51.012+0000 7fe6385bc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:29:51.308 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:51.160+0000 7fe6385bc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:29:51.309 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:51.304+0000 7fe6385bc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:29:51.579 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.492+0000 7f5da1b15640 1 Processor -- start 2024-09-12T02:29:51.579 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.492+0000 7f5da1b15640 1 -- start start 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.492+0000 7f5da1b15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c10a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.492+0000 7f5da1b15640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c07be90 con 0x7f5d9c108120 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.492+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c10a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.492+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c10a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35784/0 (socket says 172.21.15.100:35784) 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.492+0000 7f5d9b7fe640 1 -- 172.21.15.100:0/2489965169 learned_addr learned my addr 172.21.15.100:0/2489965169 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.493+0000 7f5d9b7fe640 1 -- 172.21.15.100:0/2489965169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c10aa50 con 0x7f5d9c108120 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.493+0000 7f5d9b7fe640 1 --2- 172.21.15.100:0/2489965169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c10a510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009820 tx=0x7f5d8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d194becc32a4f26f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.493+0000 7f5d9affd640 1 -- 172.21.15.100:0/2489965169 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c037070 con 0x7f5d9c108120 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.493+0000 7f5d9affd640 1 -- 172.21.15.100:0/2489965169 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d8c032920 con 0x7f5d9c108120 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.493+0000 7f5d9affd640 1 -- 172.21.15.100:0/2489965169 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c030810 con 0x7f5d9c108120 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.494+0000 7f5da1b15640 1 -- 172.21.15.100:0/2489965169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 msgr2=0x7f5d9c10a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.494+0000 7f5da1b15640 1 --2- 172.21.15.100:0/2489965169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c10a510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009820 tx=0x7f5d8c02a270 comp rx=0 tx=0).stop 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.494+0000 7f5da1b15640 1 -- 172.21.15.100:0/2489965169 shutdown_connections 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.494+0000 7f5da1b15640 1 --2- 172.21.15.100:0/2489965169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c10a510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.494+0000 7f5da1b15640 1 -- 172.21.15.100:0/2489965169 >> 172.21.15.100:0/2489965169 conn(0x7f5d9c101d60 msgr2=0x7f5d9c104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.494+0000 7f5da1b15640 1 -- 172.21.15.100:0/2489965169 shutdown_connections 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.494+0000 7f5da1b15640 1 -- 172.21.15.100:0/2489965169 wait complete. 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5da1b15640 1 Processor -- start 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5da1b15640 1 -- start start 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5da1b15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5da1b15640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c10bad0 con 0x7f5d9c108120 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35786/0 (socket says 172.21.15.100:35786) 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5d9b7fe640 1 -- 172.21.15.100:0/2573073796 learned_addr learned my addr 172.21.15.100:0/2573073796 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:51.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5d9b7fe640 1 -- 172.21.15.100:0/2573073796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c19bbc0 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.495+0000 7f5d9b7fe640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c19b680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097f0 tx=0x7f5d8c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.496+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c037040 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.496+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d8c030cc0 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.496+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c19be50 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.496+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c03a6b0 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.496+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c19eb40 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.497+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5d8c03b3f0 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.497+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9c108580 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.497+0000 7f5d997fa640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5d88038fc0 0x7f5d8803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.497+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5d8c06c4b0 con 0x7f5d9c108120 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.497+0000 7f5d93fff640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5d88038fc0 0x7f5d8803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.497+0000 7f5d93fff640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5d88038fc0 0x7f5d8803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d840098c0 tx=0x7f5d84006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.501+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d8c042dc0 con 0x7f5d9c108120 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:49.719+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f5d9c19f130 con 0x7f5d9c108120 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.589+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f5d8c03a850 con 0x7f5d9c108120 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.590+0000 7f5d997fa640 1 -- 172.21.15.100:0/2573073796 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f5d8c03baf0 con 0x7f5d9c108120 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.591+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5d88038fc0 msgr2=0x7f5d8803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.591+0000 7f5da1b15640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5d88038fc0 0x7f5d8803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d840098c0 tx=0x7f5d84006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 msgr2=0x7f5d9c19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c19b680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097f0 tx=0x7f5d8c0327b0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 shutdown_connections 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5d88038fc0 0x7f5d8803b480 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d840098c0 tx=0x7f5d84006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 --2- 172.21.15.100:0/2573073796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c108120 0x7f5d9c19b680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 >> 172.21.15.100:0/2573073796 conn(0x7f5d9c101d60 msgr2=0x7f5d9c102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 shutdown_connections 2024-09-12T02:29:51.583 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:50.592+0000 7f5da1b15640 1 -- 172.21.15.100:0/2573073796 wait complete. 2024-09-12T02:29:51.852 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2573073796' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T02:29:51.852 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-mon[31390]: mgrmap e9: x(active, since 19s) 2024-09-12T02:29:51.852 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:51.622+0000 7fe6385bc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:29:51.852 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:51.683+0000 7fe6385bc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:29:52.121 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:51.877+0000 7fe6385bc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:29:52.852 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:52 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3915460168' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:29:52.853 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:52 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:52.784+0000 7fe6385bc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:29:52.853 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:52 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:52.851+0000 7fe6385bc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T02:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.053+0000 7f0ec6a9a640 1 Processor -- start 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.053+0000 7f0ec6a9a640 1 -- start start 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.053+0000 7f0ec6a9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec0106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.053+0000 7f0ec6a9a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0106f50 con 0x7f0ec0106580 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.053+0000 7f0ec4836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec0106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.054+0000 7f0ec4836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec0106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35820/0 (socket says 172.21.15.100:35820) 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.054+0000 7f0ec4836640 1 -- 172.21.15.100:0/1371385019 learned_addr learned my addr 172.21.15.100:0/1371385019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.054+0000 7f0ec4836640 1 -- 172.21.15.100:0/1371385019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec0107780 con 0x7f0ec0106580 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.054+0000 7f0ec4836640 1 --2- 172.21.15.100:0/1371385019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec0106980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009820 tx=0x7f0eb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11544b7024f871cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.055+0000 7f0ebf7fe640 1 -- 172.21.15.100:0/1371385019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4037070 con 0x7f0ec0106580 2024-09-12T02:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.055+0000 7f0ebf7fe640 1 -- 172.21.15.100:0/1371385019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eb4032920 con 0x7f0ec0106580 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.055+0000 7f0ebf7fe640 1 -- 172.21.15.100:0/1371385019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4030810 con 0x7f0ec0106580 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/1371385019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 msgr2=0x7f0ec0106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 --2- 172.21.15.100:0/1371385019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec0106980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009820 tx=0x7f0eb402a270 comp rx=0 tx=0).stop 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/1371385019 shutdown_connections 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 --2- 172.21.15.100:0/1371385019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec0106980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/1371385019 >> 172.21.15.100:0/1371385019 conn(0x7f0ec0101d10 msgr2=0x7f0ec0104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/1371385019 shutdown_connections 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/1371385019 wait complete. 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 Processor -- start 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 -- start start 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.056+0000 7f0ec6a9a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec010ab30 con 0x7f0ec0106580 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.057+0000 7f0ec4836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.057+0000 7f0ec4836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec007ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35824/0 (socket says 172.21.15.100:35824) 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.057+0000 7f0ec4836640 1 -- 172.21.15.100:0/3915460168 learned_addr learned my addr 172.21.15.100:0/3915460168 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.057+0000 7f0ec4836640 1 -- 172.21.15.100:0/3915460168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec019e400 con 0x7f0ec0106580 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.057+0000 7f0ec4836640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec007ba70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4030560 tx=0x7f0eb4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.057+0000 7f0ebdffb640 1 -- 172.21.15.100:0/3915460168 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4037040 con 0x7f0ec0106580 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.057+0000 7f0ebdffb640 1 -- 172.21.15.100:0/3915460168 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eb4040070 con 0x7f0ec0106580 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.058+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec019e5d0 con 0x7f0ec0106580 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.058+0000 7f0ebdffb640 1 -- 172.21.15.100:0/3915460168 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb403a740 con 0x7f0ec0106580 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.058+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec019e970 con 0x7f0ec0106580 2024-09-12T02:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.059+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec0106a00 con 0x7f0ec0106580 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.059+0000 7f0ebdffb640 1 -- 172.21.15.100:0/3915460168 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f0eb403bb90 con 0x7f0ec0106580 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.059+0000 7f0ebdffb640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 0x7f0eb003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.059+0000 7f0ebdffb640 1 -- 172.21.15.100:0/3915460168 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0eb406c580 con 0x7f0ec0106580 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.059+0000 7f0ebffff640 1 -- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 msgr2=0x7f0eb003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3548885308 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.059+0000 7f0ebffff640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 0x7f0eb003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.064+0000 7f0ebdffb640 1 -- 172.21.15.100:0/3915460168 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0eb404a200 con 0x7f0ec0106580 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.260+0000 7f0ebffff640 1 -- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 msgr2=0x7f0eb003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3548885308 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.260+0000 7f0ebffff640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 0x7f0eb003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.284+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0ec019edb0 con 0x7f0ec0106580 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.284+0000 7f0ebdffb640 1 -- 172.21.15.100:0/3915460168 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f0ec019edb0 con 0x7f0ec0106580 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 msgr2=0x7f0eb003b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 0x7f0eb003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 msgr2=0x7f0ec007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec007ba70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4030560 tx=0x7f0eb4032670 comp rx=0 tx=0).stop 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 shutdown_connections 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f0eb0039020 0x7f0eb003b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 --2- 172.21.15.100:0/3915460168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ec0106580 0x7f0ec007ba70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 >> 172.21.15.100:0/3915460168 conn(0x7f0ec0101d10 msgr2=0x7f0ec01028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 shutdown_connections 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:52.287+0000 7f0ec6a9a640 1 -- 172.21.15.100:0/3915460168 wait complete. 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-09-12T02:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 9... 2024-09-12T02:29:53.839 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:53.581+0000 7fe6385bc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:29:53.839 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:53.696+0000 7fe6385bc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:29:54.119 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:53.838+0000 7fe6385bc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:29:54.119 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:53.898+0000 7fe6385bc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:29:54.119 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.047+0000 7fe6385bc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:29:54.119 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.114+0000 7fe6385bc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:29:54.371 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.174+0000 7fe6385bc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:29:54.372 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.330+0000 7fe6385bc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:29:54.660 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.395+0000 7fe6385bc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:29:54.660 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.460+0000 7fe6385bc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:29:54.660 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.541+0000 7fe6385bc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:29:54.661 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.599+0000 7fe6385bc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:29:54.661 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:54.658+0000 7fe6385bc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:29:55.871 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:55.440+0000 7fe6385bc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:29:55.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: Active manager daemon x restarted 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: Activating manager daemon x 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: mgrmap e10: x(active, starting, since 0.00329684s) 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: Manager daemon x is now available 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:29:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:56.640+0000 7fe5a38d0640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:29:56] ENGINE Error in HTTPServer.serve 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: Traceback (most recent call last): 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self._connections.run(self.expiration_interval) 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self._run(expiration_interval) 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:29:57.032 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: s = self.context.wrap_socket( 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: return self.sslsocket_class._create( 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self.do_handshake() 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: self._sslobj.do_handshake() 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:29:57.033 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:29:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:29:57.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.293+0000 7f58accdb640 1 Processor -- start 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.293+0000 7f58accdb640 1 -- start start 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.293+0000 7f58accdb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a810a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.293+0000 7f58accdb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58a807be80 con 0x7f58a8108180 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.293+0000 7f58a659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a810a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.293+0000 7f58a659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a810a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35826/0 (socket says 172.21.15.100:35826) 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.293+0000 7f58a659c640 1 -- 172.21.15.100:0/3009084830 learned_addr learned my addr 172.21.15.100:0/3009084830 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.294+0000 7f58a659c640 1 -- 172.21.15.100:0/3009084830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a810aab0 con 0x7f58a8108180 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.294+0000 7f58a659c640 1 --2- 172.21.15.100:0/3009084830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a810a570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5898009820 tx=0x7f589802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71610ccdef9cda17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58a5d9b640 1 -- 172.21.15.100:0/3009084830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5898037070 con 0x7f58a8108180 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58a5d9b640 1 -- 172.21.15.100:0/3009084830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5898032920 con 0x7f58a8108180 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58a5d9b640 1 -- 172.21.15.100:0/3009084830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5898030810 con 0x7f58a8108180 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58accdb640 1 -- 172.21.15.100:0/3009084830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 msgr2=0x7f58a810a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58accdb640 1 --2- 172.21.15.100:0/3009084830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a810a570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5898009820 tx=0x7f589802a270 comp rx=0 tx=0).stop 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58accdb640 1 -- 172.21.15.100:0/3009084830 shutdown_connections 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58accdb640 1 --2- 172.21.15.100:0/3009084830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a810a570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58accdb640 1 -- 172.21.15.100:0/3009084830 >> 172.21.15.100:0/3009084830 conn(0x7f58a8101da0 msgr2=0x7f58a81041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58accdb640 1 -- 172.21.15.100:0/3009084830 shutdown_connections 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.295+0000 7f58accdb640 1 -- 172.21.15.100:0/3009084830 wait complete. 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.296+0000 7f58accdb640 1 Processor -- start 2024-09-12T02:29:57.301 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.296+0000 7f58accdb640 1 -- start start 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.296+0000 7f58accdb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a8107a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.296+0000 7f58accdb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58a810bb30 con 0x7f58a8108180 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.296+0000 7f58a659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a8107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.296+0000 7f58a659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a8107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35842/0 (socket says 172.21.15.100:35842) 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.296+0000 7f58a659c640 1 -- 172.21.15.100:0/467122408 learned_addr learned my addr 172.21.15.100:0/467122408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.297+0000 7f58a659c640 1 -- 172.21.15.100:0/467122408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a8107f40 con 0x7f58a8108180 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.297+0000 7f58a659c640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a8107a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5898030420 tx=0x7f5898032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.297+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5898037040 con 0x7f58a8108180 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.297+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5898040070 con 0x7f58a8108180 2024-09-12T02:29:57.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.297+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a8106130 con 0x7f58a8108180 2024-09-12T02:29:57.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.297+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589803a6e0 con 0x7f58a8108180 2024-09-12T02:29:57.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.297+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a8106670 con 0x7f58a8108180 2024-09-12T02:29:57.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.298+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f589803a9e0 con 0x7f58a8108180 2024-09-12T02:29:57.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.298+0000 7f589f7fe640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 0x7f589403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:57.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.298+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 --> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f589403bb90 con 0x7f5894038fc0 2024-09-12T02:29:57.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.298+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f589806c600 con 0x7f58a8108180 2024-09-12T02:29:57.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.298+0000 7f589ffff640 1 -- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 msgr2=0x7f589403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3548885308 2024-09-12T02:29:57.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.298+0000 7f589ffff640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 0x7f589403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:57.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.499+0000 7f589ffff640 1 -- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 msgr2=0x7f589403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3548885308 2024-09-12T02:29:57.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.499+0000 7f589ffff640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 0x7f589403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:57.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.900+0000 7f589ffff640 1 -- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 msgr2=0x7f589403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3548885308 2024-09-12T02:29:57.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:53.900+0000 7f589ffff640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 0x7f589403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:57.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:54.701+0000 7f589ffff640 1 -- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 msgr2=0x7f589403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3548885308 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:54.701+0000 7f589ffff640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 0x7f589403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:55.443+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f589806b0b0 con 0x7f58a8108180 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:55.443+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 msgr2=0x7f589403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:55.443+0000 7f589f7fe640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 0x7f589403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.445+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f5898045460 con 0x7f58a8108180 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.445+0000 7f589f7fe640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f589403ca80 0x7f589403ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.445+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5898001d30 con 0x7f589403ca80 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.445+0000 7f589ffff640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f589403ca80 0x7f589403ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.446+0000 7f589ffff640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f589403ca80 0x7f589403ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5890003980 tx=0x7f5890006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.447+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f5898001d30 con 0x7f589403ca80 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f58a81085e0 con 0x7f589403ca80 2024-09-12T02:29:57.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f589f7fe640 1 -- 172.21.15.100:0/467122408 <== mgr.14150 v2:172.21.15.100:6800/2819887168 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f58a81085e0 con 0x7f589403ca80 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f589403ca80 msgr2=0x7f589403ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f589403ca80 0x7f589403ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5890003980 tx=0x7f5890006e10 comp rx=0 tx=0).stop 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 msgr2=0x7f58a8107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a8107a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5898030420 tx=0x7f5898032670 comp rx=0 tx=0).stop 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 shutdown_connections 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f589403ca80 0x7f589403ee70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:6800/3548885308,v1:172.21.15.100:6801/3548885308] conn(0x7f5894038fc0 0x7f589403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 --2- 172.21.15.100:0/467122408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a8108180 0x7f58a8107a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:57.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 >> 172.21.15.100:0/467122408 conn(0x7f58a8101da0 msgr2=0x7f58a81029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:57.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 shutdown_connections 2024-09-12T02:29:57.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:56.454+0000 7f58accdb640 1 -- 172.21.15.100:0/467122408 wait complete. 2024-09-12T02:29:57.307 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 9 is available 2024-09-12T02:29:57.307 INFO:teuthology.orchestra.run.smithi100.stdout:Generating a dashboard self-signed certificate... 2024-09-12T02:29:57.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:57 smithi100 ceph-mon[31390]: mgrmap e11: x(active, since 1.00582s) 2024-09-12T02:29:57.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:57 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:56] ENGINE Bus STARTING 2024-09-12T02:29:57.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:57 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:56] ENGINE Serving on https://172.21.15.100:7150 2024-09-12T02:29:57.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:57 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:56] ENGINE Error in HTTPServer.serve 2024-09-12T02:29:57.575 INFO:journalctl@ceph.mon.a.smithi100.stdout: Traceback (most recent call last): 2024-09-12T02:29:57.575 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:29:57.575 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._run(expiration_interval) 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: s = self.context.wrap_socket( 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: return self.sslsocket_class._create( 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: self.do_handshake() 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:29:57.576 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._sslobj.do_handshake() 2024-09-12T02:29:57.577 INFO:journalctl@ceph.mon.a.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:29:57.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:29:58.645 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T02:29:58.645 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.752+0000 7f426c630640 1 Processor -- start 2024-09-12T02:29:58.645 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.752+0000 7f426c630640 1 -- start start 2024-09-12T02:29:58.645 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.752+0000 7f426c630640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f4264106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.752+0000 7f426c630640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4264106f50 con 0x7f4264106580 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.753+0000 7f426a3cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f4264106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.753+0000 7f426a3cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f4264106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40372/0 (socket says 172.21.15.100:40372) 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.753+0000 7f426a3cc640 1 -- 172.21.15.100:0/1111611047 learned_addr learned my addr 172.21.15.100:0/1111611047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.753+0000 7f426a3cc640 1 -- 172.21.15.100:0/1111611047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4264107780 con 0x7f4264106580 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426a3cc640 1 --2- 172.21.15.100:0/1111611047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f4264106980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4254009e80 tx=0x7f425402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dae163a09b3710b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f42693ca640 1 -- 172.21.15.100:0/1111611047 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4254036070 con 0x7f4264106580 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f42693ca640 1 -- 172.21.15.100:0/1111611047 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42540318e0 con 0x7f4264106580 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f42693ca640 1 -- 172.21.15.100:0/1111611047 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4254007a00 con 0x7f4264106580 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426c630640 1 -- 172.21.15.100:0/1111611047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 msgr2=0x7f4264106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426c630640 1 --2- 172.21.15.100:0/1111611047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f4264106980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4254009e80 tx=0x7f425402a7a0 comp rx=0 tx=0).stop 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426c630640 1 -- 172.21.15.100:0/1111611047 shutdown_connections 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426c630640 1 --2- 172.21.15.100:0/1111611047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f4264106980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:58.646 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426c630640 1 -- 172.21.15.100:0/1111611047 >> 172.21.15.100:0/1111611047 conn(0x7f4264101d10 msgr2=0x7f4264104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426c630640 1 -- 172.21.15.100:0/1111611047 shutdown_connections 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.754+0000 7f426c630640 1 -- 172.21.15.100:0/1111611047 wait complete. 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426c630640 1 Processor -- start 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426c630640 1 -- start start 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426c630640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f426419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426c630640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f426410ab30 con 0x7f4264106580 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426a3cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f426419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426a3cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f426419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40374/0 (socket says 172.21.15.100:40374) 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426a3cc640 1 -- 172.21.15.100:0/3796622258 learned_addr learned my addr 172.21.15.100:0/3796622258 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.755+0000 7f426a3cc640 1 -- 172.21.15.100:0/3796622258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426419bc30 con 0x7f4264106580 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.756+0000 7f426a3cc640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f426419b6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4254031cc0 tx=0x7f4254031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.756+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4254036050 con 0x7f4264106580 2024-09-12T02:29:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.756+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4254042070 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.756+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426419bec0 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.756+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f425403d8e0 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.756+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426419ebb0 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.757+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f425403db90 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.757+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426410acb0 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.757+0000 7f42637fe640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f424c038f00 0x7f424c03b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.757+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f425406d310 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.757+0000 7f4269bcb640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f424c038f00 0x7f424c03b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.757+0000 7f4269bcb640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f424c038f00 0x7f424c03b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42580098c0 tx=0x7f4258006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.762+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f425403bd30 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.941+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f4254047460 con 0x7f4264106580 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:57.955+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f426402da60 con 0x7f424c038f00 2024-09-12T02:29:58.648 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.036+0000 7f42637fe640 1 -- 172.21.15.100:0/3796622258 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f426402da60 con 0x7f424c038f00 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f424c038f00 msgr2=0x7f424c03b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f424c038f00 0x7f424c03b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42580098c0 tx=0x7f4258006db0 comp rx=0 tx=0).stop 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 msgr2=0x7f426419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f426419b6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4254031cc0 tx=0x7f4254031cf0 comp rx=0 tx=0).stop 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 shutdown_connections 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f424c038f00 0x7f424c03b3c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 --2- 172.21.15.100:0/3796622258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4264106580 0x7f426419b6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 >> 172.21.15.100:0/3796622258 conn(0x7f4264101d10 msgr2=0x7f4264102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 shutdown_connections 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:58.039+0000 7f426c630640 1 -- 172.21.15.100:0/3796622258 wait complete. 2024-09-12T02:29:58.649 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial admin user... 2024-09-12T02:29:58.763 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:58 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:56] ENGINE Serving on http://172.21.15.100:8765 2024-09-12T02:29:58.763 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:58 smithi100 ceph-mon[31390]: [12/Sep/2024:02:29:56] ENGINE Bus STARTED 2024-09-12T02:29:58.763 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:29:58.764 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:58 smithi100 ceph-mon[31390]: mgrmap e12: x(active, since 2s) 2024-09-12T02:29:58.764 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:29:58.764 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:29:59.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:29:59 smithi100 ceph-mon[31390]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:00.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:00 smithi100 ceph-mon[31390]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:00.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$jW3OxJSoRt6Ol0jiJDwaNej9i4Yfr9VaLHbg5giKsL121mM4apyCG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726108199, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T02:30:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.037+0000 7f613e81c640 1 Processor -- start 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.037+0000 7f613e81c640 1 -- start start 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.037+0000 7f613e81c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613810a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.037+0000 7f613e81c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f613807be70 con 0x7f61381081a0 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.037+0000 7f6137fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613810a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.038+0000 7f6137fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613810a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40388/0 (socket says 172.21.15.100:40388) 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.038+0000 7f6137fff640 1 -- 172.21.15.100:0/3498214039 learned_addr learned my addr 172.21.15.100:0/3498214039 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.038+0000 7f6137fff640 1 -- 172.21.15.100:0/3498214039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613810aad0 con 0x7f61381081a0 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.038+0000 7f6137fff640 1 --2- 172.21.15.100:0/3498214039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613810a590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6128009820 tx=0x7f612802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9cd7689d931875 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f6136ffd640 1 -- 172.21.15.100:0/3498214039 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6128037070 con 0x7f61381081a0 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f6136ffd640 1 -- 172.21.15.100:0/3498214039 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128032920 con 0x7f61381081a0 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f6136ffd640 1 -- 172.21.15.100:0/3498214039 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6128030810 con 0x7f61381081a0 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f613e81c640 1 -- 172.21.15.100:0/3498214039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 msgr2=0x7f613810a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.843 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f613e81c640 1 --2- 172.21.15.100:0/3498214039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613810a590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6128009820 tx=0x7f612802a270 comp rx=0 tx=0).stop 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f613e81c640 1 -- 172.21.15.100:0/3498214039 shutdown_connections 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f613e81c640 1 --2- 172.21.15.100:0/3498214039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613810a590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f613e81c640 1 -- 172.21.15.100:0/3498214039 >> 172.21.15.100:0/3498214039 conn(0x7f6138101da0 msgr2=0x7f61381041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f613e81c640 1 -- 172.21.15.100:0/3498214039 shutdown_connections 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.039+0000 7f613e81c640 1 -- 172.21.15.100:0/3498214039 wait complete. 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.040+0000 7f613e81c640 1 Processor -- start 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.040+0000 7f613e81c640 1 -- start start 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.040+0000 7f613e81c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.040+0000 7f613e81c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f613810bb50 con 0x7f61381081a0 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.040+0000 7f6137fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.040+0000 7f6137fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40402/0 (socket says 172.21.15.100:40402) 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.040+0000 7f6137fff640 1 -- 172.21.15.100:0/419217066 learned_addr learned my addr 172.21.15.100:0/419217066 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:00.844 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.041+0000 7f6137fff640 1 -- 172.21.15.100:0/419217066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613819bc40 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.041+0000 7f6137fff640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613819b700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6128030380 tx=0x7f6128032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.041+0000 7f61357fa640 1 -- 172.21.15.100:0/419217066 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6128037040 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.041+0000 7f61357fa640 1 -- 172.21.15.100:0/419217066 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128040070 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.041+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613819bed0 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.041+0000 7f61357fa640 1 -- 172.21.15.100:0/419217066 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f612803a7b0 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.041+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613819ebc0 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.042+0000 7f61357fa640 1 -- 172.21.15.100:0/419217066 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f612803a9e0 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.042+0000 7f61357fa640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6120039020 0x7f612003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.042+0000 7f61357fa640 1 -- 172.21.15.100:0/419217066 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f612803bc00 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.042+0000 7f61377fe640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6120039020 0x7f612003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.042+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6138108600 con 0x7f61381081a0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.043+0000 7f61377fe640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6120039020 0x7f612003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098c0 tx=0x7f612c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.047+0000 7f61357fa640 1 -- 172.21.15.100:0/419217066 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6128044c70 con 0x7f61381081a0 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.232+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f6138103010 con 0x7f6120039020 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.456+0000 7f61357fa640 1 -- 172.21.15.100:0/419217066 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f6138103010 con 0x7f6120039020 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.459+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6120039020 msgr2=0x7f612003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.459+0000 7f613e81c640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6120039020 0x7f612003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098c0 tx=0x7f612c006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.459+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 msgr2=0x7f613819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.459+0000 7f613e81c640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613819b700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6128030380 tx=0x7f6128032670 comp rx=0 tx=0).stop 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.460+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 shutdown_connections 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.460+0000 7f613e81c640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6120039020 0x7f612003b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.460+0000 7f613e81c640 1 --2- 172.21.15.100:0/419217066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61381081a0 0x7f613819b700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.460+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 >> 172.21.15.100:0/419217066 conn(0x7f6138101da0 msgr2=0x7f6138102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.460+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 shutdown_connections 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:29:59.460+0000 7f613e81c640 1 -- 172.21.15.100:0/419217066 wait complete. 2024-09-12T02:30:00.846 INFO:teuthology.orchestra.run.smithi100.stdout:Fetching dashboard port number... 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9e210e640 1 Processor -- start 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9e210e640 1 -- start start 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9e210e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9e210e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc1080b0 con 0x7fe9dc1076e0 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40408/0 (socket says 172.21.15.100:40408) 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9db7fe640 1 -- 172.21.15.100:0/3983378013 learned_addr learned my addr 172.21.15.100:0/3983378013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.284+0000 7fe9db7fe640 1 -- 172.21.15.100:0/3983378013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9dc1088e0 con 0x7fe9dc1076e0 2024-09-12T02:30:02.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.285+0000 7fe9db7fe640 1 --2- 172.21.15.100:0/3983378013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc107ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009820 tx=0x7fe9cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c8c848fe889055 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.285+0000 7fe9da7fc640 1 -- 172.21.15.100:0/3983378013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9cc037070 con 0x7fe9dc1076e0 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.285+0000 7fe9da7fc640 1 -- 172.21.15.100:0/3983378013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9cc032920 con 0x7fe9dc1076e0 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.285+0000 7fe9da7fc640 1 -- 172.21.15.100:0/3983378013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9cc030810 con 0x7fe9dc1076e0 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 -- 172.21.15.100:0/3983378013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 msgr2=0x7fe9dc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 --2- 172.21.15.100:0/3983378013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc107ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009820 tx=0x7fe9cc02a270 comp rx=0 tx=0).stop 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 -- 172.21.15.100:0/3983378013 shutdown_connections 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 --2- 172.21.15.100:0/3983378013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc107ae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 -- 172.21.15.100:0/3983378013 >> 172.21.15.100:0/3983378013 conn(0x7fe9dc102e90 msgr2=0x7fe9dc1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 -- 172.21.15.100:0/3983378013 shutdown_connections 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 -- 172.21.15.100:0/3983378013 wait complete. 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.286+0000 7fe9e210e640 1 Processor -- start 2024-09-12T02:30:02.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9e210e640 1 -- start start 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9e210e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc19b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9e210e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc10bc90 con 0x7fe9dc1076e0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc19b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc19b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40412/0 (socket says 172.21.15.100:40412) 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9db7fe640 1 -- 172.21.15.100:0/1440232003 learned_addr learned my addr 172.21.15.100:0/1440232003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9db7fe640 1 -- 172.21.15.100:0/1440232003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9dc19bca0 con 0x7fe9dc1076e0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.287+0000 7fe9db7fe640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc19b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc030560 tx=0x7fe9cc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.288+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9cc037040 con 0x7fe9dc1076e0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.288+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9cc040070 con 0x7fe9dc1076e0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.288+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9dc19bf30 con 0x7fe9dc1076e0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.288+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9cc03a6d0 con 0x7fe9dc1076e0 2024-09-12T02:30:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.288+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9dc19ec20 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.289+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fe9cc03a870 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.289+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9dc10be10 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.289+0000 7fe9d8ff9640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe9c4039020 0x7fe9c403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.289+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe9cc06c610 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.289+0000 7fe9daffd640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe9c4039020 0x7fe9c403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.289+0000 7fe9daffd640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe9c4039020 0x7fe9c403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00098c0 tx=0x7fe9d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.293+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9cc044c70 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.457+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fe9cc045980 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.463+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fe9dc19edf0 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.463+0000 7fe9d8ff9640 1 -- 172.21.15.100:0/1440232003 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fe9cc036170 con 0x7fe9dc1076e0 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe9c4039020 msgr2=0x7fe9c403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe9c4039020 0x7fe9c403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00098c0 tx=0x7fe9d0006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 msgr2=0x7fe9dc19b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc19b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc030560 tx=0x7fe9cc032670 comp rx=0 tx=0).stop 2024-09-12T02:30:02.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 shutdown_connections 2024-09-12T02:30:02.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe9c4039020 0x7fe9c403b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 --2- 172.21.15.100:0/1440232003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9dc1076e0 0x7fe9dc19b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.465+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 >> 172.21.15.100:0/1440232003 conn(0x7fe9dc102e90 msgr2=0x7fe9dc103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:02.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.466+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 shutdown_connections 2024-09-12T02:30:02.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:01.466+0000 7fe9e210e640 1 -- 172.21.15.100:0/1440232003 wait complete. 2024-09-12T02:30:02.055 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:30:02.056 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T02:30:02.062 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:30:02.062 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T02:30:02.063 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T02:30:02.063 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T02:30:02.064 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph Dashboard is now available at: 2024-09-12T02:30:02.064 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:02.064 INFO:teuthology.orchestra.run.smithi100.stdout: URL: https://smithi100.front.sepia.ceph.com:8443/ 2024-09-12T02:30:02.065 INFO:teuthology.orchestra.run.smithi100.stdout: User: admin 2024-09-12T02:30:02.065 INFO:teuthology.orchestra.run.smithi100.stdout: Password: qj949kfpl8 2024-09-12T02:30:02.065 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:02.065 INFO:teuthology.orchestra.run.smithi100.stdout:Saving cluster configuration to /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config directory 2024-09-12T02:30:02.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:02 smithi100 ceph-mon[31390]: mgrmap e13: x(active, since 6s) 2024-09-12T02:30:02.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:02 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1440232003' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd92509d640 1 Processor -- start 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd92509d640 1 -- start start 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd92509d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd920107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd92509d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201080b0 con 0x7fd9201076e0 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd91ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd920107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd91ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd920107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40414/0 (socket says 172.21.15.100:40414) 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd91ed9d640 1 -- 172.21.15.100:0/3550146979 learned_addr learned my addr 172.21.15.100:0/3550146979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.455+0000 7fd91ed9d640 1 -- 172.21.15.100:0/3550146979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9201088e0 con 0x7fd9201076e0 2024-09-12T02:30:03.357 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.456+0000 7fd91ed9d640 1 --2- 172.21.15.100:0/3550146979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd920107ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd910009820 tx=0x7fd91002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75909c017ba39dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.458+0000 7fd91dd9b640 1 -- 172.21.15.100:0/3550146979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd910037070 con 0x7fd9201076e0 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.458+0000 7fd91dd9b640 1 -- 172.21.15.100:0/3550146979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd910032920 con 0x7fd9201076e0 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.458+0000 7fd91dd9b640 1 -- 172.21.15.100:0/3550146979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd910030810 con 0x7fd9201076e0 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.459+0000 7fd92509d640 1 -- 172.21.15.100:0/3550146979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 msgr2=0x7fd920107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.459+0000 7fd92509d640 1 --2- 172.21.15.100:0/3550146979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd920107ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd910009820 tx=0x7fd91002a270 comp rx=0 tx=0).stop 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.459+0000 7fd92509d640 1 -- 172.21.15.100:0/3550146979 shutdown_connections 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.459+0000 7fd92509d640 1 --2- 172.21.15.100:0/3550146979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd920107ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.459+0000 7fd92509d640 1 -- 172.21.15.100:0/3550146979 >> 172.21.15.100:0/3550146979 conn(0x7fd920102e90 msgr2=0x7fd9201052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.459+0000 7fd92509d640 1 -- 172.21.15.100:0/3550146979 shutdown_connections 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.459+0000 7fd92509d640 1 -- 172.21.15.100:0/3550146979 wait complete. 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd92509d640 1 Processor -- start 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd92509d640 1 -- start start 2024-09-12T02:30:03.358 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd92509d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd92007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd92509d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd92010bc90 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd91ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd92007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd91ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd92007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40418/0 (socket says 172.21.15.100:40418) 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd91ed9d640 1 -- 172.21.15.100:0/3377860846 learned_addr learned my addr 172.21.15.100:0/3377860846 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.460+0000 7fd91ed9d640 1 -- 172.21.15.100:0/3377860846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92007e0d0 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.461+0000 7fd91ed9d640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd92007db90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097f0 tx=0x7fd9100327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.461+0000 7fd917fff640 1 -- 172.21.15.100:0/3377860846 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd910037040 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.461+0000 7fd917fff640 1 -- 172.21.15.100:0/3377860846 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd910030c40 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.461+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92007c2c0 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.461+0000 7fd917fff640 1 -- 172.21.15.100:0/3377860846 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd91003a5b0 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.461+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92007c800 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.462+0000 7fd917fff640 1 -- 172.21.15.100:0/3377860846 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fd91003a7f0 con 0x7fd9201076e0 2024-09-12T02:30:03.359 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.462+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd920107b60 con 0x7fd9201076e0 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.462+0000 7fd917fff640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd90c039060 0x7fd90c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.462+0000 7fd917fff640 1 -- 172.21.15.100:0/3377860846 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd91006c5d0 con 0x7fd9201076e0 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.462+0000 7fd91e59c640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd90c039060 0x7fd90c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.462+0000 7fd91e59c640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd90c039060 0x7fd90c03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd9080098c0 tx=0x7fd908006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.466+0000 7fd917fff640 1 -- 172.21.15.100:0/3377860846 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd910039950 con 0x7fd9201076e0 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.721+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fd92007ca80 con 0x7fd9201076e0 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.724+0000 7fd917fff640 1 -- 172.21.15.100:0/3377860846 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fd9100371e0 con 0x7fd9201076e0 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd90c039060 msgr2=0x7fd90c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd90c039060 0x7fd90c03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd9080098c0 tx=0x7fd908006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 msgr2=0x7fd92007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:03.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd92007db90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097f0 tx=0x7fd9100327b0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 shutdown_connections 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd90c039060 0x7fd90c03b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 --2- 172.21.15.100:0/3377860846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9201076e0 0x7fd92007db90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 >> 172.21.15.100:0/3377860846 conn(0x7fd920102e90 msgr2=0x7fd920103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 shutdown_connections 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T02:30:02.726+0000 7fd92509d640 1 -- 172.21.15.100:0/3377860846 wait complete. 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.361 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout: ceph telemetry on 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout:For more information see: 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:03.362 INFO:teuthology.orchestra.run.smithi100.stdout:Bootstrap complete. 2024-09-12T02:30:03.396 INFO:tasks.cephadm:Fetching config... 2024-09-12T02:30:03.397 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:30:03.397 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T02:30:03.413 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T02:30:03.413 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:30:03.413 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T02:30:03.469 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T02:30:03.469 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:30:03.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T02:30:03.533 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T02:30:03.534 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:30:03.534 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T02:30:03.589 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T02:30:03.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC11D6AUAwRHDO2DF9rxkuJc9fe20K/4mTCIRBuNfupdar3W6JcybC/hlmTG6YkeYUpYMb28NoNi4CSMyQmlpQOXIbnFIkKt4PKzxYBuJlLzLhwhS8hU6AOs85aWbmLy6VPgIBD7PjQLph5Z4x3AV0eYWPqTcxtBahAYtBC7YcU+N4djaSDwOp+WC4IgQAoMmCc0cLNHro1jYCI//ReGWzo8/l+nk9MHbMNmL+6V8k+d+47pOvvAF6shp3FYyTmvAlGprI67w95hWW3+pPY5Y2/Rsobk/yhGcdH+EuBlEKzs9hmGlQFkq6bMUutHMcPBp3J/fS6L6PRg3Y247gCTljXS0Fhfzoonxm9K7jZe+mEmwHp4l1IskwsZwp9FfNTDAmFK2uz5MO4hiIvY2cvdELvkZn19KITFxmL/Das/k/uG1xMzwJlB3ZW4jtxaOas6IWIFIF1My096VOcjPZYwl5fHCijjEwuvYYzawG0MiGOfVgDbryrLVu16/tfHuR7qbc= ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:30:03.672 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC11D6AUAwRHDO2DF9rxkuJc9fe20K/4mTCIRBuNfupdar3W6JcybC/hlmTG6YkeYUpYMb28NoNi4CSMyQmlpQOXIbnFIkKt4PKzxYBuJlLzLhwhS8hU6AOs85aWbmLy6VPgIBD7PjQLph5Z4x3AV0eYWPqTcxtBahAYtBC7YcU+N4djaSDwOp+WC4IgQAoMmCc0cLNHro1jYCI//ReGWzo8/l+nk9MHbMNmL+6V8k+d+47pOvvAF6shp3FYyTmvAlGprI67w95hWW3+pPY5Y2/Rsobk/yhGcdH+EuBlEKzs9hmGlQFkq6bMUutHMcPBp3J/fS6L6PRg3Y247gCTljXS0Fhfzoonxm9K7jZe+mEmwHp4l1IskwsZwp9FfNTDAmFK2uz5MO4hiIvY2cvdELvkZn19KITFxmL/Das/k/uG1xMzwJlB3ZW4jtxaOas6IWIFIF1My096VOcjPZYwl5fHCijjEwuvYYzawG0MiGOfVgDbryrLVu16/tfHuR7qbc= ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:03.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC11D6AUAwRHDO2DF9rxkuJc9fe20K/4mTCIRBuNfupdar3W6JcybC/hlmTG6YkeYUpYMb28NoNi4CSMyQmlpQOXIbnFIkKt4PKzxYBuJlLzLhwhS8hU6AOs85aWbmLy6VPgIBD7PjQLph5Z4x3AV0eYWPqTcxtBahAYtBC7YcU+N4djaSDwOp+WC4IgQAoMmCc0cLNHro1jYCI//ReGWzo8/l+nk9MHbMNmL+6V8k+d+47pOvvAF6shp3FYyTmvAlGprI67w95hWW3+pPY5Y2/Rsobk/yhGcdH+EuBlEKzs9hmGlQFkq6bMUutHMcPBp3J/fS6L6PRg3Y247gCTljXS0Fhfzoonxm9K7jZe+mEmwHp4l1IskwsZwp9FfNTDAmFK2uz5MO4hiIvY2cvdELvkZn19KITFxmL/Das/k/uG1xMzwJlB3ZW4jtxaOas6IWIFIF1My096VOcjPZYwl5fHCijjEwuvYYzawG0MiGOfVgDbryrLVu16/tfHuR7qbc= ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:30:03.729 INFO:teuthology.orchestra.run.smithi117.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC11D6AUAwRHDO2DF9rxkuJc9fe20K/4mTCIRBuNfupdar3W6JcybC/hlmTG6YkeYUpYMb28NoNi4CSMyQmlpQOXIbnFIkKt4PKzxYBuJlLzLhwhS8hU6AOs85aWbmLy6VPgIBD7PjQLph5Z4x3AV0eYWPqTcxtBahAYtBC7YcU+N4djaSDwOp+WC4IgQAoMmCc0cLNHro1jYCI//ReGWzo8/l+nk9MHbMNmL+6V8k+d+47pOvvAF6shp3FYyTmvAlGprI67w95hWW3+pPY5Y2/Rsobk/yhGcdH+EuBlEKzs9hmGlQFkq6bMUutHMcPBp3J/fS6L6PRg3Y247gCTljXS0Fhfzoonxm9K7jZe+mEmwHp4l1IskwsZwp9FfNTDAmFK2uz5MO4hiIvY2cvdELvkZn19KITFxmL/Das/k/uG1xMzwJlB3ZW4jtxaOas6IWIFIF1My096VOcjPZYwl5fHCijjEwuvYYzawG0MiGOfVgDbryrLVu16/tfHuR7qbc= ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:03.742 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC11D6AUAwRHDO2DF9rxkuJc9fe20K/4mTCIRBuNfupdar3W6JcybC/hlmTG6YkeYUpYMb28NoNi4CSMyQmlpQOXIbnFIkKt4PKzxYBuJlLzLhwhS8hU6AOs85aWbmLy6VPgIBD7PjQLph5Z4x3AV0eYWPqTcxtBahAYtBC7YcU+N4djaSDwOp+WC4IgQAoMmCc0cLNHro1jYCI//ReGWzo8/l+nk9MHbMNmL+6V8k+d+47pOvvAF6shp3FYyTmvAlGprI67w95hWW3+pPY5Y2/Rsobk/yhGcdH+EuBlEKzs9hmGlQFkq6bMUutHMcPBp3J/fS6L6PRg3Y247gCTljXS0Fhfzoonxm9K7jZe+mEmwHp4l1IskwsZwp9FfNTDAmFK2uz5MO4hiIvY2cvdELvkZn19KITFxmL/Das/k/uG1xMzwJlB3ZW4jtxaOas6IWIFIF1My096VOcjPZYwl5fHCijjEwuvYYzawG0MiGOfVgDbryrLVu16/tfHuR7qbc= ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:30:03.785 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC11D6AUAwRHDO2DF9rxkuJc9fe20K/4mTCIRBuNfupdar3W6JcybC/hlmTG6YkeYUpYMb28NoNi4CSMyQmlpQOXIbnFIkKt4PKzxYBuJlLzLhwhS8hU6AOs85aWbmLy6VPgIBD7PjQLph5Z4x3AV0eYWPqTcxtBahAYtBC7YcU+N4djaSDwOp+WC4IgQAoMmCc0cLNHro1jYCI//ReGWzo8/l+nk9MHbMNmL+6V8k+d+47pOvvAF6shp3FYyTmvAlGprI67w95hWW3+pPY5Y2/Rsobk/yhGcdH+EuBlEKzs9hmGlQFkq6bMUutHMcPBp3J/fS6L6PRg3Y247gCTljXS0Fhfzoonxm9K7jZe+mEmwHp4l1IskwsZwp9FfNTDAmFK2uz5MO4hiIvY2cvdELvkZn19KITFxmL/Das/k/uG1xMzwJlB3ZW4jtxaOas6IWIFIF1My096VOcjPZYwl5fHCijjEwuvYYzawG0MiGOfVgDbryrLVu16/tfHuR7qbc= ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:03.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T02:30:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:04.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:03 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3377860846' entity='client.admin' 2024-09-12T02:30:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.588+0000 7fb6f50d6640 1 -- 172.21.15.100:0/1130163403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 msgr2=0x7fb6f0100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.588+0000 7fb6f50d6640 1 --2- 172.21.15.100:0/1130163403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f0100930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009880 tx=0x7fb6e002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.588+0000 7fb6f50d6640 1 -- 172.21.15.100:0/1130163403 shutdown_connections 2024-09-12T02:30:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.588+0000 7fb6f50d6640 1 --2- 172.21.15.100:0/1130163403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f0100930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.588+0000 7fb6f50d6640 1 -- 172.21.15.100:0/1130163403 >> 172.21.15.100:0/1130163403 conn(0x7fb6f00fbca0 msgr2=0x7fb6f00fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.588+0000 7fb6f50d6640 1 -- 172.21.15.100:0/1130163403 shutdown_connections 2024-09-12T02:30:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.588+0000 7fb6f50d6640 1 -- 172.21.15.100:0/1130163403 wait complete. 2024-09-12T02:30:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.589+0000 7fb6f50d6640 1 Processor -- start 2024-09-12T02:30:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.589+0000 7fb6f50d6640 1 -- start start 2024-09-12T02:30:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6f50d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f006a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6f50d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0106640 con 0x7fb6f0100530 2024-09-12T02:30:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6eed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6eed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f006a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52800/0 (socket says 172.21.15.100:52800) 2024-09-12T02:30:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6eed9d640 1 -- 172.21.15.100:0/3748732363 learned_addr learned my addr 172.21.15.100:0/3748732363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6eed9d640 1 -- 172.21.15.100:0/3748732363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f0199ad0 con 0x7fb6f0100530 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6eed9d640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f006a180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0004f60 tx=0x7fb6e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6d7fff640 1 -- 172.21.15.100:0/3748732363 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e003f070 con 0x7fb6f0100530 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f0199ca0 con 0x7fb6f0100530 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6d7fff640 1 -- 172.21.15.100:0/3748732363 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6e0004d40 con 0x7fb6f0100530 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.590+0000 7fb6d7fff640 1 -- 172.21.15.100:0/3748732363 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e0035030 con 0x7fb6f0100530 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.591+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f019a0c0 con 0x7fb6f0100530 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.591+0000 7fb6d7fff640 1 -- 172.21.15.100:0/3748732363 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb6e0042070 con 0x7fb6f0100530 2024-09-12T02:30:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.592+0000 7fb6d7fff640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6d8039060 0x7fb6d803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:04.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.592+0000 7fb6d7fff640 1 -- 172.21.15.100:0/3748732363 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb6e006dd20 con 0x7fb6f0100530 2024-09-12T02:30:04.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.592+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f0106dc0 con 0x7fb6f0100530 2024-09-12T02:30:04.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.592+0000 7fb6ee59c640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6d8039060 0x7fb6d803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:04.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.592+0000 7fb6ee59c640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6d8039060 0x7fb6d803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40098c0 tx=0x7fb6e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.596+0000 7fb6d7fff640 1 -- 172.21.15.100:0/3748732363 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6e0040260 con 0x7fb6f0100530 2024-09-12T02:30:04.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.772+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fb6f002d970 con 0x7fb6f0100530 2024-09-12T02:30:04.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.774+0000 7fb6d7fff640 1 -- 172.21.15.100:0/3748732363 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fb6e00307a0 con 0x7fb6f0100530 2024-09-12T02:30:04.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6d8039060 msgr2=0x7fb6d803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6d8039060 0x7fb6d803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40098c0 tx=0x7fb6e4006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 msgr2=0x7fb6f006a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f006a180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0004f60 tx=0x7fb6e00048f0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 shutdown_connections 2024-09-12T02:30:04.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6d8039060 0x7fb6d803b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 --2- 172.21.15.100:0/3748732363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0100530 0x7fb6f006a180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 >> 172.21.15.100:0/3748732363 conn(0x7fb6f00fbca0 msgr2=0x7fb6f00fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:04.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 shutdown_connections 2024-09-12T02:30:04.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:04.777+0000 7fb6f50d6640 1 -- 172.21.15.100:0/3748732363 wait complete. 2024-09-12T02:30:05.850 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T02:30:05.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T02:30:06.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:05 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3748732363' entity='client.admin' 2024-09-12T02:30:06.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:06.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:06.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:06.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:06.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:06.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:06.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.851+0000 7f5c23fb5640 1 -- 172.21.15.100:0/3568179723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 msgr2=0x7f5c1c100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:06.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.851+0000 7f5c23fb5640 1 --2- 172.21.15.100:0/3568179723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c100930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009880 tx=0x7f5c1802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 -- 172.21.15.100:0/3568179723 shutdown_connections 2024-09-12T02:30:06.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 --2- 172.21.15.100:0/3568179723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c100930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 -- 172.21.15.100:0/3568179723 >> 172.21.15.100:0/3568179723 conn(0x7f5c1c0fbca0 msgr2=0x7f5c1c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 -- 172.21.15.100:0/3568179723 shutdown_connections 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 -- 172.21.15.100:0/3568179723 wait complete. 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 Processor -- start 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 -- start start 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c06a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.852+0000 7f5c23fb5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c106640 con 0x7f5c1c100530 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.853+0000 7f5c21d51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c06a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.853+0000 7f5c21d51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c06a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52818/0 (socket says 172.21.15.100:52818) 2024-09-12T02:30:06.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.853+0000 7f5c21d51640 1 -- 172.21.15.100:0/1436075797 learned_addr learned my addr 172.21.15.100:0/1436075797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:06.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.853+0000 7f5c21d51640 1 -- 172.21.15.100:0/1436075797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c197950 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.853+0000 7f5c21d51640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c06a140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c18004f60 tx=0x7f5c180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.854+0000 7f5c12ffd640 1 -- 172.21.15.100:0/1436075797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1803f070 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.854+0000 7f5c12ffd640 1 -- 172.21.15.100:0/1436075797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c18004d40 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.854+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c19bf60 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.854+0000 7f5c12ffd640 1 -- 172.21.15.100:0/1436075797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c18035030 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.854+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c19c300 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.855+0000 7f5c12ffd640 1 -- 172.21.15.100:0/1436075797 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f5c18042070 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.855+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c106dc0 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.855+0000 7f5c12ffd640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5c080390c0 0x7f5c0803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.855+0000 7f5c12ffd640 1 -- 172.21.15.100:0/1436075797 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5c1806cd80 con 0x7f5c1c100530 2024-09-12T02:30:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.855+0000 7f5c21550640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5c080390c0 0x7f5c0803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:06.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.856+0000 7f5c21550640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5c080390c0 0x7f5c0803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098c0 tx=0x7f5c0c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:06.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:06.860+0000 7f5c12ffd640 1 -- 172.21.15.100:0/1436075797 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c18039350 con 0x7f5c1c100530 2024-09-12T02:30:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.034+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f5c1c02d8d0 con 0x7f5c080390c0 2024-09-12T02:30:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.037+0000 7f5c12ffd640 1 -- 172.21.15.100:0/1436075797 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c1c02d8d0 con 0x7f5c080390c0 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5c080390c0 msgr2=0x7f5c0803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5c080390c0 0x7f5c0803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098c0 tx=0x7f5c0c006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 msgr2=0x7f5c1c06a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c06a140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c18004f60 tx=0x7f5c180048f0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 shutdown_connections 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5c080390c0 0x7f5c0803b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 --2- 172.21.15.100:0/1436075797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c100530 0x7f5c1c06a140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 >> 172.21.15.100:0/1436075797 conn(0x7f5c1c0fbca0 msgr2=0x7f5c1c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 shutdown_connections 2024-09-12T02:30:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:07.040+0000 7f5c23fb5640 1 -- 172.21.15.100:0/1436075797 wait complete. 2024-09-12T02:30:08.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:08.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:08.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:08.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:08.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:08.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T02:30:08.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: Updating smithi100:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:08.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:08.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:08.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:08.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:08.285 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi117 2024-09-12T02:30:08.285 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:30:08.285 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:30:08.305 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:30:08.305 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:08.363 INFO:tasks.cephadm:Adding host smithi117 to orchestrator... 2024-09-12T02:30:08.363 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch host add smithi117 2024-09-12T02:30:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.075+0000 7fb0998e9640 1 -- 172.21.15.100:0/4232188893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 msgr2=0x7fb094107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.075+0000 7fb0998e9640 1 --2- 172.21.15.100:0/4232188893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094107a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb084009880 tx=0x7fb08402a670 comp rx=0 tx=0).stop 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.075+0000 7fb0998e9640 1 -- 172.21.15.100:0/4232188893 shutdown_connections 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.075+0000 7fb0998e9640 1 --2- 172.21.15.100:0/4232188893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094107a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.075+0000 7fb0998e9640 1 -- 172.21.15.100:0/4232188893 >> 172.21.15.100:0/4232188893 conn(0x7fb0940fb920 msgr2=0x7fb0940fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.075+0000 7fb0998e9640 1 -- 172.21.15.100:0/4232188893 shutdown_connections 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.075+0000 7fb0998e9640 1 -- 172.21.15.100:0/4232188893 wait complete. 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.076+0000 7fb0998e9640 1 Processor -- start 2024-09-12T02:30:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.076+0000 7fb0998e9640 1 -- start start 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.076+0000 7fb0998e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.076+0000 7fb0998e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb09410bc80 con 0x7fb094107690 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb092ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb092ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52838/0 (socket says 172.21.15.100:52838) 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb092ffd640 1 -- 172.21.15.100:0/1709974127 learned_addr learned my addr 172.21.15.100:0/1709974127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb092ffd640 1 -- 172.21.15.100:0/1709974127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb094197660 con 0x7fb094107690 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb092ffd640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094197120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb084009230 tx=0x7fb084003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb0988e7640 1 -- 172.21.15.100:0/1709974127 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08403f070 con 0x7fb094107690 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb094197950 con 0x7fb094107690 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb0988e7640 1 -- 172.21.15.100:0/1709974127 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb08403bc80 con 0x7fb094107690 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb0988e7640 1 -- 172.21.15.100:0/1709974127 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084035030 con 0x7fb094107690 2024-09-12T02:30:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.077+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09419b9f0 con 0x7fb094107690 2024-09-12T02:30:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.078+0000 7fb0988e7640 1 -- 172.21.15.100:0/1709974127 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb084042070 con 0x7fb094107690 2024-09-12T02:30:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.078+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb094102d30 con 0x7fb094107690 2024-09-12T02:30:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.078+0000 7fb0988e7640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb080039060 0x7fb08003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.078+0000 7fb0988e7640 1 -- 172.21.15.100:0/1709974127 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb08406cc80 con 0x7fb094107690 2024-09-12T02:30:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.078+0000 7fb08a7fc640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb080039060 0x7fb08003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.079+0000 7fb08a7fc640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb080039060 0x7fb08003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0098c0 tx=0x7fb07c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:09.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.083+0000 7fb0988e7640 1 -- 172.21.15.100:0/1709974127 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb08404c350 con 0x7fb094107690 2024-09-12T02:30:09.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:09.253+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}) -- 0x7fb094107af0 con 0x7fb080039060 2024-09-12T02:30:09.254 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:09 smithi100 ceph-mon[31390]: Updating smithi100:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:30:10.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:10 smithi100 ceph-mon[31390]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:11.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:11 smithi100 ceph-mon[31390]: Deploying cephadm binary to smithi117 2024-09-12T02:30:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.344+0000 7fb0988e7640 1 -- 172.21.15.100:0/1709974127 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb094107af0 con 0x7fb080039060 2024-09-12T02:30:12.344 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi117' with addr '172.21.15.117' 2024-09-12T02:30:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb080039060 msgr2=0x7fb08003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb080039060 0x7fb08003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0098c0 tx=0x7fb07c006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 msgr2=0x7fb094197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094197120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb084009230 tx=0x7fb084003d40 comp rx=0 tx=0).stop 2024-09-12T02:30:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 shutdown_connections 2024-09-12T02:30:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb080039060 0x7fb08003b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 --2- 172.21.15.100:0/1709974127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb094107690 0x7fb094197120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 >> 172.21.15.100:0/1709974127 conn(0x7fb0940fb920 msgr2=0x7fb0940fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:12.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 shutdown_connections 2024-09-12T02:30:12.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:12.346+0000 7fb0998e9640 1 -- 172.21.15.100:0/1709974127 wait complete. 2024-09-12T02:30:12.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:30:13.157 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:13.551 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:13.551 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:13 smithi100 ceph-mon[31390]: Added host smithi117 2024-09-12T02:30:13.551 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:13.551 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:13.551 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 -- 172.21.15.100:0/2989393828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 msgr2=0x7f07d80ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 --2- 172.21.15.100:0/2989393828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d80ffea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009880 tx=0x7f07c802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:30:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 -- 172.21.15.100:0/2989393828 shutdown_connections 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 --2- 172.21.15.100:0/2989393828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d80ffea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 -- 172.21.15.100:0/2989393828 >> 172.21.15.100:0/2989393828 conn(0x7f07d80fb920 msgr2=0x7f07d80fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 -- 172.21.15.100:0/2989393828 shutdown_connections 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 -- 172.21.15.100:0/2989393828 wait complete. 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.632+0000 7f07dd10b640 1 Processor -- start 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07dd10b640 1 -- start start 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07dd10b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d81960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07dd10b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07d810ab70 con 0x7f07d8069650 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07d6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d81960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07d6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d81960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52848/0 (socket says 172.21.15.100:52848) 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07d6d9d640 1 -- 172.21.15.100:0/2662243878 learned_addr learned my addr 172.21.15.100:0/2662243878 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07d6d9d640 1 -- 172.21.15.100:0/2662243878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d8196630 con 0x7f07d8069650 2024-09-12T02:30:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07d6d9d640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d81960f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009230 tx=0x7f07c8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07bffff640 1 -- 172.21.15.100:0/2662243878 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07c803f070 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.633+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d8196920 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.634+0000 7f07bffff640 1 -- 172.21.15.100:0/2662243878 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07c803bc80 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.634+0000 7f07bffff640 1 -- 172.21.15.100:0/2662243878 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07c8035030 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.634+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d819a9c0 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.635+0000 7f07bffff640 1 -- 172.21.15.100:0/2662243878 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f07c8042070 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.635+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d8101380 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.635+0000 7f07bffff640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f07c0039060 0x7f07c003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.635+0000 7f07bffff640 1 -- 172.21.15.100:0/2662243878 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f07c806ca60 con 0x7f07d8069650 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.635+0000 7f07d659c640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f07c0039060 0x7f07c003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.635+0000 7f07d659c640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f07c0039060 0x7f07c003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0098c0 tx=0x7f07cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.640+0000 7f07bffff640 1 -- 172.21.15.100:0/2662243878 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07c80314c0 con 0x7f07d8069650 2024-09-12T02:30:13.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.812+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07d80fff80 con 0x7f07c0039060 2024-09-12T02:30:13.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.813+0000 7f07bffff640 1 -- 172.21.15.100:0/2662243878 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f07d80fff80 con 0x7f07c0039060 2024-09-12T02:30:13.813 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:13.813 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}] 2024-09-12T02:30:13.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f07c0039060 msgr2=0x7f07c003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f07c0039060 0x7f07c003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0098c0 tx=0x7f07cc006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 msgr2=0x7f07d81960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d81960f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009230 tx=0x7f07c8003d40 comp rx=0 tx=0).stop 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 shutdown_connections 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f07c0039060 0x7f07c003b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 --2- 172.21.15.100:0/2662243878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d8069650 0x7f07d81960f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 >> 172.21.15.100:0/2662243878 conn(0x7f07d80fb920 msgr2=0x7f07d81088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 shutdown_connections 2024-09-12T02:30:13.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:13.815+0000 7f07dd10b640 1 -- 172.21.15.100:0/2662243878 wait complete. 2024-09-12T02:30:14.448 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-12T02:30:14.448 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:30:14.448 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:30:14.468 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:30:14.468 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:14.527 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-12T02:30:14.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch host add smithi189 2024-09-12T02:30:14.764 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:14.979 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:14.979 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:14 smithi100 ceph-mon[31390]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.170+0000 7fb723ec9640 1 -- 172.21.15.100:0/2682640638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 msgr2=0x7fb71c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.170+0000 7fb723ec9640 1 --2- 172.21.15.100:0/2682640638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009880 tx=0x7fb70c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.170+0000 7fb723ec9640 1 -- 172.21.15.100:0/2682640638 shutdown_connections 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.170+0000 7fb723ec9640 1 --2- 172.21.15.100:0/2682640638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.170+0000 7fb723ec9640 1 -- 172.21.15.100:0/2682640638 >> 172.21.15.100:0/2682640638 conn(0x7fb71c0fd2b0 msgr2=0x7fb71c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.170+0000 7fb723ec9640 1 -- 172.21.15.100:0/2682640638 shutdown_connections 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.170+0000 7fb723ec9640 1 -- 172.21.15.100:0/2682640638 wait complete. 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb723ec9640 1 Processor -- start 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb723ec9640 1 -- start start 2024-09-12T02:30:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb723ec9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb723ec9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c10bc70 con 0x7fb71c107660 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb721c65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb721c65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51222/0 (socket says 172.21.15.100:51222) 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb721c65640 1 -- 172.21.15.100:0/114732054 learned_addr learned my addr 172.21.15.100:0/114732054 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb721c65640 1 -- 172.21.15.100:0/114732054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c1975e0 con 0x7fb71c107660 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.171+0000 7fb721c65640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c1970a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009230 tx=0x7fb70c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.172+0000 7fb712ffd640 1 -- 172.21.15.100:0/114732054 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb70c03f070 con 0x7fb71c107660 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.172+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71c1978d0 con 0x7fb71c107660 2024-09-12T02:30:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.172+0000 7fb712ffd640 1 -- 172.21.15.100:0/114732054 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb70c03bc80 con 0x7fb71c107660 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.172+0000 7fb712ffd640 1 -- 172.21.15.100:0/114732054 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb70c035030 con 0x7fb71c107660 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.172+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb71c19b970 con 0x7fb71c107660 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.173+0000 7fb712ffd640 1 -- 172.21.15.100:0/114732054 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb70c042070 con 0x7fb71c107660 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.173+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb71c102d10 con 0x7fb71c107660 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.173+0000 7fb712ffd640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb708039060 0x7fb70803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.173+0000 7fb712ffd640 1 -- 172.21.15.100:0/114732054 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb70c06cc90 con 0x7fb71c107660 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.173+0000 7fb721464640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb708039060 0x7fb70803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.173+0000 7fb721464640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb708039060 0x7fb70803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb7180098c0 tx=0x7fb718006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.177+0000 7fb712ffd640 1 -- 172.21.15.100:0/114732054 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb70c031e20 con 0x7fb71c107660 2024-09-12T02:30:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:15.347+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}) -- 0x7fb71c198400 con 0x7fb708039060 2024-09-12T02:30:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:16.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:16.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:16.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:16.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:16.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:16.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:17 smithi100 ceph-mon[31390]: Deploying cephadm binary to smithi189 2024-09-12T02:30:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:17 smithi100 ceph-mon[31390]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T02:30:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:17 smithi100 ceph-mon[31390]: Updating smithi117:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:18.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.503+0000 7fb712ffd640 1 -- 172.21.15.100:0/114732054 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb71c198400 con 0x7fb708039060 2024-09-12T02:30:18.504 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-12T02:30:18.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb708039060 msgr2=0x7fb70803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb708039060 0x7fb70803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb7180098c0 tx=0x7fb718006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 msgr2=0x7fb71c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c1970a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009230 tx=0x7fb70c003d40 comp rx=0 tx=0).stop 2024-09-12T02:30:18.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 shutdown_connections 2024-09-12T02:30:18.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb708039060 0x7fb70803b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 --2- 172.21.15.100:0/114732054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb71c107660 0x7fb71c1970a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 >> 172.21.15.100:0/114732054 conn(0x7fb71c0fd2b0 msgr2=0x7fb71c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 shutdown_connections 2024-09-12T02:30:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:18.506+0000 7fb723ec9640 1 -- 172.21.15.100:0/114732054 wait complete. 2024-09-12T02:30:18.811 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:18 smithi100 ceph-mon[31390]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:18.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:18 smithi100 ceph-mon[31390]: Updating smithi117:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:30:18.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:18 smithi100 ceph-mon[31390]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:18.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:18.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:18.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:19.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:30:19.612 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:19.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:19.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:19 smithi100 ceph-mon[31390]: Added host smithi189 2024-09-12T02:30:19.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:19.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:19.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:20.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.078+0000 7f7a09901640 1 -- 172.21.15.100:0/2095048577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 msgr2=0x7f7a04107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:20.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.078+0000 7f7a09901640 1 --2- 172.21.15.100:0/2095048577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a04107a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009c20 tx=0x7f79f402aa90 comp rx=0 tx=0).stop 2024-09-12T02:30:20.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.078+0000 7f7a09901640 1 -- 172.21.15.100:0/2095048577 shutdown_connections 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.078+0000 7f7a09901640 1 --2- 172.21.15.100:0/2095048577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a04107a70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.078+0000 7f7a09901640 1 -- 172.21.15.100:0/2095048577 >> 172.21.15.100:0/2095048577 conn(0x7f7a04076250 msgr2=0x7f7a04076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.079+0000 7f7a09901640 1 -- 172.21.15.100:0/2095048577 shutdown_connections 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.079+0000 7f7a09901640 1 -- 172.21.15.100:0/2095048577 wait complete. 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.079+0000 7f7a09901640 1 Processor -- start 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.079+0000 7f7a09901640 1 -- start start 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.079+0000 7f7a09901640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a041970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.080+0000 7f7a09901640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0410bce0 con 0x7f7a04107690 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.080+0000 7f7a02ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a041970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.080+0000 7f7a02ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a041970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51244/0 (socket says 172.21.15.100:51244) 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.080+0000 7f7a02ffd640 1 -- 172.21.15.100:0/3804299321 learned_addr learned my addr 172.21.15.100:0/3804299321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.080+0000 7f7a02ffd640 1 -- 172.21.15.100:0/3804299321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a04197620 con 0x7f7a04107690 2024-09-12T02:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.080+0000 7f7a02ffd640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a041970e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005e30 tx=0x7f79f402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.081+0000 7f7a088ff640 1 -- 172.21.15.100:0/3804299321 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f4047070 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.081+0000 7f7a088ff640 1 -- 172.21.15.100:0/3804299321 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f4003df0 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.081+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a041978b0 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.081+0000 7f7a088ff640 1 -- 172.21.15.100:0/3804299321 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f4033050 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.081+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0419b9b0 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.082+0000 7f7a088ff640 1 -- 172.21.15.100:0/3804299321 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f79f404a070 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.082+0000 7f7a088ff640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79ec0390c0 0x7f79ec03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.082+0000 7f7a088ff640 1 -- 172.21.15.100:0/3804299321 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f79f403e030 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.082+0000 7f7a027fc640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79ec0390c0 0x7f79ec03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.082+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a04102d30 con 0x7f7a04107690 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.082+0000 7f7a027fc640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79ec0390c0 0x7f79ec03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79f80098c0 tx=0x7f79f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.087+0000 7f7a088ff640 1 -- 172.21.15.100:0/3804299321 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79f4051080 con 0x7f7a04107690 2024-09-12T02:30:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.257+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a04198440 con 0x7f79ec0390c0 2024-09-12T02:30:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.258+0000 7f7a088ff640 1 -- 172.21.15.100:0/3804299321 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f7a04198440 con 0x7f79ec0390c0 2024-09-12T02:30:20.258 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:20.258 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79ec0390c0 msgr2=0x7f79ec03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79ec0390c0 0x7f79ec03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79f80098c0 tx=0x7f79f8006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 msgr2=0x7f7a041970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a041970e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005e30 tx=0x7f79f402fc10 comp rx=0 tx=0).stop 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 shutdown_connections 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79ec0390c0 0x7f79ec03b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 --2- 172.21.15.100:0/3804299321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a04107690 0x7f7a041970e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 >> 172.21.15.100:0/3804299321 conn(0x7f7a04076250 msgr2=0x7f7a040fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 shutdown_connections 2024-09-12T02:30:20.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:20.260+0000 7f7a09901640 1 -- 172.21.15.100:0/3804299321 wait complete. 2024-09-12T02:30:20.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:20 smithi100 ceph-mon[31390]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:20.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:20.879 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T02:30:20.879 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T02:30:21.113 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 -- 172.21.15.100:0/3819010326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 msgr2=0x7f865c107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 --2- 172.21.15.100:0/3819010326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c107a70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f864c009c20 tx=0x7f864c02aa90 comp rx=0 tx=0).stop 2024-09-12T02:30:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 -- 172.21.15.100:0/3819010326 shutdown_connections 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 --2- 172.21.15.100:0/3819010326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c107a70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 -- 172.21.15.100:0/3819010326 >> 172.21.15.100:0/3819010326 conn(0x7f865c076250 msgr2=0x7f865c076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 -- 172.21.15.100:0/3819010326 shutdown_connections 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 -- 172.21.15.100:0/3819010326 wait complete. 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 Processor -- start 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.528+0000 7f8660ed0640 1 -- start start 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f8660ed0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f8660ed0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f865c10bce0 con 0x7f865c107690 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f865a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f865a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51266/0 (socket says 172.21.15.100:51266) 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f865a59c640 1 -- 172.21.15.100:0/3241216513 learned_addr learned my addr 172.21.15.100:0/3241216513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f865a59c640 1 -- 172.21.15.100:0/3241216513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c197650 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f865a59c640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c197110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f864c005e30 tx=0x7f864c02fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f86537fe640 1 -- 172.21.15.100:0/3241216513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864c047070 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f86537fe640 1 -- 172.21.15.100:0/3241216513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f864c003df0 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f86537fe640 1 -- 172.21.15.100:0/3241216513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864c033050 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865c1978e0 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.529+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865c19b9e0 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.530+0000 7f86537fe640 1 -- 172.21.15.100:0/3241216513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f864c04a070 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.530+0000 7f86537fe640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8648039060 0x7f864803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.530+0000 7f86537fe640 1 -- 172.21.15.100:0/3241216513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f864c03e030 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.530+0000 7f8659d9b640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8648039060 0x7f864803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.530+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865c102d30 con 0x7f865c107690 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.531+0000 7f8659d9b640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8648039060 0x7f864803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86440098c0 tx=0x7f8644006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.535+0000 7f86537fe640 1 -- 172.21.15.100:0/3241216513 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f864c051080 con 0x7f865c107690 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:21.704+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f865c107b20 con 0x7f865c107690 2024-09-12T02:30:21.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:21 smithi100 ceph-mon[31390]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:22.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.506+0000 7f86537fe640 1 -- 172.21.15.100:0/3241216513 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f865c107b20 con 0x7f865c107690 2024-09-12T02:30:22.507 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-09-12T02:30:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8648039060 msgr2=0x7f864803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8648039060 0x7f864803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86440098c0 tx=0x7f8644006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 msgr2=0x7f865c197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c197110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f864c005e30 tx=0x7f864c02fc10 comp rx=0 tx=0).stop 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 shutdown_connections 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8648039060 0x7f864803b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 --2- 172.21.15.100:0/3241216513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f865c107690 0x7f865c197110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 >> 172.21.15.100:0/3241216513 conn(0x7f865c076250 msgr2=0x7f865c0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 shutdown_connections 2024-09-12T02:30:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:22.509+0000 7f8660ed0640 1 -- 172.21.15.100:0/3241216513 wait complete. 2024-09-12T02:30:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:22 smithi100 ceph-mon[31390]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:22 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3241216513' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:30:23.166 INFO:tasks.cephadm:Adding mon.a on smithi100 2024-09-12T02:30:23.166 INFO:tasks.cephadm:Adding mon.b on smithi117 2024-09-12T02:30:23.166 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-09-12T02:30:23.166 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c' 2024-09-12T02:30:23.410 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:23.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3241216513' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:23.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 -- 172.21.15.189:0/2698129989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 msgr2=0x7f7eb4106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:23.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 --2- 172.21.15.189:0/2698129989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4106970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009880 tx=0x7f7eb002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:30:23.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 -- 172.21.15.189:0/2698129989 shutdown_connections 2024-09-12T02:30:23.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 --2- 172.21.15.189:0/2698129989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4106970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:23.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 -- 172.21.15.189:0/2698129989 >> 172.21.15.189:0/2698129989 conn(0x7f7eb40fc1a0 msgr2=0x7f7eb40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 -- 172.21.15.189:0/2698129989 shutdown_connections 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 -- 172.21.15.189:0/2698129989 wait complete. 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 Processor -- start 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.876+0000 7f7ebc681640 1 -- start start 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.877+0000 7f7ebc681640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.877+0000 7f7ebc681640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb410abc0 con 0x7f7eb4106590 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.877+0000 7f7eba41d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:23.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.877+0000 7f7eba41d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.189:39316/0 (socket says 172.21.15.189:39316) 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.877+0000 7f7eba41d640 1 -- 172.21.15.189:0/2311952582 learned_addr learned my addr 172.21.15.189:0/2311952582 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.877+0000 7f7eba41d640 1 -- 172.21.15.189:0/2311952582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb4197640 con 0x7f7eb4106590 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.877+0000 7f7eba41d640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4197100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009230 tx=0x7f7eb0003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.878+0000 7f7eab7fe640 1 -- 172.21.15.189:0/2311952582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eb003f070 con 0x7f7eb4106590 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.878+0000 7f7eab7fe640 1 -- 172.21.15.189:0/2311952582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb003bd40 con 0x7f7eb4106590 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.878+0000 7f7eab7fe640 1 -- 172.21.15.189:0/2311952582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eb0035030 con 0x7f7eb4106590 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.878+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb41978d0 con 0x7f7eb4106590 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.878+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb419b9d0 con 0x7f7eb4106590 2024-09-12T02:30:23.913 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.878+0000 7f7eab7fe640 1 -- 172.21.15.189:0/2311952582 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f7eb0042070 con 0x7f7eb4106590 2024-09-12T02:30:23.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.879+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb4101c00 con 0x7f7eb4106590 2024-09-12T02:30:23.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.879+0000 7f7eab7fe640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ea0039060 0x7f7ea003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:23.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.879+0000 7f7eab7fe640 1 -- 172.21.15.189:0/2311952582 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7eb006cd20 con 0x7f7eb4106590 2024-09-12T02:30:23.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.879+0000 7f7eb9c1c640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ea0039060 0x7f7ea003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:23.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.879+0000 7f7eb9c1c640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ea0039060 0x7f7ea003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40098c0 tx=0x7f7ea4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:23.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:23.884+0000 7f7eab7fe640 1 -- 172.21.15.189:0/2311952582 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7eb0030d60 con 0x7f7eb4106590 2024-09-12T02:30:24.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.060+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}) -- 0x7f7eb4198460 con 0x7f7ea0039060 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.065+0000 7f7eab7fe640 1 -- 172.21.15.189:0/2311952582 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7eb4198460 con 0x7f7ea0039060 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mon update... 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ea0039060 msgr2=0x7f7ea003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ea0039060 0x7f7ea003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40098c0 tx=0x7f7ea4006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 msgr2=0x7f7eb4197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4197100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009230 tx=0x7f7eb0003d80 comp rx=0 tx=0).stop 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 shutdown_connections 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ea0039060 0x7f7ea003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 --2- 172.21.15.189:0/2311952582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7eb4106590 0x7f7eb4197100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 >> 172.21.15.189:0/2311952582 conn(0x7f7eb40fc1a0 msgr2=0x7f7eb4069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 shutdown_connections 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:24.067+0000 7f7ebc681640 1 -- 172.21.15.189:0/2311952582 wait complete. 2024-09-12T02:30:24.688 DEBUG:teuthology.orchestra.run.smithi117:mon.b> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T02:30:24.691 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T02:30:24.695 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:30:24.695 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: Updating smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: Updating smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:24.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:24.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:24.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:24.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:24.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:24.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:24 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:25.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:25 smithi100 ceph-mon[31390]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:25.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:25 smithi100 ceph-mon[31390]: Saving service mon spec with placement smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c;count:3 2024-09-12T02:30:25.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:25 smithi100 ceph-mon[31390]: Deploying daemon mon.c on smithi189 2024-09-12T02:30:25.949 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:26 smithi100 ceph-mon[31390]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:27.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 -- 172.21.15.189:0/4083739560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 msgr2=0x7efd40100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 --2- 172.21.15.189:0/4083739560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd40100d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd30009880 tx=0x7efd3002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 -- 172.21.15.189:0/4083739560 shutdown_connections 2024-09-12T02:30:27.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 --2- 172.21.15.189:0/4083739560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd40100d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 -- 172.21.15.189:0/4083739560 >> 172.21.15.189:0/4083739560 conn(0x7efd40076250 msgr2=0x7efd40076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:27.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 -- 172.21.15.189:0/4083739560 shutdown_connections 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 -- 172.21.15.189:0/4083739560 wait complete. 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.309+0000 7efd45516640 1 Processor -- start 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.310+0000 7efd45516640 1 -- start start 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.310+0000 7efd45516640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd401980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.310+0000 7efd45516640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd4010ab90 con 0x7efd40100990 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.311+0000 7efd3effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd401980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.311+0000 7efd3effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd401980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.189:51880/0 (socket says 172.21.15.189:51880) 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.311+0000 7efd3effd640 1 -- 172.21.15.189:0/3565517349 learned_addr learned my addr 172.21.15.189:0/3565517349 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.311+0000 7efd3effd640 1 -- 172.21.15.189:0/3565517349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd401985e0 con 0x7efd40100990 2024-09-12T02:30:27.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.312+0000 7efd3effd640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd401980a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd30009230 tx=0x7efd30003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.312+0000 7efd27fff640 1 -- 172.21.15.189:0/3565517349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd3003f070 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.312+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd401988d0 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.312+0000 7efd27fff640 1 -- 172.21.15.189:0/3565517349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd3003bd40 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.312+0000 7efd27fff640 1 -- 172.21.15.189:0/3565517349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd30035030 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.312+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd40198d90 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.313+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd40101c40 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.313+0000 7efd27fff640 1 -- 172.21.15.189:0/3565517349 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7efd30042070 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.314+0000 7efd27fff640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efd28039060 0x7efd2803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.314+0000 7efd27fff640 1 -- 172.21.15.189:0/3565517349 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efd3006cc00 con 0x7efd40100990 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.314+0000 7efd3e7fc640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efd28039060 0x7efd2803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.314+0000 7efd3e7fc640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efd28039060 0x7efd2803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efd340098c0 tx=0x7efd34006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.319+0000 7efd27fff640 1 -- 172.21.15.189:0/3565517349 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd30073080 con 0x7efd40100990 2024-09-12T02:30:27.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.565+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efd40100df0 con 0x7efd40100990 2024-09-12T02:30:27.567 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.565+0000 7efd27fff640 1 -- 172.21.15.189:0/3565517349 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7efd30030d60 con 0x7efd40100990 2024-09-12T02:30:27.567 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:30:27.567 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:29:06.153104Z","created":"2024-09-12T02:29:06.153104Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T02:30:27.567 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-12T02:30:27.569 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efd28039060 msgr2=0x7efd2803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.569 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efd28039060 0x7efd2803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efd340098c0 tx=0x7efd34006db0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.569 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 msgr2=0x7efd401980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd401980a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd30009230 tx=0x7efd30003d80 comp rx=0 tx=0).stop 2024-09-12T02:30:27.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 shutdown_connections 2024-09-12T02:30:27.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efd28039060 0x7efd2803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 --2- 172.21.15.189:0/3565517349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40100990 0x7efd401980a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.567+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 >> 172.21.15.189:0/3565517349 conn(0x7efd40076250 msgr2=0x7efd401020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:27.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.568+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 shutdown_connections 2024-09-12T02:30:27.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:27.568+0000 7efd45516640 1 -- 172.21.15.189:0/3565517349 wait complete. 2024-09-12T02:30:27.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:27 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/3565517349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:30:28.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 systemd[1]: Starting Ceph mon.c for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:30:28.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 podman[35177]: 2024-09-12 02:30:28.401725131 +0000 UTC m=+0.016065834 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:30:28.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 podman[35177]: 2024-09-12 02:30:28.503543796 +0000 UTC m=+0.117884530 container create 59e872dd50d83bb0ebfb604f9a47b54052bf3025ea1fef7d41d4ad08d2bb641d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:30:28.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:28 smithi100 ceph-mon[31390]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 podman[35177]: 2024-09-12 02:30:28.705753803 +0000 UTC m=+0.320094498 container init 59e872dd50d83bb0ebfb604f9a47b54052bf3025ea1fef7d41d4ad08d2bb641d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:30:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 podman[35177]: 2024-09-12 02:30:28.708731364 +0000 UTC m=+0.323072056 container start 59e872dd50d83bb0ebfb604f9a47b54052bf3025ea1fef7d41d4ad08d2bb641d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:30:29.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:30:29.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:30:29.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: pidfile_write: ignore empty --pid-file 2024-09-12T02:30:29.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: load: jerasure load: lrc 2024-09-12T02:30:29.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:30:29.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Git sha 0 2024-09-12T02:30:29.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:30:29.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: DB SUMMARY 2024-09-12T02:30:29.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: DB Session ID: ISMRQY0PRKADG1YAFO2D 2024-09-12T02:30:29.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:30:29.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:30:29.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T02:30:29.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-12T02:30:29.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-12T02:30:29.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:30:29.018 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:30:29.018 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:30:29.018 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:30:29.018 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:30:29.018 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:30:29.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.env: 0x55d0b6ee3940 2024-09-12T02:30:29.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:30:29.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.info_log: 0x55d0b7bbb6e0 2024-09-12T02:30:29.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:30:29.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.statistics: (nil) 2024-09-12T02:30:29.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.use_fsync: 0 2024-09-12T02:30:29.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:30:29.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:30:29.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:30:29.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:30:29.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:30:29.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:30:29.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:30:29.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:30:29.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:30:29.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:30:29.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:30:29.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.db_log_dir: 2024-09-12T02:30:29.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.wal_dir: 2024-09-12T02:30:29.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:30:29.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:30:29.023 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:30:29.023 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:30:29.023 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:30:29.023 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:30:29.023 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:30:29.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:30:29.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.write_buffer_manager: 0x55d0b7bcadc0 2024-09-12T02:30:29.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:30:29.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:30:29.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:30:29.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:30:29.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:30:29.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:30:29.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:30:29.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:30:29.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.unordered_write: 0 2024-09-12T02:30:29.026 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:30:29.026 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:30:29.026 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:30:29.026 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:30:29.026 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.row_cache: None 2024-09-12T02:30:29.027 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.wal_filter: None 2024-09-12T02:30:29.029 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:30:29.030 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:30:29.030 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:30:29.030 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:30:29.030 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.wal_compression: 0 2024-09-12T02:30:29.030 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:30:29.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:30:29.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:30:29.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:30:29.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:30:29.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:30:29.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:30:29.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:30:29.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:30:29.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:30:29.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:30:29.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:30:29.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:30:29.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:30:29.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:30:29.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:30:29.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:30:29.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:30:29.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:30:29.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:30:29.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:30:29.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:30:29.035 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:30:29.035 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_open_files: -1 2024-09-12T02:30:29.035 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:30:29.035 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:30:29.035 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:30:29.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:30:29.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:30:29.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Compression algorithms supported: 2024-09-12T02:30:29.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kZSTD supported: 0 2024-09-12T02:30:29.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:30:29.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:30:29.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:30:29.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-12T02:30:29.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:30:29.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:30:29.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.merge_operator: 2024-09-12T02:30:29.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_filter: None 2024-09-12T02:30:29.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:30:29.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:30:29.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:30:29.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:30:29.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d0b7bbb320) 2024-09-12T02:30:29.040 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:30:29.040 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:30:29.040 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:30:29.040 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:30:29.041 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_type: 0 2024-09-12T02:30:29.041 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_index_type: 0 2024-09-12T02:30:29.041 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_shortening: 1 2024-09-12T02:30:29.041 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:30:29.041 INFO:journalctl@ceph.mon.c.smithi189.stdout: checksum: 4 2024-09-12T02:30:29.042 INFO:journalctl@ceph.mon.c.smithi189.stdout: no_block_cache: 0 2024-09-12T02:30:29.042 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache: 0x55d0b7baf1f0 2024-09-12T02:30:29.042 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:30:29.042 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_options: 2024-09-12T02:30:29.042 INFO:journalctl@ceph.mon.c.smithi189.stdout: capacity : 536870912 2024-09-12T02:30:29.043 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_shard_bits : 4 2024-09-12T02:30:29.043 INFO:journalctl@ceph.mon.c.smithi189.stdout: strict_capacity_limit : 0 2024-09-12T02:30:29.043 INFO:journalctl@ceph.mon.c.smithi189.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:30:29.043 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_compressed: (nil) 2024-09-12T02:30:29.043 INFO:journalctl@ceph.mon.c.smithi189.stdout: persistent_cache: (nil) 2024-09-12T02:30:29.043 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size: 4096 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size_deviation: 10 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_restart_interval: 16 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_block_restart_interval: 1 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: metadata_block_size: 4096 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: partition_filters: 0 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: use_delta_encoding: 1 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: filter_policy: bloomfilter 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: whole_key_filtering: 1 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: verify_compression: 0 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:30:29.044 INFO:journalctl@ceph.mon.c.smithi189.stdout: format_version: 5 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_index_compression: 1 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_align: 0 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout: max_auto_readahead_size: 262144 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout: prepopulate_block_cache: 0 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression: NoCompression 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:30:29.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.num_levels: 7 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:30:29.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:30:29.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:30:29.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:30:29.049 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:30:29.050 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.ttl: 2592000 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:30:29.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2bed63ad-ce96-44fa-84c2-292e088a4590 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108228735515, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T02:30:29.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108228735933, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726108228, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2bed63ad-ce96-44fa-84c2-292e088a4590", "db_session_id": "ISMRQY0PRKADG1YAFO2D", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108228736028, "job": 1, "event": "recovery_finished"} 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d0b7bdce00 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: DB pointer 0x55d0b7cd8000 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** DB Stats ** 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:30:29.053 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-12T02:30:29.054 INFO:journalctl@ceph.mon.c.smithi189.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:30:29.055 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache BinnedLRUCache@0x55d0b7baf1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: using public_addr v2:172.21.15.189:0/0 -> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: starting mon.c rank -1 at public addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] at bind addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(???) e0 preinit fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T02:30:29.056 INFO:journalctl@ceph.mon.c.smithi189.stdout: e1 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout: btime 2024-09-12T02:29:09:444586+0000 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout: legacy client fscid: -1 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout: No filesystems configured 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T02:30:29.057 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:29.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3241216513' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3241216513' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:29.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: Updating smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: Updating smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.060 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: Saving service mon spec with placement smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c;count:3 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: Deploying daemon mon.c on smithi189 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/3565517349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 ceph-mon[35196]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T02:30:29.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 bash[35177]: 59e872dd50d83bb0ebfb604f9a47b54052bf3025ea1fef7d41d4ad08d2bb641d 2024-09-12T02:30:29.062 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:28 smithi189 systemd[1]: Started Ceph mon.c for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:30:29.316 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:30:29.316 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:30:29.564 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:30:34.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: mon.a calling monitor election 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: mon.c calling monitor election 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: monmap epoch 2 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: last_changed 2024-09-12T02:30:28.760323+0000 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: created 2024-09-12T02:29:06.153104+0000 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: min_mon_release 19 (squid) 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: election_strategy: 1 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: fsmap 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:30:34.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: mgrmap e13: x(active, since 38s) 2024-09-12T02:30:34.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: overall HEALTH_OK 2024-09-12T02:30:34.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:34.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:34.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:34.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:34.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:34.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:34.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: mon.a calling monitor election 2024-09-12T02:30:34.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: mon.c calling monitor election 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: monmap epoch 2 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: last_changed 2024-09-12T02:30:28.760323+0000 2024-09-12T02:30:34.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: created 2024-09-12T02:29:06.153104+0000 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: min_mon_release 19 (squid) 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: election_strategy: 1 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: fsmap 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: mgrmap e13: x(active, since 38s) 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: overall HEALTH_OK 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:34.266 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:34.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 -- 172.21.15.189:0/2697825135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 msgr2=0x7f63000059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 --2- 172.21.15.189:0/2697825135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 0x7f63000059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63181016a0 tx=0x7f630802c490 comp rx=0 tx=0).stop 2024-09-12T02:30:34.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 -- 172.21.15.189:0/2697825135 shutdown_connections 2024-09-12T02:30:34.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 --2- 172.21.15.189:0/2697825135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 0x7f63000059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 -- 172.21.15.189:0/2697825135 >> 172.21.15.189:0/2697825135 conn(0x7f63180fc220 msgr2=0x7f63180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:34.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 -- 172.21.15.189:0/2697825135 shutdown_connections 2024-09-12T02:30:34.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 -- 172.21.15.189:0/2697825135 wait complete. 2024-09-12T02:30:34.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.403+0000 7f631e653640 1 Processor -- start 2024-09-12T02:30:34.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f631e653640 1 -- start start 2024-09-12T02:30:34.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f631e653640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 0x7f6318195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:34.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f631e653640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 0x7f6318196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:34.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f631e653640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6318108670 con 0x7f6300003530 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f631e653640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63181084f0 con 0x7f6318196430 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f63177fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 0x7f6318196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f63177fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 0x7f6318196890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:54436/0 (socket says 172.21.15.189:54436) 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.404+0000 7f63177fe640 1 -- 172.21.15.189:0/2197851121 learned_addr learned my addr 172.21.15.189:0/2197851121 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f63177fe640 1 -- 172.21.15.189:0/2197851121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 msgr2=0x7f6318196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f63177fe640 1 -- 172.21.15.189:0/2197851121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 msgr2=0x7f6318196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f63177fe640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 0x7f6318196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f63177fe640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 0x7f6318196890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:34.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f6317fff640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 0x7f6318195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:34.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f6317fff640 1 -- 172.21.15.189:0/2197851121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 msgr2=0x7f6318196890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:34.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f6317fff640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 0x7f6318196890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.405+0000 7f6317fff640 1 -- 172.21.15.189:0/2197851121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631806b230 con 0x7f6300003530 2024-09-12T02:30:34.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.406+0000 7f6317fff640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 0x7f6318195ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f630802ca80 tx=0x7f63080339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:34.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.406+0000 7f63157fa640 1 -- 172.21.15.189:0/2197851121 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f63080329e0 con 0x7f6300003530 2024-09-12T02:30:34.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.406+0000 7f63157fa640 1 -- 172.21.15.189:0/2197851121 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6308005550 con 0x7f6300003530 2024-09-12T02:30:34.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.406+0000 7f63157fa640 1 -- 172.21.15.189:0/2197851121 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6308004ca0 con 0x7f6300003530 2024-09-12T02:30:34.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.406+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63181a3560 con 0x7f6300003530 2024-09-12T02:30:34.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.406+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63181a3a90 con 0x7f6300003530 2024-09-12T02:30:34.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.407+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6318101ca0 con 0x7f6300003530 2024-09-12T02:30:34.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.407+0000 7f63157fa640 1 -- 172.21.15.189:0/2197851121 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f6308005070 con 0x7f6300003530 2024-09-12T02:30:34.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.408+0000 7f63157fa640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6304038e50 0x7f630403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:34.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.408+0000 7f63157fa640 1 -- 172.21.15.189:0/2197851121 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f630806e290 con 0x7f6300003530 2024-09-12T02:30:34.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.409+0000 7f63177fe640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6304038e50 0x7f630403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:34.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.409+0000 7f63177fe640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6304038e50 0x7f630403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f630c009100 tx=0x7f630c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:34.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.413+0000 7f63157fa640 1 -- 172.21.15.189:0/2197851121 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6308032e50 con 0x7f6300003530 2024-09-12T02:30:34.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.647+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f631818f8c0 con 0x7f6300003530 2024-09-12T02:30:34.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.648+0000 7f63157fa640 1 -- 172.21.15.189:0/2197851121 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f6308039250 con 0x7f6300003530 2024-09-12T02:30:34.649 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:30:34.649 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:30:28.760323Z","created":"2024-09-12T02:29:06.153104Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:30:34.649 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6304038e50 msgr2=0x7f630403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6304038e50 0x7f630403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f630c009100 tx=0x7f630c008040 comp rx=0 tx=0).stop 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 msgr2=0x7f6318195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 0x7f6318195ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f630802ca80 tx=0x7f63080339a0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 shutdown_connections 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6304038e50 0x7f630403b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6318196430 0x7f6318196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 --2- 172.21.15.189:0/2197851121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6300003530 0x7f6318195ef0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 >> 172.21.15.189:0/2197851121 conn(0x7f63180fc220 msgr2=0x7f63180fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 shutdown_connections 2024-09-12T02:30:34.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:34.650+0000 7f631e653640 1 -- 172.21.15.189:0/2197851121 wait complete. 2024-09-12T02:30:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:34 smithi189 ceph-mon[35196]: Deploying daemon mon.b on smithi117 2024-09-12T02:30:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/2197851121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:30:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:34 smithi100 ceph-mon[31390]: Deploying daemon mon.b on smithi117 2024-09-12T02:30:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/2197851121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:30:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:36.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:35 smithi100 ceph-mon[31390]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:36.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:35 smithi189 ceph-mon[35196]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:36.346 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:30:36.346 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:30:36.597 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:30:37.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.254+0000 7f4ab3767640 1 -- 172.21.15.189:0/124206491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 msgr2=0x7f4aac102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.254+0000 7f4ab3767640 1 --2- 172.21.15.189:0/124206491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 0x7f4aac102cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009880 tx=0x7f4aa002a670 comp rx=0 tx=0).stop 2024-09-12T02:30:37.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.254+0000 7f4ab3767640 1 -- 172.21.15.189:0/124206491 shutdown_connections 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.254+0000 7f4ab3767640 1 --2- 172.21.15.189:0/124206491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 0x7f4aac102cc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.254+0000 7f4ab3767640 1 -- 172.21.15.189:0/124206491 >> 172.21.15.189:0/124206491 conn(0x7f4aac0fc280 msgr2=0x7f4aac0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.254+0000 7f4ab3767640 1 -- 172.21.15.189:0/124206491 shutdown_connections 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.254+0000 7f4ab3767640 1 -- 172.21.15.189:0/124206491 wait complete. 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab3767640 1 Processor -- start 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab3767640 1 -- start start 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab3767640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 0x7f4aac197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab3767640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 0x7f4aac19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab3767640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10bdb0 con 0x7f4aac1028e0 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab3767640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10bc30 con 0x7f4aac197990 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab0d02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 0x7f4aac19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab0d02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 0x7f4aac19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:58140/0 (socket says 172.21.15.189:58140) 2024-09-12T02:30:37.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.255+0000 7f4ab0d02640 1 -- 172.21.15.189:0/4021684729 learned_addr learned my addr 172.21.15.189:0/4021684729 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab0d02640 1 -- 172.21.15.189:0/4021684729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 msgr2=0x7f4aac19bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab0d02640 1 -- 172.21.15.189:0/4021684729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 msgr2=0x7f4aac19bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab0d02640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 0x7f4aac19bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab0d02640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 0x7f4aac19bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab1503640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 0x7f4aac197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab1503640 1 -- 172.21.15.189:0/4021684729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 msgr2=0x7f4aac19bd20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab1503640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 0x7f4aac19bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab1503640 1 -- 172.21.15.189:0/4021684729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac197fb0 con 0x7f4aac1028e0 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.256+0000 7f4ab1503640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 0x7f4aac197450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0005ab0 tx=0x7f4aa0032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.257+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4aa0035070 con 0x7f4aac1028e0 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.257+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aa0032e40 con 0x7f4aac1028e0 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.257+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac19c260 con 0x7f4aac1028e0 2024-09-12T02:30:37.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.257+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4aa003bc10 con 0x7f4aac1028e0 2024-09-12T02:30:37.260 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.257+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac19c740 con 0x7f4aac1028e0 2024-09-12T02:30:37.261 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.257+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f4aa0042030 con 0x7f4aac1028e0 2024-09-12T02:30:37.261 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.257+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac06a450 con 0x7f4aac1028e0 2024-09-12T02:30:37.261 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.258+0000 7f4a9e7fc640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a98038e00 0x7f4a9803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.261 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.258+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4aa0040070 con 0x7f4aac1028e0 2024-09-12T02:30:37.261 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.258+0000 7f4ab0d02640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a98038e00 0x7f4a9803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.261 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.259+0000 7f4ab0d02640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a98038e00 0x7f4a9803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009100 tx=0x7f4aa8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.263 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.263+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4aa003b510 con 0x7f4aac1028e0 2024-09-12T02:30:37.466 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.466+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0039530 con 0x7f4aac1028e0 2024-09-12T02:30:37.496 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:37.495+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4aac19ca20 con 0x7f4aac1028e0 2024-09-12T02:30:42.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.476+0000 7f4a9e7fc640 1 -- 172.21.15.189:0/4021684729 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1289 (secure 0 0 0) 0x7f4aa00433c0 con 0x7f4aac1028e0 2024-09-12T02:30:42.477 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:30:42.477 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":3,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:30:37.465785Z","created":"2024-09-12T02:29:06.153104Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-12T02:30:42.478 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 3 2024-09-12T02:30:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a98038e00 msgr2=0x7f4a9803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a98038e00 0x7f4a9803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009100 tx=0x7f4aa8008040 comp rx=0 tx=0).stop 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 msgr2=0x7f4aac197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 0x7f4aac197450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0005ab0 tx=0x7f4aa0032c50 comp rx=0 tx=0).stop 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 shutdown_connections 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a98038e00 0x7f4a9803b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac197990 0x7f4aac19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 --2- 172.21.15.189:0/4021684729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aac1028e0 0x7f4aac197450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 >> 172.21.15.189:0/4021684729 conn(0x7f4aac0fc280 msgr2=0x7f4aac1056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 shutdown_connections 2024-09-12T02:30:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:42.479+0000 7f4ab3767640 1 -- 172.21.15.189:0/4021684729 wait complete. 2024-09-12T02:30:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: mon.a calling monitor election 2024-09-12T02:30:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: mon.c calling monitor election 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/4021684729' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: mon.b calling monitor election 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: monmap epoch 3 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: last_changed 2024-09-12T02:30:37.465785+0000 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: created 2024-09-12T02:29:06.153104+0000 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: min_mon_release 19 (squid) 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: election_strategy: 1 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: fsmap 2024-09-12T02:30:42.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:30:42.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: mgrmap e13: x(active, since 47s) 2024-09-12T02:30:42.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: overall HEALTH_OK 2024-09-12T02:30:42.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: mon.a calling monitor election 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: mon.c calling monitor election 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/4021684729' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: mon.b calling monitor election 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: monmap epoch 3 2024-09-12T02:30:42.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: last_changed 2024-09-12T02:30:37.465785+0000 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: created 2024-09-12T02:29:06.153104+0000 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: min_mon_release 19 (squid) 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: election_strategy: 1 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: fsmap 2024-09-12T02:30:42.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:30:42.875 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: mgrmap e13: x(active, since 47s) 2024-09-12T02:30:42.875 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: overall HEALTH_OK 2024-09-12T02:30:42.875 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.875 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.875 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:42.875 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:43.057 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T02:30:43.057 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T02:30:43.308 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:43.640 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:43.640 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:43.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:43.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.807+0000 7f439619a640 1 -- 172.21.15.100:0/1627414305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4390107690 msgr2=0x7f4390107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.807+0000 7f439619a640 1 --2- 172.21.15.100:0/1627414305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4390107690 0x7f4390107a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4380009880 tx=0x7f438002a670 comp rx=0 tx=0).stop 2024-09-12T02:30:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.807+0000 7f439619a640 1 -- 172.21.15.100:0/1627414305 shutdown_connections 2024-09-12T02:30:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.807+0000 7f439619a640 1 --2- 172.21.15.100:0/1627414305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4390107690 0x7f4390107a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.807+0000 7f439619a640 1 -- 172.21.15.100:0/1627414305 >> 172.21.15.100:0/1627414305 conn(0x7f43900fb920 msgr2=0x7f43900fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.807+0000 7f439619a640 1 -- 172.21.15.100:0/1627414305 shutdown_connections 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.807+0000 7f439619a640 1 -- 172.21.15.100:0/1627414305 wait complete. 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.808+0000 7f439619a640 1 Processor -- start 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.808+0000 7f439619a640 1 -- start start 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.808+0000 7f439619a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4390107690 0x7f4390197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.808+0000 7f439619a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4390197870 0x7f439019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.808+0000 7f439619a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f439019c140 0x7f439019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f439619a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f439010bc80 con 0x7f439019c140 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f439619a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f439010bb00 con 0x7f4390107690 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f439619a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f439010be00 con 0x7f4390197870 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f439019c140 0x7f439019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f439019c140 0x7f439019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37274/0 (socket says 172.21.15.100:37274) 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 -- 172.21.15.100:0/4166657826 learned_addr learned my addr 172.21.15.100:0/4166657826 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438f7fe640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4390107690 0x7f4390197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438effd640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4390197870 0x7f439019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 -- 172.21.15.100:0/4166657826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4390197870 msgr2=0x7f439019bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4390197870 0x7f439019bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 -- 172.21.15.100:0/4166657826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4390107690 msgr2=0x7f4390197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4390107690 0x7f4390197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 -- 172.21.15.100:0/4166657826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901a3eb0 con 0x7f439019c140 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438ffff640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f439019c140 0x7f439019c5f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f438800ba50 tx=0x7f438800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.809+0000 7f438cff9640 1 -- 172.21.15.100:0/4166657826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388019070 con 0x7f439019c140 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.810+0000 7f438cff9640 1 -- 172.21.15.100:0/4166657826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f438800cbe0 con 0x7f439019c140 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.810+0000 7f438cff9640 1 -- 172.21.15.100:0/4166657826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43880076a0 con 0x7f439019c140 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.810+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43901a40e0 con 0x7f439019c140 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.810+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43901a4540 con 0x7f439019c140 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.811+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390107af0 con 0x7f439019c140 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.811+0000 7f438cff9640 1 -- 172.21.15.100:0/4166657826 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f438801c070 con 0x7f439019c140 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.811+0000 7f438cff9640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43780394f0 0x7f437803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.811+0000 7f438cff9640 1 -- 172.21.15.100:0/4166657826 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f438804bb40 con 0x7f439019c140 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.811+0000 7f438f7fe640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43780394f0 0x7f437803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.812+0000 7f438f7fe640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43780394f0 0x7f437803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4380000c00 tx=0x7f4380005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:43.820+0000 7f438cff9640 1 -- 172.21.15.100:0/4166657826 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43880133a0 con 0x7f439019c140 2024-09-12T02:30:43.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:43.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:44.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.016+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f43901a4990 con 0x7f439019c140 2024-09-12T02:30:44.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.017+0000 7f438cff9640 1 -- 172.21.15.100:0/4166657826 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f4388012340 con 0x7f439019c140 2024-09-12T02:30:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:# minimal ceph.conf for a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-12T02:30:44.018 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:30:44.018 INFO:teuthology.orchestra.run.smithi100.stdout: mon_host = [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43780394f0 msgr2=0x7f437803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43780394f0 0x7f437803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4380000c00 tx=0x7f4380005a20 comp rx=0 tx=0).stop 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f439019c140 msgr2=0x7f439019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f439019c140 0x7f439019c5f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f438800ba50 tx=0x7f438800bf10 comp rx=0 tx=0).stop 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 shutdown_connections 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43780394f0 0x7f437803b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f439019c140 0x7f439019c5f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4390197870 0x7f439019bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 --2- 172.21.15.100:0/4166657826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4390107690 0x7f4390197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.019+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 >> 172.21.15.100:0/4166657826 conn(0x7f43900fb920 msgr2=0x7f43900fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.020+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 shutdown_connections 2024-09-12T02:30:44.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:44.020+0000 7f439619a640 1 -- 172.21.15.100:0/4166657826 wait complete. 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4166657826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:44.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.724 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T02:30:44.724 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:30:44.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:30:44.753 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:30:44.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:44.819 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:30:44.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:30:44.847 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:30:44.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:44.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:44.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.909 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4166657826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.910 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:44.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:44.911 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.913 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:30:44.913 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:30:44.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4166657826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:44.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:44.941 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:30:44.941 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:30:45.007 INFO:tasks.cephadm:Adding mgr.x on smithi100 2024-09-12T02:30:45.007 INFO:tasks.cephadm:Adding mgr.y on smithi117 2024-09-12T02:30:45.007 INFO:tasks.cephadm:Adding mgr.z on smithi189 2024-09-12T02:30:45.007 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi100=x;smithi117=y;smithi189=z' 2024-09-12T02:30:45.283 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.707+0000 7fb082468640 1 -- 172.21.15.189:0/767015679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c1005e0 msgr2=0x7fb07c1009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.707+0000 7fb082468640 1 --2- 172.21.15.189:0/767015679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c1005e0 0x7fb07c1009e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009880 tx=0x7fb06c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.707+0000 7fb082468640 1 -- 172.21.15.189:0/767015679 shutdown_connections 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.707+0000 7fb082468640 1 --2- 172.21.15.189:0/767015679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c1005e0 0x7fb07c1009e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.707+0000 7fb082468640 1 -- 172.21.15.189:0/767015679 >> 172.21.15.189:0/767015679 conn(0x7fb07c0fbdb0 msgr2=0x7fb07c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.707+0000 7fb082468640 1 -- 172.21.15.189:0/767015679 shutdown_connections 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.707+0000 7fb082468640 1 -- 172.21.15.189:0/767015679 wait complete. 2024-09-12T02:30:45.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 Processor -- start 2024-09-12T02:30:45.709 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Updating smithi117:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Updating smithi100:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Updating smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: Reconfiguring daemon mon.a on smithi100 2024-09-12T02:30:45.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:45 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:45.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 -- start start 2024-09-12T02:30:45.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb07c1005e0 0x7fb07c197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c197580 0x7fb07c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c197a00 0x7fb07c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1066d0 con 0x7fb07c197580 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c106550 con 0x7fb07c197a00 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb082468640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c106850 con 0x7fb07c1005e0 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb07b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c197580 0x7fb07c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb07c1005e0 0x7fb07c197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.708+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb07c1005e0 0x7fb07c197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:58152/0 (socket says 172.21.15.189:58152) 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c197580 0x7fb07c19c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.189:56688/0 (socket says 172.21.15.189:56688) 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07bfff640 1 -- 172.21.15.189:0/937522631 learned_addr learned my addr 172.21.15.189:0/937522631 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb080a05640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c197a00 0x7fb07c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07b7fe640 1 -- 172.21.15.189:0/937522631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb07c1005e0 msgr2=0x7fb07c197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07b7fe640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb07c1005e0 0x7fb07c197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07b7fe640 1 -- 172.21.15.189:0/937522631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c197a00 msgr2=0x7fb07c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07b7fe640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c197a00 0x7fb07c19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07b7fe640 1 -- 172.21.15.189:0/937522631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c19f440 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb07b7fe640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c197580 0x7fb07c19c5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb06400b450 tx=0x7fb06400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb0797fa640 1 -- 172.21.15.189:0/937522631 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064004230 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb0797fa640 1 -- 172.21.15.189:0/937522631 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0640043d0 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c19f730 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb0797fa640 1 -- 172.21.15.189:0/937522631 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064003cb0 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.709+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c19fd40 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.710+0000 7fb0797fa640 1 -- 172.21.15.189:0/937522631 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb06400f050 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.710+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07c190860 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.710+0000 7fb0797fa640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb0680394f0 0x7fb06803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.711+0000 7fb0797fa640 1 -- 172.21.15.189:0/937522631 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb06404bd20 con 0x7fb07c197580 2024-09-12T02:30:45.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.711+0000 7fb07bfff640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb0680394f0 0x7fb06803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.715 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.711+0000 7fb07bfff640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb0680394f0 0x7fb06803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009230 tx=0x7fb06c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:45.716 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.716+0000 7fb0797fa640 1 -- 172.21.15.189:0/937522631 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb06400d040 con 0x7fb07c197580 2024-09-12T02:30:45.849 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T02:30:45.849 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T02:30:45.849 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T02:30:45.849 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Updating smithi117:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:45.849 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Updating smithi100:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:45.849 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Updating smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:45.850 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:30:45.850 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: Reconfiguring daemon mon.a on smithi100 2024-09-12T02:30:45.850 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:45 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:45.892 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.891+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}) -- 0x7fb07c0626c0 con 0x7fb0680394f0 2024-09-12T02:30:45.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.900+0000 7fb0797fa640 1 -- 172.21.15.189:0/937522631 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb07c0626c0 con 0x7fb0680394f0 2024-09-12T02:30:45.901 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mgr update... 2024-09-12T02:30:45.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb0680394f0 msgr2=0x7fb06803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb0680394f0 0x7fb06803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009230 tx=0x7fb06c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c197580 msgr2=0x7fb07c19c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c197580 0x7fb07c19c5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb06400b450 tx=0x7fb06400b910 comp rx=0 tx=0).stop 2024-09-12T02:30:45.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 shutdown_connections 2024-09-12T02:30:45.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb0680394f0 0x7fb06803b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c197a00 0x7fb07c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.904 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb07c197580 0x7fb07c19c5f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.904 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 --2- 172.21.15.189:0/937522631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb07c1005e0 0x7fb07c197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.904 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 >> 172.21.15.189:0/937522631 conn(0x7fb07c0fbdb0 msgr2=0x7fb07c06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:45.904 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 shutdown_connections 2024-09-12T02:30:45.904 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:30:45.902+0000 7fb082468640 1 -- 172.21.15.189:0/937522631 wait complete. 2024-09-12T02:30:46.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T02:30:46.313 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T02:30:46.313 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T02:30:46.313 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Updating smithi117:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:46.313 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Updating smithi100:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:46.313 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Updating smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:30:46.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:30:46.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: Reconfiguring daemon mon.a on smithi100 2024-09-12T02:30:46.314 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:45 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:46.497 DEBUG:teuthology.orchestra.run.smithi117:mgr.y> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T02:30:46.500 DEBUG:teuthology.orchestra.run.smithi189:mgr.z> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T02:30:46.503 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T02:30:46.503 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:30:46.503 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:30:46.519 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:30:46.520 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 02:30:06.631568976 +0000 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 02:25:43.270661802 +0000 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 02:25:43.270661802 +0000 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 02:25:43.270661802 +0000 2024-09-12T02:30:46.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000196515 s, 2.6 MB/s 2024-09-12T02:30:46.641 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:30:46.697 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 02:30:06.666568072 +0000 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 02:25:43.592653438 +0000 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 02:25:43.592653438 +0000 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 02:25:43.592653438 +0000 2024-09-12T02:30:46.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:30:46.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:46 smithi189 ceph-mon[35196]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:46.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:46.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:46 smithi100 ceph-mon[31390]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:46.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:46.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:46.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:46.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:46.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:46.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000221808 s, 2.3 MB/s 2024-09-12T02:30:46.816 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:30:46.873 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 02:30:06.698567246 +0000 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 02:25:43.920644918 +0000 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 02:25:43.920644918 +0000 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 02:25:43.920644918 +0000 2024-09-12T02:30:46.930 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000183933 s, 2.8 MB/s 2024-09-12T02:30:46.993 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:30:47.050 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-12T02:30:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:46 smithi117 ceph-mon[34898]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:47.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:47.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:47.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:47.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:47.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:47.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 02:30:06.732566368 +0000 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 02:25:44.233636788 +0000 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 02:25:44.233636788 +0000 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 02:25:44.233636788 +0000 2024-09-12T02:30:47.106 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000169083 s, 3.0 MB/s 2024-09-12T02:30:47.170 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:30:47.226 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T02:30:47.226 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:30:47.246 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:30:47.246 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 02:30:36.942888710 +0000 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 02:25:58.501741417 +0000 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 02:25:58.501741417 +0000 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 02:25:58.501741417 +0000 2024-09-12T02:30:47.306 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000261163 s, 2.0 MB/s 2024-09-12T02:30:47.373 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:30:47.430 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 02:30:36.942888710 +0000 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 02:25:58.830734855 +0000 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 02:25:58.830734855 +0000 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 02:25:58.830734855 +0000 2024-09-12T02:30:47.487 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000171419 s, 3.0 MB/s 2024-09-12T02:30:47.553 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:30:47.609 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-12T02:30:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:30:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:47.664 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T02:30:47.664 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:47.664 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:47.665 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 02:30:36.943888690 +0000 2024-09-12T02:30:47.665 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 02:25:59.154728393 +0000 2024-09-12T02:30:47.665 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 02:25:59.154728393 +0000 2024-09-12T02:30:47.665 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 02:25:59.154728393 +0000 2024-09-12T02:30:47.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:30:47.682 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: Saving service mgr spec with placement smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: Reconfiguring daemon mgr.x on smithi100 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:47.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:47 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:47.705 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T02:30:47.705 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T02:30:47.705 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.0001932 s, 2.7 MB/s 2024-09-12T02:30:47.707 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:30:47.763 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-12T02:30:47.819 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 02:30:36.943888690 +0000 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 02:25:59.480721891 +0000 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 02:25:59.480721891 +0000 2024-09-12T02:30:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 02:25:59.480721891 +0000 2024-09-12T02:30:47.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:30:47.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:47.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: Saving service mgr spec with placement smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T02:30:47.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:30:47.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: Reconfiguring daemon mgr.x on smithi100 2024-09-12T02:30:47.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:47.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:47.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:47.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:47.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:47 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:47.883 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T02:30:47.884 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T02:30:47.884 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000177275 s, 2.9 MB/s 2024-09-12T02:30:47.885 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:30:47.941 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T02:30:47.941 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:30:47.961 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:30:47.961 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-12T02:30:48.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: Saving service mgr spec with placement smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: Reconfiguring daemon mgr.x on smithi100 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:48.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:47 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:48.020 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:30:48.020 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:48.020 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:30:48.020 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:48.020 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:48.020 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 02:30:28.029900006 +0000 2024-09-12T02:30:48.021 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 02:25:58.847269787 +0000 2024-09-12T02:30:48.021 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 02:25:58.847269787 +0000 2024-09-12T02:30:48.021 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 02:25:58.847269787 +0000 2024-09-12T02:30:48.021 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:30:48.088 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T02:30:48.088 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T02:30:48.088 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000288256 s, 1.8 MB/s 2024-09-12T02:30:48.089 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:30:48.148 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-12T02:30:48.205 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 02:30:28.029900006 +0000 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 02:25:59.183262892 +0000 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 02:25:59.183262892 +0000 2024-09-12T02:30:48.206 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 02:25:59.183262892 +0000 2024-09-12T02:30:48.206 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:30:48.271 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T02:30:48.271 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T02:30:48.271 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000210459 s, 2.4 MB/s 2024-09-12T02:30:48.273 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:30:48.330 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 02:30:28.029900006 +0000 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 02:25:59.496256469 +0000 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 02:25:59.496256469 +0000 2024-09-12T02:30:48.387 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 02:25:59.496256469 +0000 2024-09-12T02:30:48.388 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:30:48.452 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T02:30:48.452 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T02:30:48.452 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000172996 s, 3.0 MB/s 2024-09-12T02:30:48.453 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:30:48.510 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-12T02:30:48.566 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:30:48.566 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:30:48.566 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T02:30:48.566 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:48.566 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:30:48.566 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 02:30:28.030899986 +0000 2024-09-12T02:30:48.566 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 02:25:59.822249779 +0000 2024-09-12T02:30:48.567 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 02:25:59.822249779 +0000 2024-09-12T02:30:48.567 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 02:25:59.822249779 +0000 2024-09-12T02:30:48.567 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:30:48.630 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T02:30:48.630 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T02:30:48.630 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000209861 s, 2.4 MB/s 2024-09-12T02:30:48.631 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:30:48.686 INFO:tasks.cephadm:Deploying osd.0 on smithi100 with /dev/vg_nvme/lv_4... 2024-09-12T02:30:48.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:30:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:48 smithi189 ceph-mon[35196]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:30:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:48 smithi189 ceph-mon[35196]: Reconfiguring daemon mon.b on smithi117 2024-09-12T02:30:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:48 smithi189 ceph-mon[35196]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:48.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:48 smithi100 ceph-mon[31390]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:30:48.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:48 smithi100 ceph-mon[31390]: Reconfiguring daemon mon.b on smithi117 2024-09-12T02:30:48.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:48 smithi100 ceph-mon[31390]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:48.932 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:48 smithi117 ceph-mon[34898]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:30:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:48 smithi117 ceph-mon[34898]: Reconfiguring daemon mon.b on smithi117 2024-09-12T02:30:49.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:48 smithi117 ceph-mon[34898]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:49.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:49.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:49.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:49 smithi189 ceph-mon[35196]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:30:49.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:49.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:49.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:49.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:49 smithi189 ceph-mon[35196]: Reconfiguring daemon mon.c on smithi189 2024-09-12T02:30:50.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:50.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:50.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:49 smithi100 ceph-mon[31390]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:30:50.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:50.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:50.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:50.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:49 smithi100 ceph-mon[31390]: Reconfiguring daemon mon.c on smithi189 2024-09-12T02:30:50.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:50.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:50.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:49 smithi117 ceph-mon[34898]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:30:50.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:30:50.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:30:50.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:50.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:49 smithi117 ceph-mon[34898]: Reconfiguring daemon mon.c on smithi189 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:50.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:30:51.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-09-12T02:30:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:51.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:51 smithi100 ceph-mon[31390]: Deploying daemon mgr.z on smithi189 2024-09-12T02:30:51.961 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:51 smithi189 ceph-mon[35196]: Deploying daemon mgr.z on smithi189 2024-09-12T02:30:51.961 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:51 smithi189 systemd[1]: Starting Ceph mgr.z for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:30:52.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:51 smithi117 ceph-mon[34898]: Deploying daemon mgr.z on smithi189 2024-09-12T02:30:52.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 -- 172.21.15.100:0/1536007946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 msgr2=0x7fa22c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 --2- 172.21.15.100:0/1536007946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c102000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009ca0 tx=0x7fa21c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 -- 172.21.15.100:0/1536007946 shutdown_connections 2024-09-12T02:30:52.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 --2- 172.21.15.100:0/1536007946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa22c1037c0 0x7fa22c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 --2- 172.21.15.100:0/1536007946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22c102e00 0x7fa22c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 --2- 172.21.15.100:0/1536007946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c102000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 -- 172.21.15.100:0/1536007946 >> 172.21.15.100:0/1536007946 conn(0x7fa22c0fd390 msgr2=0x7fa22c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 -- 172.21.15.100:0/1536007946 shutdown_connections 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.122+0000 7fa23210f640 1 -- 172.21.15.100:0/1536007946 wait complete. 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.123+0000 7fa23210f640 1 Processor -- start 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.123+0000 7fa23210f640 1 -- start start 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.123+0000 7fa23210f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.123+0000 7fa23210f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22c102e00 0x7fa22c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.123+0000 7fa23210f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa22c1037c0 0x7fa22c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa23210f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c10d8e0 con 0x7fa22c101c00 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa23210f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c10d760 con 0x7fa22c102e00 2024-09-12T02:30:52.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa23210f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c10da60 con 0x7fa22c1037c0 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35416/0 (socket says 172.21.15.100:35416) 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 -- 172.21.15.100:0/3526649075 learned_addr learned my addr 172.21.15.100:0/3526649075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22bfff640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa22c1037c0 0x7fa22c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22affd640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22c102e00 0x7fa22c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 -- 172.21.15.100:0/3526649075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa22c1037c0 msgr2=0x7fa22c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa22c1037c0 0x7fa22c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 -- 172.21.15.100:0/3526649075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22c102e00 msgr2=0x7fa22c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22c102e00 0x7fa22c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 -- 172.21.15.100:0/3526649075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c19fb90 con 0x7fa22c101c00 2024-09-12T02:30:52.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa22b7fe640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c197f60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa21c004af0 tx=0x7fa21c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c02fb60 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c19fe20 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa21c02fd00 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c046920 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.124+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c1a0300 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.125+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fa21c046ac0 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.125+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22c109070 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.125+0000 7fa228ff9640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa2140392c0 0x7fa21403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.125+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa21c06dc30 con 0x7fa22c101c00 2024-09-12T02:30:52.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.126+0000 7fa22affd640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa2140392c0 0x7fa21403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.126+0000 7fa22affd640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa2140392c0 0x7fa21403b780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa22c199480 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.130+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa21c042290 con 0x7fa22c101c00 2024-09-12T02:30:52.255 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:51 smithi189 podman[36875]: 2024-09-12 02:30:51.960563144 +0000 UTC m=+0.113521729 container create 4b00d1651fc960f5781c9f8f46164aaa8b8a65adb2daec5e14070bc17ed1f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:30:52.255 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:51 smithi189 podman[36875]: 2024-09-12 02:30:51.863267172 +0000 UTC m=+0.016225771 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:30:52.255 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 podman[36875]: 2024-09-12 02:30:52.179981995 +0000 UTC m=+0.332940581 container init 4b00d1651fc960f5781c9f8f46164aaa8b8a65adb2daec5e14070bc17ed1f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T02:30:52.255 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 podman[36875]: 2024-09-12 02:30:52.182840942 +0000 UTC m=+0.335799537 container start 4b00d1651fc960f5781c9f8f46164aaa8b8a65adb2daec5e14070bc17ed1f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:30:52.255 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mgr[36894]: -- 172.21.15.189:0/1824435340 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bef026b0e0 con 0x55bef0249400 2024-09-12T02:30:52.255 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 bash[36875]: 4b00d1651fc960f5781c9f8f46164aaa8b8a65adb2daec5e14070bc17ed1f7b4 2024-09-12T02:30:52.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:52.306+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa22c062630 con 0x7fa2140392c0 2024-09-12T02:30:52.513 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 systemd[1]: Started Ceph mgr.z for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:30:52.514 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:52.308+0000 7f3db9b4c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:30:52.514 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:52.368+0000 7f3db9b4c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:30:52.871 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:52.517+0000 7f3db9b4c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:30:52.871 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:52.583+0000 7f3db9b4c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:30:52.871 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:52.730+0000 7f3db9b4c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:30:52.871 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:52.870+0000 7f3db9b4c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:30:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:30:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:52 smithi189 ceph-mon[35196]: Deploying daemon mgr.y on smithi117 2024-09-12T02:30:52.938 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:52.938 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:52.938 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:52.938 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:52.938 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:52.938 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.938 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:52.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:30:52.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:52.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:52.939 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:52 smithi117 ceph-mon[34898]: Deploying daemon mgr.y on smithi117 2024-09-12T02:30:52.968 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:52.968 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:52.968 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:52.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:52 smithi100 ceph-mon[31390]: Deploying daemon mgr.y on smithi117 2024-09-12T02:30:53.513 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:53.182+0000 7f3db9b4c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:30:53.514 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:53.242+0000 7f3db9b4c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:30:53.514 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:53.425+0000 7f3db9b4c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:30:53.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:53 smithi117 ceph-mon[34898]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:54.000 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:53 smithi100 ceph-mon[31390]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:54.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:53 smithi189 ceph-mon[35196]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:54.093 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:53 smithi117 systemd[1]: Starting Ceph mgr.y for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:30:54.454 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 podman[36244]: 2024-09-12 02:30:54.102718549 +0000 UTC m=+0.016137727 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:30:54.454 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 podman[36244]: 2024-09-12 02:30:54.209910015 +0000 UTC m=+0.123329194 container create b77a863990c8bcc7db5486ef4bf81260f1aad9395a471d92db1e487b7f504ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T02:30:54.454 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 podman[36244]: 2024-09-12 02:30:54.454022071 +0000 UTC m=+0.367441249 container init b77a863990c8bcc7db5486ef4bf81260f1aad9395a471d92db1e487b7f504ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:30:54.763 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:54.302+0000 7f3db9b4c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:30:54.763 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:54.369+0000 7f3db9b4c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:30:54.796 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 podman[36244]: 2024-09-12 02:30:54.456933281 +0000 UTC m=+0.370352472 container start b77a863990c8bcc7db5486ef4bf81260f1aad9395a471d92db1e487b7f504ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:30:54.796 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 ceph-mgr[36263]: -- 172.21.15.117:0/3205532717 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55db380450e0 con 0x55db38023400 2024-09-12T02:30:54.796 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:54.575+0000 7ff0042a4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:30:54.796 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 bash[36244]: b77a863990c8bcc7db5486ef4bf81260f1aad9395a471d92db1e487b7f504ff3 2024-09-12T02:30:54.796 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 systemd[1]: Started Ceph mgr.y for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:30:54.796 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:54.640+0000 7ff0042a4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:30:54.796 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:54.795+0000 7ff0042a4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:30:55.093 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:54.864+0000 7ff0042a4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:30:55.093 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:55.016+0000 7ff0042a4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:30:55.392 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.123+0000 7f3db9b4c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:30:55.393 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.244+0000 7f3db9b4c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:30:55.506 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:55.177+0000 7ff0042a4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:30:55.506 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:55.505+0000 7ff0042a4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:30:55.654 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.391+0000 7f3db9b4c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:30:55.654 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.459+0000 7f3db9b4c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:30:55.654 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.614+0000 7f3db9b4c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:30:55.762 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:55.566+0000 7ff0042a4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1224171116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "061ede74-c965-4987-8ac2-94b01404f060"}]: dispatch 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1224171116' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "061ede74-c965-4987-8ac2-94b01404f060"}]': finished 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3336758051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:55.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.684+0000 7f3db9b4c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.748+0000 7f3db9b4c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.923+0000 7f3db9b4c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1224171116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "061ede74-c965-4987-8ac2-94b01404f060"}]: dispatch 2024-09-12T02:30:55.925 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1224171116' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "061ede74-c965-4987-8ac2-94b01404f060"}]': finished 2024-09-12T02:30:55.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:30:55.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:30:55.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3336758051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:55.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:56.093 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:55.761+0000 7ff0042a4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:30:56.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:56.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:56.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1224171116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "061ede74-c965-4987-8ac2-94b01404f060"}]: dispatch 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1224171116' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "061ede74-c965-4987-8ac2-94b01404f060"}]': finished 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3336758051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:56.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:56.204 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:55.992+0000 7f3db9b4c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:30:56.204 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:56.061+0000 7f3db9b4c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:30:56.204 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:56.144+0000 7f3db9b4c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:30:56.204 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:56.203+0000 7f3db9b4c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:30:56.513 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:56.262+0000 7f3db9b4c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:30:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.093 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:56.652+0000 7ff0042a4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:56.719+0000 7ff0042a4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:57.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:57.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:57.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:57.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:30:57.513 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:30:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z[36890]: 2024-09-12T02:30:57.049+0000 7f3db9b4c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:30:57.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:57.660+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7fa21c030c30 con 0x7fa22c101c00 2024-09-12T02:30:57.691 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-mon[34898]: Standby manager daemon z started 2024-09-12T02:30:57.692 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:30:57.692 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:30:57.692 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:30:57.692 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:30:57.692 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:57.432+0000 7ff0042a4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:30:57.692 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:57.547+0000 7ff0042a4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:30:57.692 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:57.691+0000 7ff0042a4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:30:57.968 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:57.752+0000 7ff0042a4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:30:57.968 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:57.900+0000 7ff0042a4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:30:57.968 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:57.967+0000 7ff0042a4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:30:58.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:57 smithi189 ceph-mon[35196]: Standby manager daemon z started 2024-09-12T02:30:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:57 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:30:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:57 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:30:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:57 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:30:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:57 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:30:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:57 smithi100 ceph-mon[31390]: Standby manager daemon z started 2024-09-12T02:30:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:57 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:30:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:57 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:30:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:57 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:30:58.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:57 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.189:0/2944356984' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:30:58.249 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:58.027+0000 7ff0042a4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:30:58.250 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:58.185+0000 7ff0042a4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:30:58.250 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:58.249+0000 7ff0042a4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:30:58.515 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:58.315+0000 7ff0042a4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:30:58.515 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:58.396+0000 7ff0042a4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:30:58.515 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:58.455+0000 7ff0042a4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:30:58.515 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:58.514+0000 7ff0042a4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:30:58.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-mon[34898]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:58.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-mon[34898]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T02:30:58.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:30:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:58 smithi189 ceph-mon[35196]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:59.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:58 smithi189 ceph-mon[35196]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T02:30:59.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:30:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:58 smithi100 ceph-mon[31390]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:30:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:58 smithi100 ceph-mon[31390]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T02:30:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:30:59.593 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:30:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y[36259]: 2024-09-12T02:30:59.298+0000 7ff0042a4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:30:59.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:30:59.665+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7fa21c001250 con 0x7fa22c101c00 2024-09-12T02:30:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:59 smithi100 ceph-mon[31390]: Standby manager daemon y started 2024-09-12T02:30:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:59 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:30:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:59 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:30:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:59 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:30:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:59 smithi100 ceph-mon[31390]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:30:59.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:30:59 smithi100 ceph-mon[31390]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:59 smithi189 ceph-mon[35196]: Standby manager daemon y started 2024-09-12T02:31:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:59 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:31:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:59 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:31:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:59 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:31:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:59 smithi189 ceph-mon[35196]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:31:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:30:59 smithi189 ceph-mon[35196]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:59 smithi117 ceph-mon[34898]: Standby manager daemon y started 2024-09-12T02:31:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:59 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:31:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:59 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:31:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:59 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:31:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:59 smithi117 ceph-mon[34898]: from='mgr.? 172.21.15.117:0/629449189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:31:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:30:59 smithi117 ceph-mon[34898]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:00 smithi100 ceph-mon[31390]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-12T02:31:00.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:31:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:00 smithi189 ceph-mon[35196]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-12T02:31:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:31:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:00 smithi117 ceph-mon[34898]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-12T02:31:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:31:01.780 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:01 smithi100 ceph-mon[31390]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:01 smithi189 ceph-mon[35196]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:02.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:01 smithi117 ceph-mon[34898]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:31:03.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:03.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:31:03.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:31:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:04.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:03 smithi100 ceph-mon[31390]: Deploying daemon osd.0 on smithi100 2024-09-12T02:31:04.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:03 smithi100 ceph-mon[31390]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:03 smithi117 ceph-mon[34898]: Deploying daemon osd.0 on smithi100 2024-09-12T02:31:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:03 smithi117 ceph-mon[34898]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:04.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:03 smithi189 ceph-mon[35196]: Deploying daemon osd.0 on smithi100 2024-09-12T02:31:04.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:03 smithi189 ceph-mon[35196]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:06.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:06 smithi189 ceph-mon[35196]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:06.796 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:06 smithi117 ceph-mon[34898]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:06.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:06 smithi100 ceph-mon[31390]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:08.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:08 smithi189 ceph-mon[35196]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:08.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:08 smithi100 ceph-mon[31390]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:08 smithi117 ceph-mon[34898]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:09.710 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:09.710 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:09.710 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:09.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:09.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:09.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:10.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:10.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:10.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:10.761 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:10 smithi100 ceph-mon[31390]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:10.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:10 smithi117 ceph-mon[34898]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:10 smithi189 ceph-mon[35196]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:12.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:12 smithi189 ceph-mon[35196]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:12.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:12.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:12.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:12 smithi117 ceph-mon[34898]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:12.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:12.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:12.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:12 smithi100 ceph-mon[31390]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:13.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.224+0000 7fa228ff9640 1 -- 172.21.15.100:0/3526649075 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa22c062630 con 0x7fa2140392c0 2024-09-12T02:31:13.226 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 0 on host 'smithi100' 2024-09-12T02:31:13.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa2140392c0 msgr2=0x7fa21403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa2140392c0 0x7fa21403b780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa22c199480 tx=0x7fa220008040 comp rx=0 tx=0).stop 2024-09-12T02:31:13.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 msgr2=0x7fa22c197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c197f60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa21c004af0 tx=0x7fa21c031ee0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 shutdown_connections 2024-09-12T02:31:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa2140392c0 0x7fa21403b780 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa22c1037c0 0x7fa22c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22c102e00 0x7fa22c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 --2- 172.21.15.100:0/3526649075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c101c00 0x7fa22c197f60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 >> 172.21.15.100:0/3526649075 conn(0x7fa22c0fd390 msgr2=0x7fa22c106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 shutdown_connections 2024-09-12T02:31:13.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:31:13.226+0000 7fa23210f640 1 -- 172.21.15.100:0/3526649075 wait complete. 2024-09-12T02:31:13.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:13.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:13.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:13.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:13.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:13.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:13.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:13.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:13.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:13.929 DEBUG:teuthology.orchestra.run.smithi100:osd.0> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T02:31:13.931 INFO:tasks.cephadm:Deploying osd.1 on smithi117 with /dev/vg_nvme/lv_4... 2024-09-12T02:31:13.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:31:14.184 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:31:14.472 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:14 smithi100 ceph-mon[31390]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:14.582 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:14 smithi117 ceph-mon[34898]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:14.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:14 smithi189 ceph-mon[35196]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:15.371 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:31:15 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0[45347]: 2024-09-12T02:31:15.074+0000 7ff7f420d640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:31:15.511 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:15 smithi117 ceph-mon[34898]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:31:15.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:15 smithi189 ceph-mon[35196]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:31:15.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:15 smithi100 ceph-mon[31390]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:31:16.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:16 smithi117 ceph-mon[34898]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:31:16.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:16 smithi117 ceph-mon[34898]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:31:16.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:16 smithi117 ceph-mon[34898]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:31:16.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:16 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:16.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:16 smithi117 ceph-mon[34898]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:16.604 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:31:16.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_4 2024-09-12T02:31:16.706 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:31:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0[45347]: 2024-09-12T02:31:16.428+0000 7ff7f0190640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:31:16.706 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:31:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0[45347]: 2024-09-12T02:31:16.431+0000 7ff7ebfb8640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:31:16.707 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:16 smithi100 ceph-mon[31390]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:31:16.707 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:16 smithi100 ceph-mon[31390]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:31:16.707 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:16 smithi100 ceph-mon[31390]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:31:16.707 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:16 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:16.707 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:16 smithi100 ceph-mon[31390]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:16.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:16 smithi189 ceph-mon[35196]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:31:16.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:16 smithi189 ceph-mon[35196]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:31:16.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:16 smithi189 ceph-mon[35196]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:31:16.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:16 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:16.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:16 smithi189 ceph-mon[35196]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:31:16.873 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:31:17.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 -- 172.21.15.117:0/3270005532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 msgr2=0x7f02c8100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:17.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/3270005532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c8100f10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009900 tx=0x7f02b802a410 comp rx=0 tx=0).stop 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 -- 172.21.15.117:0/3270005532 shutdown_connections 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/3270005532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c81026d0 0x7f02c8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/3270005532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101d10 0x7f02c8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/3270005532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c8100f10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 -- 172.21.15.117:0/3270005532 >> 172.21.15.117:0/3270005532 conn(0x7f02c80fc2a0 msgr2=0x7f02c80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 -- 172.21.15.117:0/3270005532 shutdown_connections 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.278+0000 7f02ce2e2640 1 -- 172.21.15.117:0/3270005532 wait complete. 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 Processor -- start 2024-09-12T02:31:17.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 -- start start 2024-09-12T02:31:17.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c810ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:17.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101d10 0x7f02c810b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:17.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c81026d0 0x7f02c810ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:17.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02c810d900 con 0x7f02c81026d0 2024-09-12T02:31:17.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f02c810d780 con 0x7f02c8100b10 2024-09-12T02:31:17.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02ce2e2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02c810da80 con 0x7f02c8101d10 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02c7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c810ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.279+0000 7f02c7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c810ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34706/0 (socket says 172.21.15.117:34706) 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c7fff640 1 -- 172.21.15.117:0/738761908 learned_addr learned my addr 172.21.15.117:0/738761908 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02cc87f640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c81026d0 0x7f02c810ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c77fe640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101d10 0x7f02c810b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c7fff640 1 -- 172.21.15.117:0/738761908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101d10 msgr2=0x7f02c810b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c7fff640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101d10 0x7f02c810b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c7fff640 1 -- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c81026d0 msgr2=0x7f02c810ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c7fff640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c81026d0 0x7f02c810ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c7fff640 1 -- 172.21.15.117:0/738761908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c810c2d0 con 0x7f02c8100b10 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02cc87f640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c81026d0 0x7f02c810ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c7fff640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c810ce80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02b8031440 tx=0x7f02b8032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:17.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c57fa640 1 -- 172.21.15.117:0/738761908 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b803f030 con 0x7f02c8100b10 2024-09-12T02:31:17.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c57fa640 1 -- 172.21.15.117:0/738761908 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b8003ce0 con 0x7f02c8100b10 2024-09-12T02:31:17.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c81a1f90 con 0x7f02c8100b10 2024-09-12T02:31:17.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02c57fa640 1 -- 172.21.15.117:0/738761908 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8035070 con 0x7f02c8100b10 2024-09-12T02:31:17.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.280+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c81a2330 con 0x7f02c8100b10 2024-09-12T02:31:17.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.281+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c8107ee0 con 0x7f02c8100b10 2024-09-12T02:31:17.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.282+0000 7f02c57fa640 1 -- 172.21.15.117:0/738761908 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f02b8042030 con 0x7f02c8100b10 2024-09-12T02:31:17.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.283+0000 7f02c57fa640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2af0 0x7f02b00a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:17.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.283+0000 7f02c57fa640 1 -- 172.21.15.117:0/738761908 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f02b80ed9c0 con 0x7f02c8100b10 2024-09-12T02:31:17.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.283+0000 7f02c77fe640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2af0 0x7f02b00a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:17.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.284+0000 7f02c77fe640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2af0 0x7f02b00a4fb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f02c810cc00 tx=0x7f02bc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:17.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.287+0000 7f02c57fa640 1 -- 172.21.15.117:0/738761908 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02b80bc4b0 con 0x7f02c8100b10 2024-09-12T02:31:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:17.463+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f02c8062630 con 0x7f02b00a2af0 2024-09-12T02:31:17.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:17.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:17.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:31:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:31:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:17.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:17.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:17.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:17.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:17.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi100 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] boot 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:18.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:18.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:18.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:31:18.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:31:18.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi100 2024-09-12T02:31:18.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T02:31:18.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] boot 2024-09-12T02:31:18.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:31:18.810 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:18.811 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:18.811 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:18.811 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:18.811 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:18.811 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:18.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi100 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: osd.0 [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] boot 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:18.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:18.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:18.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:19.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:19 smithi189 ceph-mon[35196]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:31:19.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:19 smithi117 ceph-mon[34898]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:31:19.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:19 smithi100 ceph-mon[31390]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:31:20.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:20 smithi117 ceph-mon[34898]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:20.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:20 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/3189074894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]: dispatch 2024-09-12T02:31:20.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:20 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]: dispatch 2024-09-12T02:31:20.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:20 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]': finished 2024-09-12T02:31:20.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:20 smithi117 ceph-mon[34898]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:31:20.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:20 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:20.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:20 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/1681772777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:20.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:20 smithi189 ceph-mon[35196]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:20.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:20 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/3189074894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]: dispatch 2024-09-12T02:31:20.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:20 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]: dispatch 2024-09-12T02:31:20.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:20 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]': finished 2024-09-12T02:31:20.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:20 smithi189 ceph-mon[35196]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:31:20.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:20 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:20.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:20 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/1681772777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:20.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:20 smithi100 ceph-mon[31390]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:20.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:20 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/3189074894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]: dispatch 2024-09-12T02:31:20.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:20 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]: dispatch 2024-09-12T02:31:20.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:20 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efb6f9f2-be2b-4368-baa2-38e7cc3e27f3"}]': finished 2024-09-12T02:31:20.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:20 smithi100 ceph-mon[31390]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:31:20.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:20.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:20 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/1681772777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:22.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:22 smithi189 ceph-mon[35196]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:22.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:22 smithi117 ceph-mon[34898]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:22 smithi100 ceph-mon[31390]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:24.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:24 smithi117 ceph-mon[34898]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:24.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:24 smithi100 ceph-mon[31390]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:24 smithi189 ceph-mon[35196]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:26.556 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:26 smithi117 ceph-mon[34898]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:26 smithi100 ceph-mon[31390]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:26 smithi189 ceph-mon[35196]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:28 smithi117 ceph-mon[34898]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:31:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:28.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:28 smithi100 ceph-mon[31390]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:28.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:31:28.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:28 smithi189 ceph-mon[35196]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:31:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:29.612 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:29 smithi117 ceph-mon[34898]: Deploying daemon osd.1 on smithi117 2024-09-12T02:31:29.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:29 smithi100 ceph-mon[31390]: Deploying daemon osd.1 on smithi117 2024-09-12T02:31:30.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:29 smithi189 ceph-mon[35196]: Deploying daemon osd.1 on smithi117 2024-09-12T02:31:30.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:30 smithi117 ceph-mon[34898]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:30 smithi100 ceph-mon[31390]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:30 smithi189 ceph-mon[35196]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:32.789 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:32 smithi117 ceph-mon[34898]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:32 smithi100 ceph-mon[31390]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:32 smithi189 ceph-mon[35196]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:34.687 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:34 smithi117 ceph-mon[34898]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:34.687 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:34.687 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:34.687 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:34.816 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:34 smithi189 ceph-mon[35196]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:34.816 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:34.816 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:34.816 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:34 smithi100 ceph-mon[31390]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:34.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:34.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:34.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:36.628 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:36 smithi117 ceph-mon[34898]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:36.628 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:36 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:36.628 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:36 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:36 smithi100 ceph-mon[31390]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:36 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:36 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:36 smithi189 ceph-mon[35196]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:36 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:36 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:37.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:37.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:37.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:37.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:37.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:37.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:38.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:38.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:38.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.197+0000 7f02c57fa640 1 -- 172.21.15.117:0/738761908 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f02c8062630 con 0x7f02b00a2af0 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 1 on host 'smithi117' 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.199+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2af0 msgr2=0x7f02b00a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.199+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2af0 0x7f02b00a4fb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f02c810cc00 tx=0x7f02bc00a2d0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.199+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 msgr2=0x7f02c810ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.199+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c810ce80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02b8031440 tx=0x7f02b8032ce0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 shutdown_connections 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2af0 0x7f02b00a4fb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c81026d0 0x7f02c810ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101d10 0x7f02c810b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 --2- 172.21.15.117:0/738761908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8100b10 0x7f02c810ce80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 >> 172.21.15.117:0/738761908 conn(0x7f02c80fc2a0 msgr2=0x7f02c81050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 shutdown_connections 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:31:38.200+0000 7f02ce2e2640 1 -- 172.21.15.117:0/738761908 wait complete. 2024-09-12T02:31:38.821 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:38 smithi117 ceph-mon[34898]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:38.822 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:38 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:38.822 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:38 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:38.822 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:38 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:38.848 DEBUG:teuthology.orchestra.run.smithi117:osd.1> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T02:31:38.850 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-12T02:31:38.850 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:31:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:38 smithi100 ceph-mon[31390]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:38 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:38 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:38 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:38.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:38 smithi189 ceph-mon[35196]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:38.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:38 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:38.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:38 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:38.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:38 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:39.105 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:31:40.042 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:31:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1[39231]: 2024-09-12T02:31:39.734+0000 7f1187aea640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:31:40.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:40 smithi117 ceph-mon[34898]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:40.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:40 smithi117 ceph-mon[34898]: from='osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:31:40.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:40 smithi117 ceph-mon[34898]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:31:40.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:40 smithi189 ceph-mon[35196]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:40.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:40 smithi189 ceph-mon[35196]: from='osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:31:40.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:40 smithi189 ceph-mon[35196]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:31:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:40 smithi100 ceph-mon[31390]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:40 smithi100 ceph-mon[31390]: from='osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:31:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:40 smithi100 ceph-mon[31390]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:31:41.530 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:31:41.557 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-12T02:31:41.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:31:41.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: from='osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:31:41.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:31:41.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:41.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:31:41.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:31:41.831 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:31:41.831 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:41 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: from='osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:31:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:41.844 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1[39231]: 2024-09-12T02:31:41.548+0000 7f1183a6d640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:31:41.844 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:31:41 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1[39231]: 2024-09-12T02:31:41.558+0000 7f117f895640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:31:41.848 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:31:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:31:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: from='osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:31:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:31:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:31:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:31:41.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:31:41.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:41 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:42.263 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/132307429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf98104f90 msgr2=0x7fcf98107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/132307429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf98104f90 0x7fcf98107380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009900 tx=0x7fcf8002a410 comp rx=0 tx=0).stop 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/132307429 shutdown_connections 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/132307429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf981078c0 0x7fcf98109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/132307429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf98104f90 0x7fcf98107380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/132307429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf98102660 0x7fcf98104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/132307429 >> 172.21.15.189:0/132307429 conn(0x7fcf980fc280 msgr2=0x7fcf980fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/132307429 shutdown_connections 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.258+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/132307429 wait complete. 2024-09-12T02:31:42.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 Processor -- start 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 -- start start 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf98102660 0x7fcf98101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf98104f90 0x7fcf98100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf981078c0 0x7fcf98100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810d930 con 0x7fcf98104f90 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810d7b0 con 0x7fcf98102660 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf9ddd3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810dab0 con 0x7fcf981078c0 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf981078c0 0x7fcf98100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf981078c0 0x7fcf98100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:52274/0 (socket says 172.21.15.189:52274) 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 -- 172.21.15.189:0/2383200798 learned_addr learned my addr 172.21.15.189:0/2383200798 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf8ffff640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf98104f90 0x7fcf98100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf977fe640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf98102660 0x7fcf98101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.265 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 -- 172.21.15.189:0/2383200798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf98102660 msgr2=0x7fcf98101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf98102660 0x7fcf98101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 -- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf98104f90 msgr2=0x7fcf98100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf98104f90 0x7fcf98100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.259+0000 7fcf97fff640 1 -- 172.21.15.189:0/2383200798 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf98101410 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.260+0000 7fcf97fff640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf981078c0 0x7fcf98100b50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000b970 tx=0x7fcf9000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.260+0000 7fcf957fa640 1 -- 172.21.15.189:0/2383200798 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90019070 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.260+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf981a2210 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.260+0000 7fcf957fa640 1 -- 172.21.15.189:0/2383200798 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf9000cb40 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.260+0000 7fcf957fa640 1 -- 172.21.15.189:0/2383200798 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90007650 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.260+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf981a27a0 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.261+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf980fdd70 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.263+0000 7fcf957fa640 1 -- 172.21.15.189:0/2383200798 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7fcf9001c070 con 0x7fcf981078c0 2024-09-12T02:31:42.266 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.263+0000 7fcf957fa640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf840a2af0 0x7fcf840a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.267 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.264+0000 7fcf957fa640 1 -- 172.21.15.189:0/2383200798 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fcf900cd1b0 con 0x7fcf981078c0 2024-09-12T02:31:42.267 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.264+0000 7fcf977fe640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf840a2af0 0x7fcf840a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.267 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.264+0000 7fcf977fe640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf840a2af0 0x7fcf840a4fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009890 tx=0x7fcf88008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.267 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.267+0000 7fcf957fa640 1 -- 172.21.15.189:0/2383200798 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf9009ba80 con 0x7fcf981078c0 2024-09-12T02:31:42.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:31:42.444+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcf98062630 con 0x7fcf840a2af0 2024-09-12T02:31:42.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi117 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi117 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:42.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:42.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi117 2024-09-12T02:31:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:43.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:43 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:31:43.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:43 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:31:43.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:43 smithi117 ceph-mon[34898]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:43.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:43 smithi117 ceph-mon[34898]: osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] boot 2024-09-12T02:31:43.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:43 smithi117 ceph-mon[34898]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:31:43.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:43 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:31:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:43 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:31:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:43 smithi100 ceph-mon[31390]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:43 smithi100 ceph-mon[31390]: osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] boot 2024-09-12T02:31:43.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:43 smithi100 ceph-mon[31390]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:31:43.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:43.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:43 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:31:43.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:43 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:31:43.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:43 smithi189 ceph-mon[35196]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:43.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:43 smithi189 ceph-mon[35196]: osd.1 [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] boot 2024-09-12T02:31:43.942 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:43 smithi189 ceph-mon[35196]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:31:43.942 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:31:44.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:44 smithi117 ceph-mon[34898]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:44 smithi117 ceph-mon[34898]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:31:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:44 smithi100 ceph-mon[31390]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:44 smithi100 ceph-mon[31390]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:31:44.976 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:44 smithi189 ceph-mon[35196]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:31:44.976 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:44 smithi189 ceph-mon[35196]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:31:45.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:45 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/875398494' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]: dispatch 2024-09-12T02:31:45.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:45 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]: dispatch 2024-09-12T02:31:45.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:45 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]': finished 2024-09-12T02:31:45.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:45 smithi117 ceph-mon[34898]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:31:45.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:45 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:31:45.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:45 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/3608854536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:45.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:45 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/875398494' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]: dispatch 2024-09-12T02:31:45.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:45 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]: dispatch 2024-09-12T02:31:45.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:45 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]': finished 2024-09-12T02:31:45.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:45 smithi100 ceph-mon[31390]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:31:45.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:45 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:31:45.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:45 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/3608854536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:46.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:45 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/875398494' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]: dispatch 2024-09-12T02:31:46.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:45 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]: dispatch 2024-09-12T02:31:46.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:45 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489afc2d-f3a0-4497-b48d-f055beda717b"}]': finished 2024-09-12T02:31:46.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:45 smithi189 ceph-mon[35196]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:31:46.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:45 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:31:46.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:45 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/3608854536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:46.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:46 smithi117 ceph-mon[34898]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:46.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:46 smithi100 ceph-mon[31390]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:46 smithi189 ceph-mon[35196]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:48.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:48 smithi117 ceph-mon[34898]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:48.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:48 smithi100 ceph-mon[31390]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:48 smithi189 ceph-mon[35196]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:50.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:50 smithi189 ceph-mon[35196]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:50.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:50 smithi117 ceph-mon[34898]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:50 smithi100 ceph-mon[31390]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:52.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:52 smithi189 ceph-mon[35196]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:52.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:31:52.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:52.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:52 smithi117 ceph-mon[34898]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:52.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:31:52.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:52 smithi100 ceph-mon[31390]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:31:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:53.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:53 smithi117 ceph-mon[34898]: Deploying daemon osd.2 on smithi189 2024-09-12T02:31:53.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:53 smithi189 ceph-mon[35196]: Deploying daemon osd.2 on smithi189 2024-09-12T02:31:53.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:53 smithi100 ceph-mon[31390]: Deploying daemon osd.2 on smithi189 2024-09-12T02:31:54.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:54 smithi117 ceph-mon[34898]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:54 smithi100 ceph-mon[31390]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:54 smithi189 ceph-mon[35196]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:56.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:56 smithi117 ceph-mon[34898]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:56 smithi100 ceph-mon[31390]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:56 smithi189 ceph-mon[35196]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:58 smithi100 ceph-mon[31390]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:58 smithi189 ceph-mon[35196]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:58 smithi117 ceph-mon[34898]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:31:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:31:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:31:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:31:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:31:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:00.858 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:00 smithi189 ceph-mon[35196]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:00 smithi100 ceph-mon[31390]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:00 smithi117 ceph-mon[34898]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:02.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:02.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:01 smithi189 ceph-mon[35196]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:02.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:01 smithi117 ceph-mon[34898]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:02.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:02.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:02.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:02.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:01 smithi100 ceph-mon[31390]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:03.079 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.078+0000 7fcf957fa640 1 -- 172.21.15.189:0/2383200798 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf98062630 con 0x7fcf840a2af0 2024-09-12T02:32:03.080 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf840a2af0 msgr2=0x7fcf840a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf840a2af0 0x7fcf840a4fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009890 tx=0x7fcf88008040 comp rx=0 tx=0).stop 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf981078c0 msgr2=0x7fcf98100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf981078c0 0x7fcf98100b50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000b970 tx=0x7fcf9000be30 comp rx=0 tx=0).stop 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 shutdown_connections 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf840a2af0 0x7fcf840a4fb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf981078c0 0x7fcf98100b50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf98104f90 0x7fcf98100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.082 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 --2- 172.21.15.189:0/2383200798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf98102660 0x7fcf98101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.083 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 >> 172.21.15.189:0/2383200798 conn(0x7fcf980fc280 msgr2=0x7fcf981030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:03.083 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 shutdown_connections 2024-09-12T02:32:03.083 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:03.081+0000 7fcf9ddd3640 1 -- 172.21.15.189:0/2383200798 wait complete. 2024-09-12T02:32:03.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:03.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:03.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:03.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:03.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:03.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:03.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:03.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:03.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:03.757 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T02:32:03.759 INFO:tasks.cephadm:Deploying osd.3 on smithi100 with /dev/vg_nvme/lv_3... 2024-09-12T02:32:03.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:32:04.010 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:04.405 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:04 smithi100 ceph-mon[31390]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:04.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:04 smithi189 ceph-mon[35196]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:04.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:04 smithi117 ceph-mon[34898]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:05.127 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:04 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2[40043]: 2024-09-12T02:32:04.843+0000 7fb7a2427640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:32:05.385 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:05 smithi100 ceph-mon[31390]: from='osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:32:05.385 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:05 smithi100 ceph-mon[31390]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:32:05.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:05 smithi189 ceph-mon[35196]: from='osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:32:05.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:05 smithi189 ceph-mon[35196]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:32:05.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:05 smithi117 ceph-mon[34898]: from='osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:32:05.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:05 smithi117 ceph-mon[34898]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:32:06.257 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-mon[35196]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:32:06.257 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-mon[35196]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:32:06.257 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:06.257 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-mon[35196]: from='osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:32:06.257 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-mon[35196]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:32:06.257 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-mon[35196]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:06.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:06 smithi100 ceph-mon[31390]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:32:06.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:06 smithi100 ceph-mon[31390]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:32:06.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:06.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:06 smithi100 ceph-mon[31390]: from='osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:32:06.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:06 smithi100 ceph-mon[31390]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:32:06.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:06 smithi100 ceph-mon[31390]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:06.495 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:06 smithi117 ceph-mon[34898]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:32:06.495 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:06 smithi117 ceph-mon[34898]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:32:06.495 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:06.495 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:06 smithi117 ceph-mon[34898]: from='osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:32:06.495 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:06 smithi117 ceph-mon[34898]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:32:06.495 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:06 smithi117 ceph-mon[34898]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:06.712 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:32:06.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-09-12T02:32:06.984 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:07.013 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2[40043]: 2024-09-12T02:32:06.549+0000 7fb79e3aa640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:32:07.014 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2[40043]: 2024-09-12T02:32:06.552+0000 7fb7961ca640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:32:07.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:32:07.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:32:07.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='osd.2 ' entity='osd.2' 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi189 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:07.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='osd.2 ' entity='osd.2' 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi189 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:07.515 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:07.515 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 -- 172.21.15.100:0/1279688720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0101d10 msgr2=0x7f4bc0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/1279688720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0101d10 0x7f4bc0102190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009900 tx=0x7f4bb002a410 comp rx=0 tx=0).stop 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 -- 172.21.15.100:0/1279688720 shutdown_connections 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/1279688720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc01026d0 0x7f4bc0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/1279688720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0101d10 0x7f4bc0102190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/1279688720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc0100b10 0x7f4bc0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 -- 172.21.15.100:0/1279688720 >> 172.21.15.100:0/1279688720 conn(0x7f4bc00fc2a0 msgr2=0x7f4bc00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 -- 172.21.15.100:0/1279688720 shutdown_connections 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.507+0000 7f4bc4b06640 1 -- 172.21.15.100:0/1279688720 wait complete. 2024-09-12T02:32:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 Processor -- start 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 -- start start 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc0100b10 0x7f4bc0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc0101d10 0x7f4bc01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc01026d0 0x7f4bc019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc010c770 con 0x7f4bc01026d0 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc010c5f0 con 0x7f4bc0101d10 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bc4b06640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc010c8f0 con 0x7f4bc0100b10 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bbed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc01026d0 0x7f4bc019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bbed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc01026d0 0x7f4bc019f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35104/0 (socket says 172.21.15.100:35104) 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bbed9d640 1 -- 172.21.15.100:0/2257687639 learned_addr learned my addr 172.21.15.100:0/2257687639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bbdd9b640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc0101d10 0x7f4bc01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.508+0000 7f4bbe59c640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc0100b10 0x7f4bc0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bbed9d640 1 -- 172.21.15.100:0/2257687639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc0100b10 msgr2=0x7f4bc0197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bbed9d640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc0100b10 0x7f4bc0197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bbed9d640 1 -- 172.21.15.100:0/2257687639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc0101d10 msgr2=0x7f4bc01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bbed9d640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc0101d10 0x7f4bc01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bbed9d640 1 -- 172.21.15.100:0/2257687639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc019fa90 con 0x7f4bc01026d0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bbe59c640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc0100b10 0x7f4bc0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bbed9d640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc01026d0 0x7f4bc019f420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800eb10 tx=0x7f4bb800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8004b20 con 0x7f4bc01026d0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bb8004cc0 con 0x7f4bc01026d0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc019fd80 con 0x7f4bc01026d0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8010760 con 0x7f4bc01026d0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.509+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc01a01e0 con 0x7f4bc01026d0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.510+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc01a0470 con 0x7f4bc01026d0 2024-09-12T02:32:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.511+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f4bb8010900 con 0x7f4bc01026d0 2024-09-12T02:32:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.512+0000 7f4bb77fe640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4bac0a2b20 0x7f4bac0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.512+0000 7f4bbe59c640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4bac0a2b20 0x7f4bac0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.512+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f4bb80ce0c0 con 0x7f4bc01026d0 2024-09-12T02:32:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.512+0000 7f4bbe59c640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4bac0a2b20 0x7f4bac0a4fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0101b70 tx=0x7f4ba8005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.515+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bb80541b0 con 0x7f4bc01026d0 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='osd.2 ' entity='osd.2' 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi189 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:07.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:07.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:07.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:07.692+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4bc01a0640 con 0x7f4bac0a2b20 2024-09-12T02:32:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:32:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:32:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:08.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] boot 2024-09-12T02:32:08.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:32:08.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:08.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:08.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:08.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] boot 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:08.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:08.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:32:08.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:32:08.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:08.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:32:08.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: osd.2 [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] boot 2024-09-12T02:32:08.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:32:08.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:32:08.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:08.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:08.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:10.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:09 smithi189 ceph-mon[35196]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:10.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:09 smithi189 ceph-mon[35196]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:32:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:09 smithi117 ceph-mon[34898]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:09 smithi117 ceph-mon[34898]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:32:10.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:09 smithi100 ceph-mon[31390]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:10.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:09 smithi100 ceph-mon[31390]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:32:10.621 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49765]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:32:10.621 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49765]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:10.621 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:10.621 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49765]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:11.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3035427303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23f116e6-4bfa-46b5-a1a6-96f999ad3e62"}]: dispatch 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3035427303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23f116e6-4bfa-46b5-a1a6-96f999ad3e62"}]': finished 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/990192995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:11.017 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:11.094 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:10 smithi117 sudo[43478]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:32:11.094 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:10 smithi117 sudo[43478]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:11.094 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:10 smithi117 sudo[43478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:11.094 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:10 smithi117 sudo[43478]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:32:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:32:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:32:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:32:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3035427303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23f116e6-4bfa-46b5-a1a6-96f999ad3e62"}]: dispatch 2024-09-12T02:32:11.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:32:11.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3035427303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23f116e6-4bfa-46b5-a1a6-96f999ad3e62"}]': finished 2024-09-12T02:32:11.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:32:11.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:11.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/990192995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:11.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:11.121 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49776]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:32:11.121 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49776]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:11.121 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:11.122 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:32:10 smithi100 sudo[49776]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3035427303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23f116e6-4bfa-46b5-a1a6-96f999ad3e62"}]: dispatch 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3035427303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23f116e6-4bfa-46b5-a1a6-96f999ad3e62"}]': finished 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:32:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:11.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/990192995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:11.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:11.593 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:11 smithi117 sudo[43481]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:32:11.593 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:11 smithi117 sudo[43481]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:11.594 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:11 smithi117 sudo[43481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:11.594 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:32:11 smithi117 sudo[43481]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:11.748 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44117]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:32:11.748 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44117]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:11.748 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:11.748 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44117]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:12.013 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44120]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:32:12.013 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44120]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:12.013 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:12.014 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:32:11 smithi189 sudo[44120]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:12.276 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50187]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:32:12.276 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50187]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:12.276 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:12.276 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50187]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:12.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:12.294+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4bb80986e0 con 0x7f4bc01026d0 2024-09-12T02:32:12.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 ceph-mon[35196]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:32:12.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:12.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:12.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 ceph-mon[35196]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:12.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:12.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 ceph-mon[35196]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:12.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 ceph-mon[35196]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:12.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44123]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:32:12.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:12.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:12.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44123]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:12.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:12 smithi117 ceph-mon[34898]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:32:12.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:12.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:12.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:12 smithi117 ceph-mon[34898]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:12.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:12.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:12 smithi117 ceph-mon[34898]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:12.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:12 smithi117 ceph-mon[34898]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:12.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50191]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:32:12.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50191]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:12.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:12.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 sudo[50191]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:12.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 ceph-mon[31390]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:32:12.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:12.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:12.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 ceph-mon[31390]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:12.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:12.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 ceph-mon[31390]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:12.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:12 smithi100 ceph-mon[31390]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44126]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:32:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:13.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:13.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:12 smithi189 sudo[44126]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:13.275 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43484]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:32:13.276 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43484]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:13.276 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:13.276 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43484]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.542 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.543 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.543 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:13 smithi100 ceph-mon[31390]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:13.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43487]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:32:13.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43487]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:32:13.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:32:13.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 sudo[43487]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:32:13.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:13.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:13.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:13 smithi117 ceph-mon[34898]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:32:13.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:32:13.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:32:13.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:32:13.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:13 smithi189 ceph-mon[35196]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:32:14.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:14 smithi117 ceph-mon[34898]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:14.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:14 smithi100 ceph-mon[31390]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:14.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:14 smithi189 ceph-mon[35196]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:16.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:16 smithi189 ceph-mon[35196]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:16.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:16 smithi117 ceph-mon[34898]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:16 smithi100 ceph-mon[31390]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:18.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:18 smithi117 ceph-mon[34898]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:18.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:18 smithi100 ceph-mon[31390]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:18 smithi189 ceph-mon[35196]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:19.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:19 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:32:19.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:19 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:19.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:19 smithi117 ceph-mon[34898]: Deploying daemon osd.3 on smithi100 2024-09-12T02:32:19.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:32:19.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:19.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:19 smithi100 ceph-mon[31390]: Deploying daemon osd.3 on smithi100 2024-09-12T02:32:20.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:19 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:32:20.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:19 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:20.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:19 smithi189 ceph-mon[35196]: Deploying daemon osd.3 on smithi100 2024-09-12T02:32:20.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:20 smithi117 ceph-mon[34898]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:20.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:20 smithi100 ceph-mon[31390]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:20 smithi189 ceph-mon[35196]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:22.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:22 smithi100 ceph-mon[31390]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:22.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:22 smithi117 ceph-mon[34898]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:23.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:22 smithi189 ceph-mon[35196]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:24.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:24 smithi100 ceph-mon[31390]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:24.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:24 smithi117 ceph-mon[34898]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:24 smithi189 ceph-mon[35196]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:25.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:25 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:25.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:25 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:25.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:25 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:25.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:25 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:25.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:25 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:25.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:25 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:26.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:25 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:26.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:25 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:26.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:25 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:26.760 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:26 smithi100 ceph-mon[31390]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:26.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:26 smithi117 ceph-mon[34898]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:26 smithi189 ceph-mon[35196]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.460+0000 7f4bb77fe640 1 -- 172.21.15.100:0/2257687639 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4bc01a0640 con 0x7f4bac0a2b20 2024-09-12T02:32:28.461 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 3 on host 'smithi100' 2024-09-12T02:32:28.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4bac0a2b20 msgr2=0x7f4bac0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4bac0a2b20 0x7f4bac0a4fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0101b70 tx=0x7f4ba8005db0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc01026d0 msgr2=0x7f4bc019f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc01026d0 0x7f4bc019f420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800eb10 tx=0x7f4bb800c2d0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 shutdown_connections 2024-09-12T02:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4bac0a2b20 0x7f4bac0a4fe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc01026d0 0x7f4bc019f420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc0101d10 0x7f4bc01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 --2- 172.21.15.100:0/2257687639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc0100b10 0x7f4bc0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 >> 172.21.15.100:0/2257687639 conn(0x7f4bc00fc2a0 msgr2=0x7f4bc006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 shutdown_connections 2024-09-12T02:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:32:28.463+0000 7f4bc4b06640 1 -- 172.21.15.100:0/2257687639 wait complete. 2024-09-12T02:32:28.785 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:28 smithi100 ceph-mon[31390]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:28.785 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:28.785 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:28.785 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:28.786 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:28.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:28 smithi117 ceph-mon[34898]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:28.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:28 smithi189 ceph-mon[35196]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:29.147 DEBUG:teuthology.orchestra.run.smithi100:osd.3> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T02:32:29.149 INFO:tasks.cephadm:Deploying osd.4 on smithi117 with /dev/vg_nvme/lv_3... 2024-09-12T02:32:29.149 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:32:29.407 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:32:30.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:30 smithi117 ceph-mon[34898]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:30 smithi100 ceph-mon[31390]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:30 smithi189 ceph-mon[35196]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:31.157 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:32:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:32:30.957+0000 7fb3d8cb5640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:32:31.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:31 smithi117 ceph-mon[34898]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:32:31.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:31 smithi100 ceph-mon[31390]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:32:32.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:31 smithi189 ceph-mon[35196]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:32:32.028 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:32:32.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_3 2024-09-12T02:32:32.302 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:32:32.712 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:32 smithi117 ceph-mon[34898]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:32.712 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:32 smithi117 ceph-mon[34898]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:32:32.712 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:32 smithi117 ceph-mon[34898]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:32:32.712 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:32 smithi117 ceph-mon[34898]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:32:32.712 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:32 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 -- 172.21.15.117:0/2522503524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101e50 msgr2=0x7fd5f01086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/2522503524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101e50 0x7fd5f01086e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009ca0 tx=0x7fd5e802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 -- 172.21.15.117:0/2522503524 shutdown_connections 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/2522503524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101e50 0x7fd5f01086e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/2522503524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5f0101490 0x7fd5f0101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/2522503524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5f0100290 0x7fd5f0100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 -- 172.21.15.117:0/2522503524 >> 172.21.15.117:0/2522503524 conn(0x7fd5f00fba40 msgr2=0x7fd5f00fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 -- 172.21.15.117:0/2522503524 shutdown_connections 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 -- 172.21.15.117:0/2522503524 wait complete. 2024-09-12T02:32:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.796+0000 7fd5f57c7640 1 Processor -- start 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5f57c7640 1 -- start start 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5f57c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5f0100290 0x7fd5f0197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5f57c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101490 0x7fd5f0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5f57c7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5f0101e50 0x7fd5f019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5f57c7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f010d8f0 con 0x7fd5f0100290 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5f57c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f010d770 con 0x7fd5f0101490 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5f57c7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f010da70 con 0x7fd5f0101e50 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101490 0x7fd5f0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101490 0x7fd5f0198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:56938/0 (socket says 172.21.15.117:56938) 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 -- 172.21.15.117:0/3079649416 learned_addr learned my addr 172.21.15.117:0/3079649416 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T02:32:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5eeffd640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5f0100290 0x7fd5f0197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ef7fe640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5f0101e50 0x7fd5f019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 -- 172.21.15.117:0/3079649416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5f0101e50 msgr2=0x7fd5f019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5f0101e50 0x7fd5f019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 -- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5f0100290 msgr2=0x7fd5f0197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5f0100290 0x7fd5f0197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5ee7fc640 1 -- 172.21.15.117:0/3079649416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f019fb60 con 0x7fd5f0101490 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.797+0000 7fd5eeffd640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5f0100290 0x7fd5f0197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.798+0000 7fd5ee7fc640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101490 0x7fd5f0198470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800d770 tx=0x7fd5d800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.798+0000 7fd5e7fff640 1 -- 172.21.15.117:0/3079649416 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8017070 con 0x7fd5f0101490 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.798+0000 7fd5e7fff640 1 -- 172.21.15.117:0/3079649416 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5d8005500 con 0x7fd5f0101490 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.798+0000 7fd5e7fff640 1 -- 172.21.15.117:0/3079649416 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8004e00 con 0x7fd5f0101490 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.798+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f019fe50 con 0x7fd5f0101490 2024-09-12T02:32:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.798+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f01a02b0 con 0x7fd5f0101490 2024-09-12T02:32:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.799+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f0107690 con 0x7fd5f0101490 2024-09-12T02:32:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.800+0000 7fd5e7fff640 1 -- 172.21.15.117:0/3079649416 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd5d8004fa0 con 0x7fd5f0101490 2024-09-12T02:32:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.800+0000 7fd5e7fff640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd5dc0a2bb0 0x7fd5dc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.800+0000 7fd5e7fff640 1 -- 172.21.15.117:0/3079649416 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7fd5d80cd620 con 0x7fd5f0101490 2024-09-12T02:32:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.801+0000 7fd5eeffd640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd5dc0a2bb0 0x7fd5dc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.801+0000 7fd5eeffd640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd5dc0a2bb0 0x7fd5dc0a5070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5f01012f0 tx=0x7fd5e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.805+0000 7fd5e7fff640 1 -- 172.21.15.117:0/3079649416 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5d809b270 con 0x7fd5f0101490 2024-09-12T02:32:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:32 smithi100 ceph-mon[31390]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:32 smithi100 ceph-mon[31390]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:32:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:32 smithi100 ceph-mon[31390]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:32:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:32 smithi100 ceph-mon[31390]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:32:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:32 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:32.871 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:32:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:32:32.555+0000 7fb3d4c38640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:32:32.872 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:32:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:32:32.564+0000 7fb3d0a60640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:32:32.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:32.979+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd5f0062630 con 0x7fd5dc0a2bb0 2024-09-12T02:32:33.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:32 smithi189 ceph-mon[35196]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:33.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:32 smithi189 ceph-mon[35196]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:32:33.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:32 smithi189 ceph-mon[35196]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:32:33.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:32 smithi189 ceph-mon[35196]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:32:33.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:32 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi100 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:33.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] boot 2024-09-12T02:32:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:32:33.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:33 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi100 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:33.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] boot 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:32:33.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:33 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi100 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: osd.3 [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] boot 2024-09-12T02:32:34.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:32:34.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:33 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:32:34.753 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:34 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:32:34.754 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:34 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:32:34.754 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:34 smithi117 ceph-mon[34898]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:34.754 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:34 smithi117 ceph-mon[34898]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:34.754 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:34 smithi117 ceph-mon[34898]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:32:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:34 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:32:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:34 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:32:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:34 smithi100 ceph-mon[31390]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:34 smithi100 ceph-mon[31390]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:34.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:34 smithi100 ceph-mon[31390]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:32:34.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:34 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:32:34.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:34 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:32:34.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:34 smithi189 ceph-mon[35196]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:34.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:34 smithi189 ceph-mon[35196]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:32:34.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:34 smithi189 ceph-mon[35196]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:32:35.561 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:35 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/1376801181' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]: dispatch 2024-09-12T02:32:35.561 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:35 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]: dispatch 2024-09-12T02:32:35.561 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:35 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]': finished 2024-09-12T02:32:35.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:35 smithi117 ceph-mon[34898]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:32:35.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:35 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/1376801181' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]: dispatch 2024-09-12T02:32:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:35 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]: dispatch 2024-09-12T02:32:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:35 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]': finished 2024-09-12T02:32:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:35 smithi100 ceph-mon[31390]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:32:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:35 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/1376801181' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]: dispatch 2024-09-12T02:32:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:35 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]: dispatch 2024-09-12T02:32:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:35 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3e44e9c-ef09-4279-b36c-21c6221798e0"}]': finished 2024-09-12T02:32:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:35 smithi189 ceph-mon[35196]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:32:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:36.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:36 smithi117 ceph-mon[34898]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:36.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:36 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/2807331407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:36.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:36 smithi117 ceph-mon[34898]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:32:36.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:36 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:36 smithi100 ceph-mon[31390]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:36 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/2807331407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:36 smithi100 ceph-mon[31390]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:32:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:36 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:36 smithi189 ceph-mon[35196]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:36 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/2807331407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:36 smithi189 ceph-mon[35196]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:32:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:36 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:38.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:38 smithi189 ceph-mon[35196]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:32:38.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:38 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:38.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:38 smithi189 ceph-mon[35196]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:38.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:38 smithi117 ceph-mon[34898]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:32:38.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:38 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:38.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:38 smithi117 ceph-mon[34898]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:38 smithi100 ceph-mon[31390]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:32:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:38 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:38 smithi100 ceph-mon[31390]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:40.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:40 smithi117 ceph-mon[34898]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-12T02:32:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:40 smithi100 ceph-mon[31390]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-12T02:32:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:40 smithi189 ceph-mon[35196]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-12T02:32:42.839 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:42 smithi117 ceph-mon[34898]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:32:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:42 smithi100 ceph-mon[31390]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:32:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:42 smithi189 ceph-mon[35196]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:32:43.795 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:32:43.795 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:43.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:32:43.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:44.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:32:44.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:44 smithi117 ceph-mon[34898]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:32:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:44 smithi117 ceph-mon[34898]: Deploying daemon osd.4 on smithi117 2024-09-12T02:32:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:44 smithi100 ceph-mon[31390]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:32:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:44 smithi100 ceph-mon[31390]: Deploying daemon osd.4 on smithi117 2024-09-12T02:32:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:44 smithi189 ceph-mon[35196]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:32:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:44 smithi189 ceph-mon[35196]: Deploying daemon osd.4 on smithi117 2024-09-12T02:32:46.840 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:46 smithi117 ceph-mon[34898]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-12T02:32:46.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:46 smithi100 ceph-mon[31390]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-12T02:32:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:46 smithi189 ceph-mon[35196]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-12T02:32:48.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:48 smithi117 ceph-mon[34898]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:32:48.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:48 smithi100 ceph-mon[31390]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:32:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:48 smithi189 ceph-mon[35196]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:32:50.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:50 smithi117 ceph-mon[34898]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:32:50.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:50.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:50.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:50 smithi100 ceph-mon[31390]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:32:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:50 smithi189 ceph-mon[35196]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:32:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:52.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:52 smithi117 ceph-mon[34898]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:52.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:52.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:52 smithi100 ceph-mon[31390]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:52 smithi189 ceph-mon[35196]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:53.773 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:53 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:53.773 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:53 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:53.773 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:53 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.813+0000 7fd5e7fff640 1 -- 172.21.15.117:0/3079649416 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd5f0062630 con 0x7fd5dc0a2bb0 2024-09-12T02:32:53.813 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 4 on host 'smithi117' 2024-09-12T02:32:53.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd5dc0a2bb0 msgr2=0x7fd5dc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:53.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd5dc0a2bb0 0x7fd5dc0a5070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5f01012f0 tx=0x7fd5e0005f90 comp rx=0 tx=0).stop 2024-09-12T02:32:53.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101490 msgr2=0x7fd5f0198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101490 0x7fd5f0198470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800d770 tx=0x7fd5d800dc30 comp rx=0 tx=0).stop 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 shutdown_connections 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd5dc0a2bb0 0x7fd5dc0a5070 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5f0101e50 0x7fd5f019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f0101490 0x7fd5f0198470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 --2- 172.21.15.117:0/3079649416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5f0100290 0x7fd5f0197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 >> 172.21.15.117:0/3079649416 conn(0x7fd5f00fba40 msgr2=0x7fd5f0104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 shutdown_connections 2024-09-12T02:32:53.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:32:53.815+0000 7fd5f57c7640 1 -- 172.21.15.117:0/3079649416 wait complete. 2024-09-12T02:32:53.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:53 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:53.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:53 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:53.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:53 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:54.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:53 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:54.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:53 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:54.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:53 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:54.436 DEBUG:teuthology.orchestra.run.smithi117:osd.4> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T02:32:54.438 INFO:tasks.cephadm:Deploying osd.5 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-12T02:32:54.438 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:32:54.660 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:54 smithi117 ceph-mon[34898]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:54.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:54 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:54.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:54 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:54.661 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:54 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:54.693 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:32:54.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:54 smithi189 ceph-mon[35196]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:54.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:54 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:54.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:54 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:54.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:54 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:54 smithi100 ceph-mon[31390]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:54 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:54 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:54 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:55.973 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:32:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:32:55.672+0000 7fa0e7f50640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:32:56.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:56 smithi189 ceph-mon[35196]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:56.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:56 smithi189 ceph-mon[35196]: from='osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:32:56.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:56 smithi189 ceph-mon[35196]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:32:56.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:56 smithi117 ceph-mon[34898]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:56.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:56 smithi117 ceph-mon[34898]: from='osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:32:56.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:56 smithi117 ceph-mon[34898]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:32:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:56 smithi100 ceph-mon[31390]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:56 smithi100 ceph-mon[31390]: from='osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:32:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:56 smithi100 ceph-mon[31390]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:32:57.121 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:32:57.146 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-12T02:32:57.399 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:32:57.656 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:32:57.656 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:32:57.656 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:32:57.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:57 smithi189 ceph-mon[35196]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:32:57.843 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:32:57.562+0000 7fa0e3ed3640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:32:57.844 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:32:57.567+0000 7fa0dfcfb640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:57.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:57.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:57.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:32:57.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:57 smithi117 ceph-mon[34898]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:32:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:32:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:32:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:32:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:32:57.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:57 smithi100 ceph-mon[31390]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:32:57.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 -- 172.21.15.189:0/167008922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 msgr2=0x7f2f70100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:57.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 --2- 172.21.15.189:0/167008922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f70100ed0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009900 tx=0x7f2f6002a410 comp rx=0 tx=0).stop 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 -- 172.21.15.189:0/167008922 shutdown_connections 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 --2- 172.21.15.189:0/167008922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70102690 0x7f2f70108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 --2- 172.21.15.189:0/167008922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f70101cd0 0x7f2f70102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 --2- 172.21.15.189:0/167008922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f70100ed0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 -- 172.21.15.189:0/167008922 >> 172.21.15.189:0/167008922 conn(0x7f2f700fc280 msgr2=0x7f2f700fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 -- 172.21.15.189:0/167008922 shutdown_connections 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.855+0000 7f2f748a0640 1 -- 172.21.15.189:0/167008922 wait complete. 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 Processor -- start 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 -- start start 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f7006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70101cd0 0x7f2f7019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:57.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f70102690 0x7f2f7019f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7010c750 con 0x7f2f70101cd0 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7010c5d0 con 0x7f2f70102690 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f748a0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7010c8d0 con 0x7f2f70100ad0 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.856+0000 7f2f6e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f7006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f7006ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:51562/0 (socket says 172.21.15.189:51562) 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 -- 172.21.15.189:0/152794251 learned_addr learned my addr 172.21.15.189:0/152794251 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6ed9d640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f70102690 0x7f2f7019f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6dd9b640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70101cd0 0x7f2f7019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 -- 172.21.15.189:0/152794251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f70102690 msgr2=0x7f2f7019f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f70102690 0x7f2f7019f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 -- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70101cd0 msgr2=0x7f2f7019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:57.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70101cd0 0x7f2f7019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 -- 172.21.15.189:0/152794251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7019fb40 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f6e59c640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f7006ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2f60031610 tx=0x7f2f600043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f5f7fe640 1 -- 172.21.15.189:0/152794251 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6003f030 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f5f7fe640 1 -- 172.21.15.189:0/152794251 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f60003ce0 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7019fdd0 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f5f7fe640 1 -- 172.21.15.189:0/152794251 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60035070 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.857+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f701a01f0 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.858+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f70107f70 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.860+0000 7f2f5f7fe640 1 -- 172.21.15.189:0/152794251 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2f60042030 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.860+0000 7f2f5f7fe640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f580a2b80 0x7f2f580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.860+0000 7f2f5f7fe640 1 -- 172.21.15.189:0/152794251 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f2f600ee6c0 con 0x7f2f70100ad0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.860+0000 7f2f6dd9b640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f580a2b80 0x7f2f580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:57.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.861+0000 7f2f6dd9b640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f580a2b80 0x7f2f580a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f64005fd0 tx=0x7f2f64005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:57.883 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:57.864+0000 7f2f5f7fe640 1 -- 172.21.15.189:0/152794251 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f600bc7b0 con 0x7f2f70100ad0 2024-09-12T02:32:58.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:32:58.042+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2f70062630 con 0x7f2f580a2b80 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi117 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:58.725 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi117 2024-09-12T02:32:58.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-12T02:32:58.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:58.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:58.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:58.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:58.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi117 2024-09-12T02:32:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-12T02:32:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:32:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:58.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:58.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:59.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:59 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:32:59.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:59 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:32:59.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:59 smithi189 ceph-mon[35196]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:59.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:59 smithi189 ceph-mon[35196]: osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] boot 2024-09-12T02:32:59.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:59 smithi189 ceph-mon[35196]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T02:32:59.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:32:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:59.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:59 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:32:59.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:59 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:32:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:59 smithi117 ceph-mon[34898]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:59 smithi117 ceph-mon[34898]: osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] boot 2024-09-12T02:32:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:59 smithi117 ceph-mon[34898]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T02:32:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:32:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:32:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:59 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:32:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:59 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:32:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:59 smithi100 ceph-mon[31390]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:59 smithi100 ceph-mon[31390]: osd.4 [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] boot 2024-09-12T02:32:59.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:59 smithi100 ceph-mon[31390]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T02:32:59.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:32:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:33:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:00 smithi117 ceph-mon[34898]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:33:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:00 smithi117 ceph-mon[34898]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:33:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:00 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/1728273179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]: dispatch 2024-09-12T02:33:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:00 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]: dispatch 2024-09-12T02:33:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:00 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]': finished 2024-09-12T02:33:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:00 smithi117 ceph-mon[34898]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:33:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:00 smithi100 ceph-mon[31390]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:33:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:00 smithi100 ceph-mon[31390]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:33:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:00 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/1728273179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]: dispatch 2024-09-12T02:33:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:00 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]: dispatch 2024-09-12T02:33:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:00 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]': finished 2024-09-12T02:33:00.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:00 smithi100 ceph-mon[31390]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:33:00.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:00 smithi189 ceph-mon[35196]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:33:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:00 smithi189 ceph-mon[35196]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:33:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:00 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/1728273179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]: dispatch 2024-09-12T02:33:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:00 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]: dispatch 2024-09-12T02:33:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:00 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c5fd350-58ff-4c17-a016-49d7b9dca138"}]': finished 2024-09-12T02:33:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:00 smithi189 ceph-mon[35196]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:33:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:01.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:01 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/1553805588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:01.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:01 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/1553805588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:01 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/1553805588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:02.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:02 smithi117 ceph-mon[34898]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:02.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:02 smithi100 ceph-mon[31390]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:02 smithi189 ceph-mon[35196]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:04.842 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:04 smithi189 ceph-mon[35196]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:04.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:04 smithi100 ceph-mon[31390]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:04 smithi117 ceph-mon[34898]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:06.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:06 smithi189 ceph-mon[35196]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:06.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:06 smithi100 ceph-mon[31390]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:06.896 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:06 smithi117 ceph-mon[34898]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:08.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:08 smithi189 ceph-mon[35196]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:08.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:33:08.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:08 smithi100 ceph-mon[31390]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:33:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:08 smithi117 ceph-mon[34898]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:33:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:09 smithi100 ceph-mon[31390]: Deploying daemon osd.5 on smithi189 2024-09-12T02:33:09.964 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:09 smithi189 ceph-mon[35196]: Deploying daemon osd.5 on smithi189 2024-09-12T02:33:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:09 smithi117 ceph-mon[34898]: Deploying daemon osd.5 on smithi189 2024-09-12T02:33:10.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:10 smithi100 ceph-mon[31390]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:10.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:10 smithi189 ceph-mon[35196]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:10 smithi117 ceph-mon[34898]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:12 smithi100 ceph-mon[31390]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:12 smithi189 ceph-mon[35196]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:12 smithi117 ceph-mon[34898]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:14.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:14 smithi100 ceph-mon[31390]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:14 smithi189 ceph-mon[35196]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:14 smithi117 ceph-mon[34898]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:15.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:15 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:15.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:15 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:15.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:15 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:16.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:15 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:15 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:15 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:16.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:15 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:16.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:15 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:15 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:16 smithi100 ceph-mon[31390]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:16.900 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:16 smithi189 ceph-mon[35196]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:16 smithi117 ceph-mon[34898]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:19.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:18 smithi189 ceph-mon[35196]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:19.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:19.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.062+0000 7f2f5f7fe640 1 -- 172.21.15.189:0/152794251 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2f70062630 con 0x7f2f580a2b80 2024-09-12T02:33:19.063 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 5 on host 'smithi189' 2024-09-12T02:33:19.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f580a2b80 msgr2=0x7f2f580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f580a2b80 0x7f2f580a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f64005fd0 tx=0x7f2f64005850 comp rx=0 tx=0).stop 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 msgr2=0x7f2f7006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f7006ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2f60031610 tx=0x7f2f600043b0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 shutdown_connections 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f580a2b80 0x7f2f580a5040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f70102690 0x7f2f7019f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70101cd0 0x7f2f7019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 --2- 172.21.15.189:0/152794251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f70100ad0 0x7f2f7006ab10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 >> 172.21.15.189:0/152794251 conn(0x7f2f700fc280 msgr2=0x7f2f70105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 shutdown_connections 2024-09-12T02:33:19.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:33:19.065+0000 7f2f748a0640 1 -- 172.21.15.189:0/152794251 wait complete. 2024-09-12T02:33:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:18 smithi117 ceph-mon[34898]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:19.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:18 smithi100 ceph-mon[31390]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:19.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:19 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:19.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:19 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:19 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:19.717 DEBUG:teuthology.orchestra.run.smithi189:osd.5> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T02:33:19.719 INFO:tasks.cephadm:Deploying osd.6 on smithi100 with /dev/vg_nvme/lv_2... 2024-09-12T02:33:19.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:33:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:19 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:19 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:19 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:20.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:20.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:19 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:20.908 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:20 smithi189 ceph-mon[35196]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:20 smithi117 ceph-mon[34898]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:20 smithi100 ceph-mon[31390]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:21.168 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:33:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:33:20.944+0000 7efd54569640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:33:21.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:21 smithi100 ceph-mon[31390]: from='osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:33:21.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:21 smithi100 ceph-mon[31390]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:33:21.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:21 smithi189 ceph-mon[35196]: from='osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:33:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:21 smithi189 ceph-mon[35196]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:33:22.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:21 smithi117 ceph-mon[34898]: from='osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:33:22.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:21 smithi117 ceph-mon[34898]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:33:22.543 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:33:22.570 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-09-12T02:33:22.821 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:22 smithi100 ceph-mon[31390]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:22.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:22 smithi100 ceph-mon[31390]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:33:22.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:22 smithi100 ceph-mon[31390]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:33:22.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:22 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:22.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:22 smithi100 ceph-mon[31390]: from='osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:33:22.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:22 smithi100 ceph-mon[31390]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:33:23.013 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:33:22.641+0000 7efd504ec640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:33:23.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:33:22.648+0000 7efd4c314640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:23.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-mon[35196]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:23.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-mon[35196]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:33:23.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-mon[35196]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:33:23.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:23.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-mon[35196]: from='osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:33:23.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:22 smithi189 ceph-mon[35196]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:33:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:22 smithi117 ceph-mon[34898]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:22 smithi117 ceph-mon[34898]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:33:23.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:22 smithi117 ceph-mon[34898]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:33:23.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:22 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:23.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:22 smithi117 ceph-mon[34898]: from='osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:33:23.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:22 smithi117 ceph-mon[34898]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:33:23.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 -- 172.21.15.100:0/750194528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890101cd0 msgr2=0x7f3890102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 --2- 172.21.15.100:0/750194528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890101cd0 0x7f3890102150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3884009900 tx=0x7f388402a410 comp rx=0 tx=0).stop 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 -- 172.21.15.100:0/750194528 shutdown_connections 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 --2- 172.21.15.100:0/750194528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3890102690 0x7f3890108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 --2- 172.21.15.100:0/750194528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890101cd0 0x7f3890102150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 --2- 172.21.15.100:0/750194528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3890100ad0 0x7f3890100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 -- 172.21.15.100:0/750194528 >> 172.21.15.100:0/750194528 conn(0x7f38900fc280 msgr2=0x7f38900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 -- 172.21.15.100:0/750194528 shutdown_connections 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 -- 172.21.15.100:0/750194528 wait complete. 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.344+0000 7f3895e8d640 1 Processor -- start 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f3895e8d640 1 -- start start 2024-09-12T02:33:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f3895e8d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3890100ad0 0x7f389010b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f3895e8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3890101cd0 0x7f3890109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f3895e8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890102690 0x7f3890109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f3895e8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f389010d880 con 0x7f3890102690 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f3895e8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f389010d700 con 0x7f3890101cd0 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f3895e8d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f389010da00 con 0x7f3890100ad0 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890102690 0x7f3890109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890102690 0x7f3890109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53844/0 (socket says 172.21.15.100:53844) 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 -- 172.21.15.100:0/82772692 learned_addr learned my addr 172.21.15.100:0/82772692 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388f7fe640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3890100ad0 0x7f389010b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388effd640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3890101cd0 0x7f3890109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 -- 172.21.15.100:0/82772692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3890100ad0 msgr2=0x7f389010b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3890100ad0 0x7f389010b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 -- 172.21.15.100:0/82772692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3890101cd0 msgr2=0x7f3890109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3890101cd0 0x7f3890109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 -- 172.21.15.100:0/82772692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389010a8a0 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.345+0000 7f388ffff640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890102690 0x7f3890109fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f388800c970 tx=0x7f388800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.346+0000 7f388cff9640 1 -- 172.21.15.100:0/82772692 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888007bb0 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.346+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38901a20c0 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.346+0000 7f388cff9640 1 -- 172.21.15.100:0/82772692 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3888007d50 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.346+0000 7f388cff9640 1 -- 172.21.15.100:0/82772692 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388800f450 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.346+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38901a25d0 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.347+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3890107f20 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.348+0000 7f388cff9640 1 -- 172.21.15.100:0/82772692 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3888004f60 con 0x7f3890102690 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.348+0000 7f388cff9640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38780a2c00 0x7f38780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.348+0000 7f388f7fe640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38780a2c00 0x7f38780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.348+0000 7f388cff9640 1 -- 172.21.15.100:0/82772692 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f38880cdc00 con 0x7f3890102690 2024-09-12T02:33:23.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.349+0000 7f388f7fe640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38780a2c00 0x7f38780a50c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3890101b30 tx=0x7f3880009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:23.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.353+0000 7f388cff9640 1 -- 172.21.15.100:0/82772692 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38880d4080 con 0x7f3890102690 2024-09-12T02:33:23.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:23.531+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3890062630 con 0x7f38780a2c00 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi189 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:23.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] boot 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:33:23.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi189 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] boot 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:33:24.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi189 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: osd.5 [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] boot 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:33:24.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:33:24.952 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:24 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:33:24.952 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:24 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:33:24.952 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:24 smithi100 ceph-mon[31390]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:24.952 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:24 smithi100 ceph-mon[31390]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:24.952 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:24 smithi100 ceph-mon[31390]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:33:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:24 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:33:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:24 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:33:25.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:24 smithi189 ceph-mon[35196]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:25.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:24 smithi189 ceph-mon[35196]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:25.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:24 smithi189 ceph-mon[35196]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:33:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:24 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:33:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:24 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:33:25.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:24 smithi117 ceph-mon[34898]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:33:25.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:24 smithi117 ceph-mon[34898]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:25.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:24 smithi117 ceph-mon[34898]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:33:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:26 smithi100 ceph-mon[31390]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:26 smithi100 ceph-mon[31390]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:33:26.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3128904581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d1f711c-acc7-40e2-93fa-961388eb3fda"}]: dispatch 2024-09-12T02:33:26.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3128904581' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d1f711c-acc7-40e2-93fa-961388eb3fda"}]': finished 2024-09-12T02:33:26.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:26 smithi100 ceph-mon[31390]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:33:26.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:26.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2081244726' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:26 smithi189 ceph-mon[35196]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:27.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:26 smithi189 ceph-mon[35196]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:33:27.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:26 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3128904581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d1f711c-acc7-40e2-93fa-961388eb3fda"}]: dispatch 2024-09-12T02:33:27.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:26 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3128904581' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d1f711c-acc7-40e2-93fa-961388eb3fda"}]': finished 2024-09-12T02:33:27.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:26 smithi189 ceph-mon[35196]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:33:27.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:27.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:26 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2081244726' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:26 smithi117 ceph-mon[34898]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:26 smithi117 ceph-mon[34898]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:33:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:26 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3128904581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d1f711c-acc7-40e2-93fa-961388eb3fda"}]: dispatch 2024-09-12T02:33:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:26 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3128904581' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d1f711c-acc7-40e2-93fa-961388eb3fda"}]': finished 2024-09-12T02:33:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:26 smithi117 ceph-mon[34898]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:33:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:26 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2081244726' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:28.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:27 smithi189 ceph-mon[35196]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:33:28.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:27 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:28.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:27 smithi189 ceph-mon[35196]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:28.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:27 smithi117 ceph-mon[34898]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:33:28.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:27 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:28.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:27 smithi117 ceph-mon[34898]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:28.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:27 smithi100 ceph-mon[31390]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:33:28.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:27 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:28.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:27 smithi100 ceph-mon[31390]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:30.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:30 smithi117 ceph-mon[34898]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-12T02:33:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:30 smithi100 ceph-mon[31390]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-12T02:33:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:30 smithi189 ceph-mon[35196]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-12T02:33:32.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:32 smithi117 ceph-mon[34898]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:33:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:32 smithi100 ceph-mon[31390]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:33:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:32 smithi189 ceph-mon[35196]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:33:34.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:34 smithi189 ceph-mon[35196]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-12T02:33:34.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:34 smithi117 ceph-mon[34898]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-12T02:33:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:34 smithi100 ceph-mon[31390]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-12T02:33:35.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:33:35.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:33:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:33:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:36.747 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:36 smithi100 ceph-mon[31390]: Deploying daemon osd.6 on smithi100 2024-09-12T02:33:36.747 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:36 smithi100 ceph-mon[31390]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:33:36.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:36 smithi117 ceph-mon[34898]: Deploying daemon osd.6 on smithi100 2024-09-12T02:33:36.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:36 smithi117 ceph-mon[34898]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:33:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:36 smithi189 ceph-mon[35196]: Deploying daemon osd.6 on smithi100 2024-09-12T02:33:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:36 smithi189 ceph-mon[35196]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:33:38.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:38 smithi117 ceph-mon[34898]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:33:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:38 smithi100 ceph-mon[31390]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:33:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:38 smithi189 ceph-mon[35196]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:33:40.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:40 smithi100 ceph-mon[31390]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:33:40.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:40 smithi117 ceph-mon[34898]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:33:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:40 smithi189 ceph-mon[35196]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:33:41.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:41 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:41 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:41.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:41 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:41 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:41 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:41.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:41 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:42.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:41 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:42.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:41 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:42.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:41 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:42.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:42 smithi117 ceph-mon[34898]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:42 smithi100 ceph-mon[31390]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:42 smithi189 ceph-mon[35196]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:44.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.739+0000 7f388cff9640 1 -- 172.21.15.100:0/82772692 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3890062630 con 0x7f38780a2c00 2024-09-12T02:33:44.740 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 6 on host 'smithi100' 2024-09-12T02:33:44.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38780a2c00 msgr2=0x7f38780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:44.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38780a2c00 0x7f38780a50c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3890101b30 tx=0x7f3880009670 comp rx=0 tx=0).stop 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890102690 msgr2=0x7f3890109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890102690 0x7f3890109fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f388800c970 tx=0x7f388800ce30 comp rx=0 tx=0).stop 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 shutdown_connections 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38780a2c00 0x7f38780a50c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3890102690 0x7f3890109fe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3890101cd0 0x7f3890109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 --2- 172.21.15.100:0/82772692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3890100ad0 0x7f389010b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 >> 172.21.15.100:0/82772692 conn(0x7f38900fc280 msgr2=0x7f38901050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 shutdown_connections 2024-09-12T02:33:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:33:44.741+0000 7f3895e8d640 1 -- 172.21.15.100:0/82772692 wait complete. 2024-09-12T02:33:44.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:44 smithi117 ceph-mon[34898]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:44 smithi100 ceph-mon[31390]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:44.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:44.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:44.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:44 smithi189 ceph-mon[35196]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:45.426 DEBUG:teuthology.orchestra.run.smithi100:osd.6> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T02:33:45.428 INFO:tasks.cephadm:Deploying osd.7 on smithi117 with /dev/vg_nvme/lv_2... 2024-09-12T02:33:45.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:33:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:33:45.705 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:45 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:45.705 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:45 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:45.705 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:45 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:45.806 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:45 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:45.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:45 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:45.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:45 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:46.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:45 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:46.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:45 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:46.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:45 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:46.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:46 smithi100 ceph-mon[31390]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:46.840 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:33:46 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:33:46.719+0000 7f1b09a10640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:33:46.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:46 smithi117 ceph-mon[34898]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:46 smithi189 ceph-mon[35196]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:47.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:47 smithi117 ceph-mon[34898]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:33:47.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:47 smithi100 ceph-mon[31390]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:33:48.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:47 smithi189 ceph-mon[35196]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:33:48.418 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:33:48.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_2 2024-09-12T02:33:48.702 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:33:48.722 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:48.723 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:48.724 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:48 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:48.871 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:33:48.587+0000 7f1b05993640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:33:48.871 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:33:48.598+0000 7f1b017bb640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:48.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:48.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:48.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:48 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:48 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:33:49.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 -- 172.21.15.117:0/1166362956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c101cd0 msgr2=0x7f411c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 --2- 172.21.15.117:0/1166362956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c101cd0 0x7f411c102150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f410c009900 tx=0x7f410c02a410 comp rx=0 tx=0).stop 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 -- 172.21.15.117:0/1166362956 shutdown_connections 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 --2- 172.21.15.117:0/1166362956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f411c102690 0x7f411c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 --2- 172.21.15.117:0/1166362956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c101cd0 0x7f411c102150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 --2- 172.21.15.117:0/1166362956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c100ad0 0x7f411c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 -- 172.21.15.117:0/1166362956 >> 172.21.15.117:0/1166362956 conn(0x7f411c0fc280 msgr2=0x7f411c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 -- 172.21.15.117:0/1166362956 shutdown_connections 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.188+0000 7f41211a6640 1 -- 172.21.15.117:0/1166362956 wait complete. 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 Processor -- start 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 -- start start 2024-09-12T02:33:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c100ad0 0x7f411c196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f411c101cd0 0x7f411c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c102690 0x7f411c19e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f411c10c7b0 con 0x7f411c100ad0 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f411c10c630 con 0x7f411c102690 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f41211a6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f411c10c930 con 0x7f411c101cd0 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f411b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c102690 0x7f411c19e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f411ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c100ad0 0x7f411c196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f411b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c102690 0x7f411c19e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43932/0 (socket says 172.21.15.117:43932) 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.189+0000 7f411b59e640 1 -- 172.21.15.117:0/1880109287 learned_addr learned my addr 172.21.15.117:0/1880109287 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411a59c640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f411c101cd0 0x7f411c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411b59e640 1 -- 172.21.15.117:0/1880109287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f411c101cd0 msgr2=0x7f411c197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411b59e640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f411c101cd0 0x7f411c197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411b59e640 1 -- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c100ad0 msgr2=0x7f411c196dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411b59e640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c100ad0 0x7f411c196dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411b59e640 1 -- 172.21.15.117:0/1880109287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c19ea00 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411ad9d640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c100ad0 0x7f411c196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f411b59e640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c102690 0x7f411c19e390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f411400b970 tx=0x7f411400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f4103fff640 1 -- 172.21.15.117:0/1880109287 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114019070 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f4103fff640 1 -- 172.21.15.117:0/1880109287 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f411400cb40 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411c19ecf0 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f4103fff640 1 -- 172.21.15.117:0/1880109287 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114007650 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.190+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411c19f270 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.191+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411c107ea0 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.192+0000 7f4103fff640 1 -- 172.21.15.117:0/1880109287 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f411401c070 con 0x7f411c102690 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.193+0000 7f4103fff640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41040a2c30 0x7f41040a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.193+0000 7f4103fff640 1 -- 172.21.15.117:0/1880109287 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4685+0+0 (secure 0 0 0) 0x7f41140cdb40 con 0x7f411c102690 2024-09-12T02:33:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.193+0000 7f411ad9d640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41040a2c30 0x7f41040a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.194+0000 7f411ad9d640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41040a2c30 0x7f41040a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f411c101b30 tx=0x7f4110005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.200+0000 7f4103fff640 1 -- 172.21.15.117:0/1880109287 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f411409b280 con 0x7f411c102690 2024-09-12T02:33:49.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:33:49.381+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f411c062630 con 0x7f41040a2c30 2024-09-12T02:33:49.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi100 2024-09-12T02:33:49.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T02:33:49.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:33:49.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:33:49.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:49.727 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:49.728 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:49.728 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:49.728 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi100 2024-09-12T02:33:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T02:33:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:33:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:33:49.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:49.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:49.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:49.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:49.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi100 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: from='osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:50.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:50.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:33:50.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:33:50.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:50.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:50.853 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:50.853 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] boot 2024-09-12T02:33:50.853 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T02:33:50.853 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:50 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:33:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:33:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:50.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] boot 2024-09-12T02:33:50.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T02:33:50.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:50 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:33:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:33:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:33:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: osd.6 [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] boot 2024-09-12T02:33:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T02:33:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:50 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:33:51.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:51 smithi117 ceph-mon[34898]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T02:33:51.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:51 smithi100 ceph-mon[31390]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T02:33:52.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:51 smithi189 ceph-mon[35196]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T02:33:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:52 smithi100 ceph-mon[31390]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:52 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/4251034848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]: dispatch 2024-09-12T02:33:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:52 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]: dispatch 2024-09-12T02:33:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:52 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]': finished 2024-09-12T02:33:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:52 smithi100 ceph-mon[31390]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:33:52.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:33:52.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:52 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/1868065219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:52 smithi189 ceph-mon[35196]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:52 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/4251034848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]: dispatch 2024-09-12T02:33:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:52 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]: dispatch 2024-09-12T02:33:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:52 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]': finished 2024-09-12T02:33:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:52 smithi189 ceph-mon[35196]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:33:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:33:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:52 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/1868065219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:52 smithi117 ceph-mon[34898]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:52 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/4251034848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]: dispatch 2024-09-12T02:33:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:52 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]: dispatch 2024-09-12T02:33:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:52 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f867c1d-c6aa-4b5a-92b9-013474aa1c21"}]': finished 2024-09-12T02:33:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:52 smithi117 ceph-mon[34898]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:33:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:33:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:52 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/1868065219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:54 smithi100 ceph-mon[31390]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:54 smithi189 ceph-mon[35196]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:54 smithi117 ceph-mon[34898]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:56.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:56 smithi117 ceph-mon[34898]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:56 smithi100 ceph-mon[31390]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:56 smithi189 ceph-mon[35196]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:58.741 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:33:58 smithi117 ceph-mon[34898]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:33:58 smithi100 ceph-mon[31390]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:33:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:33:58 smithi189 ceph-mon[35196]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:00 smithi117 ceph-mon[34898]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:34:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:00 smithi100 ceph-mon[31390]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:34:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:00 smithi189 ceph-mon[35196]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:34:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:01.889 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:01 smithi117 ceph-mon[34898]: Deploying daemon osd.7 on smithi117 2024-09-12T02:34:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:01 smithi189 ceph-mon[35196]: Deploying daemon osd.7 on smithi117 2024-09-12T02:34:02.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:01 smithi100 ceph-mon[31390]: Deploying daemon osd.7 on smithi117 2024-09-12T02:34:02.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:02 smithi117 ceph-mon[34898]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:02 smithi189 ceph-mon[35196]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:02 smithi100 ceph-mon[31390]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:05.005 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:04 smithi117 ceph-mon[34898]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:05.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:04 smithi189 ceph-mon[35196]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:04 smithi100 ceph-mon[31390]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:06.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:06 smithi117 ceph-mon[34898]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:06.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:06.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:06.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:06 smithi189 ceph-mon[35196]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:06 smithi100 ceph-mon[31390]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:08.886 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:08 smithi117 ceph-mon[34898]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:08 smithi189 ceph-mon[35196]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:08 smithi100 ceph-mon[31390]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:09.809 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 7 on host 'smithi117' 2024-09-12T02:34:09.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.808+0000 7f4103fff640 1 -- 172.21.15.117:0/1880109287 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f411c062630 con 0x7f41040a2c30 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41040a2c30 msgr2=0x7f41040a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41040a2c30 0x7f41040a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f411c101b30 tx=0x7f4110005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c102690 msgr2=0x7f411c19e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c102690 0x7f411c19e390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f411400b970 tx=0x7f411400be30 comp rx=0 tx=0).stop 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 shutdown_connections 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41040a2c30 0x7f41040a50f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f411c102690 0x7f411c19e390 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f411c101cd0 0x7f411c197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 --2- 172.21.15.117:0/1880109287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c100ad0 0x7f411c196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:09.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 >> 172.21.15.117:0/1880109287 conn(0x7f411c0fc280 msgr2=0x7f411c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:09.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 shutdown_connections 2024-09-12T02:34:09.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:34:09.810+0000 7f41211a6640 1 -- 172.21.15.117:0/1880109287 wait complete. 2024-09-12T02:34:10.517 DEBUG:teuthology.orchestra.run.smithi117:osd.7> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T02:34:10.519 INFO:tasks.cephadm:Deploying osd.8 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-12T02:34:10.519 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:34:10.776 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:34:10.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:10 smithi117 ceph-mon[34898]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:10.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:10.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:10.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:10.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:10.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:10 smithi189 ceph-mon[35196]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:10.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:10.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:10.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:10.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:10 smithi100 ceph-mon[31390]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:12.650 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:34:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:34:12.602+0000 7fcd8d20f640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:34:12.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:12 smithi189 ceph-mon[35196]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:12.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:12 smithi189 ceph-mon[35196]: from='osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:34:12.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:12 smithi189 ceph-mon[35196]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:34:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:12 smithi117 ceph-mon[34898]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:12 smithi117 ceph-mon[34898]: from='osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:34:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:12 smithi117 ceph-mon[34898]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:34:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:12 smithi100 ceph-mon[31390]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:12 smithi100 ceph-mon[31390]: from='osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:34:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:12 smithi100 ceph-mon[31390]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:34:13.626 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:34:13.653 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-12T02:34:13.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:13 smithi117 ceph-mon[34898]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:34:13.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:13 smithi117 ceph-mon[34898]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:34:13.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:13.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:13 smithi117 ceph-mon[34898]: from='osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:34:13.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:13 smithi117 ceph-mon[34898]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:34:13.844 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:34:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:34:13.657+0000 7fcd89192640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:34:13.844 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:34:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:34:13.666+0000 7fcd84fba640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:34:13.905 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:34:13.931 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:13 smithi189 ceph-mon[35196]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:34:13.931 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:13 smithi189 ceph-mon[35196]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:34:13.931 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:13.932 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:13 smithi189 ceph-mon[35196]: from='osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:34:13.932 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:13 smithi189 ceph-mon[35196]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:34:14.022 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:13 smithi100 ceph-mon[31390]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:34:14.022 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:13 smithi100 ceph-mon[31390]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:34:14.022 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:14.022 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:13 smithi100 ceph-mon[31390]: from='osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:34:14.022 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:13 smithi100 ceph-mon[31390]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:34:14.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- 172.21.15.189:0/3589078087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4104f90 msgr2=0x7f3ec4107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 --2- 172.21.15.189:0/3589078087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4104f90 0x7f3ec4107380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009900 tx=0x7f3eb002a410 comp rx=0 tx=0).stop 2024-09-12T02:34:14.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- 172.21.15.189:0/3589078087 shutdown_connections 2024-09-12T02:34:14.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 --2- 172.21.15.189:0/3589078087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec41078c0 0x7f3ec4109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 --2- 172.21.15.189:0/3589078087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4104f90 0x7f3ec4107380 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 --2- 172.21.15.189:0/3589078087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ec4102660 0x7f3ec4104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- 172.21.15.189:0/3589078087 >> 172.21.15.189:0/3589078087 conn(0x7f3ec40fc280 msgr2=0x7f3ec40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- 172.21.15.189:0/3589078087 shutdown_connections 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- 172.21.15.189:0/3589078087 wait complete. 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 Processor -- start 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- start start 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4102660 0x7f3ec4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4104f90 0x7f3ec4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ec41078c0 0x7f3ec419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410d840 con 0x7f3ec41078c0 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410d6c0 con 0x7f3ec4104f90 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.413+0000 7f3ecb250640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410d9c0 con 0x7f3ec4102660 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4102660 0x7f3ec4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4102660 0x7f3ec4197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:34356/0 (socket says 172.21.15.189:34356) 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 -- 172.21.15.189:0/2145572286 learned_addr learned my addr 172.21.15.189:0/2145572286 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec3fff640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4104f90 0x7f3ec4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec97ed640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ec41078c0 0x7f3ec419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 -- 172.21.15.189:0/2145572286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4104f90 msgr2=0x7f3ec4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4104f90 0x7f3ec4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 -- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ec41078c0 msgr2=0x7f3ec419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ec41078c0 0x7f3ec419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 -- 172.21.15.189:0/2145572286 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec419fb60 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec8fec640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4102660 0x7f3ec4197f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800d950 tx=0x7f3eb800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec1ffb640 1 -- 172.21.15.189:0/2145572286 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8017070 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec1ffb640 1 -- 172.21.15.189:0/2145572286 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3eb8009c30 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec419fe50 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.414+0000 7f3ec1ffb640 1 -- 172.21.15.189:0/2145572286 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800f6b0 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.415+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec41a02b0 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.416+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec40fdd70 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.417+0000 7f3ec1ffb640 1 -- 172.21.15.189:0/2145572286 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3eb80109d0 con 0x7f3ec4102660 2024-09-12T02:34:14.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.417+0000 7f3ec1ffb640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3eb40a2c30 0x7f3eb40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.417+0000 7f3ec1ffb640 1 -- 172.21.15.189:0/2145572286 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7f3eb80cdea0 con 0x7f3ec4102660 2024-09-12T02:34:14.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.417+0000 7f3ec3fff640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3eb40a2c30 0x7f3eb40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.418+0000 7f3ec3fff640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3eb40a2c30 0x7f3eb40a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0005ab0 tx=0x7f3eb0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:14.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.421+0000 7f3ec1ffb640 1 -- 172.21.15.189:0/2145572286 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3eb809b430 con 0x7f3ec4102660 2024-09-12T02:34:14.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:14.602+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3ec4062630 con 0x7f3eb40a2c30 2024-09-12T02:34:14.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:14.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:34:14.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:34:14.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:14.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:14.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:34:14.935 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:34:14.935 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:34:15.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:15.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:34:15.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:16.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi117 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] boot 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:15 smithi189 ceph-mon[35196]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi117 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] boot 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:16.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:15 smithi117 ceph-mon[34898]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi117 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: osd.7 [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] boot 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T02:34:16.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:34:16.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:15 smithi100 ceph-mon[31390]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:34:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:16 smithi189 ceph-mon[35196]: pgmap v170: 1 pgs: 1 peering; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:17.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:16 smithi189 ceph-mon[35196]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:34:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:16 smithi117 ceph-mon[34898]: pgmap v170: 1 pgs: 1 peering; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:17.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:16 smithi117 ceph-mon[34898]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:34:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:16 smithi100 ceph-mon[31390]: pgmap v170: 1 pgs: 1 peering; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:34:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:16 smithi100 ceph-mon[31390]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:34:18.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:34:18.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/3344333479' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]: dispatch 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]: dispatch 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]': finished 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:17 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/1426585745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/3344333479' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]: dispatch 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]: dispatch 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]': finished 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:18.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:17 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/1426585745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:34:18.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:34:18.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/3344333479' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]: dispatch 2024-09-12T02:34:18.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]: dispatch 2024-09-12T02:34:18.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa0583fc-c147-414e-8811-c43c590bd307"}]': finished 2024-09-12T02:34:18.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:34:18.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:18.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:18.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:17 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/1426585745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:34:20.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:20 smithi117 ceph-mon[34898]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:20.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:20 smithi100 ceph-mon[31390]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:20 smithi189 ceph-mon[35196]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:22.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:22 smithi117 ceph-mon[34898]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:22 smithi100 ceph-mon[31390]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:22.993 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:22 smithi189 ceph-mon[35196]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:24.709 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:24 smithi189 ceph-mon[35196]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:24.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:24 smithi117 ceph-mon[34898]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:24.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:24 smithi100 ceph-mon[31390]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:26 smithi189 ceph-mon[35196]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:34:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:26.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:26 smithi117 ceph-mon[34898]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:26.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:34:26.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:26 smithi100 ceph-mon[31390]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:34:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:27.753 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:27 smithi189 ceph-mon[35196]: Deploying daemon osd.8 on smithi189 2024-09-12T02:34:27.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:27 smithi117 ceph-mon[34898]: Deploying daemon osd.8 on smithi189 2024-09-12T02:34:27.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:27 smithi100 ceph-mon[31390]: Deploying daemon osd.8 on smithi189 2024-09-12T02:34:28.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:28 smithi189 ceph-mon[35196]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:28.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:28 smithi117 ceph-mon[34898]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:28.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:28 smithi100 ceph-mon[31390]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:30.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:30 smithi189 ceph-mon[35196]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:30.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:30 smithi117 ceph-mon[34898]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:30 smithi100 ceph-mon[31390]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:32.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:32 smithi189 ceph-mon[35196]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:32.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:32 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:32.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:32 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:32.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:32 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:32.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:32 smithi117 ceph-mon[34898]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:32.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:32 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:32.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:32 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:32.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:32 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:32 smithi100 ceph-mon[31390]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:32.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:32 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:32.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:32 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:32.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:32 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:34.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:34 smithi117 ceph-mon[34898]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:34 smithi100 ceph-mon[31390]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:34 smithi189 ceph-mon[35196]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:35.766 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.764+0000 7f3ec1ffb640 1 -- 172.21.15.189:0/2145572286 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3ec4062630 con 0x7f3eb40a2c30 2024-09-12T02:34:35.766 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 8 on host 'smithi189' 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3eb40a2c30 msgr2=0x7f3eb40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3eb40a2c30 0x7f3eb40a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0005ab0 tx=0x7f3eb0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4102660 msgr2=0x7f3ec4197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4102660 0x7f3ec4197f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800d950 tx=0x7f3eb800de10 comp rx=0 tx=0).stop 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 shutdown_connections 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3eb40a2c30 0x7f3eb40a50f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ec41078c0 0x7f3ec419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4104f90 0x7f3ec4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 --2- 172.21.15.189:0/2145572286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ec4102660 0x7f3ec4197f30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 >> 172.21.15.189:0/2145572286 conn(0x7f3ec40fc280 msgr2=0x7f3ec4103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:35.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 shutdown_connections 2024-09-12T02:34:35.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:34:35.767+0000 7f3ecb250640 1 -- 172.21.15.189:0/2145572286 wait complete. 2024-09-12T02:34:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:35 smithi189 ceph-mon[35196]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:36.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:36.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:36.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:35 smithi117 ceph-mon[34898]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:36.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:36.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:36.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:36.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:35 smithi100 ceph-mon[31390]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:36.404 DEBUG:teuthology.orchestra.run.smithi189:osd.8> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T02:34:36.407 INFO:tasks.cephadm:Deploying osd.9 on smithi100 with /dev/vg_nvme/lv_1... 2024-09-12T02:34:36.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:34:36.661 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:36 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:36 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:37.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:36 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:37.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:36 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:37.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:36 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:37.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:36 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:36 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:36 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:37.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:36 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:37.610 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:34:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:34:37.430+0000 7f9d1f0fa640 -1 osd.8 0 log_to_monitors true 2024-09-12T02:34:37.919 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:37 smithi189 ceph-mon[35196]: from='osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:34:37.919 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:37 smithi189 ceph-mon[35196]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:34:37.919 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:37 smithi189 ceph-mon[35196]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:37 smithi117 ceph-mon[34898]: from='osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:34:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:37 smithi117 ceph-mon[34898]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:34:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:37 smithi117 ceph-mon[34898]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:38.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:37 smithi100 ceph-mon[31390]: from='osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:34:38.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:37 smithi100 ceph-mon[31390]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:34:38.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:37 smithi100 ceph-mon[31390]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:39.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:38 smithi189 ceph-mon[35196]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:34:39.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:38 smithi189 ceph-mon[35196]: from='osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:34:39.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:38 smithi189 ceph-mon[35196]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:34:39.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:38 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:39.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:38 smithi189 ceph-mon[35196]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:34:39.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:38 smithi100 ceph-mon[31390]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:34:39.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:38 smithi100 ceph-mon[31390]: from='osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:34:39.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:38 smithi100 ceph-mon[31390]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:34:39.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:38 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:39.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:38 smithi100 ceph-mon[31390]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:34:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:38 smithi117 ceph-mon[34898]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:34:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:38 smithi117 ceph-mon[34898]: from='osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:34:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:38 smithi117 ceph-mon[34898]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:34:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:38 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:38 smithi117 ceph-mon[34898]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:34:39.418 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:34:39.142+0000 7f9d1b07d640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T02:34:39.418 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:34:39.152+0000 7f9d12e9d640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:34:39.455 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:34:39.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2024-09-12T02:34:39.736 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:40.010 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:34:40.010 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='osd.8 ' entity='osd.8' 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi189 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:40.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:40.012 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.012 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:39 smithi100 ceph-mon[31390]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:40.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:34:40.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='osd.8 ' entity='osd.8' 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi189 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:40.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:39 smithi189 ceph-mon[35196]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='osd.8 ' entity='osd.8' 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi189 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:40.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T02:34:40.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:40.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:40.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:40.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:39 smithi117 ceph-mon[34898]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:34:40.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 -- 172.21.15.100:0/270959681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38107980 msgr2=0x7f5f38109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 --2- 172.21.15.100:0/270959681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38107980 0x7f5f38109d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009ca0 tx=0x7f5f3002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 -- 172.21.15.100:0/270959681 shutdown_connections 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 --2- 172.21.15.100:0/270959681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38107980 0x7f5f38109d70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 --2- 172.21.15.100:0/270959681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f38105050 0x7f5f38107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 --2- 172.21.15.100:0/270959681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f38102720 0x7f5f38104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 -- 172.21.15.100:0/270959681 >> 172.21.15.100:0/270959681 conn(0x7f5f380fc280 msgr2=0x7f5f380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 -- 172.21.15.100:0/270959681 shutdown_connections 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.233+0000 7f5f3f126640 1 -- 172.21.15.100:0/270959681 wait complete. 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 Processor -- start 2024-09-12T02:34:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 -- start start 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f38102720 0x7f5f3819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38105050 0x7f5f3819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f38107980 0x7f5f381a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3810d870 con 0x7f5f38105050 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3810d6f0 con 0x7f5f38107980 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.234+0000 7f5f3f126640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3810d9f0 con 0x7f5f38102720 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f3cec2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f38102720 0x7f5f3819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38105050 0x7f5f3819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f3cec2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f38102720 0x7f5f3819a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:45256/0 (socket says 172.21.15.100:45256) 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f3d6c3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f38107980 0x7f5f381a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38105050 0x7f5f3819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54052/0 (socket says 172.21.15.100:54052) 2024-09-12T02:34:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f3cec2640 1 -- 172.21.15.100:0/3286157841 learned_addr learned my addr 172.21.15.100:0/3286157841 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 -- 172.21.15.100:0/3286157841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f38102720 msgr2=0x7f5f3819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f38102720 0x7f5f3819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 -- 172.21.15.100:0/3286157841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f38107980 msgr2=0x7f5f381a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f38107980 0x7f5f381a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 -- 172.21.15.100:0/3286157841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f381a1cc0 con 0x7f5f38105050 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f37fff640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38105050 0x7f5f3819a5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400e9c0 tx=0x7f5f2400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f35ffb640 1 -- 172.21.15.100:0/3286157841 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400ccc0 con 0x7f5f38105050 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f381a1fb0 con 0x7f5f38105050 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f35ffb640 1 -- 172.21.15.100:0/3286157841 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f24010910 con 0x7f5f38105050 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.235+0000 7f5f35ffb640 1 -- 172.21.15.100:0/3286157841 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24018880 con 0x7f5f38105050 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.236+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f381a24b0 con 0x7f5f38105050 2024-09-12T02:34:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.238+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f38109470 con 0x7f5f38105050 2024-09-12T02:34:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.238+0000 7f5f35ffb640 1 -- 172.21.15.100:0/3286157841 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5f24010ac0 con 0x7f5f38105050 2024-09-12T02:34:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.238+0000 7f5f35ffb640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5f280a2c30 0x7f5f280a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.238+0000 7f5f35ffb640 1 -- 172.21.15.100:0/3286157841 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5858+0+0 (secure 0 0 0) 0x7f5f240ce990 con 0x7f5f38105050 2024-09-12T02:34:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.238+0000 7f5f3cec2640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5f280a2c30 0x7f5f280a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.239+0000 7f5f3cec2640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5f280a2c30 0x7f5f280a50f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009c90 tx=0x7f5f2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.243+0000 7f5f35ffb640 1 -- 172.21.15.100:0/3286157841 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f2409bc30 con 0x7f5f38105050 2024-09-12T02:34:40.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:34:40.422+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5f38062630 con 0x7f5f280a2c30 2024-09-12T02:34:41.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:34:41.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:34:41.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] boot 2024-09-12T02:34:41.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:34:41.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:41.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:34:41.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:41.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:34:41.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:34:41.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] boot 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:34:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:34:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:34:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: osd.8 [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] boot 2024-09-12T02:34:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:34:41.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:34:41.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:34:41.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:41.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:34:41.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:34:41.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:42.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:41 smithi117 ceph-mon[34898]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:34:42.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:41 smithi117 ceph-mon[34898]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:42.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:41 smithi100 ceph-mon[31390]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:34:42.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:41 smithi100 ceph-mon[31390]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:42.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:41 smithi189 ceph-mon[35196]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:34:42.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:41 smithi189 ceph-mon[35196]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:42 smithi117 ceph-mon[34898]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:34:43.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:42 smithi100 ceph-mon[31390]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:34:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:42 smithi189 ceph-mon[35196]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:34:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:43 smithi100 ceph-mon[31390]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:34:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:43 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2923056768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "770580c2-fe84-4438-87c8-f42c8ffc4f85"}]: dispatch 2024-09-12T02:34:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:43 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2923056768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "770580c2-fe84-4438-87c8-f42c8ffc4f85"}]': finished 2024-09-12T02:34:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:43 smithi100 ceph-mon[31390]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:34:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:34:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:43 smithi100 ceph-mon[31390]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:43 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3425421028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:34:44.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:43 smithi117 ceph-mon[34898]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:34:44.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:43 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2923056768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "770580c2-fe84-4438-87c8-f42c8ffc4f85"}]: dispatch 2024-09-12T02:34:44.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:43 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2923056768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "770580c2-fe84-4438-87c8-f42c8ffc4f85"}]': finished 2024-09-12T02:34:44.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:43 smithi117 ceph-mon[34898]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:34:44.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:34:44.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:43 smithi117 ceph-mon[34898]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:44.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:43 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3425421028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:34:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:43 smithi189 ceph-mon[35196]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:34:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:43 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2923056768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "770580c2-fe84-4438-87c8-f42c8ffc4f85"}]: dispatch 2024-09-12T02:34:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:43 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2923056768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "770580c2-fe84-4438-87c8-f42c8ffc4f85"}]': finished 2024-09-12T02:34:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:43 smithi189 ceph-mon[35196]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:34:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:34:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:43 smithi189 ceph-mon[35196]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:43 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3425421028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:34:46.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:46 smithi117 ceph-mon[34898]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:46.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:46 smithi100 ceph-mon[31390]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:46 smithi189 ceph-mon[35196]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:34:48.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:48 smithi117 ceph-mon[34898]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:34:48.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:48 smithi100 ceph-mon[31390]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:34:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:48 smithi189 ceph-mon[35196]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:34:50.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:50 smithi117 ceph-mon[34898]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-12T02:34:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:50 smithi100 ceph-mon[31390]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-12T02:34:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:50 smithi189 ceph-mon[35196]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-12T02:34:51.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:51 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:34:51.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:51 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:51.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:51 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:34:51.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:51 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:52.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:51 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:34:52.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:51 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:52.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:52 smithi117 ceph-mon[34898]: Deploying daemon osd.9 on smithi100 2024-09-12T02:34:52.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:52 smithi117 ceph-mon[34898]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T02:34:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:52 smithi100 ceph-mon[31390]: Deploying daemon osd.9 on smithi100 2024-09-12T02:34:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:52 smithi100 ceph-mon[31390]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T02:34:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:52 smithi189 ceph-mon[35196]: Deploying daemon osd.9 on smithi100 2024-09-12T02:34:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:52 smithi189 ceph-mon[35196]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T02:34:54.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:54 smithi117 ceph-mon[34898]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:34:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:54 smithi100 ceph-mon[31390]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:34:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:54 smithi189 ceph-mon[35196]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:34:56.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:56 smithi117 ceph-mon[34898]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:56.845 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:56 smithi100 ceph-mon[31390]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:56 smithi189 ceph-mon[35196]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:57.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:34:58.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:34:58 smithi117 ceph-mon[34898]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:58.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:34:58 smithi100 ceph-mon[31390]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:34:58 smithi189 ceph-mon[35196]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:35:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:00 smithi117 ceph-mon[34898]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:00 smithi100 ceph-mon[31390]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:00 smithi189 ceph-mon[35196]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.199+0000 7f5f35ffb640 1 -- 172.21.15.100:0/3286157841 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5f38062630 con 0x7f5f280a2c30 2024-09-12T02:35:01.200 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 9 on host 'smithi100' 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5f280a2c30 msgr2=0x7f5f280a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5f280a2c30 0x7f5f280a50f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009c90 tx=0x7f5f2c005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38105050 msgr2=0x7f5f3819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38105050 0x7f5f3819a5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400e9c0 tx=0x7f5f2400ee80 comp rx=0 tx=0).stop 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 shutdown_connections 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5f280a2c30 0x7f5f280a50f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f38107980 0x7f5f381a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f38105050 0x7f5f3819a5d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 --2- 172.21.15.100:0/3286157841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f38102720 0x7f5f3819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 >> 172.21.15.100:0/3286157841 conn(0x7f5f380fc280 msgr2=0x7f5f38101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:01.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 shutdown_connections 2024-09-12T02:35:01.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:01.201+0000 7f5f3f126640 1 -- 172.21.15.100:0/3286157841 wait complete. 2024-09-12T02:35:01.974 DEBUG:teuthology.orchestra.run.smithi100:osd.9> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T02:35:01.976 INFO:tasks.cephadm:Deploying osd.10 on smithi117 with /dev/vg_nvme/lv_1... 2024-09-12T02:35:01.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:35:02.235 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:35:02.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:02 smithi117 ceph-mon[34898]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:02.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:02.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:02.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:02 smithi189 ceph-mon[35196]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:02.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:02.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:02.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:02 smithi100 ceph-mon[31390]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:03.600 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:03 smithi100 ceph-mon[31390]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:35:03.600 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:35:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:35:03.290+0000 7f1f13431640 -1 osd.9 0 log_to_monitors true 2024-09-12T02:35:03.617 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:03 smithi117 ceph-mon[34898]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:35:03.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:03 smithi189 ceph-mon[35196]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:35:04.517 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:04 smithi117 ceph-mon[34898]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:35:04.518 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:04 smithi117 ceph-mon[34898]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T02:35:04.518 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:04 smithi117 ceph-mon[34898]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:35:04.518 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:04.518 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:04 smithi117 ceph-mon[34898]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:04.518 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:04 smithi117 ceph-mon[34898]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:35:04.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-mon[31390]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:35:04.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-mon[31390]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T02:35:04.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-mon[31390]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:35:04.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:04.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-mon[31390]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:04.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-mon[31390]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:35:04.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:04 smithi189 ceph-mon[35196]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:35:04.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:04 smithi189 ceph-mon[35196]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T02:35:04.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:04 smithi189 ceph-mon[35196]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:35:04.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:04.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:04 smithi189 ceph-mon[35196]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:04.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:04 smithi189 ceph-mon[35196]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:35:04.854 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:35:04.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_1 2024-09-12T02:35:05.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:35:04.874+0000 7f1f0f3b4640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T02:35:05.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:35:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:35:04.885+0000 7f1f071d4640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:35:05.136 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:35:05.512 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:05 smithi117 ceph-mon[34898]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:35:05.512 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.512 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.512 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:05 smithi117 ceph-mon[34898]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' 2024-09-12T02:35:05.512 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:05 smithi100 ceph-mon[31390]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:35:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:05 smithi100 ceph-mon[31390]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' 2024-09-12T02:35:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 -- 172.21.15.117:0/1513915170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150100b10 msgr2=0x7f4150100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1513915170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150100b10 0x7f4150100f10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4144009900 tx=0x7f414402a410 comp rx=0 tx=0).stop 2024-09-12T02:35:05.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 -- 172.21.15.117:0/1513915170 shutdown_connections 2024-09-12T02:35:05.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1513915170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41501026d0 0x7f4150108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1513915170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4150101d10 0x7f4150102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1513915170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150100b10 0x7f4150100f10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 -- 172.21.15.117:0/1513915170 >> 172.21.15.117:0/1513915170 conn(0x7f41500fc2a0 msgr2=0x7f41500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 -- 172.21.15.117:0/1513915170 shutdown_connections 2024-09-12T02:35:05.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.638+0000 7f4156eeb640 1 -- 172.21.15.117:0/1513915170 wait complete. 2024-09-12T02:35:05.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 Processor -- start 2024-09-12T02:35:05.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 -- start start 2024-09-12T02:35:05.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4150100b10 0x7f4150196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150101d10 0x7f4150197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41501026d0 0x7f415019e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f415010c770 con 0x7f41501026d0 2024-09-12T02:35:05.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f415010c5f0 con 0x7f4150101d10 2024-09-12T02:35:05.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4156eeb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f415010c8f0 con 0x7f4150100b10 2024-09-12T02:35:05.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150101d10 0x7f4150197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150101d10 0x7f4150197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57110/0 (socket says 172.21.15.117:57110) 2024-09-12T02:35:05.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 -- 172.21.15.117:0/1105011875 learned_addr learned my addr 172.21.15.117:0/1105011875 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T02:35:05.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4154c87640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4150100b10 0x7f4150196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f4155488640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41501026d0 0x7f415019e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 -- 172.21.15.117:0/1105011875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4150100b10 msgr2=0x7f4150196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4150100b10 0x7f4150196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 -- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41501026d0 msgr2=0x7f415019e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41501026d0 0x7f415019e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.639+0000 7f414ffff640 1 -- 172.21.15.117:0/1105011875 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415019ea30 con 0x7f4150101d10 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.640+0000 7f414ffff640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150101d10 0x7f4150197340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e9f0 tx=0x7f413c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.640+0000 7f414dffb640 1 -- 172.21.15.117:0/1105011875 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c00cd80 con 0x7f4150101d10 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.640+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415019ed20 con 0x7f4150101d10 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.640+0000 7f414dffb640 1 -- 172.21.15.117:0/1105011875 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f413c010910 con 0x7f4150101d10 2024-09-12T02:35:05.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.640+0000 7f414dffb640 1 -- 172.21.15.117:0/1105011875 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c018990 con 0x7f4150101d10 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.640+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415006a9b0 con 0x7f4150101d10 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.641+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f415006b3d0 con 0x7f4150101d10 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.642+0000 7f414dffb640 1 -- 172.21.15.117:0/1105011875 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f413c010ac0 con 0x7f4150101d10 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.643+0000 7f414dffb640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41400a4dc0 0x7f41400a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.643+0000 7f414dffb640 1 -- 172.21.15.117:0/1105011875 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7f413c0ce9d0 con 0x7f4150101d10 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.643+0000 7f4154c87640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41400a4dc0 0x7f41400a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.643+0000 7f4154c87640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41400a4dc0 0x7f41400a7280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4144005ab0 tx=0x7f4144000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.647+0000 7f414dffb640 1 -- 172.21.15.117:0/1105011875 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f413c09bc00 con 0x7f4150101d10 2024-09-12T02:35:05.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:05 smithi189 ceph-mon[35196]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:35:05.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:05 smithi189 ceph-mon[35196]: from='osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490]' entity='osd.9' 2024-09-12T02:35:05.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:05.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:05.830+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4150107dd0 con 0x7f41400a4dc0 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi100 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] boot 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T02:35:06.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:06.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:35:06.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi100 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:06.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] boot 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T02:35:06.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi100 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:07.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:07.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:07.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:35:07.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:35:07.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:07.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: osd.9 [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] boot 2024-09-12T02:35:07.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T02:35:07.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:35:07.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:07 smithi100 ceph-mon[31390]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:07.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:07 smithi100 ceph-mon[31390]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T02:35:08.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:07 smithi189 ceph-mon[35196]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:08.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:07 smithi189 ceph-mon[35196]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T02:35:08.024 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:07 smithi117 ceph-mon[34898]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:08.024 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:07 smithi117 ceph-mon[34898]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T02:35:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:08 smithi100 ceph-mon[31390]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:08 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/1276890652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]: dispatch 2024-09-12T02:35:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:08 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]: dispatch 2024-09-12T02:35:08.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:08 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]': finished 2024-09-12T02:35:08.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:08 smithi100 ceph-mon[31390]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:35:08.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:08.924 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:08 smithi117 ceph-mon[34898]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:08.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:08 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/1276890652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]: dispatch 2024-09-12T02:35:08.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:08 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]: dispatch 2024-09-12T02:35:08.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:08 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]': finished 2024-09-12T02:35:08.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:08 smithi117 ceph-mon[34898]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:35:08.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:08 smithi189 ceph-mon[35196]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:08 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/1276890652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]: dispatch 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:08 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]: dispatch 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:08 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c29d5aa-1979-4f2a-9e47-6a3d566dce43"}]': finished 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:08 smithi189 ceph-mon[35196]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:09.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:09 smithi117 ceph-mon[34898]: from='client.? 172.21.15.117:0/4071655022' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:35:10.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:09 smithi189 ceph-mon[35196]: from='client.? 172.21.15.117:0/4071655022' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:35:10.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:09 smithi100 ceph-mon[31390]: from='client.? 172.21.15.117:0/4071655022' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:35:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:10 smithi189 ceph-mon[35196]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:10 smithi117 ceph-mon[34898]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:10 smithi100 ceph-mon[31390]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:12.918 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:12 smithi117 ceph-mon[34898]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:12 smithi189 ceph-mon[35196]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:12 smithi100 ceph-mon[31390]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:14.683 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:14 smithi117 ceph-mon[34898]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:14 smithi189 ceph-mon[35196]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:14 smithi100 ceph-mon[31390]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:16.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:16 smithi117 ceph-mon[34898]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:16.923 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:16 smithi100 ceph-mon[31390]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:16 smithi189 ceph-mon[35196]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:17.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:35:17.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:17 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:17.939 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:35:17.939 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:17 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:18.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:35:18.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:17 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:18.932 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:18 smithi117 ceph-mon[34898]: Deploying daemon osd.10 on smithi117 2024-09-12T02:35:18.932 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:18 smithi117 ceph-mon[34898]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:18 smithi189 ceph-mon[35196]: Deploying daemon osd.10 on smithi117 2024-09-12T02:35:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:18 smithi189 ceph-mon[35196]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:18 smithi100 ceph-mon[31390]: Deploying daemon osd.10 on smithi117 2024-09-12T02:35:19.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:18 smithi100 ceph-mon[31390]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:20 smithi189 ceph-mon[35196]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:21.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:20 smithi117 ceph-mon[34898]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:20 smithi100 ceph-mon[31390]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:22 smithi189 ceph-mon[35196]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:22 smithi117 ceph-mon[34898]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:22 smithi100 ceph-mon[31390]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:24.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:24.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:24.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:24.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:24.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:24.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:24.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:24 smithi117 ceph-mon[34898]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:24 smithi189 ceph-mon[35196]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:24 smithi100 ceph-mon[31390]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:25.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.982+0000 7f414dffb640 1 -- 172.21.15.117:0/1105011875 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4150107dd0 con 0x7f41400a4dc0 2024-09-12T02:35:25.983 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 10 on host 'smithi117' 2024-09-12T02:35:25.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41400a4dc0 msgr2=0x7f41400a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41400a4dc0 0x7f41400a7280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4144005ab0 tx=0x7f4144000bc0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150101d10 msgr2=0x7f4150197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150101d10 0x7f4150197340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e9f0 tx=0x7f413c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 shutdown_connections 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41400a4dc0 0x7f41400a7280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41501026d0 0x7f415019e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4150101d10 0x7f4150197340 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 --2- 172.21.15.117:0/1105011875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4150100b10 0x7f4150196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 >> 172.21.15.117:0/1105011875 conn(0x7f41500fc2a0 msgr2=0x7f4150105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 shutdown_connections 2024-09-12T02:35:25.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:35:25.984+0000 7f4156eeb640 1 -- 172.21.15.117:0/1105011875 wait complete. 2024-09-12T02:35:27.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:26 smithi117 ceph-mon[34898]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:27.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:27.000 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:26 smithi189 ceph-mon[35196]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:27.031 DEBUG:teuthology.orchestra.run.smithi117:osd.10> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T02:35:27.034 INFO:tasks.cephadm:Deploying osd.11 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-12T02:35:27.034 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:35:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:26 smithi100 ceph-mon[31390]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:27.293 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:35:28.237 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:28.237 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:28.237 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:28 smithi117 ceph-mon[34898]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:28.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:28.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:28.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:28 smithi189 ceph-mon[35196]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:28.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:35:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:35:28.426+0000 7fd55568f640 -1 osd.10 0 log_to_monitors true 2024-09-12T02:35:28.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:28.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:28.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:28 smithi100 ceph-mon[31390]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:29.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:29 smithi117 ceph-mon[34898]: from='osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:35:29.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:29 smithi117 ceph-mon[34898]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:35:29.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:29 smithi189 ceph-mon[35196]: from='osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:35:29.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:29 smithi189 ceph-mon[35196]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:35:29.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:29 smithi100 ceph-mon[31390]: from='osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:35:29.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:29 smithi100 ceph-mon[31390]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:35:30.126 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:35:30.152 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-12T02:35:30.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:35:30.236+0000 7fd551612640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T02:35:30.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:35:30.247+0000 7fd54d43a640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:35:30.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-mon[34898]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:35:30.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-mon[34898]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T02:35:30.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-mon[34898]: from='osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:35:30.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:30.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-mon[34898]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:35:30.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:30 smithi117 ceph-mon[34898]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:30.406 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:35:30.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:30 smithi189 ceph-mon[35196]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:35:30.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:30 smithi189 ceph-mon[35196]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T02:35:30.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:30 smithi189 ceph-mon[35196]: from='osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:35:30.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:30 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:30.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:30 smithi189 ceph-mon[35196]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:35:30.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:30 smithi189 ceph-mon[35196]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:30.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:30 smithi100 ceph-mon[31390]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:35:30.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:30 smithi100 ceph-mon[31390]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T02:35:30.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:30 smithi100 ceph-mon[31390]: from='osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:35:30.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:30 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:30.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:30 smithi100 ceph-mon[31390]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:35:30.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:30 smithi100 ceph-mon[31390]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 -- 172.21.15.189:0/1551808565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0107920 msgr2=0x7f44a0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/1551808565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0107920 0x7f44a0109d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4498009ca0 tx=0x7f449802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 -- 172.21.15.189:0/1551808565 shutdown_connections 2024-09-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/1551808565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0107920 0x7f44a0109d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/1551808565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a0104ff0 0x7f44a01073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/1551808565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a01026c0 0x7f44a0104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 -- 172.21.15.189:0/1551808565 >> 172.21.15.189:0/1551808565 conn(0x7f44a00fc280 msgr2=0x7f44a00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 -- 172.21.15.189:0/1551808565 shutdown_connections 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.910+0000 7f44a7f2c640 1 -- 172.21.15.189:0/1551808565 wait complete. 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 Processor -- start 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 -- start start 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a01026c0 0x7f44a0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0104ff0 0x7f44a0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a0107920 0x7f44a019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44a010d880 con 0x7f44a01026c0 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f44a010d700 con 0x7f44a0107920 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a7f2c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44a010da00 con 0x7f44a0104ff0 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0104ff0 0x7f44a0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0104ff0 0x7f44a0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:45724/0 (socket says 172.21.15.189:45724) 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 -- 172.21.15.189:0/659606094 learned_addr learned my addr 172.21.15.189:0/659606094 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a5cc8640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a01026c0 0x7f44a0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a64c9640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a0107920 0x7f44a019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 -- 172.21.15.189:0/659606094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a0107920 msgr2=0x7f44a019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a0107920 0x7f44a019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 -- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a01026c0 msgr2=0x7f44a0197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a01026c0 0x7f44a0197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a54c7640 1 -- 172.21.15.189:0/659606094 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a019fb10 con 0x7f44a0104ff0 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.911+0000 7f44a5cc8640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a01026c0 0x7f44a0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.912+0000 7f44a54c7640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0104ff0 0x7f44a0198420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f449000d770 tx=0x7f449000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.912+0000 7f4496ffd640 1 -- 172.21.15.189:0/659606094 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490017070 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.912+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a019fe00 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.912+0000 7f4496ffd640 1 -- 172.21.15.189:0/659606094 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4490009c30 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.912+0000 7f4496ffd640 1 -- 172.21.15.189:0/659606094 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449000f620 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.912+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a01a02b0 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.913+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a00fdd70 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.915+0000 7f4496ffd640 1 -- 172.21.15.189:0/659606094 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f449001a070 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.916+0000 7f4496ffd640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f448c0a2bb0 0x7f448c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.916+0000 7f4496ffd640 1 -- 172.21.15.189:0/659606094 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6414+0+0 (secure 0 0 0) 0x7f44900ce270 con 0x7f44a0104ff0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.916+0000 7f44a5cc8640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f448c0a2bb0 0x7f448c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.916+0000 7f44a5cc8640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f448c0a2bb0 0x7f448c0a5070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f449c009fc0 tx=0x7f449c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:30.919+0000 7f4496ffd640 1 -- 172.21.15.189:0/659606094 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f449009b2f0 con 0x7f44a0104ff0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:31.101+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f44a0062630 con 0x7f448c0a2bb0 2024-09-12T02:35:31.512 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] boot 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T02:35:31.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:35:31.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:35:31.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:35:31.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:35:31.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] boot 2024-09-12T02:35:31.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T02:35:31.596 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:35:31.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: osd.10 [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] boot 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T02:35:31.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:35:32.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:32 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:35:32.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:32 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:35:32.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:32 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi117 2024-09-12T02:35:32.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:32 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-12T02:35:32.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:32 smithi189 ceph-mon[35196]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:32.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:32 smithi189 ceph-mon[35196]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:32.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:32 smithi189 ceph-mon[35196]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T02:35:32.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:32 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:35:32.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:32 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:35:32.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:32 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi117 2024-09-12T02:35:32.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:32 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-12T02:35:32.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:32 smithi117 ceph-mon[34898]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:32.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:32 smithi117 ceph-mon[34898]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:32.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:32 smithi117 ceph-mon[34898]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T02:35:32.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:32 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:35:32.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:32 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:35:32.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:32 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi117 2024-09-12T02:35:32.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:32 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-12T02:35:32.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:32 smithi100 ceph-mon[31390]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:32.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:32 smithi100 ceph-mon[31390]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:32.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:32 smithi100 ceph-mon[31390]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/1575537342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]: dispatch 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]: dispatch 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]': finished 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:34.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.189:0/994143169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/1575537342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]: dispatch 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]: dispatch 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]': finished 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:34.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:34 smithi117 ceph-mon[34898]: from='client.? 172.21.15.189:0/994143169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:35:34.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:35:34.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:34.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/1575537342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]: dispatch 2024-09-12T02:35:34.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]: dispatch 2024-09-12T02:35:34.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7d1327c-e505-4aa9-b444-7d53cc8f6a03"}]': finished 2024-09-12T02:35:34.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:35:34.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:34.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.189:0/994143169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:35:35.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:35 smithi117 ceph-mon[34898]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:35:35.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:35 smithi100 ceph-mon[31390]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:35:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:35 smithi189 ceph-mon[35196]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:35:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:36.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:36 smithi117 ceph-mon[34898]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:36 smithi100 ceph-mon[31390]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:36 smithi189 ceph-mon[35196]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:38.702 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:38 smithi189 ceph-mon[35196]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-12T02:35:38.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:38 smithi117 ceph-mon[34898]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-12T02:35:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:38 smithi100 ceph-mon[31390]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-12T02:35:40.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:40 smithi117 ceph-mon[34898]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T02:35:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:40 smithi100 ceph-mon[31390]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T02:35:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:40 smithi189 ceph-mon[35196]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T02:35:42.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:42 smithi117 ceph-mon[34898]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:35:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:42 smithi100 ceph-mon[31390]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:35:42.993 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:42 smithi189 ceph-mon[35196]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:35:43.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:35:43.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:43 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:43.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:43 smithi117 ceph-mon[34898]: Deploying daemon osd.11 on smithi189 2024-09-12T02:35:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:35:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:43 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:43.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:43 smithi100 ceph-mon[31390]: Deploying daemon osd.11 on smithi189 2024-09-12T02:35:44.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:35:44.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:43 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:44.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:43 smithi189 ceph-mon[35196]: Deploying daemon osd.11 on smithi189 2024-09-12T02:35:44.699 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:44 smithi189 ceph-mon[35196]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:35:44.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:44 smithi117 ceph-mon[34898]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:35:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:44 smithi100 ceph-mon[31390]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:35:46.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:46 smithi117 ceph-mon[34898]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:35:46.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:46 smithi100 ceph-mon[31390]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:35:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:46 smithi189 ceph-mon[35196]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:35:48.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:48 smithi117 ceph-mon[34898]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:35:48.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:48 smithi100 ceph-mon[31390]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:35:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:48 smithi189 ceph-mon[35196]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:35:49.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:49.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:49.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:49 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:49 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:49 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:50.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:50 smithi189 ceph-mon[35196]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:50.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:50 smithi117 ceph-mon[34898]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:50.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:50 smithi100 ceph-mon[31390]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:52.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.436+0000 7f4496ffd640 1 -- 172.21.15.189:0/659606094 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f44a0062630 con 0x7f448c0a2bb0 2024-09-12T02:35:52.437 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 11 on host 'smithi189' 2024-09-12T02:35:52.438 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f448c0a2bb0 msgr2=0x7f448c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f448c0a2bb0 0x7f448c0a5070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f449c009fc0 tx=0x7f449c005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0104ff0 msgr2=0x7f44a0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0104ff0 0x7f44a0198420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f449000d770 tx=0x7f449000dc30 comp rx=0 tx=0).stop 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 shutdown_connections 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f448c0a2bb0 0x7f448c0a5070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a0107920 0x7f44a019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a0104ff0 0x7f44a0198420 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 --2- 172.21.15.189:0/659606094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a01026c0 0x7f44a0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 >> 172.21.15.189:0/659606094 conn(0x7f44a00fc280 msgr2=0x7f44a0102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 shutdown_connections 2024-09-12T02:35:52.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:35:52.438+0000 7f44a7f2c640 1 -- 172.21.15.189:0/659606094 wait complete. 2024-09-12T02:35:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:53.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:35:53.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:53.157 DEBUG:teuthology.orchestra.run.smithi189:osd.11> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T02:35:53.159 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T02:35:53.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:35:53.417 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 -- 172.21.15.100:0/2849180198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0101c00 msgr2=0x7f29e0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 --2- 172.21.15.100:0/2849180198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0101c00 0x7f29e0102000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009900 tx=0x7f29d402a410 comp rx=0 tx=0).stop 2024-09-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 -- 172.21.15.100:0/2849180198 shutdown_connections 2024-09-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 --2- 172.21.15.100:0/2849180198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e01037c0 0x7f29e010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 --2- 172.21.15.100:0/2849180198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29e0102e00 0x7f29e0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 --2- 172.21.15.100:0/2849180198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0101c00 0x7f29e0102000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 -- 172.21.15.100:0/2849180198 >> 172.21.15.100:0/2849180198 conn(0x7f29e00fd390 msgr2=0x7f29e00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 -- 172.21.15.100:0/2849180198 shutdown_connections 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.901+0000 7f29e71cf640 1 -- 172.21.15.100:0/2849180198 wait complete. 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 Processor -- start 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 -- start start 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0101c00 0x7f29e0197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0102e00 0x7f29e0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29e01037c0 0x7f29e019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f29e010d890 con 0x7f29e0102e00 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29e010d710 con 0x7f29e01037c0 2024-09-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e71cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29e010da10 con 0x7f29e0101c00 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0102e00 0x7f29e0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0102e00 0x7f29e0198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37938/0 (socket says 172.21.15.100:37938) 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 -- 172.21.15.100:0/1028810621 learned_addr learned my addr 172.21.15.100:0/1028810621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e4f6b640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0101c00 0x7f29e0197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e576c640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29e01037c0 0x7f29e019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 -- 172.21.15.100:0/1028810621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0101c00 msgr2=0x7f29e0197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0101c00 0x7f29e0197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 -- 172.21.15.100:0/1028810621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29e01037c0 msgr2=0x7f29e019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29e01037c0 0x7f29e019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29dffff640 1 -- 172.21.15.100:0/1028810621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e019fb40 con 0x7f29e0102e00 2024-09-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.902+0000 7f29e576c640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29e01037c0 0x7f29e019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.903+0000 7f29dffff640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0102e00 0x7f29e0198450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00e9f0 tx=0x7f29cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.903+0000 7f29ddffb640 1 -- 172.21.15.100:0/1028810621 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00cd80 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.903+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e019fe30 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.903+0000 7f29ddffb640 1 -- 172.21.15.100:0/1028810621 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc010910 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.903+0000 7f29ddffb640 1 -- 172.21.15.100:0/1028810621 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0188f0 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.903+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e01a0330 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.904+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e0108fd0 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.905+0000 7f29ddffb640 1 -- 172.21.15.100:0/1028810621 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f29cc010ac0 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.906+0000 7f29ddffb640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29d00a2bb0 0x7f29d00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.906+0000 7f29e4f6b640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29d00a2bb0 0x7f29d00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.906+0000 7f29ddffb640 1 -- 172.21.15.100:0/1028810621 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f29cc0cee70 con 0x7f29e0102e00 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.906+0000 7f29e4f6b640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29d00a2bb0 0x7f29d00a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005ab0 tx=0x7f29d4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:53.911+0000 7f29ddffb640 1 -- 172.21.15.100:0/1028810621 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29cc09c390 con 0x7f29e0102e00 2024-09-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.079+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f29e002d970 con 0x7f29e0102e00 2024-09-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.080+0000 7f29ddffb640 1 -- 172.21.15.100:0/1028810621 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f29cc09bc90 con 0x7f29e0102e00 2024-09-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29d00a2bb0 msgr2=0x7f29d00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29d00a2bb0 0x7f29d00a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005ab0 tx=0x7f29d4000bc0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0102e00 msgr2=0x7f29e0198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0102e00 0x7f29e0198450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00e9f0 tx=0x7f29cc00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 shutdown_connections 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29d00a2bb0 0x7f29d00a5070 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29e01037c0 0x7f29e019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e0102e00 0x7f29e0198450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 --2- 172.21.15.100:0/1028810621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29e0101c00 0x7f29e0197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 >> 172.21.15.100:0/1028810621 conn(0x7f29e00fd390 msgr2=0x7f29e01061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 shutdown_connections 2024-09-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:54.083+0000 7f29e71cf640 1 -- 172.21.15.100:0/1028810621 wait complete. 2024-09-12T02:35:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:54 smithi100 ceph-mon[31390]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:54 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1028810621' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:35:54.907 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726108531,"num_in_osds":12,"osd_in_since":1726108533,"num_remapped_pgs":0} 2024-09-12T02:35:55.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:54 smithi189 ceph-mon[35196]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:55.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:54 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1028810621' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:35:55.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:35:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:35:54.812+0000 7f0a1ede3640 -1 osd.11 0 log_to_monitors true 2024-09-12T02:35:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:54 smithi117 ceph-mon[34898]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:54 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1028810621' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:35:55.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:35:56.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:55 smithi189 ceph-mon[35196]: from='osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:35:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:55 smithi189 ceph-mon[35196]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:35:56.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:55 smithi117 ceph-mon[34898]: from='osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:35:56.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:55 smithi117 ceph-mon[34898]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:35:56.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:55 smithi100 ceph-mon[31390]: from='osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:35:56.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:55 smithi100 ceph-mon[31390]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:35:56.162 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 -- 172.21.15.100:0/3609562260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8101cd0 msgr2=0x7f43d8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 --2- 172.21.15.100:0/3609562260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8101cd0 0x7f43d8102150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009900 tx=0x7f43c002a410 comp rx=0 tx=0).stop 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 -- 172.21.15.100:0/3609562260 shutdown_connections 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 --2- 172.21.15.100:0/3609562260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d8102690 0x7f43d8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 --2- 172.21.15.100:0/3609562260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8101cd0 0x7f43d8102150 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 --2- 172.21.15.100:0/3609562260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d8100ad0 0x7f43d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 -- 172.21.15.100:0/3609562260 >> 172.21.15.100:0/3609562260 conn(0x7f43d80fc280 msgr2=0x7f43d80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 -- 172.21.15.100:0/3609562260 shutdown_connections 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.736+0000 7f43dd687640 1 -- 172.21.15.100:0/3609562260 wait complete. 2024-09-12T02:35:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 Processor -- start 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 -- start start 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d8100ad0 0x7f43d819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d8101cd0 0x7f43d819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8102690 0x7f43d81a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43d810c800 con 0x7f43d8102690 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f43d810c680 con 0x7f43d8101cd0 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43dd687640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43d810c980 con 0x7f43d8100ad0 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8102690 0x7f43d81a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8102690 0x7f43d81a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51176/0 (socket says 172.21.15.100:51176) 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 -- 172.21.15.100:0/345948979 learned_addr learned my addr 172.21.15.100:0/345948979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d6ffd640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d8100ad0 0x7f43d819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d67fc640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d8101cd0 0x7f43d819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 -- 172.21.15.100:0/345948979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d8100ad0 msgr2=0x7f43d819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d8100ad0 0x7f43d819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 -- 172.21.15.100:0/345948979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d8101cd0 msgr2=0x7f43d819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d8101cd0 0x7f43d819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d77fe640 1 -- 172.21.15.100:0/345948979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d81a1de0 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.737+0000 7f43d67fc640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d8101cd0 0x7f43d819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.738+0000 7f43d77fe640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8102690 0x7f43d81a1770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e970 tx=0x7f43c800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.738+0000 7f43cffff640 1 -- 172.21.15.100:0/345948979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c800ccc0 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.738+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d81a20d0 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.738+0000 7f43cffff640 1 -- 172.21.15.100:0/345948979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43c800ce60 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.738+0000 7f43cffff640 1 -- 172.21.15.100:0/345948979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8010450 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.738+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d81a26e0 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.739+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d81a29a0 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.741+0000 7f43cffff640 1 -- 172.21.15.100:0/345948979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f43c8005020 con 0x7f43d8102690 2024-09-12T02:35:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.741+0000 7f43cffff640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43c40a2bb0 0x7f43c40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.741+0000 7f43d6ffd640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43c40a2bb0 0x7f43c40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.741+0000 7f43cffff640 1 -- 172.21.15.100:0/345948979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f43c80cef00 con 0x7f43d8102690 2024-09-12T02:35:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.742+0000 7f43d6ffd640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43c40a2bb0 0x7f43c40a5070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43d8101b30 tx=0x7f43d000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.745+0000 7f43cffff640 1 -- 172.21.15.100:0/345948979 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43c809c420 con 0x7f43d8102690 2024-09-12T02:35:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:35:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:35:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:56.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.913+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f43d81a3060 con 0x7f43d8102690 2024-09-12T02:35:56.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.913+0000 7f43cffff640 1 -- 172.21.15.100:0/345948979 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f43c809bd20 con 0x7f43d8102690 2024-09-12T02:35:56.913 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:35:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43c40a2bb0 msgr2=0x7f43c40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43c40a2bb0 0x7f43c40a5070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43d8101b30 tx=0x7f43d000d040 comp rx=0 tx=0).stop 2024-09-12T02:35:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8102690 msgr2=0x7f43d81a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8102690 0x7f43d81a1770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e970 tx=0x7f43c800ed70 comp rx=0 tx=0).stop 2024-09-12T02:35:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 shutdown_connections 2024-09-12T02:35:56.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43c40a2bb0 0x7f43c40a5070 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43d8102690 0x7f43d81a1770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d8101cd0 0x7f43d819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 --2- 172.21.15.100:0/345948979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d8100ad0 0x7f43d819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 >> 172.21.15.100:0/345948979 conn(0x7f43d80fc280 msgr2=0x7f43d806a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 shutdown_connections 2024-09-12T02:35:56.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:56.915+0000 7f43dd687640 1 -- 172.21.15.100:0/345948979 wait complete. 2024-09-12T02:35:57.013 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:35:56.703+0000 7f0a1ad66640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T02:35:57.013 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:35:56.720+0000 7f0a16b8e640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:57.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:57.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:35:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:57.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:35:57.630 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726108531,"num_in_osds":12,"osd_in_since":1726108533,"num_remapped_pgs":0} 2024-09-12T02:35:58.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: Detected new or changed devices on smithi189 2024-09-12T02:35:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T02:35:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:35:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:35:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/345948979' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:35:58.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:57 smithi189 ceph-mon[35196]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: Detected new or changed devices on smithi189 2024-09-12T02:35:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T02:35:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:35:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:35:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/345948979' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:35:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:57 smithi117 ceph-mon[34898]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: Detected new or changed devices on smithi189 2024-09-12T02:35:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T02:35:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:35:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:35:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:58.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:58.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/345948979' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:35:58.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:57 smithi100 ceph-mon[31390]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:35:58.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:35:58.891 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:59.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:58 smithi100 ceph-mon[31390]: purged_snaps scrub starts 2024-09-12T02:35:59.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:58 smithi100 ceph-mon[31390]: purged_snaps scrub ok 2024-09-12T02:35:59.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:59.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:58 smithi100 ceph-mon[31390]: osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] boot 2024-09-12T02:35:59.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:58 smithi100 ceph-mon[31390]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:35:59.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:58 smithi189 ceph-mon[35196]: purged_snaps scrub starts 2024-09-12T02:35:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:58 smithi189 ceph-mon[35196]: purged_snaps scrub ok 2024-09-12T02:35:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:58 smithi189 ceph-mon[35196]: osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] boot 2024-09-12T02:35:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:58 smithi189 ceph-mon[35196]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:35:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:58 smithi117 ceph-mon[34898]: purged_snaps scrub starts 2024-09-12T02:35:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:58 smithi117 ceph-mon[34898]: purged_snaps scrub ok 2024-09-12T02:35:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:58 smithi117 ceph-mon[34898]: osd.11 [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] boot 2024-09-12T02:35:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:58 smithi117 ceph-mon[34898]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:35:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:35:59.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 -- 172.21.15.100:0/3565314487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc101cd0 msgr2=0x7f47bc102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 --2- 172.21.15.100:0/3565314487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc101cd0 0x7f47bc102150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009900 tx=0x7f47a402a410 comp rx=0 tx=0).stop 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 -- 172.21.15.100:0/3565314487 shutdown_connections 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 --2- 172.21.15.100:0/3565314487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc102690 0x7f47bc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 --2- 172.21.15.100:0/3565314487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc101cd0 0x7f47bc102150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 --2- 172.21.15.100:0/3565314487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47bc100ad0 0x7f47bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 -- 172.21.15.100:0/3565314487 >> 172.21.15.100:0/3565314487 conn(0x7f47bc0fc280 msgr2=0x7f47bc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 -- 172.21.15.100:0/3565314487 shutdown_connections 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.368+0000 7f47c1c42640 1 -- 172.21.15.100:0/3565314487 wait complete. 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 Processor -- start 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 -- start start 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc100ad0 0x7f47bc06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47bc101cd0 0x7f47bc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc102690 0x7f47bc19f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc10c7d0 con 0x7f47bc100ad0 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc10c650 con 0x7f47bc102690 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47c1c42640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc10c950 con 0x7f47bc101cd0 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc100ad0 0x7f47bc06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc100ad0 0x7f47bc06aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51188/0 (socket says 172.21.15.100:51188) 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 -- 172.21.15.100:0/1307797662 learned_addr learned my addr 172.21.15.100:0/1307797662 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bbfff640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc102690 0x7f47bc19f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47b3fff640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47bc101cd0 0x7f47bc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 -- 172.21.15.100:0/1307797662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47bc101cd0 msgr2=0x7f47bc19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47bc101cd0 0x7f47bc19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 -- 172.21.15.100:0/1307797662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc102690 msgr2=0x7f47bc19f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc102690 0x7f47bc19f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 -- 172.21.15.100:0/1307797662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc19fc10 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bbfff640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc102690 0x7f47bc19f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc100ad0 0x7f47bc06aad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00b450 tx=0x7f47ac00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.369+0000 7f47b97fa640 1 -- 172.21.15.100:0/1307797662 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac015020 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.370+0000 7f47b97fa640 1 -- 172.21.15.100:0/1307797662 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47ac011d70 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.370+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc19fea0 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.370+0000 7f47b97fa640 1 -- 172.21.15.100:0/1307797662 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00f340 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.370+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc1a0380 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.370+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc107f20 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.372+0000 7f47b97fa640 1 -- 172.21.15.100:0/1307797662 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f47ac018020 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.372+0000 7f47b97fa640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47a80a2b80 0x7f47a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.373+0000 7f47b3fff640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47a80a2b80 0x7f47a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.373+0000 7f47b97fa640 1 -- 172.21.15.100:0/1307797662 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f47ac0ce730 con 0x7f47bc100ad0 2024-09-12T02:35:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.373+0000 7f47b3fff640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47a80a2b80 0x7f47a80a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47a4006010 tx=0x7f47a4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.377+0000 7f47b97fa640 1 -- 172.21.15.100:0/1307797662 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47ac01f020 con 0x7f47bc100ad0 2024-09-12T02:35:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.543+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f47bc02da10 con 0x7f47bc100ad0 2024-09-12T02:35:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.543+0000 7f47b97fa640 1 -- 172.21.15.100:0/1307797662 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f47ac00d040 con 0x7f47bc100ad0 2024-09-12T02:35:59.544 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:35:59.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47a80a2b80 msgr2=0x7f47a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47a80a2b80 0x7f47a80a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47a4006010 tx=0x7f47a4000bc0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc100ad0 msgr2=0x7f47bc06aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc100ad0 0x7f47bc06aad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00b450 tx=0x7f47ac00b910 comp rx=0 tx=0).stop 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 shutdown_connections 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47a80a2b80 0x7f47a80a5040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc102690 0x7f47bc19f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47bc101cd0 0x7f47bc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 --2- 172.21.15.100:0/1307797662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc100ad0 0x7f47bc06aad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 >> 172.21.15.100:0/1307797662 conn(0x7f47bc0fc280 msgr2=0x7f47bc1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 shutdown_connections 2024-09-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:35:59.545+0000 7f47c1c42640 1 -- 172.21.15.100:0/1307797662 wait complete. 2024-09-12T02:35:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:59 smithi100 ceph-mon[31390]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:35:59.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:59 smithi100 ceph-mon[31390]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:59.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:35:59 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1307797662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:36:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:59 smithi189 ceph-mon[35196]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:36:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:59 smithi189 ceph-mon[35196]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:35:59 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1307797662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:36:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:59 smithi117 ceph-mon[34898]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:36:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:59 smithi117 ceph-mon[34898]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:35:59 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1307797662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:36:00.360 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726108557,"num_in_osds":12,"osd_in_since":1726108533,"num_remapped_pgs":0} 2024-09-12T02:36:00.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:36:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 -- 172.21.15.100:0/726388529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30105f40 msgr2=0x7f3d301063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 --2- 172.21.15.100:0/726388529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30105f40 0x7f3d301063d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009ca0 tx=0x7f3d2802a940 comp rx=0 tx=0).stop 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 -- 172.21.15.100:0/726388529 shutdown_connections 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 --2- 172.21.15.100:0/726388529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30105f40 0x7f3d301063d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 --2- 172.21.15.100:0/726388529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d30101450 0x7f3d30105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 --2- 172.21.15.100:0/726388529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d30100b30 0x7f3d30100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 -- 172.21.15.100:0/726388529 >> 172.21.15.100:0/726388529 conn(0x7f3d300fc7a0 msgr2=0x7f3d300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 -- 172.21.15.100:0/726388529 shutdown_connections 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.103+0000 7f3d3816a640 1 -- 172.21.15.100:0/726388529 wait complete. 2024-09-12T02:36:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 Processor -- start 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 -- start start 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30100b30 0x7f3d301a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d30101450 0x7f3d301a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d30105f40 0x7f3d3019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d30118560 con 0x7f3d30100b30 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d301183e0 con 0x7f3d30101450 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d3816a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d301186e0 con 0x7f3d30105f40 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30100b30 0x7f3d301a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30100b30 0x7f3d301a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51204/0 (socket says 172.21.15.100:51204) 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 -- 172.21.15.100:0/3621980170 learned_addr learned my addr 172.21.15.100:0/3621980170 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d36707640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d30105f40 0x7f3d3019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35705640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d30101450 0x7f3d301a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 -- 172.21.15.100:0/3621980170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d30105f40 msgr2=0x7f3d3019e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d30105f40 0x7f3d3019e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 -- 172.21.15.100:0/3621980170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d30101450 msgr2=0x7f3d301a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d30101450 0x7f3d301a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35f06640 1 -- 172.21.15.100:0/3621980170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3019ef50 con 0x7f3d30100b30 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.104+0000 7f3d35705640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d30101450 0x7f3d301a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.105+0000 7f3d35f06640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30100b30 0x7f3d301a4630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c920 tx=0x7f3d2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.105+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3621980170 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c007c70 con 0x7f3d30100b30 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.105+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3621980170 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d2c007e10 con 0x7f3d30100b30 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.105+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3019f240 con 0x7f3d30100b30 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.105+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3621980170 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c018890 con 0x7f3d30100b30 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.105+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d301ab490 con 0x7f3d30100b30 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.106+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3006b070 con 0x7f3d30100b30 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.107+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3621980170 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3d2c018a50 con 0x7f3d30100b30 2024-09-12T02:36:01.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.108+0000 7f3d26ffd640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3d1c0a2c00 0x7f3d1c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.108+0000 7f3d35705640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3d1c0a2c00 0x7f3d1c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.108+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3621980170 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f3d2c0cefb0 con 0x7f3d30100b30 2024-09-12T02:36:01.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.108+0000 7f3d35705640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3d1c0a2c00 0x7f3d1c0a50c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d30106590 tx=0x7f3d20005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:01.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.111+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3621980170 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d2c014030 con 0x7f3d30100b30 2024-09-12T02:36:01.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.279+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d301ab820 con 0x7f3d30100b30 2024-09-12T02:36:01.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.280+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3621980170 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18562 (secure 0 0 0) 0x7f3d2c00de20 con 0x7f3d30100b30 2024-09-12T02:36:01.281 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:01.281 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":77,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:35:58.714748+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3d1c0a2c00 msgr2=0x7f3d1c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3d1c0a2c00 0x7f3d1c0a50c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d30106590 tx=0x7f3d20005d50 comp rx=0 tx=0).stop 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30100b30 msgr2=0x7f3d301a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30100b30 0x7f3d301a4630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c920 tx=0x7f3d2c00cde0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 shutdown_connections 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3d1c0a2c00 0x7f3d1c0a50c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d30105f40 0x7f3d3019e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d30101450 0x7f3d301a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 --2- 172.21.15.100:0/3621980170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d30100b30 0x7f3d301a4630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.282+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 >> 172.21.15.100:0/3621980170 conn(0x7f3d300fc7a0 msgr2=0x7f3d301038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.283+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 shutdown_connections 2024-09-12T02:36:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:01.283+0000 7f3d3816a640 1 -- 172.21.15.100:0/3621980170 wait complete. 2024-09-12T02:36:01.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:01 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3621980170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:01.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:01 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3621980170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:01.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:01 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3621980170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:01.950 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:32:09.751769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:36:01.951 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T02:36:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:02.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:02 smithi117 ceph-mon[34898]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:02.599 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:02 smithi100 ceph-mon[31390]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 -- 172.21.15.100:0/2985637151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102ef0 msgr2=0x7f3b2010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2985637151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102ef0 0x7f3b2010da40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009ca0 tx=0x7f3b1802a950 comp rx=0 tx=0).stop 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 -- 172.21.15.100:0/2985637151 shutdown_connections 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2985637151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102ef0 0x7f3b2010da40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2985637151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b20102570 0x7f3b201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2985637151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b20100e20 0x7f3b20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 -- 172.21.15.100:0/2985637151 >> 172.21.15.100:0/2985637151 conn(0x7f3b200fc7d0 msgr2=0x7f3b200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 -- 172.21.15.100:0/2985637151 shutdown_connections 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 -- 172.21.15.100:0/2985637151 wait complete. 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 Processor -- start 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.682+0000 7f3b24abe640 1 -- start start 2024-09-12T02:36:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b20100e20 0x7f3b201984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102570 0x7f3b20198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b20102ef0 0x7f3b2019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b20110fa0 con 0x7f3b20102570 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b20110e20 con 0x7f3b20102ef0 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b20111120 con 0x7f3b20100e20 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102570 0x7f3b20198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102570 0x7f3b20198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51230/0 (socket says 172.21.15.100:51230) 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 -- 172.21.15.100:0/2516851073 learned_addr learned my addr 172.21.15.100:0/2516851073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b1ed9d640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b20102ef0 0x7f3b2019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b1e59c640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b20100e20 0x7f3b201984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 -- 172.21.15.100:0/2516851073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b20100e20 msgr2=0x7f3b201984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b20100e20 0x7f3b201984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 -- 172.21.15.100:0/2516851073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b20102ef0 msgr2=0x7f3b2019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b20102ef0 0x7f3b2019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 -- 172.21.15.100:0/2516851073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2019d480 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b17fff640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102570 0x7f3b20198a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800d950 tx=0x7f3b0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b177fe640 1 -- 172.21.15.100:0/2516851073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08017070 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b177fe640 1 -- 172.21.15.100:0/2516851073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b08009c30 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2019d770 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b177fe640 1 -- 172.21.15.100:0/2516851073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800f6b0 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.683+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b201a5050 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.685+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b20101200 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.686+0000 7f3b177fe640 1 -- 172.21.15.100:0/2516851073 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3b080109d0 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.686+0000 7f3b177fe640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b0c0a2b80 0x7f3b0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.686+0000 7f3b1e59c640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b0c0a2b80 0x7f3b0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.686+0000 7f3b177fe640 1 -- 172.21.15.100:0/2516851073 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f3b080ce830 con 0x7f3b20102570 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.687+0000 7f3b1e59c640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b0c0a2b80 0x7f3b0c0a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009890 tx=0x7f3b10008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.690+0000 7f3b177fe640 1 -- 172.21.15.100:0/2516851073 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b08009de0 con 0x7f3b20102570 2024-09-12T02:36:02.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:02 smithi189 ceph-mon[35196]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.857+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3b2010a0a0 con 0x7f3b20102570 2024-09-12T02:36:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.858+0000 7f3b177fe640 1 -- 172.21.15.100:0/2516851073 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f3b0809bc30 con 0x7f3b20102570 2024-09-12T02:36:02.858 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b0c0a2b80 msgr2=0x7f3b0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b0c0a2b80 0x7f3b0c0a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009890 tx=0x7f3b10008040 comp rx=0 tx=0).stop 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102570 msgr2=0x7f3b20198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102570 0x7f3b20198a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800d950 tx=0x7f3b0800de10 comp rx=0 tx=0).stop 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 shutdown_connections 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b0c0a2b80 0x7f3b0c0a5040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b20102ef0 0x7f3b2019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b20102570 0x7f3b20198a10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 --2- 172.21.15.100:0/2516851073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b20100e20 0x7f3b201984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 >> 172.21.15.100:0/2516851073 conn(0x7f3b200fc7d0 msgr2=0x7f3b2006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 shutdown_connections 2024-09-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:02.860+0000 7f3b24abe640 1 -- 172.21.15.100:0/2516851073 wait complete. 2024-09-12T02:36:03.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:03 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2516851073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:36:03.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:03 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2516851073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:36:03.707 INFO:tasks.cephadm:Adding mds.a on smithi100 2024-09-12T02:36:03.707 INFO:tasks.cephadm:Adding mds.d on smithi100 2024-09-12T02:36:03.707 INFO:tasks.cephadm:Adding mds.g on smithi100 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.j on smithi100 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.b on smithi117 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.e on smithi117 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.h on smithi117 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.k on smithi117 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.c on smithi189 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.f on smithi189 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.i on smithi189 2024-09-12T02:36:03.708 INFO:tasks.cephadm:Adding mds.l on smithi189 2024-09-12T02:36:03.708 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l' 2024-09-12T02:36:03.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:03 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2516851073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:36:03.967 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 -- 172.21.15.189:0/4053598499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c102df0 msgr2=0x7fd92c103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 --2- 172.21.15.189:0/4053598499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c102df0 0x7fd92c103270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009900 tx=0x7fd91c02a410 comp rx=0 tx=0).stop 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 -- 172.21.15.189:0/4053598499 shutdown_connections 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 --2- 172.21.15.189:0/4053598499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd92c1037b0 0x7fd92c10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 --2- 172.21.15.189:0/4053598499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c102df0 0x7fd92c103270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 --2- 172.21.15.189:0/4053598499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd92c101bf0 0x7fd92c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 -- 172.21.15.189:0/4053598499 >> 172.21.15.189:0/4053598499 conn(0x7fd92c0fd3c0 msgr2=0x7fd92c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 -- 172.21.15.189:0/4053598499 shutdown_connections 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.501+0000 7fd934257640 1 -- 172.21.15.189:0/4053598499 wait complete. 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 Processor -- start 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 -- start start 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c101bf0 0x7fd92c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd92c102df0 0x7fd92c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd92c1037b0 0x7fd92c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c10d940 con 0x7fd92c1037b0 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c10d7c0 con 0x7fd92c102df0 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd934257640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c10dac0 con 0x7fd92c101bf0 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd931ff3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c101bf0 0x7fd92c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd931ff3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c101bf0 0x7fd92c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:38980/0 (socket says 172.21.15.189:38980) 2024-09-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd931ff3640 1 -- 172.21.15.189:0/3333148550 learned_addr learned my addr 172.21.15.189:0/3333148550 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.502+0000 7fd9327f4640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd92c1037b0 0x7fd92c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd9317f2640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd92c102df0 0x7fd92c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd931ff3640 1 -- 172.21.15.189:0/3333148550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd92c102df0 msgr2=0x7fd92c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd931ff3640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd92c102df0 0x7fd92c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd931ff3640 1 -- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd92c1037b0 msgr2=0x7fd92c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd931ff3640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd92c1037b0 0x7fd92c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd931ff3640 1 -- 172.21.15.189:0/3333148550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c19fb60 con 0x7fd92c101bf0 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd9317f2640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd92c102df0 0x7fd92c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd931ff3640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c101bf0 0x7fd92c197f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd92800b450 tx=0x7fd92800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd922ffd640 1 -- 172.21.15.189:0/3333148550 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928015020 con 0x7fd92c101bf0 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c19fe50 con 0x7fd92c101bf0 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd922ffd640 1 -- 172.21.15.189:0/3333148550 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd928011d70 con 0x7fd92c101bf0 2024-09-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd922ffd640 1 -- 172.21.15.189:0/3333148550 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92800f340 con 0x7fd92c101bf0 2024-09-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.503+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c1a0320 con 0x7fd92c101bf0 2024-09-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.504+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92c108fa0 con 0x7fd92c101bf0 2024-09-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.506+0000 7fd922ffd640 1 -- 172.21.15.189:0/3333148550 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd928018020 con 0x7fd92c101bf0 2024-09-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.507+0000 7fd922ffd640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9180a2bb0 0x7fd9180a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.507+0000 7fd922ffd640 1 -- 172.21.15.189:0/3333148550 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fd9280ceb50 con 0x7fd92c101bf0 2024-09-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.507+0000 7fd9317f2640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9180a2bb0 0x7fd9180a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.507+0000 7fd9317f2640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9180a2bb0 0x7fd9180a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd91c006010 tx=0x7fd91c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.510+0000 7fd922ffd640 1 -- 172.21.15.189:0/3333148550 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd92801f020 con 0x7fd92c101bf0 2024-09-12T02:36:04.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:04 smithi100 ceph-mon[31390]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:04.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.689+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}) -- 0x7fd92c062730 con 0x7fd9180a2bb0 2024-09-12T02:36:04.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:04 smithi189 ceph-mon[35196]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:04.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.699+0000 7fd922ffd640 1 -- 172.21.15.189:0/3333148550 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fd92c062730 con 0x7fd9180a2bb0 2024-09-12T02:36:04.700 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mds.all update... 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9180a2bb0 msgr2=0x7fd9180a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9180a2bb0 0x7fd9180a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd91c006010 tx=0x7fd91c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c101bf0 msgr2=0x7fd92c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c101bf0 0x7fd92c197f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd92800b450 tx=0x7fd92800b910 comp rx=0 tx=0).stop 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 shutdown_connections 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9180a2bb0 0x7fd9180a5070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd92c1037b0 0x7fd92c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd92c102df0 0x7fd92c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 --2- 172.21.15.189:0/3333148550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd92c101bf0 0x7fd92c197f30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 >> 172.21.15.189:0/3333148550 conn(0x7fd92c0fd3c0 msgr2=0x7fd92c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 shutdown_connections 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:36:04.701+0000 7fd934257640 1 -- 172.21.15.189:0/3333148550 wait complete. 2024-09-12T02:36:04.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:04 smithi117 ceph-mon[34898]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:05.452 DEBUG:teuthology.orchestra.run.smithi100:mds.a> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T02:36:05.455 DEBUG:teuthology.orchestra.run.smithi100:mds.d> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T02:36:05.498 DEBUG:teuthology.orchestra.run.smithi100:mds.g> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T02:36:05.541 DEBUG:teuthology.orchestra.run.smithi100:mds.j> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T02:36:05.585 DEBUG:teuthology.orchestra.run.smithi117:mds.b> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T02:36:05.588 DEBUG:teuthology.orchestra.run.smithi117:mds.e> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T02:36:05.634 DEBUG:teuthology.orchestra.run.smithi117:mds.h> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T02:36:05.677 DEBUG:teuthology.orchestra.run.smithi117:mds.k> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T02:36:05.720 DEBUG:teuthology.orchestra.run.smithi189:mds.c> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T02:36:05.723 DEBUG:teuthology.orchestra.run.smithi189:mds.f> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T02:36:05.766 DEBUG:teuthology.orchestra.run.smithi189:mds.i> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T02:36:05.809 DEBUG:teuthology.orchestra.run.smithi189:mds.l> sudo journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T02:36:05.852 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T02:36:05.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:05.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:05.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:36:05.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:05.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:05.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:05.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:05.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:05.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:05.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:05.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:05.957 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:05.957 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:36:05.957 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:05.957 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:05.957 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:05.958 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:05.958 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:05.958 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:05.958 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:05.958 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:06.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:06.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:36:06.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 -- 172.21.15.100:0/2630792110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0102d90 msgr2=0x7f29b0103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 --2- 172.21.15.100:0/2630792110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0102d90 0x7f29b0103170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009cd0 tx=0x7f29a002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 -- 172.21.15.100:0/2630792110 shutdown_connections 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 --2- 172.21.15.100:0/2630792110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29b0108290 0x7f29b010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 --2- 172.21.15.100:0/2630792110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29b0103740 0x7f29b0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 --2- 172.21.15.100:0/2630792110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0102d90 0x7f29b0103170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 -- 172.21.15.100:0/2630792110 >> 172.21.15.100:0/2630792110 conn(0x7f29b00fc7d0 msgr2=0x7f29b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 -- 172.21.15.100:0/2630792110 shutdown_connections 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 -- 172.21.15.100:0/2630792110 wait complete. 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.581+0000 7f29b7914640 1 Processor -- start 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b7914640 1 -- start start 2024-09-12T02:36:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b7914640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29b0102d90 0x7f29b0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b7914640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29b0103740 0x7f29b0198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b7914640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0108290 0x7f29b019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b7914640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112090 con 0x7f29b0108290 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b7914640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0111f10 con 0x7f29b0103740 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b7914640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112210 con 0x7f29b0102d90 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0108290 0x7f29b019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0108290 0x7f29b019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46434/0 (socket says 172.21.15.100:46434) 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 -- 172.21.15.100:0/3372883917 learned_addr learned my addr 172.21.15.100:0/3372883917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b56b0640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29b0102d90 0x7f29b0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b4eaf640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29b0103740 0x7f29b0198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 -- 172.21.15.100:0/3372883917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29b0102d90 msgr2=0x7f29b0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29b0102d90 0x7f29b0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 -- 172.21.15.100:0/3372883917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29b0103740 msgr2=0x7f29b0198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29b0103740 0x7f29b0198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 -- 172.21.15.100:0/3372883917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b019d500 con 0x7f29b0108290 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b4eaf640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29b0103740 0x7f29b0198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29b5eb1640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0108290 0x7f29b019ce20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c970 tx=0x7f29a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.582+0000 7f29ae7fc640 1 -- 172.21.15.100:0/3372883917 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8007bb0 con 0x7f29b0108290 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.583+0000 7f29ae7fc640 1 -- 172.21.15.100:0/3372883917 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29a8007d50 con 0x7f29b0108290 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.583+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b019d7f0 con 0x7f29b0108290 2024-09-12T02:36:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.583+0000 7f29ae7fc640 1 -- 172.21.15.100:0/3372883917 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a800f450 con 0x7f29b0108290 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.583+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a50d0 con 0x7f29b0108290 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.584+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b006a7f0 con 0x7f29b0108290 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.585+0000 7f29ae7fc640 1 -- 172.21.15.100:0/3372883917 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f29a8004f00 con 0x7f29b0108290 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.586+0000 7f29ae7fc640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29980a2b80 0x7f29980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.586+0000 7f29ae7fc640 1 -- 172.21.15.100:0/3372883917 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f29a80cec20 con 0x7f29b0108290 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.586+0000 7f29b56b0640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29980a2b80 0x7f29980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.587+0000 7f29b56b0640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29980a2b80 0x7f29980a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29a0006010 tx=0x7f29a0009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.589+0000 7f29ae7fc640 1 -- 172.21.15.100:0/3372883917 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29a8014030 con 0x7f29b0108290 2024-09-12T02:36:06.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.790+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29b0103170 con 0x7f29b0108290 2024-09-12T02:36:06.791 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:06 smithi100 ceph-mon[31390]: Deploying daemon mds.l on smithi189 2024-09-12T02:36:06.791 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:06 smithi100 ceph-mon[31390]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:06.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.791+0000 7f29ae7fc640 1 -- 172.21.15.100:0/3372883917 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f29b0103170 con 0x7f29b0108290 2024-09-12T02:36:06.792 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:06.792 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"btime":"2024-09-12T02:29:09:444586+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T02:36:06.792 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 1 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.793+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29980a2b80 msgr2=0x7f29980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.793+0000 7f29b7914640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29980a2b80 0x7f29980a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29a0006010 tx=0x7f29a0009900 comp rx=0 tx=0).stop 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.793+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0108290 msgr2=0x7f29b019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.793+0000 7f29b7914640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0108290 0x7f29b019ce20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c970 tx=0x7f29a800ce30 comp rx=0 tx=0).stop 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 shutdown_connections 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29980a2b80 0x7f29980a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b0108290 0x7f29b019ce20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29b0103740 0x7f29b0198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 --2- 172.21.15.100:0/3372883917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29b0102d90 0x7f29b0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 >> 172.21.15.100:0/3372883917 conn(0x7f29b00fc7d0 msgr2=0x7f29b0105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 shutdown_connections 2024-09-12T02:36:06.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:06.794+0000 7f29b7914640 1 -- 172.21.15.100:0/3372883917 wait complete. 2024-09-12T02:36:06.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:06 smithi189 ceph-mon[35196]: Deploying daemon mds.l on smithi189 2024-09-12T02:36:06.927 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:06 smithi189 ceph-mon[35196]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:06.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:06 smithi117 ceph-mon[34898]: Deploying daemon mds.l on smithi189 2024-09-12T02:36:06.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:06 smithi117 ceph-mon[34898]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:07.264 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 systemd[1]: Starting Ceph mds.l for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:07.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 podman[65065]: 2024-09-12 02:36:07.256027253 +0000 UTC m=+0.015656501 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:07.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 podman[65065]: 2024-09-12 02:36:07.397000887 +0000 UTC m=+0.156630166 container create 76bb27898b7379b33ab966e4cb0954a679703e69a007b6834ce2bdf3c45d81af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:36:07.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 podman[65065]: 2024-09-12 02:36:07.650025461 +0000 UTC m=+0.409654695 container init 76bb27898b7379b33ab966e4cb0954a679703e69a007b6834ce2bdf3c45d81af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:36:07.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:07 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3372883917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:07.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:07 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6832/244666903,v1:172.21.15.189:6833/244666903] up:boot 2024-09-12T02:36:07.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:07 smithi100 ceph-mon[31390]: fsmap 1 up:standby 2024-09-12T02:36:07.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:07 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:36:08.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:07 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3372883917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:07 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6832/244666903,v1:172.21.15.189:6833/244666903] up:boot 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:07 smithi189 ceph-mon[35196]: fsmap 1 up:standby 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:07 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 podman[65065]: 2024-09-12 02:36:07.652962044 +0000 UTC m=+0.412591279 container start 76bb27898b7379b33ab966e4cb0954a679703e69a007b6834ce2bdf3c45d81af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 ceph-mds[65084]: -- 172.21.15.189:0/4271781374 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559688199860 con 0x559688177000 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l[65080]: starting mds.l at 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 bash[65065]: 76bb27898b7379b33ab966e4cb0954a679703e69a007b6834ce2bdf3c45d81af 2024-09-12T02:36:08.014 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:36:07 smithi189 systemd[1]: Started Ceph mds.l for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:08.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:07 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3372883917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:08.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:07 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6832/244666903,v1:172.21.15.189:6833/244666903] up:boot 2024-09-12T02:36:08.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:07 smithi117 ceph-mon[34898]: fsmap 1 up:standby 2024-09-12T02:36:08.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:07 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:36:08.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:08.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:08 smithi117 ceph-mon[34898]: Deploying daemon mds.k on smithi117 2024-09-12T02:36:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:08 smithi189 ceph-mon[35196]: Deploying daemon mds.k on smithi117 2024-09-12T02:36:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:09.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:09.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:09.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:09.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:09.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:08 smithi100 ceph-mon[31390]: Deploying daemon mds.k on smithi117 2024-09-12T02:36:09.551 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:09.806 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:09.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:09 smithi100 ceph-mon[31390]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:10.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:09 smithi189 ceph-mon[35196]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:10.057 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:09 smithi117 ceph-mon[34898]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:10.057 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:09 smithi117 systemd[1]: Starting Ceph mds.k for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/3181733341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 msgr2=0x7ff1bc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/3181733341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc10d950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009cd0 tx=0x7ff1b402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/3181733341 shutdown_connections 2024-09-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/3181733341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc10d950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/3181733341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc100a80 0x7ff1bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/3181733341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1bc106a80 0x7ff1bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/3181733341 >> 172.21.15.100:0/3181733341 conn(0x7ff1bc0fc7a0 msgr2=0x7ff1bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/3181733341 shutdown_connections 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/3181733341 wait complete. 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 Processor -- start 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.272+0000 7ff1c1ce2640 1 -- start start 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1c1ce2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc100a80 0x7ff1bc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1c1ce2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1c1ce2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1bc106a80 0x7ff1bc1a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1c1ce2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc110e80 con 0x7ff1bc101420 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1c1ce2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc110d00 con 0x7ff1bc100a80 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1c1ce2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc111000 con 0x7ff1bc106a80 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc1997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46442/0 (socket says 172.21.15.100:46442) 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc100a80 0x7ff1bc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 -- 172.21.15.100:0/1999102602 learned_addr learned my addr 172.21.15.100:0/1999102602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1bbfff640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1bc106a80 0x7ff1bc1a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 -- 172.21.15.100:0/1999102602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1bc106a80 msgr2=0x7ff1bc1a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1bc106a80 0x7ff1bc1a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 -- 172.21.15.100:0/1999102602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc100a80 msgr2=0x7ff1bc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc100a80 0x7ff1bc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 -- 172.21.15.100:0/1999102602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc1a4850 con 0x7ff1bc101420 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1bbfff640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1bc106a80 0x7ff1bc1a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b3fff640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc1997d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400d950 tx=0x7ff1a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b97fa640 1 -- 172.21.15.100:0/1999102602 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4017070 con 0x7ff1bc101420 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1bc1a4a20 con 0x7ff1bc101420 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b97fa640 1 -- 172.21.15.100:0/1999102602 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1a4009c30 con 0x7ff1bc101420 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.273+0000 7ff1b97fa640 1 -- 172.21.15.100:0/1999102602 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400f6b0 con 0x7ff1bc101420 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.274+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1bc1a4f60 con 0x7ff1bc101420 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.274+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1bc100ee0 con 0x7ff1bc101420 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.276+0000 7ff1b97fa640 1 -- 172.21.15.100:0/1999102602 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff1a40109d0 con 0x7ff1bc101420 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.276+0000 7ff1b97fa640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff1a80a2b80 0x7ff1a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.276+0000 7ff1bb7fe640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff1a80a2b80 0x7ff1a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.276+0000 7ff1b97fa640 1 -- 172.21.15.100:0/1999102602 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff1a40ce810 con 0x7ff1bc101420 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.277+0000 7ff1bb7fe640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff1a80a2b80 0x7ff1a80a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac005fd0 tx=0x7ff1ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.280+0000 7ff1b97fa640 1 -- 172.21.15.100:0/1999102602 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1a4009de0 con 0x7ff1bc101420 2024-09-12T02:36:10.327 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 podman[64362]: 2024-09-12 02:36:09.959068991 +0000 UTC m=+0.016225966 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:10.327 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 podman[64362]: 2024-09-12 02:36:10.082491417 +0000 UTC m=+0.139648433 container create 03d5629605f188c18e790065d2fa272a552ccabda76d5a6bd1a072383e5dc619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:10.327 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 podman[64362]: 2024-09-12 02:36:10.327329834 +0000 UTC m=+0.384486808 container init 03d5629605f188c18e790065d2fa272a552ccabda76d5a6bd1a072383e5dc619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:36:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.482+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1bc108ff0 con 0x7ff1bc101420 2024-09-12T02:36:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.482+0000 7ff1b97fa640 1 -- 172.21.15.100:0/1999102602 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7ff1a409bc10 con 0x7ff1bc101420 2024-09-12T02:36:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:10.483 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"btime":"2024-09-12T02:36:07:681356+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:36:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-09-12T02:36:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff1a80a2b80 msgr2=0x7ff1a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff1a80a2b80 0x7ff1a80a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac005fd0 tx=0x7ff1ac00b390 comp rx=0 tx=0).stop 2024-09-12T02:36:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 msgr2=0x7ff1bc1997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc1997d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400d950 tx=0x7ff1a400de10 comp rx=0 tx=0).stop 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 shutdown_connections 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff1a80a2b80 0x7ff1a80a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1bc106a80 0x7ff1bc1a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1bc101420 0x7ff1bc1997d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 --2- 172.21.15.100:0/1999102602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1bc100a80 0x7ff1bc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 >> 172.21.15.100:0/1999102602 conn(0x7ff1bc0fc7a0 msgr2=0x7ff1bc0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 shutdown_connections 2024-09-12T02:36:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:10.485+0000 7ff1c1ce2640 1 -- 172.21.15.100:0/1999102602 wait complete. 2024-09-12T02:36:10.594 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 podman[64362]: 2024-09-12 02:36:10.33014819 +0000 UTC m=+0.387305166 container start 03d5629605f188c18e790065d2fa272a552ccabda76d5a6bd1a072383e5dc619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:36:10.594 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 ceph-mds[64381]: -- 172.21.15.117:0/1844004928 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b5b64b860 con 0x561b5b628800 2024-09-12T02:36:10.594 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k[64377]: starting mds.k at 2024-09-12T02:36:10.594 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 bash[64362]: 03d5629605f188c18e790065d2fa272a552ccabda76d5a6bd1a072383e5dc619 2024-09-12T02:36:10.594 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:36:10 smithi117 systemd[1]: Started Ceph mds.k for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:11.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1999102602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: Deploying daemon mds.j on smithi100 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6832/369784956,v1:172.21.15.117:6833/369784956] up:boot 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: fsmap 2 up:standby 2024-09-12T02:36:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1999102602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: Deploying daemon mds.j on smithi100 2024-09-12T02:36:11.725 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6832/369784956,v1:172.21.15.117:6833/369784956] up:boot 2024-09-12T02:36:11.726 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: fsmap 2 up:standby 2024-09-12T02:36:11.726 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:36:11.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1999102602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: Deploying daemon mds.j on smithi100 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6832/369784956,v1:172.21.15.117:6833/369784956] up:boot 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: fsmap 2 up:standby 2024-09-12T02:36:11.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:36:12.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:12 smithi189 ceph-mon[35196]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:12.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:12 smithi117 ceph-mon[34898]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:12.849 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:12 smithi100 ceph-mon[31390]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:13.121 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 systemd[1]: Starting Ceph mds.j for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:13.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:13.500 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 podman[70545]: 2024-09-12 02:36:13.134689758 +0000 UTC m=+0.016086448 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:13.500 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 podman[70545]: 2024-09-12 02:36:13.255181343 +0000 UTC m=+0.136578032 container create fdcbbc8ff2174b1cd5871c5fe2d76e7deff82f910cecdc3b25ceb45067686e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:36:13.500 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 podman[70545]: 2024-09-12 02:36:13.499848925 +0000 UTC m=+0.381245617 container init fdcbbc8ff2174b1cd5871c5fe2d76e7deff82f910cecdc3b25ceb45067686e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:36:13.701 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:13.822 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 podman[70545]: 2024-09-12 02:36:13.502902707 +0000 UTC m=+0.384299412 container start fdcbbc8ff2174b1cd5871c5fe2d76e7deff82f910cecdc3b25ceb45067686e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:36:13.822 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 ceph-mds[70594]: -- 172.21.15.100:0/3183349669 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630eed01860 con 0x5630eecdf400 2024-09-12T02:36:13.822 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j[70577]: starting mds.j at 2024-09-12T02:36:13.823 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 bash[70545]: fdcbbc8ff2174b1cd5871c5fe2d76e7deff82f910cecdc3b25ceb45067686e7e 2024-09-12T02:36:13.823 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:36:13 smithi100 systemd[1]: Started Ceph mds.j for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 -- 172.21.15.100:0/2293987008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 msgr2=0x7f13581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 --2- 172.21.15.100:0/2293987008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581067e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f134c009900 tx=0x7f134c02a410 comp rx=0 tx=0).stop 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 -- 172.21.15.100:0/2293987008 shutdown_connections 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 --2- 172.21.15.100:0/2293987008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1358106f10 0x7f135810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 --2- 172.21.15.100:0/2293987008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581067e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 --2- 172.21.15.100:0/2293987008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358101de0 0x7f13581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 -- 172.21.15.100:0/2293987008 >> 172.21.15.100:0/2293987008 conn(0x7f13580fd8c0 msgr2=0x7f13580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 -- 172.21.15.100:0/2293987008 shutdown_connections 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.208+0000 7f135d4ba640 1 -- 172.21.15.100:0/2293987008 wait complete. 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 Processor -- start 2024-09-12T02:36:14.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 -- start start 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1358101de0 0x7f1358198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358106f10 0x7f135819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1358111f70 con 0x7f1358102790 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1358111df0 con 0x7f1358106f10 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f135d4ba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13581120f0 con 0x7f1358101de0 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f13567fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f13567fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46484/0 (socket says 172.21.15.100:46484) 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f13567fc640 1 -- 172.21.15.100:0/1674714309 learned_addr learned my addr 172.21.15.100:0/1674714309 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.209+0000 7f1356ffd640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1358101de0 0x7f1358198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f13577fe640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358106f10 0x7f135819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f13567fc640 1 -- 172.21.15.100:0/1674714309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1358101de0 msgr2=0x7f1358198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f13567fc640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1358101de0 0x7f1358198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f13567fc640 1 -- 172.21.15.100:0/1674714309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358106f10 msgr2=0x7f135819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f13567fc640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358106f10 0x7f135819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f13567fc640 1 -- 172.21.15.100:0/1674714309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135819d440 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f13567fc640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581989d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f134c006010 tx=0x7f134c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f133ffff640 1 -- 172.21.15.100:0/1674714309 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c03f030 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f133ffff640 1 -- 172.21.15.100:0/1674714309 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f134c003ce0 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135819d6d0 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f133ffff640 1 -- 172.21.15.100:0/1674714309 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c035070 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.210+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13581a5010 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.211+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13581032c0 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.212+0000 7f133ffff640 1 -- 172.21.15.100:0/1674714309 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f134c042030 con 0x7f1358102790 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.213+0000 7f133ffff640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13400a2b80 0x7f13400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.213+0000 7f1356ffd640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13400a2b80 0x7f13400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.213+0000 7f133ffff640 1 -- 172.21.15.100:0/1674714309 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f134c0eed70 con 0x7f1358102790 2024-09-12T02:36:14.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.213+0000 7f1356ffd640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13400a2b80 0x7f13400a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f134800bbe0 tx=0x7f134800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:14.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.217+0000 7f133ffff640 1 -- 172.21.15.100:0/1674714309 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f134c0bc230 con 0x7f1358102790 2024-09-12T02:36:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.427+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f135810a0f0 con 0x7f1358102790 2024-09-12T02:36:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.427+0000 7f133ffff640 1 -- 172.21.15.100:0/1674714309 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f134c0bbb30 con 0x7f1358102790 2024-09-12T02:36:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:14.428 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":4,"btime":"2024-09-12T02:36:13:581070+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:36:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 4 2024-09-12T02:36:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13400a2b80 msgr2=0x7f13400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13400a2b80 0x7f13400a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f134800bbe0 tx=0x7f134800b390 comp rx=0 tx=0).stop 2024-09-12T02:36:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 msgr2=0x7f13581989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581989d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f134c006010 tx=0x7f134c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 shutdown_connections 2024-09-12T02:36:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13400a2b80 0x7f13400a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1358106f10 0x7f135819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358102790 0x7f13581989d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 --2- 172.21.15.100:0/1674714309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1358101de0 0x7f1358198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 >> 172.21.15.100:0/1674714309 conn(0x7f13580fd8c0 msgr2=0x7f13580fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 shutdown_connections 2024-09-12T02:36:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:14.429+0000 7f135d4ba640 1 -- 172.21.15.100:0/1674714309 wait complete. 2024-09-12T02:36:14.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.100:6834/742594492,v1:172.21.15.100:6835/742594492] up:boot 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: fsmap 3 up:standby 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:14.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: Deploying daemon mds.d on smithi100 2024-09-12T02:36:14.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:14 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1674714309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:14.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:14.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.100:6834/742594492,v1:172.21.15.100:6835/742594492] up:boot 2024-09-12T02:36:14.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: fsmap 3 up:standby 2024-09-12T02:36:14.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:36:14.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:14.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:14.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:14.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:14.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:14.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:14.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: Deploying daemon mds.d on smithi100 2024-09-12T02:36:14.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:14 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1674714309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.100:6834/742594492,v1:172.21.15.100:6835/742594492] up:boot 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: fsmap 3 up:standby 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: Deploying daemon mds.d on smithi100 2024-09-12T02:36:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:14 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1674714309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:16.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:16 smithi117 ceph-mon[34898]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:16 smithi100 ceph-mon[31390]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:16.871 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:16 smithi100 systemd[1]: Starting Ceph mds.d for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:16 smithi189 ceph-mon[35196]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:17.132 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:16 smithi100 podman[70957]: 2024-09-12 02:36:16.780691958 +0000 UTC m=+0.015469260 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:17.132 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:16 smithi100 podman[70957]: 2024-09-12 02:36:16.996903162 +0000 UTC m=+0.231680444 container create ebb4589b0184b4bc2c6a5f147e5ca9c0976e0cdd7239a2e2b08eb1d7ce9647b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:36:17.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:17.385 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:17 smithi100 podman[70957]: 2024-09-12 02:36:17.258326354 +0000 UTC m=+0.493103634 container init ebb4589b0184b4bc2c6a5f147e5ca9c0976e0cdd7239a2e2b08eb1d7ce9647b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T02:36:17.385 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:17 smithi100 podman[70957]: 2024-09-12 02:36:17.261160061 +0000 UTC m=+0.495937341 container start ebb4589b0184b4bc2c6a5f147e5ca9c0976e0cdd7239a2e2b08eb1d7ce9647b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:36:17.385 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:17 smithi100 ceph-mds[70978]: -- 172.21.15.100:0/1220032895 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56391007b860 con 0x563910058800 2024-09-12T02:36:17.385 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d[70973]: starting mds.d at 2024-09-12T02:36:17.386 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:17 smithi100 bash[70957]: ebb4589b0184b4bc2c6a5f147e5ca9c0976e0cdd7239a2e2b08eb1d7ce9647b9 2024-09-12T02:36:17.386 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:36:17 smithi100 systemd[1]: Started Ceph mds.d for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:18.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 -- 172.21.15.100:0/340903913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 msgr2=0x7f698c1056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 --2- 172.21.15.100:0/340903913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1056b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6974009900 tx=0x7f697402a410 comp rx=0 tx=0).stop 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 -- 172.21.15.100:0/340903913 shutdown_connections 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 --2- 172.21.15.100:0/340903913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f698c105de0 0x7f698c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 --2- 172.21.15.100:0/340903913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1056b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 --2- 172.21.15.100:0/340903913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c101470 0x7f698c101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 -- 172.21.15.100:0/340903913 >> 172.21.15.100:0/340903913 conn(0x7f698c077230 msgr2=0x7f698c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 -- 172.21.15.100:0/340903913 shutdown_connections 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.142+0000 7f6992a17640 1 -- 172.21.15.100:0/340903913 wait complete. 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.143+0000 7f6992a17640 1 Processor -- start 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.143+0000 7f6992a17640 1 -- start start 2024-09-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6992a17640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f698c101470 0x7f698c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6992a17640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6992a17640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c105de0 0x7f698c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6992a17640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f698c110e40 con 0x7f698c101e20 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6992a17640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f698c110cc0 con 0x7f698c105de0 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6992a17640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f698c110fc0 con 0x7f698c101470 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33974/0 (socket says 172.21.15.100:33974) 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 -- 172.21.15.100:0/2754481511 learned_addr learned my addr 172.21.15.100:0/2754481511 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f698bfff640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f698c101470 0x7f698c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6990fb4640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c105de0 0x7f698c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 -- 172.21.15.100:0/2754481511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f698c101470 msgr2=0x7f698c197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f698c101470 0x7f698c197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 -- 172.21.15.100:0/2754481511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c105de0 msgr2=0x7f698c19bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c105de0 0x7f698c19bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 -- 172.21.15.100:0/2754481511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c19c310 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6990fb4640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c105de0 0x7f698c19bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6983fff640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1978a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6974006010 tx=0x7f69740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6989ffb640 1 -- 172.21.15.100:0/2754481511 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697403f030 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.144+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c19c5a0 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.145+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c1a3ee0 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.145+0000 7f6989ffb640 1 -- 172.21.15.100:0/2754481511 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6974003ce0 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.145+0000 7f6989ffb640 1 -- 172.21.15.100:0/2754481511 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974049060 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.146+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c005290 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.147+0000 7f6989ffb640 1 -- 172.21.15.100:0/2754481511 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6974042030 con 0x7f698c101e20 2024-09-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.147+0000 7f6989ffb640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69780a2c00 0x7f69780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.147+0000 7f698bfff640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69780a2c00 0x7f69780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.147+0000 7f6989ffb640 1 -- 172.21.15.100:0/2754481511 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f69740eeff0 con 0x7f698c101e20 2024-09-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.148+0000 7f698bfff640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69780a2c00 0x7f69780a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f697c005d00 tx=0x7f697c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.152+0000 7f6989ffb640 1 -- 172.21.15.100:0/2754481511 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69740bc4b0 con 0x7f698c101e20 2024-09-12T02:36:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.354+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f696c005850 con 0x7f698c101e20 2024-09-12T02:36:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.354+0000 7f6989ffb640 1 -- 172.21.15.100:0/2754481511 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f69740bbdb0 con 0x7f698c101e20 2024-09-12T02:36:18.356 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:18.356 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"btime":"2024-09-12T02:36:17:585935+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:36:18.356 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 5 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.356+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69780a2c00 msgr2=0x7f69780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.356+0000 7f6992a17640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69780a2c00 0x7f69780a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f697c005d00 tx=0x7f697c00b410 comp rx=0 tx=0).stop 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.356+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 msgr2=0x7f698c1978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.356+0000 7f6992a17640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1978a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6974006010 tx=0x7f69740042f0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 shutdown_connections 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69780a2c00 0x7f69780a50c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c105de0 0x7f698c19bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698c101e20 0x7f698c1978a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 --2- 172.21.15.100:0/2754481511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f698c101470 0x7f698c197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 >> 172.21.15.100:0/2754481511 conn(0x7f698c077230 msgr2=0x7f698c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 shutdown_connections 2024-09-12T02:36:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:18.357+0000 7f6992a17640 1 -- 172.21.15.100:0/2754481511 wait complete. 2024-09-12T02:36:18.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: Deploying daemon mds.e on smithi117 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:18.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.100:6836/3109981916,v1:172.21.15.100:6837/3109981916] up:boot 2024-09-12T02:36:18.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: fsmap 4 up:standby 2024-09-12T02:36:18.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:36:18.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:18 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2754481511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:18.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: Deploying daemon mds.e on smithi117 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.100:6836/3109981916,v1:172.21.15.100:6837/3109981916] up:boot 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: fsmap 4 up:standby 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:36:18.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:18 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2754481511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: Deploying daemon mds.e on smithi117 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.100:6836/3109981916,v1:172.21.15.100:6837/3109981916] up:boot 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: fsmap 4 up:standby 2024-09-12T02:36:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:36:18.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:18 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2754481511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:19.594 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:19 smithi117 systemd[1]: Starting Ceph mds.e for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:19.957 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:19 smithi117 podman[64673]: 2024-09-12 02:36:19.592304975 +0000 UTC m=+0.015701247 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:19.958 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:19 smithi117 podman[64673]: 2024-09-12 02:36:19.713316809 +0000 UTC m=+0.136713081 container create 71268767d9c5b6eca3f0f20b663503cd1f8e989131527d9c1cdf7e8aaeddf847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:19.958 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:19 smithi117 podman[64673]: 2024-09-12 02:36:19.957710528 +0000 UTC m=+0.381106799 container init 71268767d9c5b6eca3f0f20b663503cd1f8e989131527d9c1cdf7e8aaeddf847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T02:36:20.344 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:19 smithi117 podman[64673]: 2024-09-12 02:36:19.960749444 +0000 UTC m=+0.384145721 container start 71268767d9c5b6eca3f0f20b663503cd1f8e989131527d9c1cdf7e8aaeddf847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:20.344 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:19 smithi117 ceph-mds[64691]: -- 172.21.15.117:0/3178715763 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56317ed9b860 con 0x56317ed79000 2024-09-12T02:36:20.344 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:19 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e[64687]: starting mds.e at 2024-09-12T02:36:20.344 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:20 smithi117 bash[64673]: 71268767d9c5b6eca3f0f20b663503cd1f8e989131527d9c1cdf7e8aaeddf847 2024-09-12T02:36:20.345 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:36:20 smithi117 systemd[1]: Started Ceph mds.e for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:20.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:20 smithi117 ceph-mon[34898]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:20.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:20 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:20 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:20 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:20 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:20.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:20 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:20.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:20 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:20.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:20 smithi189 ceph-mon[35196]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:20.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:20 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:20 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:20 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:20 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:20.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:20 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:20.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:20 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:20.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:20 smithi100 ceph-mon[31390]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:20.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:20.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:20.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:20.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:20 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:21.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:21.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:21 smithi100 ceph-mon[31390]: Deploying daemon mds.f on smithi189 2024-09-12T02:36:21.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:21 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6834/3724625594,v1:172.21.15.117:6835/3724625594] up:boot 2024-09-12T02:36:21.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:21 smithi100 ceph-mon[31390]: fsmap 5 up:standby 2024-09-12T02:36:21.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:21 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:36:21.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:21 smithi117 ceph-mon[34898]: Deploying daemon mds.f on smithi189 2024-09-12T02:36:21.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:21 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6834/3724625594,v1:172.21.15.117:6835/3724625594] up:boot 2024-09-12T02:36:21.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:21 smithi117 ceph-mon[34898]: fsmap 5 up:standby 2024-09-12T02:36:21.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:21 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:36:21.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:21 smithi189 ceph-mon[35196]: Deploying daemon mds.f on smithi189 2024-09-12T02:36:21.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:21 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6834/3724625594,v1:172.21.15.117:6835/3724625594] up:boot 2024-09-12T02:36:21.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:21 smithi189 ceph-mon[35196]: fsmap 5 up:standby 2024-09-12T02:36:21.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:21 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:36:21.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 -- 172.21.15.100:0/2246999869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 msgr2=0x7f4918119410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:21.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 --2- 172.21.15.100:0/2246999869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f4918119410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4910009900 tx=0x7f491002a410 comp rx=0 tx=0).stop 2024-09-12T02:36:21.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 -- 172.21.15.100:0/2246999869 shutdown_connections 2024-09-12T02:36:21.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 --2- 172.21.15.100:0/2246999869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f4918119410 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:21.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 --2- 172.21.15.100:0/2246999869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f491810c590 0x7f491810c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:21.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 --2- 172.21.15.100:0/2246999869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4918112640 0x7f4918112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 -- 172.21.15.100:0/2246999869 >> 172.21.15.100:0/2246999869 conn(0x7f491806cdc0 msgr2=0x7f491806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 -- 172.21.15.100:0/2246999869 shutdown_connections 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.900+0000 7f491fc62640 1 -- 172.21.15.100:0/2246999869 wait complete. 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 Processor -- start 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 -- start start 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f491810c590 0x7f49181a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f49181a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4918112640 0x7f49181a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f491811c9a0 con 0x7f491810cf30 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f491811c820 con 0x7f4918112640 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491fc62640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f491811cb20 con 0x7f491810c590 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491d1fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f49181a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:21.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491d1fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f49181a32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33994/0 (socket says 172.21.15.100:33994) 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491d1fd640 1 -- 172.21.15.100:0/3169756130 learned_addr learned my addr 172.21.15.100:0/3169756130 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491d9fe640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f491810c590 0x7f49181a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.901+0000 7f491e1ff640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4918112640 0x7f49181a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491d1fd640 1 -- 172.21.15.100:0/3169756130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f491810c590 msgr2=0x7f49181a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491d1fd640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f491810c590 0x7f49181a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491d1fd640 1 -- 172.21.15.100:0/3169756130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4918112640 msgr2=0x7f49181a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491d1fd640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4918112640 0x7f49181a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491d1fd640 1 -- 172.21.15.100:0/3169756130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49181a7d30 con 0x7f491810cf30 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491d1fd640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f49181a32c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f490c00d950 tx=0x7f490c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f4916ffd640 1 -- 172.21.15.100:0/3169756130 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c017030 con 0x7f491810cf30 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f4916ffd640 1 -- 172.21.15.100:0/3169756130 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f490c004020 con 0x7f491810cf30 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f4916ffd640 1 -- 172.21.15.100:0/3169756130 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c0047a0 con 0x7f491810cf30 2024-09-12T02:36:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49181a8020 con 0x7f491810cf30 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.902+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49181af900 con 0x7f491810cf30 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.903+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f491810dcb0 con 0x7f491810cf30 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.904+0000 7f4916ffd640 1 -- 172.21.15.100:0/3169756130 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f490c0041d0 con 0x7f491810cf30 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.905+0000 7f4916ffd640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f49000a2b80 0x7f49000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.905+0000 7f491d9fe640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f49000a2b80 0x7f49000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.905+0000 7f4916ffd640 1 -- 172.21.15.100:0/3169756130 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f490c0cebf0 con 0x7f491810cf30 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.905+0000 7f491d9fe640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f49000a2b80 0x7f49000a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4908005fd0 tx=0x7f4908009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:21.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:21.908+0000 7f4916ffd640 1 -- 172.21.15.100:0/3169756130 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f490c09bff0 con 0x7f491810cf30 2024-09-12T02:36:22.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.109+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f491810c9f0 con 0x7f491810cf30 2024-09-12T02:36:22.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.110+0000 7f4916ffd640 1 -- 172.21.15.100:0/3169756130 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f491810c9f0 con 0x7f491810cf30 2024-09-12T02:36:22.112 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:22.112 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":6,"btime":"2024-09-12T02:36:20:568978+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T02:36:22.112 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 6 2024-09-12T02:36:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f49000a2b80 msgr2=0x7f49000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f49000a2b80 0x7f49000a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4908005fd0 tx=0x7f4908009680 comp rx=0 tx=0).stop 2024-09-12T02:36:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 msgr2=0x7f49181a32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f49181a32c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f490c00d950 tx=0x7f490c00de10 comp rx=0 tx=0).stop 2024-09-12T02:36:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 shutdown_connections 2024-09-12T02:36:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f49000a2b80 0x7f49000a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4918112640 0x7f49181a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491810cf30 0x7f49181a32c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 --2- 172.21.15.100:0/3169756130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f491810c590 0x7f49181a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.112+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 >> 172.21.15.100:0/3169756130 conn(0x7f491806cdc0 msgr2=0x7f491810ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.113+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 shutdown_connections 2024-09-12T02:36:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:22.113+0000 7f491fc62640 1 -- 172.21.15.100:0/3169756130 wait complete. 2024-09-12T02:36:22.263 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 systemd[1]: Starting Ceph mds.f for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:22.581 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 podman[65367]: 2024-09-12 02:36:22.21887394 +0000 UTC m=+0.015480708 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:22.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 podman[65367]: 2024-09-12 02:36:22.352523297 +0000 UTC m=+0.149130066 container create ea3d8faa13b135460054fdf6f0bacb8ef6c72a9e399b8cd9fc226f18ddc57de1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:36:22.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:22 smithi117 ceph-mon[34898]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:22.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:22 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3169756130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:22 smithi100 ceph-mon[31390]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:22 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3169756130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:22 smithi189 ceph-mon[35196]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:22 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3169756130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:23.014 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 podman[65367]: 2024-09-12 02:36:22.605581383 +0000 UTC m=+0.402188160 container init ea3d8faa13b135460054fdf6f0bacb8ef6c72a9e399b8cd9fc226f18ddc57de1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T02:36:23.014 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 podman[65367]: 2024-09-12 02:36:22.608639976 +0000 UTC m=+0.405246753 container start ea3d8faa13b135460054fdf6f0bacb8ef6c72a9e399b8cd9fc226f18ddc57de1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:36:23.014 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 ceph-mds[65386]: -- 172.21.15.189:0/4132332675 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a489ab1860 con 0x55a489a8f000 2024-09-12T02:36:23.014 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f[65382]: starting mds.f at 2024-09-12T02:36:23.014 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 bash[65367]: ea3d8faa13b135460054fdf6f0bacb8ef6c72a9e399b8cd9fc226f18ddc57de1 2024-09-12T02:36:23.014 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:36:22 smithi189 systemd[1]: Started Ceph mds.f for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:23.988 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:23.988 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:23.988 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:23.988 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:23.988 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:23.988 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:23.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: Deploying daemon mds.c on smithi189 2024-09-12T02:36:23.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:23.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6834/4244197989,v1:172.21.15.189:6835/4244197989] up:boot 2024-09-12T02:36:23.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: fsmap 6 up:standby 2024-09-12T02:36:23.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:23 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: Deploying daemon mds.c on smithi189 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6834/4244197989,v1:172.21.15.189:6835/4244197989] up:boot 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: fsmap 6 up:standby 2024-09-12T02:36:24.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:23 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:36:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:24.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:24.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: Deploying daemon mds.c on smithi189 2024-09-12T02:36:24.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:24.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6834/4244197989,v1:172.21.15.189:6835/4244197989] up:boot 2024-09-12T02:36:24.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: fsmap 6 up:standby 2024-09-12T02:36:24.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:23 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:36:24.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:25.014 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:24 smithi189 systemd[1]: Starting Ceph mds.c for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:25.033 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:25.336 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 podman[65665]: 2024-09-12 02:36:24.944059567 +0000 UTC m=+0.015745567 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:25.336 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 podman[65665]: 2024-09-12 02:36:25.0670492 +0000 UTC m=+0.138735206 container create cd1dd181a195d61dbbc771b7c255c3d81260b5f988949f97f5095864dca7f124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:36:25.337 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 podman[65665]: 2024-09-12 02:36:25.336560136 +0000 UTC m=+0.408246134 container init cd1dd181a195d61dbbc771b7c255c3d81260b5f988949f97f5095864dca7f124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 -- 172.21.15.100:0/1127443650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85781068d0 msgr2=0x7f8578106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 --2- 172.21.15.100:0/1127443650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85781068d0 0x7f8578106cb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8568009930 tx=0x7f856802a420 comp rx=0 tx=0).stop 2024-09-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 -- 172.21.15.100:0/1127443650 shutdown_connections 2024-09-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 --2- 172.21.15.100:0/1127443650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8578101270 0x7f857810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 --2- 172.21.15.100:0/1127443650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85781008d0 0x7f8578100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 --2- 172.21.15.100:0/1127443650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85781068d0 0x7f8578106cb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 -- 172.21.15.100:0/1127443650 >> 172.21.15.100:0/1127443650 conn(0x7f85780fc630 msgr2=0x7f85780fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 -- 172.21.15.100:0/1127443650 shutdown_connections 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.522+0000 7f857759e640 1 -- 172.21.15.100:0/1127443650 wait complete. 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 Processor -- start 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 -- start start 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781008d0 0x7f85781971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8578101270 0x7f8578197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85781068d0 0x7f857819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8578110cf0 con 0x7f8578101270 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8578110b70 con 0x7f85781008d0 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857759e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8578110e70 con 0x7f85781068d0 2024-09-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8578101270 0x7f8578197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8578101270 0x7f8578197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37606/0 (socket says 172.21.15.100:37606) 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 -- 172.21.15.100:0/3419062587 learned_addr learned my addr 172.21.15.100:0/3419062587 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f857659c640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781008d0 0x7f85781971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8576d9d640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85781068d0 0x7f857819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 -- 172.21.15.100:0/3419062587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85781068d0 msgr2=0x7f857819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85781068d0 0x7f857819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 -- 172.21.15.100:0/3419062587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781008d0 msgr2=0x7f85781971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781008d0 0x7f85781971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.523+0000 7f8575d9b640 1 -- 172.21.15.100:0/3419062587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857819c1a0 con 0x7f8578101270 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.524+0000 7f8575d9b640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8578101270 0x7f8578197730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f856c00b4a0 tx=0x7f856c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.524+0000 7f85677fe640 1 -- 172.21.15.100:0/3419062587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c014070 con 0x7f8578101270 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.524+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857819c490 con 0x7f8578101270 2024-09-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.524+0000 7f85677fe640 1 -- 172.21.15.100:0/3419062587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f856c010af0 con 0x7f8578101270 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.524+0000 7f85677fe640 1 -- 172.21.15.100:0/3419062587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c017d10 con 0x7f8578101270 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.524+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85781a3d70 con 0x7f8578101270 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.525+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8578100d30 con 0x7f8578101270 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.527+0000 7f85677fe640 1 -- 172.21.15.100:0/3419062587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f856c017070 con 0x7f8578101270 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.527+0000 7f85677fe640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85600a2b80 0x7f85600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.527+0000 7f85677fe640 1 -- 172.21.15.100:0/3419062587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f856c0ce2d0 con 0x7f8578101270 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.527+0000 7f857659c640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85600a2b80 0x7f85600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.528+0000 7f857659c640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85600a2b80 0x7f85600a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8568009900 tx=0x7f85680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.531+0000 7f85677fe640 1 -- 172.21.15.100:0/3419062587 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f856c09b080 con 0x7f8578101270 2024-09-12T02:36:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.753+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8578198550 con 0x7f8578101270 2024-09-12T02:36:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.754+0000 7f85677fe640 1 -- 172.21.15.100:0/3419062587 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7f8578198550 con 0x7f8578101270 2024-09-12T02:36:25.755 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:25.756 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"btime":"2024-09-12T02:36:25:417692+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T02:36:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-09-12T02:36:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85600a2b80 msgr2=0x7f85600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85600a2b80 0x7f85600a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8568009900 tx=0x7f85680058d0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8578101270 msgr2=0x7f8578197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8578101270 0x7f8578197730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f856c00b4a0 tx=0x7f856c00b960 comp rx=0 tx=0).stop 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 shutdown_connections 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85600a2b80 0x7f85600a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85781068d0 0x7f857819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8578101270 0x7f8578197730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 --2- 172.21.15.100:0/3419062587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85781008d0 0x7f85781971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 >> 172.21.15.100:0/3419062587 conn(0x7f85780fc630 msgr2=0x7f85780fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 shutdown_connections 2024-09-12T02:36:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:25.757+0000 7f857759e640 1 -- 172.21.15.100:0/3419062587 wait complete. 2024-09-12T02:36:25.764 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 podman[65665]: 2024-09-12 02:36:25.339462945 +0000 UTC m=+0.411148944 container start cd1dd181a195d61dbbc771b7c255c3d81260b5f988949f97f5095864dca7f124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T02:36:25.764 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 ceph-mds[65684]: -- 172.21.15.189:0/1398008649 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555716af7860 con 0x555716ad5400 2024-09-12T02:36:25.764 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c[65680]: starting mds.c at 2024-09-12T02:36:25.764 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 bash[65665]: cd1dd181a195d61dbbc771b7c255c3d81260b5f988949f97f5095864dca7f124 2024-09-12T02:36:25.764 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:36:25 smithi189 systemd[1]: Started Ceph mds.c for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:26.453 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] up:boot 2024-09-12T02:36:26.453 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: fsmap 7 up:standby 2024-09-12T02:36:26.453 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:36:26.453 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.453 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:26.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:26.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:26.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: Deploying daemon mds.h on smithi117 2024-09-12T02:36:26.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:26.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3419062587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] up:boot 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: fsmap 7 up:standby 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: Deploying daemon mds.h on smithi117 2024-09-12T02:36:26.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:26.595 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:26 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3419062587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:26.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] up:boot 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: fsmap 7 up:standby 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: Deploying daemon mds.h on smithi117 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:26.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:26 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3419062587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:27.894 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:36:27 smithi117 podman[64972]: 2024-09-12 02:36:27.893952679 +0000 UTC m=+0.184455958 container create 601dab64b243233426a81aa010c68472d626562a38c268ee8ddd252cbdb7149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:36:28.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:28.571 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:36:28 smithi117 podman[64972]: 2024-09-12 02:36:28.146688247 +0000 UTC m=+0.437191519 container init 601dab64b243233426a81aa010c68472d626562a38c268ee8ddd252cbdb7149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:36:28.572 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:36:28 smithi117 podman[64972]: 2024-09-12 02:36:28.1494801 +0000 UTC m=+0.439983374 container start 601dab64b243233426a81aa010c68472d626562a38c268ee8ddd252cbdb7149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:36:28.572 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mds[64991]: -- 172.21.15.117:0/3983977631 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8c7599860 con 0x55c8c7576800 2024-09-12T02:36:28.572 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h[64987]: starting mds.h at 2024-09-12T02:36:28.572 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:36:28 smithi117 bash[64972]: 601dab64b243233426a81aa010c68472d626562a38c268ee8ddd252cbdb7149e 2024-09-12T02:36:28.572 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:36:28 smithi117 systemd[1]: Started Ceph mds.h for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:28.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mon[34898]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:28.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:28 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:28.862 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:28 smithi100 ceph-mon[31390]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:28.862 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.862 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.862 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.862 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:28.862 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:28.862 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:28 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:28.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:28 smithi189 ceph-mon[35196]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:28.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:28.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:28.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:28.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:28 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 -- 172.21.15.100:0/3107418108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 msgr2=0x7fce641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 --2- 172.21.15.100:0/3107418108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 0x7fce641067e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce58009900 tx=0x7fce5802a410 comp rx=0 tx=0).stop 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 -- 172.21.15.100:0/3107418108 shutdown_connections 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 --2- 172.21.15.100:0/3107418108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce64106f10 0x7fce6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 --2- 172.21.15.100:0/3107418108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 0x7fce641067e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 --2- 172.21.15.100:0/3107418108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64101de0 0x7fce641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 -- 172.21.15.100:0/3107418108 >> 172.21.15.100:0/3107418108 conn(0x7fce640fd8c0 msgr2=0x7fce640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 -- 172.21.15.100:0/3107418108 shutdown_connections 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.286+0000 7fce6a10f640 1 -- 172.21.15.100:0/3107418108 wait complete. 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 Processor -- start 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 -- start start 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64101de0 0x7fce64198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce64102790 0x7fce64198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64106f10 0x7fce6419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce64111f30 con 0x7fce64101de0 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce64111db0 con 0x7fce64102790 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce6a10f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce641120b0 con 0x7fce64106f10 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce637fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64101de0 0x7fce64198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce637fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64101de0 0x7fce64198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37618/0 (socket says 172.21.15.100:37618) 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce637fe640 1 -- 172.21.15.100:0/812526242 learned_addr learned my addr 172.21.15.100:0/812526242 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce62ffd640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce64102790 0x7fce64198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce63fff640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64106f10 0x7fce6419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce637fe640 1 -- 172.21.15.100:0/812526242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64106f10 msgr2=0x7fce6419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.287+0000 7fce637fe640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64106f10 0x7fce6419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce637fe640 1 -- 172.21.15.100:0/812526242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce64102790 msgr2=0x7fce64198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce637fe640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce64102790 0x7fce64198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce637fe640 1 -- 172.21.15.100:0/812526242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6419d3e0 con 0x7fce64101de0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce637fe640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64101de0 0x7fce64198430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce5400e9f0 tx=0x7fce5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce60ff9640 1 -- 172.21.15.100:0/812526242 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400cd80 con 0x7fce64101de0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce60ff9640 1 -- 172.21.15.100:0/812526242 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce54010910 con 0x7fce64101de0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6419d6d0 con 0x7fce64101de0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce60ff9640 1 -- 172.21.15.100:0/812526242 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54018990 con 0x7fce64101de0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.288+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce641a4fb0 con 0x7fce64101de0 2024-09-12T02:36:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.289+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce641021c0 con 0x7fce64101de0 2024-09-12T02:36:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.290+0000 7fce60ff9640 1 -- 172.21.15.100:0/812526242 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fce54018b30 con 0x7fce64101de0 2024-09-12T02:36:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.291+0000 7fce60ff9640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce4c0a2c00 0x7fce4c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.291+0000 7fce62ffd640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce4c0a2c00 0x7fce4c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.291+0000 7fce60ff9640 1 -- 172.21.15.100:0/812526242 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fce540cef00 con 0x7fce64101de0 2024-09-12T02:36:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.291+0000 7fce62ffd640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce4c0a2c00 0x7fce4c0a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce58009230 tx=0x7fce580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.295+0000 7fce60ff9640 1 -- 172.21.15.100:0/812526242 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce5409c300 con 0x7fce64101de0 2024-09-12T02:36:29.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.498+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce6410a0f0 con 0x7fce64101de0 2024-09-12T02:36:29.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.499+0000 7fce60ff9640 1 -- 172.21.15.100:0/812526242 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7fce5409bc00 con 0x7fce64101de0 2024-09-12T02:36:29.500 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:29.500 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-12T02:36:28:570819+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T02:36:29.501 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce4c0a2c00 msgr2=0x7fce4c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce4c0a2c00 0x7fce4c0a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce58009230 tx=0x7fce580058d0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64101de0 msgr2=0x7fce64198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64101de0 0x7fce64198430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce5400e9f0 tx=0x7fce5400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 shutdown_connections 2024-09-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce4c0a2c00 0x7fce4c0a50c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64106f10 0x7fce6419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce64102790 0x7fce64198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 --2- 172.21.15.100:0/812526242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64101de0 0x7fce64198430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 >> 172.21.15.100:0/812526242 conn(0x7fce640fd8c0 msgr2=0x7fce640fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 shutdown_connections 2024-09-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:29.501+0000 7fce6a10f640 1 -- 172.21.15.100:0/812526242 wait complete. 2024-09-12T02:36:29.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:29 smithi117 ceph-mon[34898]: Deploying daemon mds.i on smithi189 2024-09-12T02:36:29.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:29 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6836/2625823245,v1:172.21.15.117:6837/2625823245] up:boot 2024-09-12T02:36:29.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:29 smithi117 ceph-mon[34898]: fsmap 8 up:standby 2024-09-12T02:36:29.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:29 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:36:29.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:29 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/812526242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:29.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:29 smithi189 ceph-mon[35196]: Deploying daemon mds.i on smithi189 2024-09-12T02:36:29.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:29 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6836/2625823245,v1:172.21.15.117:6837/2625823245] up:boot 2024-09-12T02:36:29.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:29 smithi189 ceph-mon[35196]: fsmap 8 up:standby 2024-09-12T02:36:29.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:29 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:36:29.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:29 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/812526242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:29.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:29 smithi100 ceph-mon[31390]: Deploying daemon mds.i on smithi189 2024-09-12T02:36:29.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:29 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6836/2625823245,v1:172.21.15.117:6837/2625823245] up:boot 2024-09-12T02:36:29.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:29 smithi100 ceph-mon[31390]: fsmap 8 up:standby 2024-09-12T02:36:29.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:29 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:36:29.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:29 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/812526242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:30.514 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:36:30 smithi189 podman[65966]: 2024-09-12 02:36:30.47337201 +0000 UTC m=+0.133794573 container create 6361032910f35fd506493f15c5e0b1c74699a1d769955627a67cff4895c22bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T02:36:30.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:30 smithi117 ceph-mon[34898]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:30 smithi100 ceph-mon[31390]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:31.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:30 smithi189 ceph-mon[35196]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:31.014 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:36:30 smithi189 podman[65966]: 2024-09-12 02:36:30.726133786 +0000 UTC m=+0.386556349 container init 6361032910f35fd506493f15c5e0b1c74699a1d769955627a67cff4895c22bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:36:31.014 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:36:30 smithi189 podman[65966]: 2024-09-12 02:36:30.72903877 +0000 UTC m=+0.389461347 container start 6361032910f35fd506493f15c5e0b1c74699a1d769955627a67cff4895c22bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:36:31.014 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:36:30 smithi189 ceph-mds[65985]: -- 172.21.15.189:0/4093268706 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a420a7860 con 0x561a42085000 2024-09-12T02:36:31.014 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:36:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i[65981]: starting mds.i at 2024-09-12T02:36:31.014 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:36:30 smithi189 bash[65966]: 6361032910f35fd506493f15c5e0b1c74699a1d769955627a67cff4895c22bfa 2024-09-12T02:36:31.015 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:36:30 smithi189 systemd[1]: Started Ceph mds.i for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:32.151 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:32.174 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.174 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.174 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: Deploying daemon mds.g on smithi100 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] up:boot 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: fsmap 9 up:standby 2024-09-12T02:36:32.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:31 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:36:32.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: Deploying daemon mds.g on smithi100 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] up:boot 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: fsmap 9 up:standby 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:31 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: Deploying daemon mds.g on smithi100 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] up:boot 2024-09-12T02:36:32.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: fsmap 9 up:standby 2024-09-12T02:36:32.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:31 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:36:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 -- 172.21.15.100:0/2396239310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20106a80 msgr2=0x7fef20106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 --2- 172.21.15.100:0/2396239310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20106a80 0x7fef20106e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef10009930 tx=0x7fef1002a420 comp rx=0 tx=0).stop 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 -- 172.21.15.100:0/2396239310 shutdown_connections 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 --2- 172.21.15.100:0/2396239310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef20101420 0x7fef2010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 --2- 172.21.15.100:0/2396239310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef20100a80 0x7fef20100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 --2- 172.21.15.100:0/2396239310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20106a80 0x7fef20106e60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 -- 172.21.15.100:0/2396239310 >> 172.21.15.100:0/2396239310 conn(0x7fef200fc7a0 msgr2=0x7fef200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 -- 172.21.15.100:0/2396239310 shutdown_connections 2024-09-12T02:36:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 -- 172.21.15.100:0/2396239310 wait complete. 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 Processor -- start 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.175+0000 7fef258fe640 1 -- start start 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20100a80 0x7fef20199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef20101420 0x7fef201997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef20106a80 0x7fef201a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef20110ea0 con 0x7fef20100a80 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef20110d20 con 0x7fef20106a80 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef20111020 con 0x7fef20101420 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20100a80 0x7fef20199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20100a80 0x7fef20199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37644/0 (socket says 172.21.15.100:37644) 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 -- 172.21.15.100:0/811197911 learned_addr learned my addr 172.21.15.100:0/811197911 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1f7fe640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef20106a80 0x7fef201a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef17fff640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef20101420 0x7fef201997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 -- 172.21.15.100:0/811197911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef20101420 msgr2=0x7fef201997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef20101420 0x7fef201997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 -- 172.21.15.100:0/811197911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef20106a80 msgr2=0x7fef201a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef20106a80 0x7fef201a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 -- 172.21.15.100:0/811197911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef201a4830 con 0x7fef20100a80 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef17fff640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef20101420 0x7fef201997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef1effd640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20100a80 0x7fef20199270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fef10009a50 tx=0x7fef10004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef248fc640 1 -- 172.21.15.100:0/811197911 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1003f030 con 0x7fef20100a80 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef248fc640 1 -- 172.21.15.100:0/811197911 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef10003ce0 con 0x7fef20100a80 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef248fc640 1 -- 172.21.15.100:0/811197911 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10035070 con 0x7fef20100a80 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef201a4a00 con 0x7fef20100a80 2024-09-12T02:36:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.176+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef201a4eb0 con 0x7fef20100a80 2024-09-12T02:36:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.177+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef20100ee0 con 0x7fef20100a80 2024-09-12T02:36:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.178+0000 7fef248fc640 1 -- 172.21.15.100:0/811197911 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fef10042030 con 0x7fef20100a80 2024-09-12T02:36:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.179+0000 7fef248fc640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef0c0a2c00 0x7fef0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.179+0000 7fef17fff640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef0c0a2c00 0x7fef0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.179+0000 7fef248fc640 1 -- 172.21.15.100:0/811197911 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fef100ef0c0 con 0x7fef20100a80 2024-09-12T02:36:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.180+0000 7fef17fff640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef0c0a2c00 0x7fef0c0a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fef2006b2e0 tx=0x7fef08005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.183+0000 7fef248fc640 1 -- 172.21.15.100:0/811197911 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef100bc4c0 con 0x7fef20100a80 2024-09-12T02:36:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.399+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef201a5080 con 0x7fef20100a80 2024-09-12T02:36:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.400+0000 7fef248fc640 1 -- 172.21.15.100:0/811197911 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7fef100bbdc0 con 0x7fef20100a80 2024-09-12T02:36:33.401 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:33.401 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"btime":"2024-09-12T02:36:31:586536+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:36:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 10 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef0c0a2c00 msgr2=0x7fef0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef0c0a2c00 0x7fef0c0a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fef2006b2e0 tx=0x7fef08005d90 comp rx=0 tx=0).stop 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20100a80 msgr2=0x7fef20199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20100a80 0x7fef20199270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fef10009a50 tx=0x7fef10004270 comp rx=0 tx=0).stop 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 shutdown_connections 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef0c0a2c00 0x7fef0c0a50c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef20106a80 0x7fef201a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef20101420 0x7fef201997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 --2- 172.21.15.100:0/811197911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef20100a80 0x7fef20199270 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 >> 172.21.15.100:0/811197911 conn(0x7fef200fc7a0 msgr2=0x7fef200fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 shutdown_connections 2024-09-12T02:36:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:33.402+0000 7fef258fe640 1 -- 172.21.15.100:0/811197911 wait complete. 2024-09-12T02:36:33.654 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:33 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/811197911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:33.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:33 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/811197911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:33.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:33 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/811197911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:34 smithi100 ceph-mon[31390]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:34.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:34.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:34 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:34.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:34 smithi189 ceph-mon[35196]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:34.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:34.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:34.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:34 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:34.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:34 smithi117 ceph-mon[34898]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:34.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:34.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:34.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:34.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:34 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:35.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:35 smithi189 ceph-mon[35196]: Deploying daemon mds.a on smithi100 2024-09-12T02:36:35.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:35 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.100:6838/3873069130,v1:172.21.15.100:6839/3873069130] up:boot 2024-09-12T02:36:35.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:35 smithi189 ceph-mon[35196]: fsmap 10 up:standby 2024-09-12T02:36:35.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:35 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:36:35.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:35 smithi100 ceph-mon[31390]: Deploying daemon mds.a on smithi100 2024-09-12T02:36:35.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:35 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.100:6838/3873069130,v1:172.21.15.100:6839/3873069130] up:boot 2024-09-12T02:36:35.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:35 smithi100 ceph-mon[31390]: fsmap 10 up:standby 2024-09-12T02:36:35.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:35 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:36:35.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:35 smithi117 ceph-mon[34898]: Deploying daemon mds.a on smithi100 2024-09-12T02:36:35.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:35 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.100:6838/3873069130,v1:172.21.15.100:6839/3873069130] up:boot 2024-09-12T02:36:35.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:35 smithi117 ceph-mon[34898]: fsmap 10 up:standby 2024-09-12T02:36:35.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:35 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:36:36.464 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:36:36 smithi100 podman[72142]: 2024-09-12 02:36:36.432864843 +0000 UTC m=+0.130257003 container create 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-12T02:36:36.607 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:36.746 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:36 smithi117 ceph-mon[34898]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:36.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:36 smithi189 ceph-mon[35196]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:36.780 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:36 smithi100 ceph-mon[31390]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:36.781 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:36:36 smithi100 podman[72142]: 2024-09-12 02:36:36.677680727 +0000 UTC m=+0.375072889 container init 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:36:36.781 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:36:36 smithi100 podman[72142]: 2024-09-12 02:36:36.681898974 +0000 UTC m=+0.379291149 container start 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:36:36.781 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:36:36 smithi100 ceph-mds[72179]: -- 172.21.15.100:0/3698652544 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56130d283860 con 0x56130d261400 2024-09-12T02:36:36.781 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:36:36 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a[72157]: starting mds.a at 2024-09-12T02:36:36.781 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:36:36 smithi100 bash[72142]: 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda 2024-09-12T02:36:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:37.121 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:36:36 smithi100 systemd[1]: Started Ceph mds.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:37.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.336+0000 7f5e448d1640 1 -- 172.21.15.100:0/3577028754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40106f10 msgr2=0x7f5e4010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:37.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.336+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3577028754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40106f10 0x7f5e4010ea90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009ca0 tx=0x7f5e3002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 -- 172.21.15.100:0/3577028754 shutdown_connections 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3577028754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40106f10 0x7f5e4010ea90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3577028754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e40102790 0x7f5e401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3577028754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e40101de0 0x7f5e401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 -- 172.21.15.100:0/3577028754 >> 172.21.15.100:0/3577028754 conn(0x7f5e400fd8c0 msgr2=0x7f5e400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 -- 172.21.15.100:0/3577028754 shutdown_connections 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 -- 172.21.15.100:0/3577028754 wait complete. 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 Processor -- start 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.337+0000 7f5e448d1640 1 -- start start 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40101de0 0x7f5e400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e40102790 0x7f5e40074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e40106f10 0x7f5e40074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40111f90 con 0x7f5e40101de0 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40111e10 con 0x7f5e40106f10 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40112110 con 0x7f5e40102790 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40101de0 0x7f5e400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40101de0 0x7f5e400744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44396/0 (socket says 172.21.15.100:44396) 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 -- 172.21.15.100:0/3984462016 learned_addr learned my addr 172.21.15.100:0/3984462016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3ed9d640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e40106f10 0x7f5e40074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3dd9b640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e40102790 0x7f5e40074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 -- 172.21.15.100:0/3984462016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e40102790 msgr2=0x7f5e40074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e40102790 0x7f5e40074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 -- 172.21.15.100:0/3984462016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e40106f10 msgr2=0x7f5e40074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e40106f10 0x7f5e40074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 -- 172.21.15.100:0/3984462016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e401a6930 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3dd9b640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e40102790 0x7f5e40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e3e59c640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40101de0 0x7f5e400744f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b4a0 tx=0x7f5e3800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e2f7fe640 1 -- 172.21.15.100:0/3984462016 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38014070 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e401a6c20 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e2f7fe640 1 -- 172.21.15.100:0/3984462016 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e38010af0 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e2f7fe640 1 -- 172.21.15.100:0/3984462016 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38017d10 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.338+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e401a7110 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.339+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e401021c0 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.341+0000 7f5e2f7fe640 1 -- 172.21.15.100:0/3984462016 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5e38017070 con 0x7f5e40101de0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.341+0000 7f5e2f7fe640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5e280a2b80 0x7f5e280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.341+0000 7f5e3dd9b640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5e280a2b80 0x7f5e280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.341+0000 7f5e2f7fe640 1 -- 172.21.15.100:0/3984462016 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f5e380cdf70 con 0x7f5e40101de0 2024-09-12T02:36:37.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.342+0000 7f5e3dd9b640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5e280a2b80 0x7f5e280a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e40075f80 tx=0x7f5e34005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:37.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.346+0000 7f5e2f7fe640 1 -- 172.21.15.100:0/3984462016 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e3809b370 con 0x7f5e40101de0 2024-09-12T02:36:37.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.549+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e40109b60 con 0x7f5e40101de0 2024-09-12T02:36:37.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.550+0000 7f5e2f7fe640 1 -- 172.21.15.100:0/3984462016 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9707 (secure 0 0 0) 0x7f5e3809ac70 con 0x7f5e40101de0 2024-09-12T02:36:37.550 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:37.550 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":12,"btime":"2024-09-12T02:36:37:463649+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:36:37.551 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 12 2024-09-12T02:36:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5e280a2b80 msgr2=0x7f5e280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5e280a2b80 0x7f5e280a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e40075f80 tx=0x7f5e34005e50 comp rx=0 tx=0).stop 2024-09-12T02:36:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40101de0 msgr2=0x7f5e400744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40101de0 0x7f5e400744f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b4a0 tx=0x7f5e3800b960 comp rx=0 tx=0).stop 2024-09-12T02:36:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 shutdown_connections 2024-09-12T02:36:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5e280a2b80 0x7f5e280a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e40106f10 0x7f5e40074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e40102790 0x7f5e40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 --2- 172.21.15.100:0/3984462016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e40101de0 0x7f5e400744f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:37.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 >> 172.21.15.100:0/3984462016 conn(0x7f5e400fd8c0 msgr2=0x7f5e400fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:37.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 shutdown_connections 2024-09-12T02:36:37.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:37.552+0000 7f5e448d1640 1 -- 172.21.15.100:0/3984462016 wait complete. 2024-09-12T02:36:38.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: Deploying daemon mds.b on smithi117 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.100:6840/612034998,v1:172.21.15.100:6841/612034998] up:boot 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: fsmap 11 up:standby 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:37 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3984462016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: Deploying daemon mds.b on smithi117 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.100:6840/612034998,v1:172.21.15.100:6841/612034998] up:boot 2024-09-12T02:36:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: fsmap 11 up:standby 2024-09-12T02:36:38.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:36:38.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:38.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:37 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3984462016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:38.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: Deploying daemon mds.b on smithi117 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.100:6840/612034998,v1:172.21.15.100:6841/612034998] up:boot 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: fsmap 11 up:standby 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:38.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:37 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3984462016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:39.094 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:38 smithi117 systemd[1]: Starting Ceph mds.b for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:36:39.476 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 podman[65283]: 2024-09-12 02:36:39.108121224 +0000 UTC m=+0.016149504 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:39.476 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 podman[65283]: 2024-09-12 02:36:39.215084129 +0000 UTC m=+0.123112406 container create 2e043629fb7ed15de15488ae9ae4a586c2a3d1826230c91297b3d13197a91f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T02:36:39.476 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 podman[65283]: 2024-09-12 02:36:39.476126605 +0000 UTC m=+0.384154883 container init 2e043629fb7ed15de15488ae9ae4a586c2a3d1826230c91297b3d13197a91f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T02:36:39.843 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 podman[65283]: 2024-09-12 02:36:39.479153398 +0000 UTC m=+0.387181681 container start 2e043629fb7ed15de15488ae9ae4a586c2a3d1826230c91297b3d13197a91f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:36:39.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 ceph-mds[65302]: -- 172.21.15.117:0/2868735082 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555bb11cb860 con 0x555bb11a8800 2024-09-12T02:36:39.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: starting mds.b at 2024-09-12T02:36:39.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 bash[65283]: 2e043629fb7ed15de15488ae9ae4a586c2a3d1826230c91297b3d13197a91f6b 2024-09-12T02:36:39.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:39 smithi117 systemd[1]: Started Ceph mds.b for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:36:40.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:40.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:40.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] up:boot 2024-09-12T02:36:40.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: fsmap 12 up:standby 2024-09-12T02:36:40.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:36:40.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:40 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.795 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:40.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] up:boot 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: fsmap 12 up:standby 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:40.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:40 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] up:boot 2024-09-12T02:36:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: fsmap 12 up:standby 2024-09-12T02:36:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:36:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:40.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:40.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:40 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 -- 172.21.15.100:0/1903160060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 msgr2=0x7f7e481031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 --2- 172.21.15.100:0/1903160060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481031a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009900 tx=0x7f7e3802a480 comp rx=0 tx=0).stop 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 -- 172.21.15.100:0/1903160060 shutdown_connections 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 --2- 172.21.15.100:0/1903160060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e4810c1a0 0x7f7e4810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 --2- 172.21.15.100:0/1903160060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e481036e0 0x7f7e4810bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 --2- 172.21.15.100:0/1903160060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481031a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 -- 172.21.15.100:0/1903160060 >> 172.21.15.100:0/1903160060 conn(0x7f7e480fc7a0 msgr2=0x7f7e480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 -- 172.21.15.100:0/1903160060 shutdown_connections 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.269+0000 7f7e4e567640 1 -- 172.21.15.100:0/1903160060 wait complete. 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 Processor -- start 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 -- start start 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e481036e0 0x7f7e481989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e4810c1a0 0x7f7e4819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48111f70 con 0x7f7e48102dc0 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48111df0 con 0x7f7e4810c1a0 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4e567640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e481120f0 con 0x7f7e481036e0 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44424/0 (socket says 172.21.15.100:44424) 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e47fff640 1 -- 172.21.15.100:0/2272473222 learned_addr learned my addr 172.21.15.100:0/2272473222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e4cb04640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e4810c1a0 0x7f7e4819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.270+0000 7f7e477fe640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e481036e0 0x7f7e481989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e47fff640 1 -- 172.21.15.100:0/2272473222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e481036e0 msgr2=0x7f7e481989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e47fff640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e481036e0 0x7f7e481989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e47fff640 1 -- 172.21.15.100:0/2272473222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e4810c1a0 msgr2=0x7f7e4819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e47fff640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e4810c1a0 0x7f7e4819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e47fff640 1 -- 172.21.15.100:0/2272473222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4819d450 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e47fff640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481984a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006010 tx=0x7f7e380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e457fa640 1 -- 172.21.15.100:0/2272473222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3803f030 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e457fa640 1 -- 172.21.15.100:0/2272473222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e38003ce0 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4819d6e0 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e457fa640 1 -- 172.21.15.100:0/2272473222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38035070 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.271+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e481a5020 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.272+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e481031a0 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.273+0000 7f7e457fa640 1 -- 172.21.15.100:0/2272473222 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7e38042030 con 0x7f7e48102dc0 2024-09-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.274+0000 7f7e457fa640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7e300a2c00 0x7f7e300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.274+0000 7f7e457fa640 1 -- 172.21.15.100:0/2272473222 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f7e380ef3c0 con 0x7f7e48102dc0 2024-09-12T02:36:41.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.274+0000 7f7e477fe640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7e300a2c00 0x7f7e300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.274+0000 7f7e477fe640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7e300a2c00 0x7f7e300a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e480fee30 tx=0x7f7e3c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:41.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.277+0000 7f7e457fa640 1 -- 172.21.15.100:0/2272473222 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e380bc230 con 0x7f7e48102dc0 2024-09-12T02:36:41.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.506+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e48107240 con 0x7f7e48102dc0 2024-09-12T02:36:41.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.507+0000 7f7e457fa640 1 -- 172.21.15.100:0/2272473222 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f7e380c0530 con 0x7f7e48102dc0 2024-09-12T02:36:41.508 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:41.508 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"btime":"2024-09-12T02:36:39:557541+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2024-09-12T02:36:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.509+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7e300a2c00 msgr2=0x7f7e300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.509+0000 7f7e4e567640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7e300a2c00 0x7f7e300a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e480fee30 tx=0x7f7e3c00b410 comp rx=0 tx=0).stop 2024-09-12T02:36:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.509+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 msgr2=0x7f7e481984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.509+0000 7f7e4e567640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481984a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006010 tx=0x7f7e380042f0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 shutdown_connections 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7e300a2c00 0x7f7e300a50c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e4810c1a0 0x7f7e4819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e481036e0 0x7f7e481989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 --2- 172.21.15.100:0/2272473222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48102dc0 0x7f7e481984a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 >> 172.21.15.100:0/2272473222 conn(0x7f7e480fc7a0 msgr2=0x7f7e480fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 shutdown_connections 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:41.510+0000 7f7e4e567640 1 -- 172.21.15.100:0/2272473222 wait complete. 2024-09-12T02:36:42.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T02:36:42.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2272473222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:42 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:42.542 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.542 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.542 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2272473222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.543 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:42 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:42.554 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.554 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2272473222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:42.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:42 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:43.186 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 -- 172.21.15.100:0/2402114704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 msgr2=0x7fb58010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2402114704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010da40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb578009ca0 tx=0x7fb57802a950 comp rx=0 tx=0).stop 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 -- 172.21.15.100:0/2402114704 shutdown_connections 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2402114704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010da40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2402114704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb580102570 0x7fb5801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2402114704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb580100e20 0x7fb580101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 -- 172.21.15.100:0/2402114704 >> 172.21.15.100:0/2402114704 conn(0x7fb5800fc7d0 msgr2=0x7fb5800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 -- 172.21.15.100:0/2402114704 shutdown_connections 2024-09-12T02:36:43.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.627+0000 7fb5863bf640 1 -- 172.21.15.100:0/2402114704 wait complete. 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 Processor -- start 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 -- start start 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb580100e20 0x7fb58010e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb580102570 0x7fb58010e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb580112090 con 0x7fb580102ef0 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb580111f10 con 0x7fb580102570 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb5863bf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb580112210 con 0x7fb580100e20 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb58495c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb58495c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44440/0 (socket says 172.21.15.100:44440) 2024-09-12T02:36:43.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.628+0000 7fb58495c640 1 -- 172.21.15.100:0/2733649620 learned_addr learned my addr 172.21.15.100:0/2733649620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb57ffff640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb580100e20 0x7fb58010e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb57f7fe640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb580102570 0x7fb58010e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb58495c640 1 -- 172.21.15.100:0/2733649620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb580100e20 msgr2=0x7fb58010e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb58495c640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb580100e20 0x7fb58010e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb58495c640 1 -- 172.21.15.100:0/2733649620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb580102570 msgr2=0x7fb58010e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb58495c640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb580102570 0x7fb58010e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb58495c640 1 -- 172.21.15.100:0/2733649620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5801a6910 con 0x7fb580102ef0 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb57f7fe640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb580102570 0x7fb58010e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb58495c640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010ec50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb578004af0 tx=0x7fb57802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:43.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb57d7fa640 1 -- 172.21.15.100:0/2733649620 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578034040 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb57d7fa640 1 -- 172.21.15.100:0/2733649620 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb578030920 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5801a6ba0 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb57d7fa640 1 -- 172.21.15.100:0/2733649620 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578004820 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.629+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5801a70d0 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.630+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb580101200 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.631+0000 7fb57d7fa640 1 -- 172.21.15.100:0/2733649620 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb578037020 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.632+0000 7fb57d7fa640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb5680a2c00 0x7fb5680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.632+0000 7fb57ffff640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb5680a2c00 0x7fb5680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.632+0000 7fb57d7fa640 1 -- 172.21.15.100:0/2733649620 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fb5780efa80 con 0x7fb580102ef0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.632+0000 7fb57ffff640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb5680a2c00 0x7fb5680a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb57000bbe0 tx=0x7fb57000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.635+0000 7fb57d7fa640 1 -- 172.21.15.100:0/2733649620 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5780bce80 con 0x7fb580102ef0 2024-09-12T02:36:43.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.813+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb5801a72d0 con 0x7fb580102ef0 2024-09-12T02:36:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.815+0000 7fb57d7fa640 1 -- 172.21.15.100:0/2733649620 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7fb5780bc780 con 0x7fb580102ef0 2024-09-12T02:36:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:43.815 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-09-12T02:36:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:36:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-09-12T02:36:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-09-12T02:36:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:36:43.816 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb5680a2c00 msgr2=0x7fb5680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb5680a2c00 0x7fb5680a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb57000bbe0 tx=0x7fb57000b390 comp rx=0 tx=0).stop 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 msgr2=0x7fb58010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010ec50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb578004af0 tx=0x7fb57802f5b0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 shutdown_connections 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb5680a2c00 0x7fb5680a50c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb580102ef0 0x7fb58010ec50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb580102570 0x7fb58010e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 --2- 172.21.15.100:0/2733649620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb580100e20 0x7fb58010e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 >> 172.21.15.100:0/2733649620 conn(0x7fb5800fc7d0 msgr2=0x7fb580106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 shutdown_connections 2024-09-12T02:36:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:43.818+0000 7fb5863bf640 1 -- 172.21.15.100:0/2733649620 wait complete. 2024-09-12T02:36:44.543 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:36:44.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:36:44.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:44.565 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.566 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.566 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2733649620' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:36:44.566 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:44.566 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:44.566 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2733649620' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:44.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.784 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:44.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2733649620' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:44.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:36:45.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 -- 172.21.15.100:0/932363302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada01000b0 msgr2=0x7fada0100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 --2- 172.21.15.100:0/932363302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada01000b0 0x7fada0100510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad94009900 tx=0x7fad9402a410 comp rx=0 tx=0).stop 2024-09-12T02:36:45.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 -- 172.21.15.100:0/932363302 shutdown_connections 2024-09-12T02:36:45.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 --2- 172.21.15.100:0/932363302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fada0100a50 0x7fada010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 --2- 172.21.15.100:0/932363302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada01000b0 0x7fada0100510 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 --2- 172.21.15.100:0/932363302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada0106b80 0x7fada0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 -- 172.21.15.100:0/932363302 >> 172.21.15.100:0/932363302 conn(0x7fada00fbee0 msgr2=0x7fada00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:45.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 -- 172.21.15.100:0/932363302 shutdown_connections 2024-09-12T02:36:45.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.269+0000 7fada53e0640 1 -- 172.21.15.100:0/932363302 wait complete. 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 Processor -- start 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 -- start start 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada01000b0 0x7fada0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fada0100a50 0x7fada0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada0106b80 0x7fada019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fada0112030 con 0x7fada0106b80 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fada0111eb0 con 0x7fada01000b0 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fada53e0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fada01121b0 con 0x7fada0100a50 2024-09-12T02:36:45.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada0106b80 0x7fada019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada0106b80 0x7fada019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48294/0 (socket says 172.21.15.100:48294) 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 -- 172.21.15.100:0/1882173287 learned_addr learned my addr 172.21.15.100:0/1882173287 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9e7fc640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fada0100a50 0x7fada0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9effd640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada01000b0 0x7fada0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 -- 172.21.15.100:0/1882173287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fada0100a50 msgr2=0x7fada0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fada0100a50 0x7fada0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 -- 172.21.15.100:0/1882173287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada01000b0 msgr2=0x7fada0198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada01000b0 0x7fada0198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.270+0000 7fad9f7fe640 1 -- 172.21.15.100:0/1882173287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada019d4c0 con 0x7fada0106b80 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.271+0000 7fad9f7fe640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada0106b80 0x7fada019cde0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad9800eaa0 tx=0x7fad9800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.271+0000 7fad87fff640 1 -- 172.21.15.100:0/1882173287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9800cdb0 con 0x7fada0106b80 2024-09-12T02:36:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.271+0000 7fad87fff640 1 -- 172.21.15.100:0/1882173287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad98005020 con 0x7fada0106b80 2024-09-12T02:36:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.271+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada019d7b0 con 0x7fada0106b80 2024-09-12T02:36:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.271+0000 7fad87fff640 1 -- 172.21.15.100:0/1882173287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad980116b0 con 0x7fada0106b80 2024-09-12T02:36:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.271+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada01a5090 con 0x7fada0106b80 2024-09-12T02:36:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.272+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada0100510 con 0x7fada0106b80 2024-09-12T02:36:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.273+0000 7fad87fff640 1 -- 172.21.15.100:0/1882173287 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fad98005560 con 0x7fada0106b80 2024-09-12T02:36:45.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.273+0000 7fad87fff640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad880a2b80 0x7fad880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.274+0000 7fad9effd640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad880a2b80 0x7fad880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.274+0000 7fad87fff640 1 -- 172.21.15.100:0/1882173287 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fad980ced50 con 0x7fada0106b80 2024-09-12T02:36:45.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.274+0000 7fad9effd640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad880a2b80 0x7fad880a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fad900058c0 tx=0x7fad9000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:45.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.278+0000 7fad87fff640 1 -- 172.21.15.100:0/1882173287 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad980d2030 con 0x7fada0106b80 2024-09-12T02:36:45.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.443+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fada010a090 con 0x7fada0106b80 2024-09-12T02:36:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.843+0000 7fad87fff640 1 -- 172.21.15.100:0/1882173287 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7fad98016030 con 0x7fada0106b80 2024-09-12T02:36:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad880a2b80 msgr2=0x7fad880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad880a2b80 0x7fad880a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fad900058c0 tx=0x7fad9000a2d0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada0106b80 msgr2=0x7fada019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada0106b80 0x7fada019cde0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad9800eaa0 tx=0x7fad9800ef60 comp rx=0 tx=0).stop 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 shutdown_connections 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad880a2b80 0x7fad880a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fada0106b80 0x7fada019cde0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fada0100a50 0x7fada0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 --2- 172.21.15.100:0/1882173287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada01000b0 0x7fada0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.845+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 >> 172.21.15.100:0/1882173287 conn(0x7fada00fbee0 msgr2=0x7fada00fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.846+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 shutdown_connections 2024-09-12T02:36:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:45.846+0000 7fada53e0640 1 -- 172.21.15.100:0/1882173287 wait complete. 2024-09-12T02:36:46.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:45 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1882173287' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:36:46.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:45 smithi100 ceph-mon[31390]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:46.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:45 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1882173287' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:36:46.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:45 smithi189 ceph-mon[35196]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:46.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:45 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1882173287' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:36:46.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:45 smithi117 ceph-mon[34898]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:46.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:36:46.854 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:46 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1882173287' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:36:46.854 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:46 smithi100 ceph-mon[31390]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:36:46.863 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:46 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1882173287' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:36:47.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:46 smithi189 ceph-mon[35196]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:36:47.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 -- 172.21.15.100:0/221875708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 msgr2=0x7f620c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 --2- 172.21.15.100:0/221875708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c1067e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009900 tx=0x7f61f402a410 comp rx=0 tx=0).stop 2024-09-12T02:36:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 -- 172.21.15.100:0/221875708 shutdown_connections 2024-09-12T02:36:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 --2- 172.21.15.100:0/221875708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f620c106f10 0x7f620c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 --2- 172.21.15.100:0/221875708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c1067e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 --2- 172.21.15.100:0/221875708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620c101de0 0x7f620c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 -- 172.21.15.100:0/221875708 >> 172.21.15.100:0/221875708 conn(0x7f620c0fd8c0 msgr2=0x7f620c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:47.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 -- 172.21.15.100:0/221875708 shutdown_connections 2024-09-12T02:36:47.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 -- 172.21.15.100:0/221875708 wait complete. 2024-09-12T02:36:47.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.309+0000 7f6211592640 1 Processor -- start 2024-09-12T02:36:47.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f6211592640 1 -- start start 2024-09-12T02:36:47.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f6211592640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620c101de0 0x7f620c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f6211592640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f6211592640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f620c106f10 0x7f620c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f6211592640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f620c111f90 con 0x7f620c102790 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f6211592640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f620c111e10 con 0x7f620c101de0 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f6211592640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f620c112110 con 0x7f620c106f10 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48314/0 (socket says 172.21.15.100:48314) 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 -- 172.21.15.100:0/1162406735 learned_addr learned my addr 172.21.15.100:0/1162406735 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620b7fe640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f620c106f10 0x7f620c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620affd640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620c101de0 0x7f620c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 -- 172.21.15.100:0/1162406735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f620c106f10 msgr2=0x7f620c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f620c106f10 0x7f620c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 -- 172.21.15.100:0/1162406735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620c101de0 msgr2=0x7f620c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620c101de0 0x7f620c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 -- 172.21.15.100:0/1162406735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c1a68b0 con 0x7f620c102790 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620affd640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620c101de0 0x7f620c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.310+0000 7f620a7fc640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c074a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61f4005ab0 tx=0x7f61f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.311+0000 7f6203fff640 1 -- 172.21.15.100:0/1162406735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f403f030 con 0x7f620c102790 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.311+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c1a6b40 con 0x7f620c102790 2024-09-12T02:36:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.311+0000 7f6203fff640 1 -- 172.21.15.100:0/1162406735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61f4003ce0 con 0x7f620c102790 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.311+0000 7f6203fff640 1 -- 172.21.15.100:0/1162406735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4035070 con 0x7f620c102790 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.311+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c1a7070 con 0x7f620c102790 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.312+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620c1021c0 con 0x7f620c102790 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.313+0000 7f6203fff640 1 -- 172.21.15.100:0/1162406735 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f61f4042030 con 0x7f620c102790 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.314+0000 7f6203fff640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f80a2b80 0x7f61f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.314+0000 7f620affd640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f80a2b80 0x7f61f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.314+0000 7f6203fff640 1 -- 172.21.15.100:0/1162406735 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f61f40ef820 con 0x7f620c102790 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.314+0000 7f620affd640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f80a2b80 0x7f61f80a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00abe0 tx=0x7f61fc00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.317+0000 7f6203fff640 1 -- 172.21.15.100:0/1162406735 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61f40bcab0 con 0x7f620c102790 2024-09-12T02:36:47.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:46 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1882173287' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:36:47.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:46 smithi117 ceph-mon[34898]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:36:47.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.492+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f620c02d7c0 con 0x7f620c102790 2024-09-12T02:36:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.855+0000 7f6203fff640 1 -- 172.21.15.100:0/1162406735 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7f61f40bc3b0 con 0x7f620c102790 2024-09-12T02:36:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f80a2b80 msgr2=0x7f61f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f80a2b80 0x7f61f80a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00abe0 tx=0x7f61fc00a5c0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 msgr2=0x7f620c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c074a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61f4005ab0 tx=0x7f61f40042f0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 shutdown_connections 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f80a2b80 0x7f61f80a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f620c106f10 0x7f620c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f620c102790 0x7f620c074a30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 --2- 172.21.15.100:0/1162406735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620c101de0 0x7f620c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 >> 172.21.15.100:0/1162406735 conn(0x7f620c0fd8c0 msgr2=0x7f620c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.858+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 shutdown_connections 2024-09-12T02:36:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:47.859+0000 7f6211592640 1 -- 172.21.15.100:0/1162406735 wait complete. 2024-09-12T02:36:48.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:47 smithi100 ceph-mon[31390]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:36:48.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:47 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1162406735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:36:48.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:47 smithi100 ceph-mon[31390]: pgmap v275: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:48.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:47 smithi189 ceph-mon[35196]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:36:48.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:47 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1162406735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:36:48.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:47 smithi189 ceph-mon[35196]: pgmap v275: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:48.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:47 smithi117 ceph-mon[34898]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:36:48.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:47 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1162406735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:36:48.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:47 smithi117 ceph-mon[34898]: pgmap v275: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:48.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:36:48.796 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:48.856 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:48 smithi100 ceph-mon[31390]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:36:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1162406735' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:36:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:48 smithi100 ceph-mon[31390]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:36:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:48 smithi189 ceph-mon[35196]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:36:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1162406735' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:36:49.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:48 smithi189 ceph-mon[35196]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 -- 172.21.15.100:0/578190317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101dd0 msgr2=0x7f51881021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 --2- 172.21.15.100:0/578190317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101dd0 0x7f51881021b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5178009900 tx=0x7f517802a410 comp rx=0 tx=0).stop 2024-09-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 -- 172.21.15.100:0/578190317 shutdown_connections 2024-09-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 --2- 172.21.15.100:0/578190317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5188106f00 0x7f518810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 --2- 172.21.15.100:0/578190317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188102780 0x7f51881067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 --2- 172.21.15.100:0/578190317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101dd0 0x7f51881021b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 -- 172.21.15.100:0/578190317 >> 172.21.15.100:0/578190317 conn(0x7f51880fd8b0 msgr2=0x7f51880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 -- 172.21.15.100:0/578190317 shutdown_connections 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.278+0000 7f518dd11640 1 -- 172.21.15.100:0/578190317 wait complete. 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 Processor -- start 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 -- start start 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188101dd0 0x7f5188198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5188102780 0x7f5188198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188106f00 0x7f518819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5188111f60 con 0x7f5188106f00 2024-09-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5188111de0 con 0x7f5188102780 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f518dd11640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51881120e0 con 0x7f5188101dd0 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f5187fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188106f00 0x7f518819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f5187fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188106f00 0x7f518819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48334/0 (socket says 172.21.15.100:48334) 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f5187fff640 1 -- 172.21.15.100:0/2551981287 learned_addr learned my addr 172.21.15.100:0/2551981287 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f5186ffd640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5188102780 0x7f5188198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.279+0000 7f51877fe640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188101dd0 0x7f5188198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5187fff640 1 -- 172.21.15.100:0/2551981287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188101dd0 msgr2=0x7f5188198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5187fff640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188101dd0 0x7f5188198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5187fff640 1 -- 172.21.15.100:0/2551981287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5188102780 msgr2=0x7f5188198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5187fff640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5188102780 0x7f5188198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5187fff640 1 -- 172.21.15.100:0/2551981287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518819d3e0 con 0x7f5188106f00 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5187fff640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188106f00 0x7f518819cd00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f518000eaa0 tx=0x7f518000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5184ff9640 1 -- 172.21.15.100:0/2551981287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518000cdb0 con 0x7f5188106f00 2024-09-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518819d6d0 con 0x7f5188106f00 2024-09-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5184ff9640 1 -- 172.21.15.100:0/2551981287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5180005020 con 0x7f5188106f00 2024-09-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f5184ff9640 1 -- 172.21.15.100:0/2551981287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800116b0 con 0x7f5188106f00 2024-09-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.280+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881a4fb0 con 0x7f5188106f00 2024-09-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.281+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51881021b0 con 0x7f5188106f00 2024-09-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.282+0000 7f5184ff9640 1 -- 172.21.15.100:0/2551981287 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5180005560 con 0x7f5188106f00 2024-09-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.283+0000 7f5184ff9640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51700a2b80 0x7f51700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.283+0000 7f51877fe640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51700a2b80 0x7f51700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.283+0000 7f5184ff9640 1 -- 172.21.15.100:0/2551981287 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f51800cf470 con 0x7f5188106f00 2024-09-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.283+0000 7f51877fe640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51700a2b80 0x7f51700a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5178005ab0 tx=0x7f5178005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.286+0000 7f5184ff9640 1 -- 172.21.15.100:0/2551981287 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5180016030 con 0x7f5188106f00 2024-09-12T02:36:49.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:48 smithi117 ceph-mon[34898]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:36:49.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1162406735' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:36:49.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:48 smithi117 ceph-mon[34898]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:36:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.489+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5188109b50 con 0x7f5188106f00 2024-09-12T02:36:49.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.869+0000 7f5184ff9640 1 -- 172.21.15.100:0/2551981287 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f518009c560 con 0x7f5188106f00 2024-09-12T02:36:49.870 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:36:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51700a2b80 msgr2=0x7f51700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51700a2b80 0x7f51700a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5178005ab0 tx=0x7f5178005a20 comp rx=0 tx=0).stop 2024-09-12T02:36:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188106f00 msgr2=0x7f518819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188106f00 0x7f518819cd00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f518000eaa0 tx=0x7f518000ef60 comp rx=0 tx=0).stop 2024-09-12T02:36:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 shutdown_connections 2024-09-12T02:36:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51700a2b80 0x7f51700a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188106f00 0x7f518819cd00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5188102780 0x7f5188198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 --2- 172.21.15.100:0/2551981287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188101dd0 0x7f5188198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 >> 172.21.15.100:0/2551981287 conn(0x7f51880fd8b0 msgr2=0x7f51880fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 shutdown_connections 2024-09-12T02:36:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:49.872+0000 7f518dd11640 1 -- 172.21.15.100:0/2551981287 wait complete. 2024-09-12T02:36:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:49 smithi100 ceph-mon[31390]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:36:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:49 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2551981287' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:36:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:49 smithi100 ceph-mon[31390]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:36:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:49 smithi100 ceph-mon[31390]: pgmap v278: 97 pgs: 36 creating+peering, 49 unknown, 12 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:50.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:49 smithi189 ceph-mon[35196]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:36:50.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:49 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2551981287' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:36:50.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:49 smithi189 ceph-mon[35196]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:36:50.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:49 smithi189 ceph-mon[35196]: pgmap v278: 97 pgs: 36 creating+peering, 49 unknown, 12 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:50.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:49 smithi117 ceph-mon[34898]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:36:50.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:49 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2551981287' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:36:50.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:49 smithi117 ceph-mon[34898]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:36:50.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:49 smithi117 ceph-mon[34898]: pgmap v278: 97 pgs: 36 creating+peering, 49 unknown, 12 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:36:50.495 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:36:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:50 smithi100 ceph-mon[31390]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:36:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:50 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2551981287' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:36:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:50 smithi100 ceph-mon[31390]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:36:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:50 smithi100 ceph-mon[31390]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:36:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 -- 172.21.15.100:0/197031236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c101de0 msgr2=0x7f121c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 --2- 172.21.15.100:0/197031236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c101de0 0x7f121c1021c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1214009900 tx=0x7f121402a410 comp rx=0 tx=0).stop 2024-09-12T02:36:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 -- 172.21.15.100:0/197031236 shutdown_connections 2024-09-12T02:36:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 --2- 172.21.15.100:0/197031236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c106f10 0x7f121c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 --2- 172.21.15.100:0/197031236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102790 0x7f121c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 --2- 172.21.15.100:0/197031236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c101de0 0x7f121c1021c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 -- 172.21.15.100:0/197031236 >> 172.21.15.100:0/197031236 conn(0x7f121c0fd8c0 msgr2=0x7f121c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 -- 172.21.15.100:0/197031236 shutdown_connections 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.209+0000 7f1223932640 1 -- 172.21.15.100:0/197031236 wait complete. 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 Processor -- start 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 -- start start 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c101de0 0x7f121c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102790 0x7f121c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c106f10 0x7f121c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f121c111f70 con 0x7f121c106f10 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f121c111df0 con 0x7f121c101de0 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1223932640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f121c1120f0 con 0x7f121c102790 2024-09-12T02:36:51.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1221ecf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c106f10 0x7f121c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1221ecf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c106f10 0x7f121c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48354/0 (socket says 172.21.15.100:48354) 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1221ecf640 1 -- 172.21.15.100:0/2624419728 learned_addr learned my addr 172.21.15.100:0/2624419728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f12216ce640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c101de0 0x7f121c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.210+0000 7f1220ecd640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102790 0x7f121c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1221ecf640 1 -- 172.21.15.100:0/2624419728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102790 msgr2=0x7f121c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1221ecf640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102790 0x7f121c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1221ecf640 1 -- 172.21.15.100:0/2624419728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c101de0 msgr2=0x7f121c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1221ecf640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c101de0 0x7f121c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1221ecf640 1 -- 172.21.15.100:0/2624419728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c19d480 con 0x7f121c106f10 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1221ecf640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c106f10 0x7f121c19cda0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c970 tx=0x7f120c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f121a7fc640 1 -- 172.21.15.100:0/2624419728 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c007bb0 con 0x7f121c106f10 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121c19d770 con 0x7f121c106f10 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f121a7fc640 1 -- 172.21.15.100:0/2624419728 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f120c007d50 con 0x7f121c106f10 2024-09-12T02:36:51.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f121a7fc640 1 -- 172.21.15.100:0/2624419728 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c00f450 con 0x7f121c106f10 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.211+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121c1a5050 con 0x7f121c106f10 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.212+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121c1021c0 con 0x7f121c106f10 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.213+0000 7f121a7fc640 1 -- 172.21.15.100:0/2624419728 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f120c004f20 con 0x7f121c106f10 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.214+0000 7f121a7fc640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12040a2b80 0x7f12040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.214+0000 7f12216ce640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12040a2b80 0x7f12040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.214+0000 7f121a7fc640 1 -- 172.21.15.100:0/2624419728 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f120c0ceec0 con 0x7f121c106f10 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.214+0000 7f12216ce640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12040a2b80 0x7f12040a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1214000c00 tx=0x7f12140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.217+0000 7f121a7fc640 1 -- 172.21.15.100:0/2624419728 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f120c014030 con 0x7f121c106f10 2024-09-12T02:36:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:50 smithi189 ceph-mon[35196]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:36:51.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:50 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2551981287' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:36:51.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:50 smithi189 ceph-mon[35196]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:36:51.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:50 smithi189 ceph-mon[35196]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:36:51.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:50 smithi117 ceph-mon[34898]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:36:51.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:50 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2551981287' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:36:51.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:50 smithi117 ceph-mon[34898]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:36:51.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:50 smithi117 ceph-mon[34898]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:36:51.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.384+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f121c199830 con 0x7f121c106f10 2024-09-12T02:36:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.386+0000 7f121a7fc640 1 -- 172.21.15.100:0/2624419728 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22373 (secure 0 0 0) 0x7f121c199830 con 0x7f121c106f10 2024-09-12T02:36:51.386 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:51.386 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:36:49.489990+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.388+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12040a2b80 msgr2=0x7f12040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.388+0000 7f1223932640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12040a2b80 0x7f12040a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1214000c00 tx=0x7f12140058d0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.388+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c106f10 msgr2=0x7f121c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.388+0000 7f1223932640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c106f10 0x7f121c19cda0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c970 tx=0x7f120c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 shutdown_connections 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12040a2b80 0x7f12040a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c106f10 0x7f121c19cda0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102790 0x7f121c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 --2- 172.21.15.100:0/2624419728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c101de0 0x7f121c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 >> 172.21.15.100:0/2624419728 conn(0x7f121c0fd8c0 msgr2=0x7f121c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 shutdown_connections 2024-09-12T02:36:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:51.389+0000 7f1223932640 1 -- 172.21.15.100:0/2624419728 wait complete. 2024-09-12T02:36:51.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:51 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] up:active 2024-09-12T02:36:51.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:51 smithi100 ceph-mon[31390]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:51.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:51 smithi100 ceph-mon[31390]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:51.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:51 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2624419728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:51.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:51 smithi100 ceph-mon[31390]: pgmap v280: 97 pgs: 30 creating+peering, 8 unknown, 59 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s wr, 2 op/s 2024-09-12T02:36:52.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:36:52.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:51 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] up:active 2024-09-12T02:36:52.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:51 smithi189 ceph-mon[35196]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:52.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:51 smithi189 ceph-mon[35196]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:52.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:51 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2624419728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:52.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:51 smithi189 ceph-mon[35196]: pgmap v280: 97 pgs: 30 creating+peering, 8 unknown, 59 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s wr, 2 op/s 2024-09-12T02:36:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:52.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:51 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] up:active 2024-09-12T02:36:52.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:51 smithi117 ceph-mon[34898]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:52.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:51 smithi117 ceph-mon[34898]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:52.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:51 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2624419728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:52.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:51 smithi117 ceph-mon[34898]: pgmap v280: 97 pgs: 30 creating+peering, 8 unknown, 59 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s wr, 2 op/s 2024-09-12T02:36:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 -- 172.21.15.100:0/771949000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb458103660 msgr2=0x7fb45810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 --2- 172.21.15.100:0/771949000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb458103660 0x7fb45810bb50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb448009900 tx=0x7fb44802a480 comp rx=0 tx=0).stop 2024-09-12T02:36:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 -- 172.21.15.100:0/771949000 shutdown_connections 2024-09-12T02:36:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 --2- 172.21.15.100:0/771949000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb45810c170 0x7fb45810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 --2- 172.21.15.100:0/771949000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb458103660 0x7fb45810bb50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 --2- 172.21.15.100:0/771949000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb458102d40 0x7fb458103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 -- 172.21.15.100:0/771949000 >> 172.21.15.100:0/771949000 conn(0x7fb4580fc7a0 msgr2=0x7fb4580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.728+0000 7fb45cae2640 1 -- 172.21.15.100:0/771949000 shutdown_connections 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.729+0000 7fb45cae2640 1 -- 172.21.15.100:0/771949000 wait complete. 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.729+0000 7fb45cae2640 1 Processor -- start 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.729+0000 7fb45cae2640 1 -- start start 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.729+0000 7fb45cae2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb458102d40 0x7fb4581009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.729+0000 7fb45cae2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb458103660 0x7fb458100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.729+0000 7fb45cae2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45810c170 0x7fb458101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb45cae2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb458112030 con 0x7fb45810c170 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb45cae2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb458111eb0 con 0x7fb458102d40 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb45cae2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581121b0 con 0x7fb458103660 2024-09-12T02:36:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45810c170 0x7fb458101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45810c170 0x7fb458101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48380/0 (socket says 172.21.15.100:48380) 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 -- 172.21.15.100:0/2330249754 learned_addr learned my addr 172.21.15.100:0/2330249754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb455d9b640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb458103660 0x7fb458100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb45659c640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb458102d40 0x7fb4581009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 -- 172.21.15.100:0/2330249754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb458103660 msgr2=0x7fb458100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb458103660 0x7fb458100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 -- 172.21.15.100:0/2330249754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb458102d40 msgr2=0x7fb4581009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb458102d40 0x7fb4581009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 -- 172.21.15.100:0/2330249754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4581a6a40 con 0x7fb45810c170 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb456d9d640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45810c170 0x7fb458101420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb45000b970 tx=0x7fb45000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb4477fe640 1 -- 172.21.15.100:0/2330249754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450019070 con 0x7fb45810c170 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb4477fe640 1 -- 172.21.15.100:0/2330249754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb45000cb40 con 0x7fb45810c170 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4581a6d30 con 0x7fb45810c170 2024-09-12T02:36:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb4477fe640 1 -- 172.21.15.100:0/2330249754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450007650 con 0x7fb45810c170 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.730+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4581a7270 con 0x7fb45810c170 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.731+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4581031a0 con 0x7fb45810c170 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.732+0000 7fb4477fe640 1 -- 172.21.15.100:0/2330249754 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb45001c070 con 0x7fb45810c170 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.733+0000 7fb4477fe640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb4400a2b80 0x7fb4400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.733+0000 7fb45659c640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb4400a2b80 0x7fb4400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.733+0000 7fb4477fe640 1 -- 172.21.15.100:0/2330249754 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb4500ce520 con 0x7fb45810c170 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.733+0000 7fb45659c640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb4400a2b80 0x7fb4400a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009890 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.737+0000 7fb4477fe640 1 -- 172.21.15.100:0/2330249754 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb45009b5d0 con 0x7fb45810c170 2024-09-12T02:36:52.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.904+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4581071e0 con 0x7fb45810c170 2024-09-12T02:36:52.905 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:52 smithi100 ceph-mon[31390]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:36:52.905 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:52 smithi100 ceph-mon[31390]: Cluster is now healthy 2024-09-12T02:36:52.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.905+0000 7fb4477fe640 1 -- 172.21.15.100:0/2330249754 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22373 (secure 0 0 0) 0x7fb45009aed0 con 0x7fb45810c170 2024-09-12T02:36:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:36:52.906 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:36:49.489990+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:52.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb4400a2b80 msgr2=0x7fb4400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb4400a2b80 0x7fb4400a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009890 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2024-09-12T02:36:52.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45810c170 msgr2=0x7fb458101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45810c170 0x7fb458101420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb45000b970 tx=0x7fb45000be30 comp rx=0 tx=0).stop 2024-09-12T02:36:52.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 shutdown_connections 2024-09-12T02:36:52.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb4400a2b80 0x7fb4400a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45810c170 0x7fb458101420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb458103660 0x7fb458100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 --2- 172.21.15.100:0/2330249754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb458102d40 0x7fb4581009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 >> 172.21.15.100:0/2330249754 conn(0x7fb4580fc7a0 msgr2=0x7fb4580fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:52.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 shutdown_connections 2024-09-12T02:36:52.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:52.908+0000 7fb45cae2640 1 -- 172.21.15.100:0/2330249754 wait complete. 2024-09-12T02:36:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:52 smithi189 ceph-mon[35196]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:36:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:52 smithi189 ceph-mon[35196]: Cluster is now healthy 2024-09-12T02:36:53.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:52 smithi117 ceph-mon[34898]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:36:53.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:52 smithi117 ceph-mon[34898]: Cluster is now healthy 2024-09-12T02:36:53.532 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:36:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:54.233 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:53 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2330249754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:54.233 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:53 smithi100 ceph-mon[31390]: pgmap v281: 97 pgs: 26 creating+peering, 71 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-09-12T02:36:54.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:53 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2330249754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:54.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:53 smithi189 ceph-mon[35196]: pgmap v281: 97 pgs: 26 creating+peering, 71 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-09-12T02:36:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 -- 172.21.15.100:0/1510954203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0101420 msgr2=0x7feeb010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 --2- 172.21.15.100:0/1510954203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0101420 0x7feeb010d950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feea8009cd0 tx=0x7feea802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 -- 172.21.15.100:0/1510954203 shutdown_connections 2024-09-12T02:36:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 --2- 172.21.15.100:0/1510954203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0101420 0x7feeb010d950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 --2- 172.21.15.100:0/1510954203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeb0100a80 0x7feeb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 --2- 172.21.15.100:0/1510954203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feeb0106a80 0x7feeb0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 -- 172.21.15.100:0/1510954203 >> 172.21.15.100:0/1510954203 conn(0x7feeb00fc7a0 msgr2=0x7feeb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 -- 172.21.15.100:0/1510954203 shutdown_connections 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 -- 172.21.15.100:0/1510954203 wait complete. 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 Processor -- start 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.314+0000 7feeb7204640 1 -- start start 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0100a80 0x7feeb01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeb0101420 0x7feeb0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feeb0106a80 0x7feeb019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feeb0112020 con 0x7feeb0100a80 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feeb0111ea0 con 0x7feeb0101420 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feeb01121a0 con 0x7feeb0106a80 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0100a80 0x7feeb01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0100a80 0x7feeb01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48882/0 (socket says 172.21.15.100:48882) 2024-09-12T02:36:54.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 -- 172.21.15.100:0/4012667679 learned_addr learned my addr 172.21.15.100:0/4012667679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 -- 172.21.15.100:0/4012667679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feeb0106a80 msgr2=0x7feeb019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feeb0106a80 0x7feeb019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 -- 172.21.15.100:0/4012667679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeb0101420 msgr2=0x7feeb0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeb0101420 0x7feeb0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 -- 172.21.15.100:0/4012667679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb019d550 con 0x7feeb0100a80 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb4fa0640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0100a80 0x7feeb01985a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feea400b4a0 tx=0x7feea400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeadffb640 1 -- 172.21.15.100:0/4012667679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4014070 con 0x7feeb0100a80 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeadffb640 1 -- 172.21.15.100:0/4012667679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feea4010af0 con 0x7feeb0100a80 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb019d840 con 0x7feeb0100a80 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeadffb640 1 -- 172.21.15.100:0/4012667679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4017d10 con 0x7feeb0100a80 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.315+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb01a5120 con 0x7feeb0100a80 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.316+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb0100f60 con 0x7feeb0100a80 2024-09-12T02:36:54.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.317+0000 7feeadffb640 1 -- 172.21.15.100:0/4012667679 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7feea4017070 con 0x7feeb0100a80 2024-09-12T02:36:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.318+0000 7feeadffb640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7feea00a2b80 0x7feea00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.318+0000 7feeaffff640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7feea00a2b80 0x7feea00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.318+0000 7feeadffb640 1 -- 172.21.15.100:0/4012667679 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7feea40ce3e0 con 0x7feeb0100a80 2024-09-12T02:36:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.318+0000 7feeaffff640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7feea00a2b80 0x7feea00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feeb00fedf0 tx=0x7fee9c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.322+0000 7feeadffb640 1 -- 172.21.15.100:0/4012667679 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feea409b490 con 0x7feeb0100a80 2024-09-12T02:36:54.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:53 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2330249754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:54.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:53 smithi117 ceph-mon[34898]: pgmap v281: 97 pgs: 26 creating+peering, 71 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-09-12T02:36:54.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.524+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7feeb002d7c0 con 0x7feeb0100a80 2024-09-12T02:36:54.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: 2024-09-12T02:36:54.564+0000 7f533edba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:36:54.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.891+0000 7feeadffb640 1 -- 172.21.15.100:0/4012667679 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7feea409ad90 con 0x7feeb0100a80 2024-09-12T02:36:54.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7feea00a2b80 msgr2=0x7feea00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7feea00a2b80 0x7feea00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feeb00fedf0 tx=0x7fee9c006c90 comp rx=0 tx=0).stop 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0100a80 msgr2=0x7feeb01985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0100a80 0x7feeb01985a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feea400b4a0 tx=0x7feea400b960 comp rx=0 tx=0).stop 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 shutdown_connections 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7feea00a2b80 0x7feea00a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feeb0106a80 0x7feeb019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeb0101420 0x7feeb0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 --2- 172.21.15.100:0/4012667679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb0100a80 0x7feeb01985a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 >> 172.21.15.100:0/4012667679 conn(0x7feeb00fc7a0 msgr2=0x7feeb00fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 shutdown_connections 2024-09-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:54.893+0000 7feeb7204640 1 -- 172.21.15.100:0/4012667679 wait complete. 2024-09-12T02:36:55.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:54 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4012667679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:36:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:54 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4012667679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:36:55.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:54 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4012667679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:36:55.589 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T02:36:55.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-12T02:36:55.834 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:56.193 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:55 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4012667679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:36:56.193 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:55 smithi100 ceph-mon[31390]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:56.193 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:55 smithi100 ceph-mon[31390]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T02:36:56.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:55 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4012667679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:36:56.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:55 smithi189 ceph-mon[35196]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:56.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:55 smithi189 ceph-mon[35196]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T02:36:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.280+0000 7f9c466f8640 1 -- 172.21.15.100:0/2005707722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40102d40 msgr2=0x7f9c40103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.280+0000 7f9c466f8640 1 --2- 172.21.15.100:0/2005707722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40102d40 0x7f9c40103120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009900 tx=0x7f9c3002a480 comp rx=0 tx=0).stop 2024-09-12T02:36:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 -- 172.21.15.100:0/2005707722 shutdown_connections 2024-09-12T02:36:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 --2- 172.21.15.100:0/2005707722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4010c170 0x7f9c4010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 --2- 172.21.15.100:0/2005707722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c40103660 0x7f9c4010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 --2- 172.21.15.100:0/2005707722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40102d40 0x7f9c40103120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 -- 172.21.15.100:0/2005707722 >> 172.21.15.100:0/2005707722 conn(0x7f9c400fc7a0 msgr2=0x7f9c400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 -- 172.21.15.100:0/2005707722 shutdown_connections 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 -- 172.21.15.100:0/2005707722 wait complete. 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 Processor -- start 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.281+0000 7f9c466f8640 1 -- start start 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c466f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c40102d40 0x7f9c40198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c466f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40103660 0x7f9c40198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c466f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4010c170 0x7f9c4019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c466f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c40112030 con 0x7f9c40103660 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c466f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c40111eb0 con 0x7f9c40102d40 2024-09-12T02:36:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c466f8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c401121b0 con 0x7f9c4010c170 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40103660 0x7f9c40198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40103660 0x7f9c40198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48900/0 (socket says 172.21.15.100:48900) 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 -- 172.21.15.100:0/4149800897 learned_addr learned my addr 172.21.15.100:0/4149800897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3ffff640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c40102d40 0x7f9c40198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 -- 172.21.15.100:0/4149800897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4010c170 msgr2=0x7f9c4019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4010c170 0x7f9c4019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 -- 172.21.15.100:0/4149800897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c40102d40 msgr2=0x7f9c40198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c40102d40 0x7f9c40198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 -- 172.21.15.100:0/4149800897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4019d5c0 con 0x7f9c40103660 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3f7fe640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40103660 0x7f9c40198b50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400b3f0 tx=0x7f9c3400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.282+0000 7f9c3d7fa640 1 -- 172.21.15.100:0/4149800897 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34015020 con 0x7f9c40103660 2024-09-12T02:36:56.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.283+0000 7f9c3d7fa640 1 -- 172.21.15.100:0/4149800897 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c34011d10 con 0x7f9c40103660 2024-09-12T02:36:56.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.283+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4019d8b0 con 0x7f9c40103660 2024-09-12T02:36:56.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.283+0000 7f9c3d7fa640 1 -- 172.21.15.100:0/4149800897 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400f2e0 con 0x7f9c40103660 2024-09-12T02:36:56.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.283+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c401a5190 con 0x7f9c40103660 2024-09-12T02:36:56.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.284+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c401031a0 con 0x7f9c40103660 2024-09-12T02:36:56.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.285+0000 7f9c3d7fa640 1 -- 172.21.15.100:0/4149800897 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f9c34018020 con 0x7f9c40103660 2024-09-12T02:36:56.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.286+0000 7f9c3d7fa640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c280a2b80 0x7f9c280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.286+0000 7f9c3ffff640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c280a2b80 0x7f9c280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:56.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.287+0000 7f9c3d7fa640 1 -- 172.21.15.100:0/4149800897 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f9c340ce8a0 con 0x7f9c40103660 2024-09-12T02:36:56.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.287+0000 7f9c3ffff640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c280a2b80 0x7f9c280a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c300096c0 tx=0x7f9c30031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.291+0000 7f9c3d7fa640 1 -- 172.21.15.100:0/4149800897 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c3401f020 con 0x7f9c40103660 2024-09-12T02:36:56.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:55 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4012667679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:36:56.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:55 smithi117 ceph-mon[34898]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:56.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:55 smithi117 ceph-mon[34898]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T02:36:56.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.495+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f9c4002d7c0 con 0x7f9c40103660 2024-09-12T02:36:56.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.902+0000 7f9c3d7fa640 1 -- 172.21.15.100:0/4149800897 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f9c3409b8b0 con 0x7f9c40103660 2024-09-12T02:36:56.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c280a2b80 msgr2=0x7f9c280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c280a2b80 0x7f9c280a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c300096c0 tx=0x7f9c30031490 comp rx=0 tx=0).stop 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40103660 msgr2=0x7f9c40198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40103660 0x7f9c40198b50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400b3f0 tx=0x7f9c3400b8b0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 shutdown_connections 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c280a2b80 0x7f9c280a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4010c170 0x7f9c4019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c40103660 0x7f9c40198b50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 --2- 172.21.15.100:0/4149800897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c40102d40 0x7f9c40198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.904+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 >> 172.21.15.100:0/4149800897 conn(0x7f9c400fc7a0 msgr2=0x7f9c400fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.905+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 shutdown_connections 2024-09-12T02:36:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:56.905+0000 7f9c466f8640 1 -- 172.21.15.100:0/4149800897 wait complete. 2024-09-12T02:36:57.250 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:56 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4149800897' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:36:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:56 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4149800897' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:36:57.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:56 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4149800897' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:36:57.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T02:36:57.833 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:58.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:57 smithi100 ceph-mon[31390]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:36:58.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:57 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4149800897' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:36:58.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:57 smithi100 ceph-mon[31390]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:36:58.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:57 smithi100 ceph-mon[31390]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:58.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:57 smithi100 ceph-mon[31390]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:36:58.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:57 smithi100 ceph-mon[31390]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:36:58.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:57 smithi100 ceph-mon[31390]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:36:58.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:57 smithi189 ceph-mon[35196]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:36:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:57 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4149800897' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:36:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:57 smithi189 ceph-mon[35196]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:36:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:57 smithi189 ceph-mon[35196]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:57 smithi189 ceph-mon[35196]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:36:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:57 smithi189 ceph-mon[35196]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:36:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:57 smithi189 ceph-mon[35196]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:36:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3876313988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 msgr2=0x7f51f010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3876313988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f010d910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009ca0 tx=0x7f51e802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3876313988 shutdown_connections 2024-09-12T02:36:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3876313988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f010d910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3876313988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f0101240 0x7f51f0101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3876313988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f0105a90 0x7f51f0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3876313988 >> 172.21.15.100:0/3876313988 conn(0x7f51f0077210 msgr2=0x7f51f00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3876313988 shutdown_connections 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.287+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3876313988 wait complete. 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 Processor -- start 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 -- start start 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f0101240 0x7f51f0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f0105a90 0x7f51f019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0110fb0 con 0x7f51f0101bc0 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0110e30 con 0x7f51f0105a90 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51f4f7c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0111130 con 0x7f51f0101240 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48916/0 (socket says 172.21.15.100:48916) 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 -- 172.21.15.100:0/3264595246 learned_addr learned my addr 172.21.15.100:0/3264595246 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51ee59c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f0101240 0x7f51f0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 -- 172.21.15.100:0/3264595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f0101240 msgr2=0x7f51f0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51eed9d640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f0105a90 0x7f51f019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f0101240 0x7f51f0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 -- 172.21.15.100:0/3264595246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f0105a90 msgr2=0x7f51f019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f0105a90 0x7f51f019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51e7fff640 1 -- 172.21.15.100:0/3264595246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f019d440 con 0x7f51f0101bc0 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.288+0000 7f51eed9d640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f0105a90 0x7f51f019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.289+0000 7f51e7fff640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f01989d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51d800d950 tx=0x7f51d800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.289+0000 7f51e77fe640 1 -- 172.21.15.100:0/3264595246 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8017070 con 0x7f51f0101bc0 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.289+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f019d730 con 0x7f51f0101bc0 2024-09-12T02:36:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.289+0000 7f51e77fe640 1 -- 172.21.15.100:0/3264595246 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d800de80 con 0x7f51f0101bc0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.289+0000 7f51e77fe640 1 -- 172.21.15.100:0/3264595246 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d800f620 con 0x7f51f0101bc0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.289+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f01a5010 con 0x7f51f0101bc0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.290+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f0101680 con 0x7f51f0101bc0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.291+0000 7f51e77fe640 1 -- 172.21.15.100:0/3264595246 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f51d8009c30 con 0x7f51f0101bc0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.291+0000 7f51e77fe640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51dc0a2b80 0x7f51dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.292+0000 7f51ee59c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51dc0a2b80 0x7f51dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.292+0000 7f51e77fe640 1 -- 172.21.15.100:0/3264595246 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f51d80ceba0 con 0x7f51f0101bc0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.292+0000 7f51ee59c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51dc0a2b80 0x7f51dc0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009990 tx=0x7f51e0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.296+0000 7f51e77fe640 1 -- 172.21.15.100:0/3264595246 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51d809bc50 con 0x7f51f0101bc0 2024-09-12T02:36:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:57 smithi117 ceph-mon[34898]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:36:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:57 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4149800897' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:36:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:57 smithi117 ceph-mon[34898]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:36:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:57 smithi117 ceph-mon[34898]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:36:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:57 smithi117 ceph-mon[34898]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:36:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:57 smithi117 ceph-mon[34898]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:36:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:57 smithi117 ceph-mon[34898]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:36:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.498+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f51f0109a30 con 0x7f51f0101bc0 2024-09-12T02:36:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.921+0000 7f51e77fe640 1 -- 172.21.15.100:0/3264595246 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f51d809b550 con 0x7f51f0101bc0 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51dc0a2b80 msgr2=0x7f51dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51dc0a2b80 0x7f51dc0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009990 tx=0x7f51e0009110 comp rx=0 tx=0).stop 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 msgr2=0x7f51f01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f01989d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51d800d950 tx=0x7f51d800dd50 comp rx=0 tx=0).stop 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 shutdown_connections 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51dc0a2b80 0x7f51dc0a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f0105a90 0x7f51f019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51f0101bc0 0x7f51f01989d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 --2- 172.21.15.100:0/3264595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f0101240 0x7f51f0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 >> 172.21.15.100:0/3264595246 conn(0x7f51f0077210 msgr2=0x7f51f0100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.923+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 shutdown_connections 2024-09-12T02:36:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:36:58.924+0000 7f51f4f7c640 1 -- 172.21.15.100:0/3264595246 wait complete. 2024-09-12T02:36:59.224 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] up:active 2024-09-12T02:36:59.224 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:36:59.225 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:36:59.225 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: Cluster is now healthy 2024-09-12T02:36:59.225 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:36:59.225 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-12T02:36:59.225 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-12T02:36:59.225 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:58 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3264595246' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:36:59.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] up:active 2024-09-12T02:36:59.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:36:59.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:36:59.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: Cluster is now healthy 2024-09-12T02:36:59.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:36:59.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-12T02:36:59.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-12T02:36:59.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:58 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3264595246' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] up:active 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: Cluster is now healthy 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-12T02:36:59.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:58 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3264595246' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:36:59.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T02:36:59.800 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:59.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: 2024-09-12T02:36:59.565+0000 7f533edba640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T02:36:59.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:36:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: 2024-09-12T02:36:59.565+0000 7f533edba640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T02:37:00.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:59 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3264595246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:37:00.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:59 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] up:active 2024-09-12T02:37:00.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:59 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-12T02:37:00.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:59 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:37:00.204 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:36:59 smithi100 ceph-mon[31390]: pgmap v284: 97 pgs: 97 active+clean; 581 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T02:37:00.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:59 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3264595246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:37:00.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:59 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] up:active 2024-09-12T02:37:00.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:59 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-12T02:37:00.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:59 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:37:00.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:36:59 smithi189 ceph-mon[35196]: pgmap v284: 97 pgs: 97 active+clean; 581 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T02:37:00.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.284+0000 7fe868f6c640 1 -- 172.21.15.100:0/608269665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864106a80 msgr2=0x7fe864106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.284+0000 7fe868f6c640 1 --2- 172.21.15.100:0/608269665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864106a80 0x7fe864106e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe854009930 tx=0x7fe85402a420 comp rx=0 tx=0).stop 2024-09-12T02:37:00.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 -- 172.21.15.100:0/608269665 shutdown_connections 2024-09-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 --2- 172.21.15.100:0/608269665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe864101420 0x7fe86410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 --2- 172.21.15.100:0/608269665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe864100a80 0x7fe864100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 --2- 172.21.15.100:0/608269665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864106a80 0x7fe864106e60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 -- 172.21.15.100:0/608269665 >> 172.21.15.100:0/608269665 conn(0x7fe8640fc7a0 msgr2=0x7fe8640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 -- 172.21.15.100:0/608269665 shutdown_connections 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 -- 172.21.15.100:0/608269665 wait complete. 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.285+0000 7fe868f6c640 1 Processor -- start 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe868f6c640 1 -- start start 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe868f6c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe864100a80 0x7fe864199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe868f6c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864101420 0x7fe8641998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe868f6c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe864106a80 0x7fe8641a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe868f6c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe864110ec0 con 0x7fe864101420 2024-09-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe868f6c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe864110d40 con 0x7fe864100a80 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe868f6c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe864111040 con 0x7fe864106a80 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864101420 0x7fe8641998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864101420 0x7fe8641998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48926/0 (socket says 172.21.15.100:48926) 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 -- 172.21.15.100:0/3634786331 learned_addr learned my addr 172.21.15.100:0/3634786331 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe86259c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe864100a80 0x7fe864199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe862d9d640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe864106a80 0x7fe8641a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 -- 172.21.15.100:0/3634786331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe864106a80 msgr2=0x7fe8641a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe864106a80 0x7fe8641a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 -- 172.21.15.100:0/3634786331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe864100a80 msgr2=0x7fe864199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe864100a80 0x7fe864199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 -- 172.21.15.100:0/3634786331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8641a4930 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe861d9b640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864101420 0x7fe8641998b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c970 tx=0x7fe85800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.286+0000 7fe8537fe640 1 -- 172.21.15.100:0/3634786331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858007bb0 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.287+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8641a4b00 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.287+0000 7fe8537fe640 1 -- 172.21.15.100:0/3634786331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe858007d50 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.287+0000 7fe8537fe640 1 -- 172.21.15.100:0/3634786331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85800f450 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.287+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8641a4fc0 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.288+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe864100ee0 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.289+0000 7fe8537fe640 1 -- 172.21.15.100:0/3634786331 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe858005020 con 0x7fe864101420 2024-09-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.289+0000 7fe8537fe640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe84c0a2b80 0x7fe84c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.289+0000 7fe86259c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe84c0a2b80 0x7fe84c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.289+0000 7fe8537fe640 1 -- 172.21.15.100:0/3634786331 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe8580cecd0 con 0x7fe864101420 2024-09-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.290+0000 7fe86259c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe84c0a2b80 0x7fe84c0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe854009900 tx=0x7fe8540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.294+0000 7fe8537fe640 1 -- 172.21.15.100:0/3634786331 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe858014030 con 0x7fe864101420 2024-09-12T02:37:00.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:59 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3264595246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:37:00.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:59 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] up:active 2024-09-12T02:37:00.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:59 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-12T02:37:00.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:59 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:37:00.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:36:59 smithi117 ceph-mon[34898]: pgmap v284: 97 pgs: 97 active+clean; 581 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T02:37:00.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.494+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe864108ff0 con 0x7fe864101420 2024-09-12T02:37:00.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.934+0000 7fe8537fe640 1 -- 172.21.15.100:0/3634786331 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fe85809bd80 con 0x7fe864101420 2024-09-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe84c0a2b80 msgr2=0x7fe84c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe84c0a2b80 0x7fe84c0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe854009900 tx=0x7fe8540058d0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864101420 msgr2=0x7fe8641998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864101420 0x7fe8641998b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c970 tx=0x7fe85800ce30 comp rx=0 tx=0).stop 2024-09-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 shutdown_connections 2024-09-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe84c0a2b80 0x7fe84c0a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe864106a80 0x7fe8641a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe864101420 0x7fe8641998b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 --2- 172.21.15.100:0/3634786331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe864100a80 0x7fe864199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 >> 172.21.15.100:0/3634786331 conn(0x7fe8640fc7a0 msgr2=0x7fe8640fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 shutdown_connections 2024-09-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:00.938+0000 7fe868f6c640 1 -- 172.21.15.100:0/3634786331 wait complete. 2024-09-12T02:37:01.250 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:00 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3634786331' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:37:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:00 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3634786331' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:37:01.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:00 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3634786331' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:37:01.631 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T02:37:01.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T02:37:01.876 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:02.195 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:01 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3634786331' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:37:02.196 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:01 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:37:02.196 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:01 smithi100 ceph-mon[31390]: pgmap v285: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-12T02:37:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:01 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3634786331' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:37:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:01 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:37:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:01 smithi189 ceph-mon[35196]: pgmap v285: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-12T02:37:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 -- 172.21.15.100:0/3426405534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0106a80 msgr2=0x7fdca0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/3426405534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0106a80 0x7fdca0106e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009930 tx=0x7fdc9c02a420 comp rx=0 tx=0).stop 2024-09-12T02:37:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 -- 172.21.15.100:0/3426405534 shutdown_connections 2024-09-12T02:37:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/3426405534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca0101420 0x7fdca010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/3426405534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdca0100a80 0x7fdca0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/3426405534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0106a80 0x7fdca0106e60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 -- 172.21.15.100:0/3426405534 >> 172.21.15.100:0/3426405534 conn(0x7fdca00fc7a0 msgr2=0x7fdca00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 -- 172.21.15.100:0/3426405534 shutdown_connections 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.275+0000 7fdca7b6d640 1 -- 172.21.15.100:0/3426405534 wait complete. 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 Processor -- start 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 -- start start 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdca0100a80 0x7fdca0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0101420 0x7fdca0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca0106a80 0x7fdca01a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0110e80 con 0x7fdca0101420 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0110d00 con 0x7fdca0106a80 2024-09-12T02:37:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca7b6d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0111000 con 0x7fdca0100a80 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0101420 0x7fdca0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0101420 0x7fdca0199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48946/0 (socket says 172.21.15.100:48946) 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 -- 172.21.15.100:0/4102639461 learned_addr learned my addr 172.21.15.100:0/4102639461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5909640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdca0100a80 0x7fdca0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 -- 172.21.15.100:0/4102639461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdca0100a80 msgr2=0x7fdca0199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdca0100a80 0x7fdca0199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 -- 172.21.15.100:0/4102639461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca0106a80 msgr2=0x7fdca01a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca610a640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca0106a80 0x7fdca01a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca0106a80 0x7fdca01a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.276+0000 7fdca5108640 1 -- 172.21.15.100:0/4102639461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca01a48d0 con 0x7fdca0101420 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.277+0000 7fdca5108640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0101420 0x7fdca0199850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000d770 tx=0x7fdc9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.277+0000 7fdc96ffd640 1 -- 172.21.15.100:0/4102639461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90017070 con 0x7fdca0101420 2024-09-12T02:37:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.277+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca01a4aa0 con 0x7fdca0101420 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.277+0000 7fdc96ffd640 1 -- 172.21.15.100:0/4102639461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc90005500 con 0x7fdca0101420 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.277+0000 7fdc96ffd640 1 -- 172.21.15.100:0/4102639461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90004e00 con 0x7fdca0101420 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.277+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca01a4f60 con 0x7fdca0101420 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.278+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca0100ee0 con 0x7fdca0101420 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.279+0000 7fdc96ffd640 1 -- 172.21.15.100:0/4102639461 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdc90004fa0 con 0x7fdca0101420 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.279+0000 7fdc96ffd640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc8c0a2b80 0x7fdc8c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.279+0000 7fdca5909640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc8c0a2b80 0x7fdc8c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.280+0000 7fdc96ffd640 1 -- 172.21.15.100:0/4102639461 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fdc900cea20 con 0x7fdca0101420 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.280+0000 7fdca5909640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc8c0a2b80 0x7fdc8c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c000c00 tx=0x7fdc9c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.284+0000 7fdc96ffd640 1 -- 172.21.15.100:0/4102639461 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc9009bad0 con 0x7fdca0101420 2024-09-12T02:37:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:01 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3634786331' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:37:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:01 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:37:02.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:01 smithi117 ceph-mon[34898]: pgmap v285: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-12T02:37:02.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.473+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdca0062630 con 0x7fdc8c0a2b80 2024-09-12T02:37:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.500+0000 7fdc96ffd640 1 -- 172.21.15.100:0/4102639461 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdca0062630 con 0x7fdc8c0a2b80 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc8c0a2b80 msgr2=0x7fdc8c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc8c0a2b80 0x7fdc8c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c000c00 tx=0x7fdc9c005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0101420 msgr2=0x7fdca0199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0101420 0x7fdca0199850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000d770 tx=0x7fdc9000dc30 comp rx=0 tx=0).stop 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 shutdown_connections 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc8c0a2b80 0x7fdc8c0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca0106a80 0x7fdca01a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0101420 0x7fdca0199850 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 --2- 172.21.15.100:0/4102639461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdca0100a80 0x7fdca0199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.502+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 >> 172.21.15.100:0/4102639461 conn(0x7fdca00fc7a0 msgr2=0x7fdca00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:02.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.503+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 shutdown_connections 2024-09-12T02:37:02.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:02.503+0000 7fdca7b6d640 1 -- 172.21.15.100:0/4102639461 wait complete. 2024-09-12T02:37:02.871 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:37:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:37:02.479+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:02.871 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:37:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:37:02.479+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:02.872 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:37:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:37:02.479+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:02.872 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:37:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:37:02.479+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:02.872 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:37:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:37:02.479+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:02 smithi189 ceph-mon[35196]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:03.276 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:02 smithi100 ceph-mon[31390]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:03.307 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T02:37:03.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:02 smithi117 ceph-mon[34898]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1225949943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102570 msgr2=0x7f96e01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1225949943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102570 0x7f96e01029b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009900 tx=0x7f96c802a480 comp rx=0 tx=0).stop 2024-09-12T02:37:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1225949943 shutdown_connections 2024-09-12T02:37:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1225949943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96e0102ef0 0x7f96e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1225949943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102570 0x7f96e01029b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1225949943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96e0100e20 0x7f96e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1225949943 >> 172.21.15.100:0/1225949943 conn(0x7f96e00fc7d0 msgr2=0x7f96e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1225949943 shutdown_connections 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.018+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1225949943 wait complete. 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 Processor -- start 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 -- start start 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96e0100e20 0x7f96e01975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96e0102570 0x7f96e0197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102ef0 0x7f96e019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0111020 con 0x7f96e0102ef0 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0110ea0 con 0x7f96e0102570 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96e4f2b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96e01111a0 con 0x7f96e0100e20 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102ef0 0x7f96e019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102ef0 0x7f96e019be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48986/0 (socket says 172.21.15.100:48986) 2024-09-12T02:37:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 -- 172.21.15.100:0/1949875469 learned_addr learned my addr 172.21.15.100:0/1949875469 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ddd9b640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96e0102570 0x7f96e0197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96de59c640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96e0100e20 0x7f96e01975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 -- 172.21.15.100:0/1949875469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96e0100e20 msgr2=0x7f96e01975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96e0100e20 0x7f96e01975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 -- 172.21.15.100:0/1949875469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96e0102570 msgr2=0x7f96e0197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96e0102570 0x7f96e0197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.019+0000 7f96ded9d640 1 -- 172.21.15.100:0/1949875469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e019c550 con 0x7f96e0102ef0 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.020+0000 7f96ded9d640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102ef0 0x7f96e019be70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009fd0 tx=0x7f96d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.020+0000 7f96d77fe640 1 -- 172.21.15.100:0/1949875469 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011830 con 0x7f96e0102ef0 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.020+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e019c840 con 0x7f96e0102ef0 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.020+0000 7f96d77fe640 1 -- 172.21.15.100:0/1949875469 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96d0016070 con 0x7f96e0102ef0 2024-09-12T02:37:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.020+0000 7f96d77fe640 1 -- 172.21.15.100:0/1949875469 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d000f2e0 con 0x7f96e0102ef0 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.020+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e01a4120 con 0x7f96e0102ef0 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.021+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e0101280 con 0x7f96e0102ef0 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.022+0000 7f96d77fe640 1 -- 172.21.15.100:0/1949875469 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f96d00119d0 con 0x7f96e0102ef0 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.023+0000 7f96d77fe640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96cc0a2c10 0x7f96cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.023+0000 7f96de59c640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96cc0a2c10 0x7f96cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.023+0000 7f96d77fe640 1 -- 172.21.15.100:0/1949875469 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f96d00ce510 con 0x7f96e0102ef0 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.024+0000 7f96de59c640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96cc0a2c10 0x7f96cc0a50d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a400 tx=0x7f96d800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.027+0000 7f96d77fe640 1 -- 172.21.15.100:0/1949875469 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96d009b5d0 con 0x7f96e0102ef0 2024-09-12T02:37:04.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.219+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f96e0062630 con 0x7f96cc0a2c10 2024-09-12T02:37:04.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:03 smithi100 ceph-mon[31390]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:37:04.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.243+0000 7f96d77fe640 1 -- 172.21.15.100:0/1949875469 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f96e0062630 con 0x7f96cc0a2c10 2024-09-12T02:37:04.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96cc0a2c10 msgr2=0x7f96cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96cc0a2c10 0x7f96cc0a50d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a400 tx=0x7f96d800d040 comp rx=0 tx=0).stop 2024-09-12T02:37:04.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102ef0 msgr2=0x7f96e019be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102ef0 0x7f96e019be70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009fd0 tx=0x7f96d000b8e0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 shutdown_connections 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96cc0a2c10 0x7f96cc0a50d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e0102ef0 0x7f96e019be70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96e0102570 0x7f96e0197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 --2- 172.21.15.100:0/1949875469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96e0100e20 0x7f96e01975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 >> 172.21.15.100:0/1949875469 conn(0x7f96e00fc7d0 msgr2=0x7f96e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 shutdown_connections 2024-09-12T02:37:04.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:04.245+0000 7f96e4f2b640 1 -- 172.21.15.100:0/1949875469 wait complete. 2024-09-12T02:37:04.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:03 smithi189 ceph-mon[35196]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:37:04.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:03 smithi117 ceph-mon[34898]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:37:05.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T02:37:05.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:04 smithi189 ceph-mon[35196]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:37:05.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:04 smithi189 ceph-mon[35196]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:05.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:04 smithi117 ceph-mon[34898]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:37:05.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:04 smithi117 ceph-mon[34898]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:05.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:04 smithi100 ceph-mon[31390]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:37:05.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:04 smithi100 ceph-mon[31390]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:05.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 -- 172.21.15.100:0/95542506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4106a80 msgr2=0x7f85f4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 --2- 172.21.15.100:0/95542506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4106a80 0x7f85f4106e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009930 tx=0x7f85f002a420 comp rx=0 tx=0).stop 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 -- 172.21.15.100:0/95542506 shutdown_connections 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 --2- 172.21.15.100:0/95542506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85f4101420 0x7f85f410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 --2- 172.21.15.100:0/95542506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85f4100a80 0x7f85f4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 --2- 172.21.15.100:0/95542506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4106a80 0x7f85f4106e60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 -- 172.21.15.100:0/95542506 >> 172.21.15.100:0/95542506 conn(0x7f85f40fc7a0 msgr2=0x7f85f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 -- 172.21.15.100:0/95542506 shutdown_connections 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.765+0000 7f85fbee5640 1 -- 172.21.15.100:0/95542506 wait complete. 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 Processor -- start 2024-09-12T02:37:05.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 -- start start 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85f4100a80 0x7f85f41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4101420 0x7f85f4199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85f4106a80 0x7f85f41a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f85f4110e40 con 0x7f85f4101420 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f85f4110cc0 con 0x7f85f4100a80 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fbee5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85f4110fc0 con 0x7f85f4106a80 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85f9480640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4101420 0x7f85f4199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85f9480640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4101420 0x7f85f4199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42458/0 (socket says 172.21.15.100:42458) 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85f9480640 1 -- 172.21.15.100:0/539929548 learned_addr learned my addr 172.21.15.100:0/539929548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85fa482640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85f4106a80 0x7f85f41a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85f9c81640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85f4100a80 0x7f85f41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:05.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85f9480640 1 -- 172.21.15.100:0/539929548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85f4106a80 msgr2=0x7f85f41a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.766+0000 7f85f9480640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85f4106a80 0x7f85f41a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85f9480640 1 -- 172.21.15.100:0/539929548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85f4100a80 msgr2=0x7f85f41992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85f9480640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85f4100a80 0x7f85f41992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85f9480640 1 -- 172.21.15.100:0/539929548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f41a48b0 con 0x7f85f4101420 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85fa482640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85f4106a80 0x7f85f41a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85f9480640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4101420 0x7f85f4199830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c890 tx=0x7f85e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85eaffd640 1 -- 172.21.15.100:0/539929548 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4004220 con 0x7f85f4101420 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f41a4a80 con 0x7f85f4101420 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85eaffd640 1 -- 172.21.15.100:0/539929548 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85e40043c0 con 0x7f85f4101420 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f41a4fc0 con 0x7f85f4101420 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.767+0000 7f85eaffd640 1 -- 172.21.15.100:0/539929548 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e40049e0 con 0x7f85f4101420 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.768+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d8005290 con 0x7f85f4101420 2024-09-12T02:37:05.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.769+0000 7f85eaffd640 1 -- 172.21.15.100:0/539929548 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f85e40079b0 con 0x7f85f4101420 2024-09-12T02:37:05.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.770+0000 7f85eaffd640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85e00a2c90 0x7f85e00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:05.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.770+0000 7f85f9c81640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85e00a2c90 0x7f85e00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:05.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.770+0000 7f85eaffd640 1 -- 172.21.15.100:0/539929548 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f85e40cec20 con 0x7f85f4101420 2024-09-12T02:37:05.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.770+0000 7f85f9c81640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85e00a2c90 0x7f85e00a5150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85f0000c00 tx=0x7f85f0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:05.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.774+0000 7f85eaffd640 1 -- 172.21.15.100:0/539929548 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f85e4014030 con 0x7f85f4101420 2024-09-12T02:37:05.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.967+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f85d8000bc0 con 0x7f85e00a2c90 2024-09-12T02:37:05.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.971+0000 7f85eaffd640 1 -- 172.21.15.100:0/539929548 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f85d8000bc0 con 0x7f85e00a2c90 2024-09-12T02:37:05.972 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_0/56fadf61-0190-40f0-8062-d65290e3a1b7 2024-09-12T02:37:05.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85e00a2c90 msgr2=0x7f85e00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85e00a2c90 0x7f85e00a5150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85f0000c00 tx=0x7f85f0005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4101420 msgr2=0x7f85f4199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4101420 0x7f85f4199830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c890 tx=0x7f85e400cd50 comp rx=0 tx=0).stop 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 shutdown_connections 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85e00a2c90 0x7f85e00a5150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85f4106a80 0x7f85f41a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f4101420 0x7f85f4199830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 --2- 172.21.15.100:0/539929548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85f4100a80 0x7f85f41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 >> 172.21.15.100:0/539929548 conn(0x7f85f40fc7a0 msgr2=0x7f85f40fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 shutdown_connections 2024-09-12T02:37:05.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:05.973+0000 7f85fbee5640 1 -- 172.21.15.100:0/539929548 wait complete. 2024-09-12T02:37:06.232 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:05 smithi100 ceph-mon[31390]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-12T02:37:06.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:05 smithi117 ceph-mon[34898]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-12T02:37:06.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:05 smithi189 ceph-mon[35196]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-12T02:37:06.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T02:37:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:06 smithi100 ceph-mon[31390]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:06 smithi189 ceph-mon[35196]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:07.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:06 smithi117 ceph-mon[34898]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 -- 172.21.15.100:0/1736119912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4106a80 msgr2=0x7fdfc4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 --2- 172.21.15.100:0/1736119912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4106a80 0x7fdfc4106e60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009930 tx=0x7fdfb402a420 comp rx=0 tx=0).stop 2024-09-12T02:37:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 -- 172.21.15.100:0/1736119912 shutdown_connections 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 --2- 172.21.15.100:0/1736119912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc4101420 0x7fdfc410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 --2- 172.21.15.100:0/1736119912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc4100a80 0x7fdfc4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 --2- 172.21.15.100:0/1736119912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4106a80 0x7fdfc4106e60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 -- 172.21.15.100:0/1736119912 >> 172.21.15.100:0/1736119912 conn(0x7fdfc40fc7a0 msgr2=0x7fdfc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 -- 172.21.15.100:0/1736119912 shutdown_connections 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.491+0000 7fdfca448640 1 -- 172.21.15.100:0/1736119912 wait complete. 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 Processor -- start 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 -- start start 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4100a80 0x7fdfc4197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc4101420 0x7fdfc4197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc4106a80 0x7fdfc4197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110ea0 con 0x7fdfc4100a80 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110d20 con 0x7fdfc4106a80 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfca448640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4111020 con 0x7fdfc4101420 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4100a80 0x7fdfc4197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4100a80 0x7fdfc4197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42470/0 (socket says 172.21.15.100:42470) 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 -- 172.21.15.100:0/4074846419 learned_addr learned my addr 172.21.15.100:0/4074846419 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc37fe640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc4101420 0x7fdfc4197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc89e5640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc4106a80 0x7fdfc4197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 -- 172.21.15.100:0/4074846419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc4101420 msgr2=0x7fdfc4197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc4101420 0x7fdfc4197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 -- 172.21.15.100:0/4074846419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc4106a80 msgr2=0x7fdfc4197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc4106a80 0x7fdfc4197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.492+0000 7fdfc3fff640 1 -- 172.21.15.100:0/4074846419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc41a6970 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.493+0000 7fdfc3fff640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4100a80 0x7fdfc4197100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009230 tx=0x7fdfb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.493+0000 7fdfc17fa640 1 -- 172.21.15.100:0/4074846419 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb403f030 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.493+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc41a6c00 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.493+0000 7fdfc17fa640 1 -- 172.21.15.100:0/4074846419 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb4003ad0 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.493+0000 7fdfc17fa640 1 -- 172.21.15.100:0/4074846419 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4035070 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.493+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41a7130 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.494+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc4100ee0 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.495+0000 7fdfc17fa640 1 -- 172.21.15.100:0/4074846419 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fdfb4042030 con 0x7fdfc4100a80 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.495+0000 7fdfc17fa640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdfac0a2c10 0x7fdfac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.496+0000 7fdfc17fa640 1 -- 172.21.15.100:0/4074846419 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fdfb40ef820 con 0x7fdfc4100a80 2024-09-12T02:37:07.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.496+0000 7fdfc37fe640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdfac0a2c10 0x7fdfac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.496+0000 7fdfc37fe640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdfac0a2c10 0x7fdfac0a50d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4199260 tx=0x7fdfb800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:07.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.499+0000 7fdfc17fa640 1 -- 172.21.15.100:0/4074846419 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfb40bc180 con 0x7fdfc4100a80 2024-09-12T02:37:07.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.690+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdfc4062630 con 0x7fdfac0a2c10 2024-09-12T02:37:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.711+0000 7fdfc17fa640 1 -- 172.21.15.100:0/4074846419 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdfc4062630 con 0x7fdfac0a2c10 2024-09-12T02:37:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdfac0a2c10 msgr2=0x7fdfac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdfac0a2c10 0x7fdfac0a50d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4199260 tx=0x7fdfb800b390 comp rx=0 tx=0).stop 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4100a80 msgr2=0x7fdfc4197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4100a80 0x7fdfc4197100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009230 tx=0x7fdfb4004270 comp rx=0 tx=0).stop 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 shutdown_connections 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdfac0a2c10 0x7fdfac0a50d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc4106a80 0x7fdfc4197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfc4101420 0x7fdfc4197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 --2- 172.21.15.100:0/4074846419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4100a80 0x7fdfc4197100 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 >> 172.21.15.100:0/4074846419 conn(0x7fdfc40fc7a0 msgr2=0x7fdfc40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 shutdown_connections 2024-09-12T02:37:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:07.713+0000 7fdfca448640 1 -- 172.21.15.100:0/4074846419 wait complete. 2024-09-12T02:37:08.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:07 smithi189 ceph-mon[35196]: pgmap v288: 97 pgs: 97 active+clean; 607 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T02:37:08.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:07 smithi189 ceph-mon[35196]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:08.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:07 smithi117 ceph-mon[34898]: pgmap v288: 97 pgs: 97 active+clean; 607 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T02:37:08.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:07 smithi117 ceph-mon[34898]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:07 smithi100 ceph-mon[31390]: pgmap v288: 97 pgs: 97 active+clean; 607 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T02:37:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:07 smithi100 ceph-mon[31390]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:08.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T02:37:08.694 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 -- 172.21.15.100:0/669459835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04101de0 msgr2=0x7f7e041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 --2- 172.21.15.100:0/669459835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04101de0 0x7f7e041021c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009900 tx=0x7f7e0002a410 comp rx=0 tx=0).stop 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 -- 172.21.15.100:0/669459835 shutdown_connections 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 --2- 172.21.15.100:0/669459835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e04106f10 0x7f7e0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 --2- 172.21.15.100:0/669459835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e04102790 0x7f7e041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 --2- 172.21.15.100:0/669459835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04101de0 0x7f7e041021c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 -- 172.21.15.100:0/669459835 >> 172.21.15.100:0/669459835 conn(0x7f7e040fd8c0 msgr2=0x7f7e040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 -- 172.21.15.100:0/669459835 shutdown_connections 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 -- 172.21.15.100:0/669459835 wait complete. 2024-09-12T02:37:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.160+0000 7f7e0b891640 1 Processor -- start 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0b891640 1 -- start start 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0b891640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e04101de0 0x7f7e041985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0b891640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e04102790 0x7f7e04198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0b891640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04106f10 0x7f7e0419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0b891640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e04112010 con 0x7f7e04106f10 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0b891640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e04111e90 con 0x7f7e04101de0 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0b891640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e04112190 con 0x7f7e04102790 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04106f10 0x7f7e0419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04106f10 0x7f7e0419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42486/0 (socket says 172.21.15.100:42486) 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 -- 172.21.15.100:0/3303134891 learned_addr learned my addr 172.21.15.100:0/3303134891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e08e2c640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e04102790 0x7f7e04198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e0962d640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e04101de0 0x7f7e041985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 -- 172.21.15.100:0/3303134891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e04102790 msgr2=0x7f7e04198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e04102790 0x7f7e04198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 -- 172.21.15.100:0/3303134891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e04101de0 msgr2=0x7f7e041985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e04101de0 0x7f7e041985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 -- 172.21.15.100:0/3303134891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0419d560 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.161+0000 7f7e09e2e640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04106f10 0x7f7e0419ce80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00b970 tx=0x7f7dfc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.162+0000 7f7dfa7fc640 1 -- 172.21.15.100:0/3303134891 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc019070 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.162+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0419d850 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.162+0000 7f7dfa7fc640 1 -- 172.21.15.100:0/3303134891 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dfc014440 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.162+0000 7f7dfa7fc640 1 -- 172.21.15.100:0/3303134891 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0075d0 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.162+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e041a5130 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.163+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e04102240 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.164+0000 7f7dfa7fc640 1 -- 172.21.15.100:0/3303134891 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7dfc01c070 con 0x7f7e04106f10 2024-09-12T02:37:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.164+0000 7f7dfa7fc640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7df00a2c10 0x7f7df00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.164+0000 7f7e0962d640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7df00a2c10 0x7f7df00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.164+0000 7f7dfa7fc640 1 -- 172.21.15.100:0/3303134891 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7dfc0ce660 con 0x7f7e04106f10 2024-09-12T02:37:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.165+0000 7f7e0962d640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7df00a2c10 0x7f7df00a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e000096c0 tx=0x7f7e00031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.168+0000 7f7dfa7fc640 1 -- 172.21.15.100:0/3303134891 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7dfc09b620 con 0x7f7e04106f10 2024-09-12T02:37:09.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.361+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7e04062630 con 0x7f7df00a2c10 2024-09-12T02:37:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.365+0000 7f7dfa7fc640 1 -- 172.21.15.100:0/3303134891 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7e04062630 con 0x7f7df00a2c10 2024-09-12T02:37:09.366 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_1/9048c5c6-a64a-4258-a68c-278de7233f01 2024-09-12T02:37:09.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7df00a2c10 msgr2=0x7f7df00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7df00a2c10 0x7f7df00a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e000096c0 tx=0x7f7e00031490 comp rx=0 tx=0).stop 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04106f10 msgr2=0x7f7e0419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04106f10 0x7f7e0419ce80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00b970 tx=0x7f7dfc00bd70 comp rx=0 tx=0).stop 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 shutdown_connections 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7df00a2c10 0x7f7df00a50d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e04106f10 0x7f7e0419ce80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e04102790 0x7f7e04198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 --2- 172.21.15.100:0/3303134891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e04101de0 0x7f7e041985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.367+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 >> 172.21.15.100:0/3303134891 conn(0x7f7e040fd8c0 msgr2=0x7f7e040fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.368+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 shutdown_connections 2024-09-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:09.368+0000 7f7e0b891640 1 -- 172.21.15.100:0/3303134891 wait complete. 2024-09-12T02:37:10.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:10.250 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:10.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:10 smithi100 ceph-mon[31390]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:10.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:10 smithi100 ceph-mon[31390]: pgmap v289: 97 pgs: 97 active+clean; 607 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/1644048435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 msgr2=0x7fc6c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/1644048435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c41029b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009900 tx=0x7fc6c002a480 comp rx=0 tx=0).stop 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/1644048435 shutdown_connections 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/1644048435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6c4102ef0 0x7fc6c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/1644048435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c41029b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/1644048435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4100e20 0x7fc6c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/1644048435 >> 172.21.15.100:0/1644048435 conn(0x7fc6c40fc7d0 msgr2=0x7fc6c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/1644048435 shutdown_connections 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/1644048435 wait complete. 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 Processor -- start 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.752+0000 7fc6cbb3c640 1 -- start start 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6c4100e20 0x7fc6c4196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c4196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4102ef0 0x7fc6c419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c410ff20 con 0x7fc6c4102570 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c410fda0 con 0x7fc6c4100e20 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41100a0 con 0x7fc6c4102ef0 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c4196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c4196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42512/0 (socket says 172.21.15.100:42512) 2024-09-12T02:37:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 -- 172.21.15.100:0/3981307196 learned_addr learned my addr 172.21.15.100:0/3981307196 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6ca0d9640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4102ef0 0x7fc6c419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 -- 172.21.15.100:0/3981307196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4102ef0 msgr2=0x7fc6c419ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4102ef0 0x7fc6c419ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 -- 172.21.15.100:0/3981307196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6c4100e20 msgr2=0x7fc6c4196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c98d8640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6c4100e20 0x7fc6c4196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6c4100e20 0x7fc6c4196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 -- 172.21.15.100:0/3981307196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c419b3f0 con 0x7fc6c4102570 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6ca0d9640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4102ef0 0x7fc6c419ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c98d8640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6c4100e20 0x7fc6c4196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6c90d7640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c4196980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0006010 tx=0x7fc6c0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6b6ffd640 1 -- 172.21.15.100:0/3981307196 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c003f070 con 0x7fc6c4102570 2024-09-12T02:37:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c419b680 con 0x7fc6c4102570 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6b6ffd640 1 -- 172.21.15.100:0/3981307196 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c0031e30 con 0x7fc6c4102570 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6b6ffd640 1 -- 172.21.15.100:0/3981307196 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0035030 con 0x7fc6c4102570 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.753+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c41a2fc0 con 0x7fc6c4102570 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.754+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c4101280 con 0x7fc6c4102570 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.755+0000 7fc6b6ffd640 1 -- 172.21.15.100:0/3981307196 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc6c0042070 con 0x7fc6c4102570 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.756+0000 7fc6b6ffd640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc6b00a4e20 0x7fc6b00a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.756+0000 7fc6c98d8640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc6b00a4e20 0x7fc6b00a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.756+0000 7fc6b6ffd640 1 -- 172.21.15.100:0/3981307196 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc6c00efa20 con 0x7fc6c4102570 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.756+0000 7fc6c98d8640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc6b00a4e20 0x7fc6b00a72e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8006fd0 tx=0x7fc6b8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.760+0000 7fc6b6ffd640 1 -- 172.21.15.100:0/3981307196 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6c00bc9d0 con 0x7fc6c4102570 2024-09-12T02:37:10.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:10 smithi117 ceph-mon[34898]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:10.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:10 smithi117 ceph-mon[34898]: pgmap v289: 97 pgs: 97 active+clean; 607 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T02:37:10.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.960+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6c4109090 con 0x7fc6c4102570 2024-09-12T02:37:10.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.961+0000 7fc6b6ffd640 1 -- 172.21.15.100:0/3981307196 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fc6c00bc2d0 con 0x7fc6c4102570 2024-09-12T02:37:10.961 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:10.961 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:37:00:928817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:37:00.496863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:37:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc6b00a4e20 msgr2=0x7fc6b00a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc6b00a4e20 0x7fc6b00a72e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8006fd0 tx=0x7fc6b8008040 comp rx=0 tx=0).stop 2024-09-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 msgr2=0x7fc6c4196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c4196980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0006010 tx=0x7fc6c0003c80 comp rx=0 tx=0).stop 2024-09-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 shutdown_connections 2024-09-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc6b00a4e20 0x7fc6b00a72e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4102ef0 0x7fc6c419ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c4102570 0x7fc6c4196980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 --2- 172.21.15.100:0/3981307196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6c4100e20 0x7fc6c4196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 >> 172.21.15.100:0/3981307196 conn(0x7fc6c40fc7d0 msgr2=0x7fc6c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 shutdown_connections 2024-09-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:10.963+0000 7fc6cbb3c640 1 -- 172.21.15.100:0/3981307196 wait complete. 2024-09-12T02:37:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:10 smithi189 ceph-mon[35196]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:11.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:10 smithi189 ceph-mon[35196]: pgmap v289: 97 pgs: 97 active+clean; 607 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T02:37:11.671 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:37:11.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:11 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3981307196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:11.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:11 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3981307196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:11.916 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:11 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3981307196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:12.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 -- 172.21.15.100:0/842694681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c108290 msgr2=0x7f299c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:12.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 --2- 172.21.15.100:0/842694681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c108290 0x7f299c10ec30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2994009cd0 tx=0x7f299402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 -- 172.21.15.100:0/842694681 shutdown_connections 2024-09-12T02:37:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 --2- 172.21.15.100:0/842694681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c108290 0x7f299c10ec30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 --2- 172.21.15.100:0/842694681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c103740 0x7f299c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 --2- 172.21.15.100:0/842694681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c102d90 0x7f299c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 -- 172.21.15.100:0/842694681 >> 172.21.15.100:0/842694681 conn(0x7f299c0fc7d0 msgr2=0x7f299c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 -- 172.21.15.100:0/842694681 shutdown_connections 2024-09-12T02:37:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.385+0000 7f29a2e22640 1 -- 172.21.15.100:0/842694681 wait complete. 2024-09-12T02:37:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 Processor -- start 2024-09-12T02:37:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 -- start start 2024-09-12T02:37:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c102d90 0x7f299c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103740 0x7f299c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c108290 0x7f299c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f299c112090 con 0x7f299c102d90 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f299c111f10 con 0x7f299c108290 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a2e22640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f299c112210 con 0x7f299c103740 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c102d90 0x7f299c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c102d90 0x7f299c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42524/0 (socket says 172.21.15.100:42524) 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 -- 172.21.15.100:0/892094383 learned_addr learned my addr 172.21.15.100:0/892094383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a13bf640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c108290 0x7f299c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 -- 172.21.15.100:0/892094383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103740 msgr2=0x7f299c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103740 0x7f299c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 -- 172.21.15.100:0/892094383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c108290 msgr2=0x7f299c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c108290 0x7f299c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a0bbe640 1 -- 172.21.15.100:0/892094383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c19d500 con 0x7f299c102d90 2024-09-12T02:37:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.386+0000 7f29a13bf640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c108290 0x7f299c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:12.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.387+0000 7f29a0bbe640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c102d90 0x7f299c198550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f299000d950 tx=0x7f299000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:12.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.387+0000 7f2999ffb640 1 -- 172.21.15.100:0/892094383 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990017070 con 0x7f299c102d90 2024-09-12T02:37:12.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.387+0000 7f2999ffb640 1 -- 172.21.15.100:0/892094383 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2990009c30 con 0x7f299c102d90 2024-09-12T02:37:12.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.387+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c19d7f0 con 0x7f299c102d90 2024-09-12T02:37:12.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.387+0000 7f2999ffb640 1 -- 172.21.15.100:0/892094383 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299000f6b0 con 0x7f299c102d90 2024-09-12T02:37:12.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.387+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1a50d0 con 0x7f299c102d90 2024-09-12T02:37:12.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.388+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c103170 con 0x7f299c102d90 2024-09-12T02:37:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.389+0000 7f2999ffb640 1 -- 172.21.15.100:0/892094383 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f29900109d0 con 0x7f299c102d90 2024-09-12T02:37:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.389+0000 7f2999ffb640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f298c0a2c10 0x7f298c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.390+0000 7f299bfff640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f298c0a2c10 0x7f298c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.390+0000 7f2999ffb640 1 -- 172.21.15.100:0/892094383 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f29900ced60 con 0x7f299c102d90 2024-09-12T02:37:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.390+0000 7f299bfff640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f298c0a2c10 0x7f298c0a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2988005d80 tx=0x7f2988005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.394+0000 7f2999ffb640 1 -- 172.21.15.100:0/892094383 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2990009de0 con 0x7f299c102d90 2024-09-12T02:37:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.560+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f299c10a2a0 con 0x7f299c102d90 2024-09-12T02:37:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.561+0000 7f2999ffb640 1 -- 172.21.15.100:0/892094383 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22373 (secure 0 0 0) 0x7f299009bd10 con 0x7f299c102d90 2024-09-12T02:37:12.562 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:12.562 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:36:49.489990+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f298c0a2c10 msgr2=0x7f298c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f298c0a2c10 0x7f298c0a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2988005d80 tx=0x7f2988005c90 comp rx=0 tx=0).stop 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c102d90 msgr2=0x7f299c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c102d90 0x7f299c198550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f299000d950 tx=0x7f299000de10 comp rx=0 tx=0).stop 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 shutdown_connections 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f298c0a2c10 0x7f298c0a50d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c108290 0x7f299c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103740 0x7f299c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 --2- 172.21.15.100:0/892094383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c102d90 0x7f299c198550 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:12.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.564+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 >> 172.21.15.100:0/892094383 conn(0x7f299c0fc7d0 msgr2=0x7f299c105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:12.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.565+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 shutdown_connections 2024-09-12T02:37:12.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:12.565+0000 7f29a2e22640 1 -- 172.21.15.100:0/892094383 wait complete. 2024-09-12T02:37:12.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:12 smithi117 ceph-mon[34898]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 15 op/s 2024-09-12T02:37:12.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:12 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/892094383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:12 smithi100 ceph-mon[31390]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 15 op/s 2024-09-12T02:37:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:12 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/892094383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:12 smithi189 ceph-mon[35196]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 15 op/s 2024-09-12T02:37:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:12 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/892094383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:13.256 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:37:13.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:37:13.499 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 -- 172.21.15.100:0/2212313421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0101420 msgr2=0x7f8fb010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 --2- 172.21.15.100:0/2212313421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0101420 0x7f8fb010d950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009cd0 tx=0x7f8fa802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 -- 172.21.15.100:0/2212313421 shutdown_connections 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 --2- 172.21.15.100:0/2212313421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0101420 0x7f8fb010d950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 --2- 172.21.15.100:0/2212313421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb0100a80 0x7f8fb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 --2- 172.21.15.100:0/2212313421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0106a80 0x7f8fb0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 -- 172.21.15.100:0/2212313421 >> 172.21.15.100:0/2212313421 conn(0x7f8fb00fc7a0 msgr2=0x7f8fb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 -- 172.21.15.100:0/2212313421 shutdown_connections 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.940+0000 7f8fb722d640 1 -- 172.21.15.100:0/2212313421 wait complete. 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 Processor -- start 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 -- start start 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0100a80 0x7f8fb01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0101420 0x7f8fb0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb0106a80 0x7f8fb019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0112020 con 0x7f8fb0100a80 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0111ea0 con 0x7f8fb0106a80 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb722d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01121a0 con 0x7f8fb0101420 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb4fc9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0100a80 0x7f8fb01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb4fc9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0100a80 0x7f8fb01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42542/0 (socket says 172.21.15.100:42542) 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8fb4fc9640 1 -- 172.21.15.100:0/3779336167 learned_addr learned my addr 172.21.15.100:0/3779336167 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:13.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.941+0000 7f8faffff640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0101420 0x7f8fb0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb4fc9640 1 -- 172.21.15.100:0/3779336167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0101420 msgr2=0x7f8fb0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb4fc9640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0101420 0x7f8fb0198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb4fc9640 1 -- 172.21.15.100:0/3779336167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb0106a80 msgr2=0x7f8fb019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb4fc9640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb0106a80 0x7f8fb019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb4fc9640 1 -- 172.21.15.100:0/3779336167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb019d550 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb4fc9640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0100a80 0x7f8fb01985a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000b4a0 tx=0x7f8fa000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fadffb640 1 -- 172.21.15.100:0/3779336167 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0014070 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fadffb640 1 -- 172.21.15.100:0/3779336167 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fa0010af0 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fadffb640 1 -- 172.21.15.100:0/3779336167 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0017d10 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb019d840 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.942+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb01a5120 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.943+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb0100f60 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.944+0000 7f8fadffb640 1 -- 172.21.15.100:0/3779336167 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8fa0017070 con 0x7f8fb0100a80 2024-09-12T02:37:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.945+0000 7f8fadffb640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8f980a2c10 0x7f8f980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.945+0000 7f8faffff640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8f980a2c10 0x7f8f980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.945+0000 7f8fadffb640 1 -- 172.21.15.100:0/3779336167 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f8fa00ce400 con 0x7f8fb0100a80 2024-09-12T02:37:13.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.945+0000 7f8faffff640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8f980a2c10 0x7f8f980a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00fedf0 tx=0x7f8fa4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:13.949+0000 7f8fadffb640 1 -- 172.21.15.100:0/3779336167 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fa009b4c0 con 0x7f8fb0100a80 2024-09-12T02:37:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.113+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fb0062630 con 0x7f8f980a2c10 2024-09-12T02:37:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.120+0000 7f8fadffb640 1 -- 172.21.15.100:0/3779336167 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258861 (secure 0 0 0) 0x7f8fb0062630 con 0x7f8f980a2c10 2024-09-12T02:37:14.124 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:14.125 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:37:14.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8f980a2c10 msgr2=0x7f8f980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:14.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8f980a2c10 0x7f8f980a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00fedf0 tx=0x7f8fa4008040 comp rx=0 tx=0).stop 2024-09-12T02:37:14.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0100a80 msgr2=0x7f8fb01985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:14.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0100a80 0x7f8fb01985a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000b4a0 tx=0x7f8fa000b960 comp rx=0 tx=0).stop 2024-09-12T02:37:14.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 shutdown_connections 2024-09-12T02:37:14.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8f980a2c10 0x7f8f980a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb0106a80 0x7f8fb019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0101420 0x7f8fb0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 --2- 172.21.15.100:0/3779336167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0100a80 0x7f8fb01985a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.123+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 >> 172.21.15.100:0/3779336167 conn(0x7f8fb00fc7a0 msgr2=0x7f8fb00fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:14.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.124+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 shutdown_connections 2024-09-12T02:37:14.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:14.124+0000 7f8fb722d640 1 -- 172.21.15.100:0/3779336167 wait complete. 2024-09-12T02:37:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:14 smithi100 ceph-mon[31390]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-12T02:37:14.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:14 smithi117 ceph-mon[34898]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-12T02:37:14.849 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-12T02:37:13.528969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644717,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":335,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355948,"kb_used_data":10860,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585876,"statfs":{"total":1151940427776,"available":1151575937024,"internally_reserved":0,"allocated":11120640,"data_stored":7027096,"data_compressed":107292,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49127,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":86,"num_write":30,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003137"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865174+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:36:49.865174+0000","last_peered":"2024-09-12T02:36:49.865174+0000","last_clean":"2024-09-12T02:36:49.865174+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:36:49.865174+0000","last_undegraded":"2024-09-12T02:36:49.865174+0000","last_fullsized":"2024-09-12T02:36:49.865174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881410+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:36:49.881410+0000","last_peered":"2024-09-12T02:36:49.881410+0000","last_clean":"2024-09-12T02:36:49.881410+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:36:49.881410+0000","last_undegraded":"2024-09-12T02:36:49.881410+0000","last_fullsized":"2024-09-12T02:36:49.881410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881087+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:36:49.881087+0000","last_peered":"2024-09-12T02:36:49.881087+0000","last_clean":"2024-09-12T02:36:49.881087+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:36:49.881087+0000","last_undegraded":"2024-09-12T02:36:49.881087+0000","last_fullsized":"2024-09-12T02:36:49.881087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879169+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:36:49.879169+0000","last_peered":"2024-09-12T02:36:49.879169+0000","last_clean":"2024-09-12T02:36:49.879169+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:36:49.879169+0000","last_undegraded":"2024-09-12T02:36:49.879169+0000","last_fullsized":"2024-09-12T02:36:49.879169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877696+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:36:49.877696+0000","last_peered":"2024-09-12T02:36:49.877696+0000","last_clean":"2024-09-12T02:36:49.877696+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:36:49.877696+0000","last_undegraded":"2024-09-12T02:36:49.877696+0000","last_fullsized":"2024-09-12T02:36:49.877696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868052+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:36:49.868052+0000","last_peered":"2024-09-12T02:36:49.868052+0000","last_clean":"2024-09-12T02:36:49.868052+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:36:49.868052+0000","last_undegraded":"2024-09-12T02:36:49.868052+0000","last_fullsized":"2024-09-12T02:36:49.868052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881434+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:36:49.881434+0000","last_peered":"2024-09-12T02:36:49.881434+0000","last_clean":"2024-09-12T02:36:49.881434+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:36:49.881434+0000","last_undegraded":"2024-09-12T02:36:49.881434+0000","last_fullsized":"2024-09-12T02:36:49.881434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877638+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:36:49.877638+0000","last_peered":"2024-09-12T02:36:49.877638+0000","last_clean":"2024-09-12T02:36:49.877638+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:36:49.877638+0000","last_undegraded":"2024-09-12T02:36:49.877638+0000","last_fullsized":"2024-09-12T02:36:49.877638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879042+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:36:49.879042+0000","last_peered":"2024-09-12T02:36:49.879042+0000","last_clean":"2024-09-12T02:36:49.879042+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:36:49.879042+0000","last_undegraded":"2024-09-12T02:36:49.879042+0000","last_fullsized":"2024-09-12T02:36:49.879042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868407+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:36:49.868407+0000","last_peered":"2024-09-12T02:36:49.868407+0000","last_clean":"2024-09-12T02:36:49.868407+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:36:49.868407+0000","last_undegraded":"2024-09-12T02:36:49.868407+0000","last_fullsized":"2024-09-12T02:36:49.868407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881824+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:36:49.881824+0000","last_peered":"2024-09-12T02:36:49.881824+0000","last_clean":"2024-09-12T02:36:49.881824+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:36:49.881824+0000","last_undegraded":"2024-09-12T02:36:49.881824+0000","last_fullsized":"2024-09-12T02:36:49.881824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879320+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:36:49.879320+0000","last_peered":"2024-09-12T02:36:49.879320+0000","last_clean":"2024-09-12T02:36:49.879320+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:36:49.879320+0000","last_undegraded":"2024-09-12T02:36:49.879320+0000","last_fullsized":"2024-09-12T02:36:49.879320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864515+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:36:49.864515+0000","last_peered":"2024-09-12T02:36:49.864515+0000","last_clean":"2024-09-12T02:36:49.864515+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:36:49.864515+0000","last_undegraded":"2024-09-12T02:36:49.864515+0000","last_fullsized":"2024-09-12T02:36:49.864515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880520+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:36:49.880520+0000","last_peered":"2024-09-12T02:36:49.880520+0000","last_clean":"2024-09-12T02:36:49.880520+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:36:49.880520+0000","last_undegraded":"2024-09-12T02:36:49.880520+0000","last_fullsized":"2024-09-12T02:36:49.880520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880233+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:36:49.880233+0000","last_peered":"2024-09-12T02:36:49.880233+0000","last_clean":"2024-09-12T02:36:49.880233+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:36:49.880233+0000","last_undegraded":"2024-09-12T02:36:49.880233+0000","last_fullsized":"2024-09-12T02:36:49.880233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878501+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:36:49.878501+0000","last_peered":"2024-09-12T02:36:49.878501+0000","last_clean":"2024-09-12T02:36:49.878501+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:36:49.878501+0000","last_undegraded":"2024-09-12T02:36:49.878501+0000","last_fullsized":"2024-09-12T02:36:49.878501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865248+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:36:49.865248+0000","last_peered":"2024-09-12T02:36:49.865248+0000","last_clean":"2024-09-12T02:36:49.865248+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:36:49.865248+0000","last_undegraded":"2024-09-12T02:36:49.865248+0000","last_fullsized":"2024-09-12T02:36:49.865248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877874+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:36:49.877874+0000","last_peered":"2024-09-12T02:36:49.877874+0000","last_clean":"2024-09-12T02:36:49.877874+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:36:49.877874+0000","last_undegraded":"2024-09-12T02:36:49.877874+0000","last_fullsized":"2024-09-12T02:36:49.877874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878321+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:36:49.878321+0000","last_peered":"2024-09-12T02:36:49.878321+0000","last_clean":"2024-09-12T02:36:49.878321+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:36:49.878321+0000","last_undegraded":"2024-09-12T02:36:49.878321+0000","last_fullsized":"2024-09-12T02:36:49.878321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864901+0000","last_change":"2024-09-12T02:36:48.891229+0000","last_active":"2024-09-12T02:36:49.864901+0000","last_peered":"2024-09-12T02:36:49.864901+0000","last_clean":"2024-09-12T02:36:49.864901+0000","last_became_active":"2024-09-12T02:36:48.890485+0000","last_became_peered":"2024-09-12T02:36:48.890485+0000","last_unstale":"2024-09-12T02:36:49.864901+0000","last_undegraded":"2024-09-12T02:36:49.864901+0000","last_fullsized":"2024-09-12T02:36:49.864901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.290011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864576+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:36:49.864576+0000","last_peered":"2024-09-12T02:36:49.864576+0000","last_clean":"2024-09-12T02:36:49.864576+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:36:49.864576+0000","last_undegraded":"2024-09-12T02:36:49.864576+0000","last_fullsized":"2024-09-12T02:36:49.864576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878900+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:36:49.878900+0000","last_peered":"2024-09-12T02:36:49.878900+0000","last_clean":"2024-09-12T02:36:49.878900+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:36:49.878900+0000","last_undegraded":"2024-09-12T02:36:49.878900+0000","last_fullsized":"2024-09-12T02:36:49.878900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877749+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:36:49.877749+0000","last_peered":"2024-09-12T02:36:49.877749+0000","last_clean":"2024-09-12T02:36:49.877749+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:36:49.877749+0000","last_undegraded":"2024-09-12T02:36:49.877749+0000","last_fullsized":"2024-09-12T02:36:49.877749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879626+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:36:49.879626+0000","last_peered":"2024-09-12T02:36:49.879626+0000","last_clean":"2024-09-12T02:36:49.879626+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:36:49.879626+0000","last_undegraded":"2024-09-12T02:36:49.879626+0000","last_fullsized":"2024-09-12T02:36:49.879626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878296+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:36:49.878296+0000","last_peered":"2024-09-12T02:36:49.878296+0000","last_clean":"2024-09-12T02:36:49.878296+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:36:49.878296+0000","last_undegraded":"2024-09-12T02:36:49.878296+0000","last_fullsized":"2024-09-12T02:36:49.878296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878797+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:36:49.878797+0000","last_peered":"2024-09-12T02:36:49.878797+0000","last_clean":"2024-09-12T02:36:49.878797+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:36:49.878797+0000","last_undegraded":"2024-09-12T02:36:49.878797+0000","last_fullsized":"2024-09-12T02:36:49.878797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865110+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:36:49.865110+0000","last_peered":"2024-09-12T02:36:49.865110+0000","last_clean":"2024-09-12T02:36:49.865110+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:36:49.865110+0000","last_undegraded":"2024-09-12T02:36:49.865110+0000","last_fullsized":"2024-09-12T02:36:49.865110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864446+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:36:49.864446+0000","last_peered":"2024-09-12T02:36:49.864446+0000","last_clean":"2024-09-12T02:36:49.864446+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:36:49.864446+0000","last_undegraded":"2024-09-12T02:36:49.864446+0000","last_fullsized":"2024-09-12T02:36:49.864446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881494+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:36:49.881494+0000","last_peered":"2024-09-12T02:36:49.881494+0000","last_clean":"2024-09-12T02:36:49.881494+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:36:49.881494+0000","last_undegraded":"2024-09-12T02:36:49.881494+0000","last_fullsized":"2024-09-12T02:36:49.881494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878346+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:36:49.878346+0000","last_peered":"2024-09-12T02:36:49.878346+0000","last_clean":"2024-09-12T02:36:49.878346+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:36:49.878346+0000","last_undegraded":"2024-09-12T02:36:49.878346+0000","last_fullsized":"2024-09-12T02:36:49.878346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878957+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:36:49.878957+0000","last_peered":"2024-09-12T02:36:49.878957+0000","last_clean":"2024-09-12T02:36:49.878957+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:36:49.878957+0000","last_undegraded":"2024-09-12T02:36:49.878957+0000","last_fullsized":"2024-09-12T02:36:49.878957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864847+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:36:49.864847+0000","last_peered":"2024-09-12T02:36:49.864847+0000","last_clean":"2024-09-12T02:36:49.864847+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:36:49.864847+0000","last_undegraded":"2024-09-12T02:36:49.864847+0000","last_fullsized":"2024-09-12T02:36:49.864847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877481+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:36:49.877481+0000","last_peered":"2024-09-12T02:36:49.877481+0000","last_clean":"2024-09-12T02:36:49.877481+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:36:49.877481+0000","last_undegraded":"2024-09-12T02:36:49.877481+0000","last_fullsized":"2024-09-12T02:36:49.877481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:06.946839+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:37:06.946839+0000","last_peered":"2024-09-12T02:37:06.946839+0000","last_clean":"2024-09-12T02:37:06.946839+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:37:06.946839+0000","last_undegraded":"2024-09-12T02:37:06.946839+0000","last_fullsized":"2024-09-12T02:37:06.946839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878173+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:36:49.878173+0000","last_peered":"2024-09-12T02:36:49.878173+0000","last_clean":"2024-09-12T02:36:49.878173+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:36:49.878173+0000","last_undegraded":"2024-09-12T02:36:49.878173+0000","last_fullsized":"2024-09-12T02:36:49.878173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930375+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:36:57.930375+0000","last_peered":"2024-09-12T02:36:57.930375+0000","last_clean":"2024-09-12T02:36:57.930375+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:36:57.930375+0000","last_undegraded":"2024-09-12T02:36:57.930375+0000","last_fullsized":"2024-09-12T02:36:57.930375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931131+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:36:57.931131+0000","last_peered":"2024-09-12T02:36:57.931131+0000","last_clean":"2024-09-12T02:36:57.931131+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:36:57.931131+0000","last_undegraded":"2024-09-12T02:36:57.931131+0000","last_fullsized":"2024-09-12T02:36:57.931131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877682+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:36:49.877682+0000","last_peered":"2024-09-12T02:36:49.877682+0000","last_clean":"2024-09-12T02:36:49.877682+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:36:49.877682+0000","last_undegraded":"2024-09-12T02:36:49.877682+0000","last_fullsized":"2024-09-12T02:36:49.877682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880116+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:36:49.880116+0000","last_peered":"2024-09-12T02:36:49.880116+0000","last_clean":"2024-09-12T02:36:49.880116+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:36:49.880116+0000","last_undegraded":"2024-09-12T02:36:49.880116+0000","last_fullsized":"2024-09-12T02:36:49.880116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877370+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:36:49.877370+0000","last_peered":"2024-09-12T02:36:49.877370+0000","last_clean":"2024-09-12T02:36:49.877370+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:36:49.877370+0000","last_undegraded":"2024-09-12T02:36:49.877370+0000","last_fullsized":"2024-09-12T02:36:49.877370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:09.951149+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:37:09.951149+0000","last_peered":"2024-09-12T02:37:09.951149+0000","last_clean":"2024-09-12T02:37:09.951149+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:37:09.951149+0000","last_undegraded":"2024-09-12T02:37:09.951149+0000","last_fullsized":"2024-09-12T02:37:09.951149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879865+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:36:49.879865+0000","last_peered":"2024-09-12T02:36:49.879865+0000","last_clean":"2024-09-12T02:36:49.879865+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:36:49.879865+0000","last_undegraded":"2024-09-12T02:36:49.879865+0000","last_fullsized":"2024-09-12T02:36:49.879865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917915+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:36:56.917915+0000","last_peered":"2024-09-12T02:36:56.917915+0000","last_clean":"2024-09-12T02:36:56.917915+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:36:56.917915+0000","last_undegraded":"2024-09-12T02:36:56.917915+0000","last_fullsized":"2024-09-12T02:36:56.917915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880988+0000","last_change":"2024-09-12T02:36:48.887036+0000","last_active":"2024-09-12T02:36:49.880988+0000","last_peered":"2024-09-12T02:36:49.880988+0000","last_clean":"2024-09-12T02:36:49.880988+0000","last_became_active":"2024-09-12T02:36:48.886718+0000","last_became_peered":"2024-09-12T02:36:48.886718+0000","last_unstale":"2024-09-12T02:36:49.880988+0000","last_undegraded":"2024-09-12T02:36:49.880988+0000","last_fullsized":"2024-09-12T02:36:49.880988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.170078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915509+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:36:56.915509+0000","last_peered":"2024-09-12T02:36:56.915509+0000","last_clean":"2024-09-12T02:36:56.915509+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:36:56.915509+0000","last_undegraded":"2024-09-12T02:36:56.915509+0000","last_fullsized":"2024-09-12T02:36:56.915509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879557+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:36:49.879557+0000","last_peered":"2024-09-12T02:36:49.879557+0000","last_clean":"2024-09-12T02:36:49.879557+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:36:49.879557+0000","last_undegraded":"2024-09-12T02:36:49.879557+0000","last_fullsized":"2024-09-12T02:36:49.879557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":75,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:10.953647+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:37:10.953647+0000","last_peered":"2024-09-12T02:37:10.953647+0000","last_clean":"2024-09-12T02:37:10.953647+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:37:10.953647+0000","last_undegraded":"2024-09-12T02:37:10.953647+0000","last_fullsized":"2024-09-12T02:37:10.953647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":64,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879225+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:36:49.879225+0000","last_peered":"2024-09-12T02:36:49.879225+0000","last_clean":"2024-09-12T02:36:49.879225+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:36:49.879225+0000","last_undegraded":"2024-09-12T02:36:49.879225+0000","last_fullsized":"2024-09-12T02:36:49.879225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931831+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:36:57.931831+0000","last_peered":"2024-09-12T02:36:57.931831+0000","last_clean":"2024-09-12T02:36:57.931831+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:36:57.931831+0000","last_undegraded":"2024-09-12T02:36:57.931831+0000","last_fullsized":"2024-09-12T02:36:57.931831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864187+0000","last_change":"2024-09-12T02:36:48.875478+0000","last_active":"2024-09-12T02:36:49.864187+0000","last_peered":"2024-09-12T02:36:49.864187+0000","last_clean":"2024-09-12T02:36:49.864187+0000","last_became_active":"2024-09-12T02:36:48.875194+0000","last_became_peered":"2024-09-12T02:36:48.875194+0000","last_unstale":"2024-09-12T02:36:49.864187+0000","last_undegraded":"2024-09-12T02:36:49.864187+0000","last_fullsized":"2024-09-12T02:36:49.864187+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:34.718334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918205+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:36:56.918205+0000","last_peered":"2024-09-12T02:36:56.918205+0000","last_clean":"2024-09-12T02:36:56.918205+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:36:56.918205+0000","last_undegraded":"2024-09-12T02:36:56.918205+0000","last_fullsized":"2024-09-12T02:36:56.918205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882325+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:36:49.882325+0000","last_peered":"2024-09-12T02:36:49.882325+0000","last_clean":"2024-09-12T02:36:49.882325+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:36:49.882325+0000","last_undegraded":"2024-09-12T02:36:49.882325+0000","last_fullsized":"2024-09-12T02:36:49.882325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:07.948669+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:37:07.948669+0000","last_peered":"2024-09-12T02:37:07.948669+0000","last_clean":"2024-09-12T02:37:07.948669+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:37:07.948669+0000","last_undegraded":"2024-09-12T02:37:07.948669+0000","last_fullsized":"2024-09-12T02:37:07.948669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881297+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:36:49.881297+0000","last_peered":"2024-09-12T02:36:49.881297+0000","last_clean":"2024-09-12T02:36:49.881297+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:36:49.881297+0000","last_undegraded":"2024-09-12T02:36:49.881297+0000","last_fullsized":"2024-09-12T02:36:49.881297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932773+0000","last_change":"2024-09-12T02:36:47.033201+0000","last_active":"2024-09-12T02:36:57.932773+0000","last_peered":"2024-09-12T02:36:57.932773+0000","last_clean":"2024-09-12T02:36:57.932773+0000","last_became_active":"2024-09-12T02:36:47.032847+0000","last_became_peered":"2024-09-12T02:36:47.032847+0000","last_unstale":"2024-09-12T02:36:57.932773+0000","last_undegraded":"2024-09-12T02:36:57.932773+0000","last_fullsized":"2024-09-12T02:36:57.932773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:26.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878860+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:36:49.878860+0000","last_peered":"2024-09-12T02:36:49.878860+0000","last_clean":"2024-09-12T02:36:49.878860+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:36:49.878860+0000","last_undegraded":"2024-09-12T02:36:49.878860+0000","last_fullsized":"2024-09-12T02:36:49.878860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.927108+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:36:58.927108+0000","last_peered":"2024-09-12T02:36:58.927108+0000","last_clean":"2024-09-12T02:36:58.927108+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:36:58.927108+0000","last_undegraded":"2024-09-12T02:36:58.927108+0000","last_fullsized":"2024-09-12T02:36:58.927108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864974+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:36:49.864974+0000","last_peered":"2024-09-12T02:36:49.864974+0000","last_clean":"2024-09-12T02:36:49.864974+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:36:49.864974+0000","last_undegraded":"2024-09-12T02:36:49.864974+0000","last_fullsized":"2024-09-12T02:36:49.864974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881527+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:49.881527+0000","last_peered":"2024-09-12T02:36:49.881527+0000","last_clean":"2024-09-12T02:36:49.881527+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:36:49.881527+0000","last_undegraded":"2024-09-12T02:36:49.881527+0000","last_fullsized":"2024-09-12T02:36:49.881527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882083+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:36:49.882083+0000","last_peered":"2024-09-12T02:36:49.882083+0000","last_clean":"2024-09-12T02:36:49.882083+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:36:49.882083+0000","last_undegraded":"2024-09-12T02:36:49.882083+0000","last_fullsized":"2024-09-12T02:36:49.882083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884596+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:36:49.884596+0000","last_peered":"2024-09-12T02:36:49.884596+0000","last_clean":"2024-09-12T02:36:49.884596+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:36:49.884596+0000","last_undegraded":"2024-09-12T02:36:49.884596+0000","last_fullsized":"2024-09-12T02:36:49.884596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672067+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:36:50.672067+0000","last_peered":"2024-09-12T02:36:50.672067+0000","last_clean":"2024-09-12T02:36:50.672067+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:36:50.672067+0000","last_undegraded":"2024-09-12T02:36:50.672067+0000","last_fullsized":"2024-09-12T02:36:50.672067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932449+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:36:57.932449+0000","last_peered":"2024-09-12T02:36:57.932449+0000","last_clean":"2024-09-12T02:36:57.932449+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:36:57.932449+0000","last_undegraded":"2024-09-12T02:36:57.932449+0000","last_fullsized":"2024-09-12T02:36:57.932449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881995+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:36:49.881995+0000","last_peered":"2024-09-12T02:36:49.881995+0000","last_clean":"2024-09-12T02:36:49.881995+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:36:49.881995+0000","last_undegraded":"2024-09-12T02:36:49.881995+0000","last_fullsized":"2024-09-12T02:36:49.881995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881617+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:36:49.881617+0000","last_peered":"2024-09-12T02:36:49.881617+0000","last_clean":"2024-09-12T02:36:49.881617+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:36:49.881617+0000","last_undegraded":"2024-09-12T02:36:49.881617+0000","last_fullsized":"2024-09-12T02:36:49.881617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.932283+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:36:58.932283+0000","last_peered":"2024-09-12T02:36:58.932283+0000","last_clean":"2024-09-12T02:36:58.932283+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:36:58.932283+0000","last_undegraded":"2024-09-12T02:36:58.932283+0000","last_fullsized":"2024-09-12T02:36:58.932283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878502+0000","last_change":"2024-09-12T02:36:48.881273+0000","last_active":"2024-09-12T02:36:49.878502+0000","last_peered":"2024-09-12T02:36:49.878502+0000","last_clean":"2024-09-12T02:36:49.878502+0000","last_became_active":"2024-09-12T02:36:48.880951+0000","last_became_peered":"2024-09-12T02:36:48.880951+0000","last_unstale":"2024-09-12T02:36:49.878502+0000","last_undegraded":"2024-09-12T02:36:49.878502+0000","last_fullsized":"2024-09-12T02:36:49.878502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:10.615849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930831+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:57.930831+0000","last_peered":"2024-09-12T02:36:57.930831+0000","last_clean":"2024-09-12T02:36:57.930831+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:36:57.930831+0000","last_undegraded":"2024-09-12T02:36:57.930831+0000","last_fullsized":"2024-09-12T02:36:57.930831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864151+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:36:49.864151+0000","last_peered":"2024-09-12T02:36:49.864151+0000","last_clean":"2024-09-12T02:36:49.864151+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:36:49.864151+0000","last_undegraded":"2024-09-12T02:36:49.864151+0000","last_fullsized":"2024-09-12T02:36:49.864151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:08.949455+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:08.949455+0000","last_peered":"2024-09-12T02:37:08.949455+0000","last_clean":"2024-09-12T02:37:08.949455+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:37:08.949455+0000","last_undegraded":"2024-09-12T02:37:08.949455+0000","last_fullsized":"2024-09-12T02:37:08.949455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879794+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:36:49.879794+0000","last_peered":"2024-09-12T02:36:49.879794+0000","last_clean":"2024-09-12T02:36:49.879794+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:36:49.879794+0000","last_undegraded":"2024-09-12T02:36:49.879794+0000","last_fullsized":"2024-09-12T02:36:49.879794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672038+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:36:50.672038+0000","last_peered":"2024-09-12T02:36:50.672038+0000","last_clean":"2024-09-12T02:36:50.672038+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:36:50.672038+0000","last_undegraded":"2024-09-12T02:36:50.672038+0000","last_fullsized":"2024-09-12T02:36:50.672038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868181+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:36:49.868181+0000","last_peered":"2024-09-12T02:36:49.868181+0000","last_clean":"2024-09-12T02:36:49.868181+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:36:49.868181+0000","last_undegraded":"2024-09-12T02:36:49.868181+0000","last_fullsized":"2024-09-12T02:36:49.868181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877604+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:36:49.877604+0000","last_peered":"2024-09-12T02:36:49.877604+0000","last_clean":"2024-09-12T02:36:49.877604+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:36:49.877604+0000","last_undegraded":"2024-09-12T02:36:49.877604+0000","last_fullsized":"2024-09-12T02:36:49.877604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:51.250272+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:36:51.250272+0000","last_peered":"2024-09-12T02:36:51.250272+0000","last_clean":"2024-09-12T02:36:51.250272+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:36:51.250272+0000","last_undegraded":"2024-09-12T02:36:51.250272+0000","last_fullsized":"2024-09-12T02:36:51.250272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917448+0000","last_change":"2024-09-12T02:36:47.033330+0000","last_active":"2024-09-12T02:36:56.917448+0000","last_peered":"2024-09-12T02:36:56.917448+0000","last_clean":"2024-09-12T02:36:56.917448+0000","last_became_active":"2024-09-12T02:36:47.032823+0000","last_became_peered":"2024-09-12T02:36:47.032823+0000","last_unstale":"2024-09-12T02:36:56.917448+0000","last_undegraded":"2024-09-12T02:36:56.917448+0000","last_fullsized":"2024-09-12T02:36:56.917448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:51.819661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864458+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:36:49.864458+0000","last_peered":"2024-09-12T02:36:49.864458+0000","last_clean":"2024-09-12T02:36:49.864458+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:36:49.864458+0000","last_undegraded":"2024-09-12T02:36:49.864458+0000","last_fullsized":"2024-09-12T02:36:49.864458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:07.877531+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:37:07.877531+0000","last_peered":"2024-09-12T02:37:07.877531+0000","last_clean":"2024-09-12T02:37:07.877531+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:37:07.877531+0000","last_undegraded":"2024-09-12T02:37:07.877531+0000","last_fullsized":"2024-09-12T02:37:07.877531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878434+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:36:49.878434+0000","last_peered":"2024-09-12T02:36:49.878434+0000","last_clean":"2024-09-12T02:36:49.878434+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:36:49.878434+0000","last_undegraded":"2024-09-12T02:36:49.878434+0000","last_fullsized":"2024-09-12T02:36:49.878434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917383+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:36:56.917383+0000","last_peered":"2024-09-12T02:36:56.917383+0000","last_clean":"2024-09-12T02:36:56.917383+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:36:56.917383+0000","last_undegraded":"2024-09-12T02:36:56.917383+0000","last_fullsized":"2024-09-12T02:36:56.917383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881577+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:36:49.881577+0000","last_peered":"2024-09-12T02:36:49.881577+0000","last_clean":"2024-09-12T02:36:49.881577+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:36:49.881577+0000","last_undegraded":"2024-09-12T02:36:49.881577+0000","last_fullsized":"2024-09-12T02:36:49.881577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918503+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:36:56.918503+0000","last_peered":"2024-09-12T02:36:56.918503+0000","last_clean":"2024-09-12T02:36:56.918503+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:36:56.918503+0000","last_undegraded":"2024-09-12T02:36:56.918503+0000","last_fullsized":"2024-09-12T02:36:56.918503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877329+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:36:49.877329+0000","last_peered":"2024-09-12T02:36:49.877329+0000","last_clean":"2024-09-12T02:36:49.877329+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:36:49.877329+0000","last_undegraded":"2024-09-12T02:36:49.877329+0000","last_fullsized":"2024-09-12T02:36:49.877329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915862+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:36:56.915862+0000","last_peered":"2024-09-12T02:36:56.915862+0000","last_clean":"2024-09-12T02:36:56.915862+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:36:56.915862+0000","last_undegraded":"2024-09-12T02:36:56.915862+0000","last_fullsized":"2024-09-12T02:36:56.915862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865126+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:36:49.865126+0000","last_peered":"2024-09-12T02:36:49.865126+0000","last_clean":"2024-09-12T02:36:49.865126+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:36:49.865126+0000","last_undegraded":"2024-09-12T02:36:49.865126+0000","last_fullsized":"2024-09-12T02:36:49.865126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878004+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:36:49.878004+0000","last_peered":"2024-09-12T02:36:49.878004+0000","last_clean":"2024-09-12T02:36:49.878004+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:36:49.878004+0000","last_undegraded":"2024-09-12T02:36:49.878004+0000","last_fullsized":"2024-09-12T02:36:49.878004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878241+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:36:49.878241+0000","last_peered":"2024-09-12T02:36:49.878241+0000","last_clean":"2024-09-12T02:36:49.878241+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:36:49.878241+0000","last_undegraded":"2024-09-12T02:36:49.878241+0000","last_fullsized":"2024-09-12T02:36:49.878241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918490+0000","last_change":"2024-09-12T02:36:46.857937+0000","last_active":"2024-09-12T02:36:56.918490+0000","last_peered":"2024-09-12T02:36:56.918490+0000","last_clean":"2024-09-12T02:36:56.918490+0000","last_became_active":"2024-09-12T02:36:46.857616+0000","last_became_peered":"2024-09-12T02:36:46.857616+0000","last_unstale":"2024-09-12T02:36:56.918490+0000","last_undegraded":"2024-09-12T02:36:56.918490+0000","last_fullsized":"2024-09-12T02:36:56.918490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:06.893572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881571+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:36:49.881571+0000","last_peered":"2024-09-12T02:36:49.881571+0000","last_clean":"2024-09-12T02:36:49.881571+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:36:49.881571+0000","last_undegraded":"2024-09-12T02:36:49.881571+0000","last_fullsized":"2024-09-12T02:36:49.881571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878450+0000","last_change":"2024-09-12T02:36:48.891312+0000","last_active":"2024-09-12T02:36:49.878450+0000","last_peered":"2024-09-12T02:36:49.878450+0000","last_clean":"2024-09-12T02:36:49.878450+0000","last_became_active":"2024-09-12T02:36:48.890939+0000","last_became_peered":"2024-09-12T02:36:48.890939+0000","last_unstale":"2024-09-12T02:36:49.878450+0000","last_undegraded":"2024-09-12T02:36:49.878450+0000","last_fullsized":"2024-09-12T02:36:49.878450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:55.556561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884755+0000","last_change":"2024-09-12T02:36:46.857550+0000","last_active":"2024-09-12T02:36:49.884755+0000","last_peered":"2024-09-12T02:36:49.884755+0000","last_clean":"2024-09-12T02:36:49.884755+0000","last_became_active":"2024-09-12T02:36:46.857138+0000","last_became_peered":"2024-09-12T02:36:46.857138+0000","last_unstale":"2024-09-12T02:36:49.884755+0000","last_undegraded":"2024-09-12T02:36:49.884755+0000","last_fullsized":"2024-09-12T02:36:49.884755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:44.496822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879255+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:36:49.879255+0000","last_peered":"2024-09-12T02:36:49.879255+0000","last_clean":"2024-09-12T02:36:49.879255+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:36:49.879255+0000","last_undegraded":"2024-09-12T02:36:49.879255+0000","last_fullsized":"2024-09-12T02:36:49.879255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931656+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:36:57.931656+0000","last_peered":"2024-09-12T02:36:57.931656+0000","last_clean":"2024-09-12T02:36:57.931656+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:36:57.931656+0000","last_undegraded":"2024-09-12T02:36:57.931656+0000","last_fullsized":"2024-09-12T02:36:57.931656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880904+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:36:49.880904+0000","last_peered":"2024-09-12T02:36:49.880904+0000","last_clean":"2024-09-12T02:36:49.880904+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:36:49.880904+0000","last_undegraded":"2024-09-12T02:36:49.880904+0000","last_fullsized":"2024-09-12T02:36:49.880904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881702+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:36:49.881702+0000","last_peered":"2024-09-12T02:36:49.881702+0000","last_clean":"2024-09-12T02:36:49.881702+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:36:49.881702+0000","last_undegraded":"2024-09-12T02:36:49.881702+0000","last_fullsized":"2024-09-12T02:36:49.881702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878266+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:36:49.878266+0000","last_peered":"2024-09-12T02:36:49.878266+0000","last_clean":"2024-09-12T02:36:49.878266+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:36:49.878266+0000","last_undegraded":"2024-09-12T02:36:49.878266+0000","last_fullsized":"2024-09-12T02:36:49.878266+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931839+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:36:57.931839+0000","last_peered":"2024-09-12T02:36:57.931839+0000","last_clean":"2024-09-12T02:36:57.931839+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:36:57.931839+0000","last_undegraded":"2024-09-12T02:36:57.931839+0000","last_fullsized":"2024-09-12T02:36:57.931839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54115,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":97,"num_read_kb":108,"num_write":152,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":153298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1067341,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":425984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":425904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1017836,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":425373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1017520,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":425684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":466231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":426644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:37:14.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:37:14.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:14 smithi189 ceph-mon[35196]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-12T02:37:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 -- 172.21.15.100:0/3851373214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 msgr2=0x7f2d1c10eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 --2- 172.21.15.100:0/3851373214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c10eab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009ca0 tx=0x7f2d1402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 -- 172.21.15.100:0/3851373214 shutdown_connections 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 --2- 172.21.15.100:0/3851373214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c10eab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 --2- 172.21.15.100:0/3851373214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c100cc0 0x7f2d1c106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 --2- 172.21.15.100:0/3851373214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d1c100310 0x7f2d1c1006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 -- 172.21.15.100:0/3851373214 >> 172.21.15.100:0/3851373214 conn(0x7f2d1c077210 msgr2=0x7f2d1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 -- 172.21.15.100:0/3851373214 shutdown_connections 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.535+0000 7f2d23661640 1 -- 172.21.15.100:0/3851373214 wait complete. 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 Processor -- start 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 -- start start 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d1c100310 0x7f2d1c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c100cc0 0x7f2d1c1017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c111fb0 con 0x7f2d1c106f30 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c111e30 con 0x7f2d1c100cc0 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d23661640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c112130 con 0x7f2d1c100310 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d21bfe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d21bfe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c101d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43478/0 (socket says 172.21.15.100:43478) 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.536+0000 7f2d21bfe640 1 -- 172.21.15.100:0/2652935515 learned_addr learned my addr 172.21.15.100:0/2652935515 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d20bfc640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c100cc0 0x7f2d1c1017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d213fd640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d1c100310 0x7f2d1c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d21bfe640 1 -- 172.21.15.100:0/2652935515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d1c100310 msgr2=0x7f2d1c101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d21bfe640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d1c100310 0x7f2d1c101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d21bfe640 1 -- 172.21.15.100:0/2652935515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c100cc0 msgr2=0x7f2d1c1017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d21bfe640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c100cc0 0x7f2d1c1017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d21bfe640 1 -- 172.21.15.100:0/2652935515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c1a68a0 con 0x7f2d1c106f30 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d213fd640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d1c100310 0x7f2d1c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d21bfe640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c101d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d14031a60 tx=0x7f2d14031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d127fc640 1 -- 172.21.15.100:0/2652935515 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14003b70 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c1a6b30 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d127fc640 1 -- 172.21.15.100:0/2652935515 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d14003d10 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d127fc640 1 -- 172.21.15.100:0/2652935515 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14004770 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.537+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c1a70c0 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.538+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1c1006f0 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.539+0000 7f2d127fc640 1 -- 172.21.15.100:0/2652935515 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2d1402f790 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.540+0000 7f2d127fc640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2d080a2c10 0x7f2d080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.540+0000 7f2d213fd640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2d080a2c10 0x7f2d080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.540+0000 7f2d127fc640 1 -- 172.21.15.100:0/2652935515 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f2d140f0550 con 0x7f2d1c106f30 2024-09-12T02:37:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.540+0000 7f2d213fd640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2d080a2c10 0x7f2d080a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009930 tx=0x7f2d18008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:15.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.544+0000 7f2d127fc640 1 -- 172.21.15.100:0/2652935515 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d140bd590 con 0x7f2d1c106f30 2024-09-12T02:37:15.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.710+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d1c062630 con 0x7f2d080a2c10 2024-09-12T02:37:15.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.716+0000 7f2d127fc640 1 -- 172.21.15.100:0/2652935515 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258862 (secure 0 0 0) 0x7f2d1c062630 con 0x7f2d080a2c10 2024-09-12T02:37:15.719 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:15.720 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2d080a2c10 msgr2=0x7f2d080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2d080a2c10 0x7f2d080a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009930 tx=0x7f2d18008040 comp rx=0 tx=0).stop 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 msgr2=0x7f2d1c101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c101d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d14031a60 tx=0x7f2d14031a90 comp rx=0 tx=0).stop 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 shutdown_connections 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2d080a2c10 0x7f2d080a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1c106f30 0x7f2d1c101d10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c100cc0 0x7f2d1c1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.719+0000 7f2d23661640 1 --2- 172.21.15.100:0/2652935515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d1c100310 0x7f2d1c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.720+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 >> 172.21.15.100:0/2652935515 conn(0x7f2d1c077210 msgr2=0x7f2d1c1056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.720+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 shutdown_connections 2024-09-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:15.720+0000 7f2d23661640 1 -- 172.21.15.100:0/2652935515 wait complete. 2024-09-12T02:37:15.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:15 smithi189 ceph-mon[35196]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:15.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:15 smithi100 ceph-mon[31390]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:16.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:15 smithi117 ceph-mon[34898]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:16.489 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-12T02:37:15.529463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644717,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":233,"num_read_kb":217,"num_write":335,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355960,"kb_used_data":10872,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585864,"statfs":{"total":1151940427776,"available":1151575924736,"internally_reserved":0,"allocated":11132928,"data_stored":7036143,"data_compressed":107292,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49127,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":84,"num_write":29,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003081"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865174+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:36:49.865174+0000","last_peered":"2024-09-12T02:36:49.865174+0000","last_clean":"2024-09-12T02:36:49.865174+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:36:49.865174+0000","last_undegraded":"2024-09-12T02:36:49.865174+0000","last_fullsized":"2024-09-12T02:36:49.865174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881410+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:36:49.881410+0000","last_peered":"2024-09-12T02:36:49.881410+0000","last_clean":"2024-09-12T02:36:49.881410+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:36:49.881410+0000","last_undegraded":"2024-09-12T02:36:49.881410+0000","last_fullsized":"2024-09-12T02:36:49.881410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881087+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:36:49.881087+0000","last_peered":"2024-09-12T02:36:49.881087+0000","last_clean":"2024-09-12T02:36:49.881087+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:36:49.881087+0000","last_undegraded":"2024-09-12T02:36:49.881087+0000","last_fullsized":"2024-09-12T02:36:49.881087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879169+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:36:49.879169+0000","last_peered":"2024-09-12T02:36:49.879169+0000","last_clean":"2024-09-12T02:36:49.879169+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:36:49.879169+0000","last_undegraded":"2024-09-12T02:36:49.879169+0000","last_fullsized":"2024-09-12T02:36:49.879169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877696+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:36:49.877696+0000","last_peered":"2024-09-12T02:36:49.877696+0000","last_clean":"2024-09-12T02:36:49.877696+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:36:49.877696+0000","last_undegraded":"2024-09-12T02:36:49.877696+0000","last_fullsized":"2024-09-12T02:36:49.877696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868052+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:36:49.868052+0000","last_peered":"2024-09-12T02:36:49.868052+0000","last_clean":"2024-09-12T02:36:49.868052+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:36:49.868052+0000","last_undegraded":"2024-09-12T02:36:49.868052+0000","last_fullsized":"2024-09-12T02:36:49.868052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881434+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:36:49.881434+0000","last_peered":"2024-09-12T02:36:49.881434+0000","last_clean":"2024-09-12T02:36:49.881434+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:36:49.881434+0000","last_undegraded":"2024-09-12T02:36:49.881434+0000","last_fullsized":"2024-09-12T02:36:49.881434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877638+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:36:49.877638+0000","last_peered":"2024-09-12T02:36:49.877638+0000","last_clean":"2024-09-12T02:36:49.877638+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:36:49.877638+0000","last_undegraded":"2024-09-12T02:36:49.877638+0000","last_fullsized":"2024-09-12T02:36:49.877638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879042+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:36:49.879042+0000","last_peered":"2024-09-12T02:36:49.879042+0000","last_clean":"2024-09-12T02:36:49.879042+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:36:49.879042+0000","last_undegraded":"2024-09-12T02:36:49.879042+0000","last_fullsized":"2024-09-12T02:36:49.879042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868407+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:36:49.868407+0000","last_peered":"2024-09-12T02:36:49.868407+0000","last_clean":"2024-09-12T02:36:49.868407+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:36:49.868407+0000","last_undegraded":"2024-09-12T02:36:49.868407+0000","last_fullsized":"2024-09-12T02:36:49.868407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881824+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:36:49.881824+0000","last_peered":"2024-09-12T02:36:49.881824+0000","last_clean":"2024-09-12T02:36:49.881824+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:36:49.881824+0000","last_undegraded":"2024-09-12T02:36:49.881824+0000","last_fullsized":"2024-09-12T02:36:49.881824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879320+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:36:49.879320+0000","last_peered":"2024-09-12T02:36:49.879320+0000","last_clean":"2024-09-12T02:36:49.879320+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:36:49.879320+0000","last_undegraded":"2024-09-12T02:36:49.879320+0000","last_fullsized":"2024-09-12T02:36:49.879320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864515+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:36:49.864515+0000","last_peered":"2024-09-12T02:36:49.864515+0000","last_clean":"2024-09-12T02:36:49.864515+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:36:49.864515+0000","last_undegraded":"2024-09-12T02:36:49.864515+0000","last_fullsized":"2024-09-12T02:36:49.864515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880520+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:36:49.880520+0000","last_peered":"2024-09-12T02:36:49.880520+0000","last_clean":"2024-09-12T02:36:49.880520+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:36:49.880520+0000","last_undegraded":"2024-09-12T02:36:49.880520+0000","last_fullsized":"2024-09-12T02:36:49.880520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880233+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:36:49.880233+0000","last_peered":"2024-09-12T02:36:49.880233+0000","last_clean":"2024-09-12T02:36:49.880233+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:36:49.880233+0000","last_undegraded":"2024-09-12T02:36:49.880233+0000","last_fullsized":"2024-09-12T02:36:49.880233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878501+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:36:49.878501+0000","last_peered":"2024-09-12T02:36:49.878501+0000","last_clean":"2024-09-12T02:36:49.878501+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:36:49.878501+0000","last_undegraded":"2024-09-12T02:36:49.878501+0000","last_fullsized":"2024-09-12T02:36:49.878501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865248+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:36:49.865248+0000","last_peered":"2024-09-12T02:36:49.865248+0000","last_clean":"2024-09-12T02:36:49.865248+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:36:49.865248+0000","last_undegraded":"2024-09-12T02:36:49.865248+0000","last_fullsized":"2024-09-12T02:36:49.865248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877874+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:36:49.877874+0000","last_peered":"2024-09-12T02:36:49.877874+0000","last_clean":"2024-09-12T02:36:49.877874+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:36:49.877874+0000","last_undegraded":"2024-09-12T02:36:49.877874+0000","last_fullsized":"2024-09-12T02:36:49.877874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878321+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:36:49.878321+0000","last_peered":"2024-09-12T02:36:49.878321+0000","last_clean":"2024-09-12T02:36:49.878321+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:36:49.878321+0000","last_undegraded":"2024-09-12T02:36:49.878321+0000","last_fullsized":"2024-09-12T02:36:49.878321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864901+0000","last_change":"2024-09-12T02:36:48.891229+0000","last_active":"2024-09-12T02:36:49.864901+0000","last_peered":"2024-09-12T02:36:49.864901+0000","last_clean":"2024-09-12T02:36:49.864901+0000","last_became_active":"2024-09-12T02:36:48.890485+0000","last_became_peered":"2024-09-12T02:36:48.890485+0000","last_unstale":"2024-09-12T02:36:49.864901+0000","last_undegraded":"2024-09-12T02:36:49.864901+0000","last_fullsized":"2024-09-12T02:36:49.864901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.290011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864576+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:36:49.864576+0000","last_peered":"2024-09-12T02:36:49.864576+0000","last_clean":"2024-09-12T02:36:49.864576+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:36:49.864576+0000","last_undegraded":"2024-09-12T02:36:49.864576+0000","last_fullsized":"2024-09-12T02:36:49.864576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878900+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:36:49.878900+0000","last_peered":"2024-09-12T02:36:49.878900+0000","last_clean":"2024-09-12T02:36:49.878900+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:36:49.878900+0000","last_undegraded":"2024-09-12T02:36:49.878900+0000","last_fullsized":"2024-09-12T02:36:49.878900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877749+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:36:49.877749+0000","last_peered":"2024-09-12T02:36:49.877749+0000","last_clean":"2024-09-12T02:36:49.877749+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:36:49.877749+0000","last_undegraded":"2024-09-12T02:36:49.877749+0000","last_fullsized":"2024-09-12T02:36:49.877749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879626+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:36:49.879626+0000","last_peered":"2024-09-12T02:36:49.879626+0000","last_clean":"2024-09-12T02:36:49.879626+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:36:49.879626+0000","last_undegraded":"2024-09-12T02:36:49.879626+0000","last_fullsized":"2024-09-12T02:36:49.879626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878296+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:36:49.878296+0000","last_peered":"2024-09-12T02:36:49.878296+0000","last_clean":"2024-09-12T02:36:49.878296+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:36:49.878296+0000","last_undegraded":"2024-09-12T02:36:49.878296+0000","last_fullsized":"2024-09-12T02:36:49.878296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878797+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:36:49.878797+0000","last_peered":"2024-09-12T02:36:49.878797+0000","last_clean":"2024-09-12T02:36:49.878797+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:36:49.878797+0000","last_undegraded":"2024-09-12T02:36:49.878797+0000","last_fullsized":"2024-09-12T02:36:49.878797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865110+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:36:49.865110+0000","last_peered":"2024-09-12T02:36:49.865110+0000","last_clean":"2024-09-12T02:36:49.865110+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:36:49.865110+0000","last_undegraded":"2024-09-12T02:36:49.865110+0000","last_fullsized":"2024-09-12T02:36:49.865110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864446+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:36:49.864446+0000","last_peered":"2024-09-12T02:36:49.864446+0000","last_clean":"2024-09-12T02:36:49.864446+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:36:49.864446+0000","last_undegraded":"2024-09-12T02:36:49.864446+0000","last_fullsized":"2024-09-12T02:36:49.864446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881494+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:36:49.881494+0000","last_peered":"2024-09-12T02:36:49.881494+0000","last_clean":"2024-09-12T02:36:49.881494+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:36:49.881494+0000","last_undegraded":"2024-09-12T02:36:49.881494+0000","last_fullsized":"2024-09-12T02:36:49.881494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878346+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:36:49.878346+0000","last_peered":"2024-09-12T02:36:49.878346+0000","last_clean":"2024-09-12T02:36:49.878346+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:36:49.878346+0000","last_undegraded":"2024-09-12T02:36:49.878346+0000","last_fullsized":"2024-09-12T02:36:49.878346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878957+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:36:49.878957+0000","last_peered":"2024-09-12T02:36:49.878957+0000","last_clean":"2024-09-12T02:36:49.878957+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:36:49.878957+0000","last_undegraded":"2024-09-12T02:36:49.878957+0000","last_fullsized":"2024-09-12T02:36:49.878957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864847+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:36:49.864847+0000","last_peered":"2024-09-12T02:36:49.864847+0000","last_clean":"2024-09-12T02:36:49.864847+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:36:49.864847+0000","last_undegraded":"2024-09-12T02:36:49.864847+0000","last_fullsized":"2024-09-12T02:36:49.864847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877481+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:36:49.877481+0000","last_peered":"2024-09-12T02:36:49.877481+0000","last_clean":"2024-09-12T02:36:49.877481+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:36:49.877481+0000","last_undegraded":"2024-09-12T02:36:49.877481+0000","last_fullsized":"2024-09-12T02:36:49.877481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:11.955131+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:37:11.955131+0000","last_peered":"2024-09-12T02:37:11.955131+0000","last_clean":"2024-09-12T02:37:11.955131+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:37:11.955131+0000","last_undegraded":"2024-09-12T02:37:11.955131+0000","last_fullsized":"2024-09-12T02:37:11.955131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878173+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:36:49.878173+0000","last_peered":"2024-09-12T02:36:49.878173+0000","last_clean":"2024-09-12T02:36:49.878173+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:36:49.878173+0000","last_undegraded":"2024-09-12T02:36:49.878173+0000","last_fullsized":"2024-09-12T02:36:49.878173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930375+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:36:57.930375+0000","last_peered":"2024-09-12T02:36:57.930375+0000","last_clean":"2024-09-12T02:36:57.930375+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:36:57.930375+0000","last_undegraded":"2024-09-12T02:36:57.930375+0000","last_fullsized":"2024-09-12T02:36:57.930375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931131+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:36:57.931131+0000","last_peered":"2024-09-12T02:36:57.931131+0000","last_clean":"2024-09-12T02:36:57.931131+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:36:57.931131+0000","last_undegraded":"2024-09-12T02:36:57.931131+0000","last_fullsized":"2024-09-12T02:36:57.931131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877682+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:36:49.877682+0000","last_peered":"2024-09-12T02:36:49.877682+0000","last_clean":"2024-09-12T02:36:49.877682+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:36:49.877682+0000","last_undegraded":"2024-09-12T02:36:49.877682+0000","last_fullsized":"2024-09-12T02:36:49.877682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880116+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:36:49.880116+0000","last_peered":"2024-09-12T02:36:49.880116+0000","last_clean":"2024-09-12T02:36:49.880116+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:36:49.880116+0000","last_undegraded":"2024-09-12T02:36:49.880116+0000","last_fullsized":"2024-09-12T02:36:49.880116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877370+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:36:49.877370+0000","last_peered":"2024-09-12T02:36:49.877370+0000","last_clean":"2024-09-12T02:36:49.877370+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:36:49.877370+0000","last_undegraded":"2024-09-12T02:36:49.877370+0000","last_fullsized":"2024-09-12T02:36:49.877370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:09.951149+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:37:09.951149+0000","last_peered":"2024-09-12T02:37:09.951149+0000","last_clean":"2024-09-12T02:37:09.951149+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:37:09.951149+0000","last_undegraded":"2024-09-12T02:37:09.951149+0000","last_fullsized":"2024-09-12T02:37:09.951149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879865+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:36:49.879865+0000","last_peered":"2024-09-12T02:36:49.879865+0000","last_clean":"2024-09-12T02:36:49.879865+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:36:49.879865+0000","last_undegraded":"2024-09-12T02:36:49.879865+0000","last_fullsized":"2024-09-12T02:36:49.879865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917915+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:36:56.917915+0000","last_peered":"2024-09-12T02:36:56.917915+0000","last_clean":"2024-09-12T02:36:56.917915+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:36:56.917915+0000","last_undegraded":"2024-09-12T02:36:56.917915+0000","last_fullsized":"2024-09-12T02:36:56.917915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880988+0000","last_change":"2024-09-12T02:36:48.887036+0000","last_active":"2024-09-12T02:36:49.880988+0000","last_peered":"2024-09-12T02:36:49.880988+0000","last_clean":"2024-09-12T02:36:49.880988+0000","last_became_active":"2024-09-12T02:36:48.886718+0000","last_became_peered":"2024-09-12T02:36:48.886718+0000","last_unstale":"2024-09-12T02:36:49.880988+0000","last_undegraded":"2024-09-12T02:36:49.880988+0000","last_fullsized":"2024-09-12T02:36:49.880988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.170078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915509+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:36:56.915509+0000","last_peered":"2024-09-12T02:36:56.915509+0000","last_clean":"2024-09-12T02:36:56.915509+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:36:56.915509+0000","last_undegraded":"2024-09-12T02:36:56.915509+0000","last_fullsized":"2024-09-12T02:36:56.915509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879557+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:36:49.879557+0000","last_peered":"2024-09-12T02:36:49.879557+0000","last_clean":"2024-09-12T02:36:49.879557+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:36:49.879557+0000","last_undegraded":"2024-09-12T02:36:49.879557+0000","last_fullsized":"2024-09-12T02:36:49.879557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":75,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:10.953647+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:37:10.953647+0000","last_peered":"2024-09-12T02:37:10.953647+0000","last_clean":"2024-09-12T02:37:10.953647+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:37:10.953647+0000","last_undegraded":"2024-09-12T02:37:10.953647+0000","last_fullsized":"2024-09-12T02:37:10.953647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":64,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879225+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:36:49.879225+0000","last_peered":"2024-09-12T02:36:49.879225+0000","last_clean":"2024-09-12T02:36:49.879225+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:36:49.879225+0000","last_undegraded":"2024-09-12T02:36:49.879225+0000","last_fullsized":"2024-09-12T02:36:49.879225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931831+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:36:57.931831+0000","last_peered":"2024-09-12T02:36:57.931831+0000","last_clean":"2024-09-12T02:36:57.931831+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:36:57.931831+0000","last_undegraded":"2024-09-12T02:36:57.931831+0000","last_fullsized":"2024-09-12T02:36:57.931831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864187+0000","last_change":"2024-09-12T02:36:48.875478+0000","last_active":"2024-09-12T02:36:49.864187+0000","last_peered":"2024-09-12T02:36:49.864187+0000","last_clean":"2024-09-12T02:36:49.864187+0000","last_became_active":"2024-09-12T02:36:48.875194+0000","last_became_peered":"2024-09-12T02:36:48.875194+0000","last_unstale":"2024-09-12T02:36:49.864187+0000","last_undegraded":"2024-09-12T02:36:49.864187+0000","last_fullsized":"2024-09-12T02:36:49.864187+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:34.718334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918205+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:36:56.918205+0000","last_peered":"2024-09-12T02:36:56.918205+0000","last_clean":"2024-09-12T02:36:56.918205+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:36:56.918205+0000","last_undegraded":"2024-09-12T02:36:56.918205+0000","last_fullsized":"2024-09-12T02:36:56.918205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882325+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:36:49.882325+0000","last_peered":"2024-09-12T02:36:49.882325+0000","last_clean":"2024-09-12T02:36:49.882325+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:36:49.882325+0000","last_undegraded":"2024-09-12T02:36:49.882325+0000","last_fullsized":"2024-09-12T02:36:49.882325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:12.955629+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:37:12.955629+0000","last_peered":"2024-09-12T02:37:12.955629+0000","last_clean":"2024-09-12T02:37:12.955629+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:37:12.955629+0000","last_undegraded":"2024-09-12T02:37:12.955629+0000","last_fullsized":"2024-09-12T02:37:12.955629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881297+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:36:49.881297+0000","last_peered":"2024-09-12T02:36:49.881297+0000","last_clean":"2024-09-12T02:36:49.881297+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:36:49.881297+0000","last_undegraded":"2024-09-12T02:36:49.881297+0000","last_fullsized":"2024-09-12T02:36:49.881297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932773+0000","last_change":"2024-09-12T02:36:47.033201+0000","last_active":"2024-09-12T02:36:57.932773+0000","last_peered":"2024-09-12T02:36:57.932773+0000","last_clean":"2024-09-12T02:36:57.932773+0000","last_became_active":"2024-09-12T02:36:47.032847+0000","last_became_peered":"2024-09-12T02:36:47.032847+0000","last_unstale":"2024-09-12T02:36:57.932773+0000","last_undegraded":"2024-09-12T02:36:57.932773+0000","last_fullsized":"2024-09-12T02:36:57.932773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:26.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878860+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:36:49.878860+0000","last_peered":"2024-09-12T02:36:49.878860+0000","last_clean":"2024-09-12T02:36:49.878860+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:36:49.878860+0000","last_undegraded":"2024-09-12T02:36:49.878860+0000","last_fullsized":"2024-09-12T02:36:49.878860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.927108+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:36:58.927108+0000","last_peered":"2024-09-12T02:36:58.927108+0000","last_clean":"2024-09-12T02:36:58.927108+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:36:58.927108+0000","last_undegraded":"2024-09-12T02:36:58.927108+0000","last_fullsized":"2024-09-12T02:36:58.927108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864974+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:36:49.864974+0000","last_peered":"2024-09-12T02:36:49.864974+0000","last_clean":"2024-09-12T02:36:49.864974+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:36:49.864974+0000","last_undegraded":"2024-09-12T02:36:49.864974+0000","last_fullsized":"2024-09-12T02:36:49.864974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881527+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:49.881527+0000","last_peered":"2024-09-12T02:36:49.881527+0000","last_clean":"2024-09-12T02:36:49.881527+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:36:49.881527+0000","last_undegraded":"2024-09-12T02:36:49.881527+0000","last_fullsized":"2024-09-12T02:36:49.881527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882083+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:36:49.882083+0000","last_peered":"2024-09-12T02:36:49.882083+0000","last_clean":"2024-09-12T02:36:49.882083+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:36:49.882083+0000","last_undegraded":"2024-09-12T02:36:49.882083+0000","last_fullsized":"2024-09-12T02:36:49.882083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884596+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:36:49.884596+0000","last_peered":"2024-09-12T02:36:49.884596+0000","last_clean":"2024-09-12T02:36:49.884596+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:36:49.884596+0000","last_undegraded":"2024-09-12T02:36:49.884596+0000","last_fullsized":"2024-09-12T02:36:49.884596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672067+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:36:50.672067+0000","last_peered":"2024-09-12T02:36:50.672067+0000","last_clean":"2024-09-12T02:36:50.672067+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:36:50.672067+0000","last_undegraded":"2024-09-12T02:36:50.672067+0000","last_fullsized":"2024-09-12T02:36:50.672067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932449+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:36:57.932449+0000","last_peered":"2024-09-12T02:36:57.932449+0000","last_clean":"2024-09-12T02:36:57.932449+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:36:57.932449+0000","last_undegraded":"2024-09-12T02:36:57.932449+0000","last_fullsized":"2024-09-12T02:36:57.932449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881995+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:36:49.881995+0000","last_peered":"2024-09-12T02:36:49.881995+0000","last_clean":"2024-09-12T02:36:49.881995+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:36:49.881995+0000","last_undegraded":"2024-09-12T02:36:49.881995+0000","last_fullsized":"2024-09-12T02:36:49.881995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881617+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:36:49.881617+0000","last_peered":"2024-09-12T02:36:49.881617+0000","last_clean":"2024-09-12T02:36:49.881617+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:36:49.881617+0000","last_undegraded":"2024-09-12T02:36:49.881617+0000","last_fullsized":"2024-09-12T02:36:49.881617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.932283+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:36:58.932283+0000","last_peered":"2024-09-12T02:36:58.932283+0000","last_clean":"2024-09-12T02:36:58.932283+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:36:58.932283+0000","last_undegraded":"2024-09-12T02:36:58.932283+0000","last_fullsized":"2024-09-12T02:36:58.932283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878502+0000","last_change":"2024-09-12T02:36:48.881273+0000","last_active":"2024-09-12T02:36:49.878502+0000","last_peered":"2024-09-12T02:36:49.878502+0000","last_clean":"2024-09-12T02:36:49.878502+0000","last_became_active":"2024-09-12T02:36:48.880951+0000","last_became_peered":"2024-09-12T02:36:48.880951+0000","last_unstale":"2024-09-12T02:36:49.878502+0000","last_undegraded":"2024-09-12T02:36:49.878502+0000","last_fullsized":"2024-09-12T02:36:49.878502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:10.615849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930831+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:57.930831+0000","last_peered":"2024-09-12T02:36:57.930831+0000","last_clean":"2024-09-12T02:36:57.930831+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:36:57.930831+0000","last_undegraded":"2024-09-12T02:36:57.930831+0000","last_fullsized":"2024-09-12T02:36:57.930831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864151+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:36:49.864151+0000","last_peered":"2024-09-12T02:36:49.864151+0000","last_clean":"2024-09-12T02:36:49.864151+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:36:49.864151+0000","last_undegraded":"2024-09-12T02:36:49.864151+0000","last_fullsized":"2024-09-12T02:36:49.864151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:08.949455+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:08.949455+0000","last_peered":"2024-09-12T02:37:08.949455+0000","last_clean":"2024-09-12T02:37:08.949455+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:37:08.949455+0000","last_undegraded":"2024-09-12T02:37:08.949455+0000","last_fullsized":"2024-09-12T02:37:08.949455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879794+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:36:49.879794+0000","last_peered":"2024-09-12T02:36:49.879794+0000","last_clean":"2024-09-12T02:36:49.879794+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:36:49.879794+0000","last_undegraded":"2024-09-12T02:36:49.879794+0000","last_fullsized":"2024-09-12T02:36:49.879794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672038+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:36:50.672038+0000","last_peered":"2024-09-12T02:36:50.672038+0000","last_clean":"2024-09-12T02:36:50.672038+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:36:50.672038+0000","last_undegraded":"2024-09-12T02:36:50.672038+0000","last_fullsized":"2024-09-12T02:36:50.672038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868181+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:36:49.868181+0000","last_peered":"2024-09-12T02:36:49.868181+0000","last_clean":"2024-09-12T02:36:49.868181+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:36:49.868181+0000","last_undegraded":"2024-09-12T02:36:49.868181+0000","last_fullsized":"2024-09-12T02:36:49.868181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877604+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:36:49.877604+0000","last_peered":"2024-09-12T02:36:49.877604+0000","last_clean":"2024-09-12T02:36:49.877604+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:36:49.877604+0000","last_undegraded":"2024-09-12T02:36:49.877604+0000","last_fullsized":"2024-09-12T02:36:49.877604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:51.250272+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:36:51.250272+0000","last_peered":"2024-09-12T02:36:51.250272+0000","last_clean":"2024-09-12T02:36:51.250272+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:36:51.250272+0000","last_undegraded":"2024-09-12T02:36:51.250272+0000","last_fullsized":"2024-09-12T02:36:51.250272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917448+0000","last_change":"2024-09-12T02:36:47.033330+0000","last_active":"2024-09-12T02:36:56.917448+0000","last_peered":"2024-09-12T02:36:56.917448+0000","last_clean":"2024-09-12T02:36:56.917448+0000","last_became_active":"2024-09-12T02:36:47.032823+0000","last_became_peered":"2024-09-12T02:36:47.032823+0000","last_unstale":"2024-09-12T02:36:56.917448+0000","last_undegraded":"2024-09-12T02:36:56.917448+0000","last_fullsized":"2024-09-12T02:36:56.917448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:51.819661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864458+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:36:49.864458+0000","last_peered":"2024-09-12T02:36:49.864458+0000","last_clean":"2024-09-12T02:36:49.864458+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:36:49.864458+0000","last_undegraded":"2024-09-12T02:36:49.864458+0000","last_fullsized":"2024-09-12T02:36:49.864458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:07.877531+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:37:07.877531+0000","last_peered":"2024-09-12T02:37:07.877531+0000","last_clean":"2024-09-12T02:37:07.877531+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:37:07.877531+0000","last_undegraded":"2024-09-12T02:37:07.877531+0000","last_fullsized":"2024-09-12T02:37:07.877531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878434+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:36:49.878434+0000","last_peered":"2024-09-12T02:36:49.878434+0000","last_clean":"2024-09-12T02:36:49.878434+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:36:49.878434+0000","last_undegraded":"2024-09-12T02:36:49.878434+0000","last_fullsized":"2024-09-12T02:36:49.878434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917383+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:36:56.917383+0000","last_peered":"2024-09-12T02:36:56.917383+0000","last_clean":"2024-09-12T02:36:56.917383+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:36:56.917383+0000","last_undegraded":"2024-09-12T02:36:56.917383+0000","last_fullsized":"2024-09-12T02:36:56.917383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881577+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:36:49.881577+0000","last_peered":"2024-09-12T02:36:49.881577+0000","last_clean":"2024-09-12T02:36:49.881577+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:36:49.881577+0000","last_undegraded":"2024-09-12T02:36:49.881577+0000","last_fullsized":"2024-09-12T02:36:49.881577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918503+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:36:56.918503+0000","last_peered":"2024-09-12T02:36:56.918503+0000","last_clean":"2024-09-12T02:36:56.918503+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:36:56.918503+0000","last_undegraded":"2024-09-12T02:36:56.918503+0000","last_fullsized":"2024-09-12T02:36:56.918503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877329+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:36:49.877329+0000","last_peered":"2024-09-12T02:36:49.877329+0000","last_clean":"2024-09-12T02:36:49.877329+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:36:49.877329+0000","last_undegraded":"2024-09-12T02:36:49.877329+0000","last_fullsized":"2024-09-12T02:36:49.877329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915862+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:36:56.915862+0000","last_peered":"2024-09-12T02:36:56.915862+0000","last_clean":"2024-09-12T02:36:56.915862+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:36:56.915862+0000","last_undegraded":"2024-09-12T02:36:56.915862+0000","last_fullsized":"2024-09-12T02:36:56.915862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865126+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:36:49.865126+0000","last_peered":"2024-09-12T02:36:49.865126+0000","last_clean":"2024-09-12T02:36:49.865126+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:36:49.865126+0000","last_undegraded":"2024-09-12T02:36:49.865126+0000","last_fullsized":"2024-09-12T02:36:49.865126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878004+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:36:49.878004+0000","last_peered":"2024-09-12T02:36:49.878004+0000","last_clean":"2024-09-12T02:36:49.878004+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:36:49.878004+0000","last_undegraded":"2024-09-12T02:36:49.878004+0000","last_fullsized":"2024-09-12T02:36:49.878004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878241+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:36:49.878241+0000","last_peered":"2024-09-12T02:36:49.878241+0000","last_clean":"2024-09-12T02:36:49.878241+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:36:49.878241+0000","last_undegraded":"2024-09-12T02:36:49.878241+0000","last_fullsized":"2024-09-12T02:36:49.878241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918490+0000","last_change":"2024-09-12T02:36:46.857937+0000","last_active":"2024-09-12T02:36:56.918490+0000","last_peered":"2024-09-12T02:36:56.918490+0000","last_clean":"2024-09-12T02:36:56.918490+0000","last_became_active":"2024-09-12T02:36:46.857616+0000","last_became_peered":"2024-09-12T02:36:46.857616+0000","last_unstale":"2024-09-12T02:36:56.918490+0000","last_undegraded":"2024-09-12T02:36:56.918490+0000","last_fullsized":"2024-09-12T02:36:56.918490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:06.893572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881571+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:36:49.881571+0000","last_peered":"2024-09-12T02:36:49.881571+0000","last_clean":"2024-09-12T02:36:49.881571+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:36:49.881571+0000","last_undegraded":"2024-09-12T02:36:49.881571+0000","last_fullsized":"2024-09-12T02:36:49.881571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878450+0000","last_change":"2024-09-12T02:36:48.891312+0000","last_active":"2024-09-12T02:36:49.878450+0000","last_peered":"2024-09-12T02:36:49.878450+0000","last_clean":"2024-09-12T02:36:49.878450+0000","last_became_active":"2024-09-12T02:36:48.890939+0000","last_became_peered":"2024-09-12T02:36:48.890939+0000","last_unstale":"2024-09-12T02:36:49.878450+0000","last_undegraded":"2024-09-12T02:36:49.878450+0000","last_fullsized":"2024-09-12T02:36:49.878450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:55.556561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884755+0000","last_change":"2024-09-12T02:36:46.857550+0000","last_active":"2024-09-12T02:36:49.884755+0000","last_peered":"2024-09-12T02:36:49.884755+0000","last_clean":"2024-09-12T02:36:49.884755+0000","last_became_active":"2024-09-12T02:36:46.857138+0000","last_became_peered":"2024-09-12T02:36:46.857138+0000","last_unstale":"2024-09-12T02:36:49.884755+0000","last_undegraded":"2024-09-12T02:36:49.884755+0000","last_fullsized":"2024-09-12T02:36:49.884755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:44.496822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879255+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:36:49.879255+0000","last_peered":"2024-09-12T02:36:49.879255+0000","last_clean":"2024-09-12T02:36:49.879255+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:36:49.879255+0000","last_undegraded":"2024-09-12T02:36:49.879255+0000","last_fullsized":"2024-09-12T02:36:49.879255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931656+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:36:57.931656+0000","last_peered":"2024-09-12T02:36:57.931656+0000","last_clean":"2024-09-12T02:36:57.931656+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:36:57.931656+0000","last_undegraded":"2024-09-12T02:36:57.931656+0000","last_fullsized":"2024-09-12T02:36:57.931656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880904+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:36:49.880904+0000","last_peered":"2024-09-12T02:36:49.880904+0000","last_clean":"2024-09-12T02:36:49.880904+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:36:49.880904+0000","last_undegraded":"2024-09-12T02:36:49.880904+0000","last_fullsized":"2024-09-12T02:36:49.880904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881702+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:36:49.881702+0000","last_peered":"2024-09-12T02:36:49.881702+0000","last_clean":"2024-09-12T02:36:49.881702+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:36:49.881702+0000","last_undegraded":"2024-09-12T02:36:49.881702+0000","last_fullsized":"2024-09-12T02:36:49.881702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878266+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:36:49.878266+0000","last_peered":"2024-09-12T02:36:49.878266+0000","last_clean":"2024-09-12T02:36:49.878266+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:36:49.878266+0000","last_undegraded":"2024-09-12T02:36:49.878266+0000","last_fullsized":"2024-09-12T02:36:49.878266+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931839+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:36:57.931839+0000","last_peered":"2024-09-12T02:36:57.931839+0000","last_clean":"2024-09-12T02:36:57.931839+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:36:57.931839+0000","last_undegraded":"2024-09-12T02:36:57.931839+0000","last_fullsized":"2024-09-12T02:36:57.931839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54115,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":107,"num_read_kb":108,"num_write":152,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":162345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1067341,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":425984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168609,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":425904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1017836,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":425373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1017520,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":425684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":477021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":475278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":426644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:37:16.493 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:37:16.494 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T02:37:16.494 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T02:37:16.738 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:16.854 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:16 smithi100 ceph-mon[31390]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-12T02:37:16.854 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:16 smithi100 ceph-mon[31390]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:16.983 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:16 smithi117 ceph-mon[34898]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-12T02:37:16.984 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:16 smithi117 ceph-mon[34898]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:16 smithi189 ceph-mon[35196]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-12T02:37:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:16 smithi189 ceph-mon[35196]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 -- 172.21.15.100:0/1533740486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 msgr2=0x7f6a14104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 --2- 172.21.15.100:0/1533740486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14104a90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009900 tx=0x7f6a0402a410 comp rx=0 tx=0).stop 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 -- 172.21.15.100:0/1533740486 shutdown_connections 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 --2- 172.21.15.100:0/1533740486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a14107900 0x7f6a14109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 --2- 172.21.15.100:0/1533740486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14104fd0 0x7f6a141073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 --2- 172.21.15.100:0/1533740486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14104a90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 -- 172.21.15.100:0/1533740486 >> 172.21.15.100:0/1533740486 conn(0x7f6a140fc2a0 msgr2=0x7f6a140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 -- 172.21.15.100:0/1533740486 shutdown_connections 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.179+0000 7f6a19806640 1 -- 172.21.15.100:0/1533740486 wait complete. 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 Processor -- start 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 -- start start 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a14104fd0 0x7f6a141985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14107900 0x7f6a1419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1410d990 con 0x7f6a141026a0 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1410d810 con 0x7f6a14107900 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a19806640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1410db10 con 0x7f6a14104fd0 2024-09-12T02:37:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43502/0 (socket says 172.21.15.100:43502) 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 -- 172.21.15.100:0/1618165471 learned_addr learned my addr 172.21.15.100:0/1618165471 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a137fe640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14107900 0x7f6a1419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a127fc640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a14104fd0 0x7f6a141985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 -- 172.21.15.100:0/1618165471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a14104fd0 msgr2=0x7f6a141985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a14104fd0 0x7f6a141985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 -- 172.21.15.100:0/1618165471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14107900 msgr2=0x7f6a1419f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14107900 0x7f6a1419f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.180+0000 7f6a12ffd640 1 -- 172.21.15.100:0/1618165471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1419fca0 con 0x7f6a141026a0 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.181+0000 7f6a12ffd640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14198070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009230 tx=0x7f6a04004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.181+0000 7f6a18804640 1 -- 172.21.15.100:0/1618165471 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0403f030 con 0x7f6a141026a0 2024-09-12T02:37:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.181+0000 7f6a18804640 1 -- 172.21.15.100:0/1618165471 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a04003ce0 con 0x7f6a141026a0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.181+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1419ff30 con 0x7f6a141026a0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.181+0000 7f6a18804640 1 -- 172.21.15.100:0/1618165471 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04035070 con 0x7f6a141026a0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.181+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a141a0400 con 0x7f6a141026a0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.182+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a140fdd90 con 0x7f6a141026a0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.183+0000 7f6a18804640 1 -- 172.21.15.100:0/1618165471 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6a04042030 con 0x7f6a141026a0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.184+0000 7f6a18804640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69fc0a2cc0 0x7f69fc0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.184+0000 7f6a127fc640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69fc0a2cc0 0x7f69fc0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.184+0000 7f6a18804640 1 -- 172.21.15.100:0/1618165471 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f6a040ef750 con 0x7f6a141026a0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.184+0000 7f6a127fc640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69fc0a2cc0 0x7f69fc0a5180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a14199590 tx=0x7f6a08008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.188+0000 7f6a18804640 1 -- 172.21.15.100:0/1618165471 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a040bc700 con 0x7f6a141026a0 2024-09-12T02:37:17.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.421+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6a1402da10 con 0x7f6a141026a0 2024-09-12T02:37:17.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.423+0000 7f6a18804640 1 -- 172.21.15.100:0/1618165471 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f6a040bc000 con 0x7f6a141026a0 2024-09-12T02:37:17.423 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-12T02:37:17.423 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDdU+JmwawnGRAAUufwYvMDX/XZTvwvuns4Jg== 2024-09-12T02:37:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69fc0a2cc0 msgr2=0x7f69fc0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69fc0a2cc0 0x7f69fc0a5180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a14199590 tx=0x7f6a08008040 comp rx=0 tx=0).stop 2024-09-12T02:37:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 msgr2=0x7f6a14198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14198070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009230 tx=0x7f6a04004430 comp rx=0 tx=0).stop 2024-09-12T02:37:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 shutdown_connections 2024-09-12T02:37:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69fc0a2cc0 0x7f69fc0a5180 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14107900 0x7f6a1419f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a14104fd0 0x7f6a141985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 --2- 172.21.15.100:0/1618165471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a141026a0 0x7f6a14198070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.425+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 >> 172.21.15.100:0/1618165471 conn(0x7f6a140fc2a0 msgr2=0x7f6a141030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.426+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 shutdown_connections 2024-09-12T02:37:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:17.426+0000 7f6a19806640 1 -- 172.21.15.100:0/1618165471 wait complete. 2024-09-12T02:37:17.710 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:17 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1618165471' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:37:17.710 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:17 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1618165471' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:37:17.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:17 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1618165471' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:37:17.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:17 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1618165471' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:37:18.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:17 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1618165471' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:37:18.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:17 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1618165471' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:37:18.200 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:37:18.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T02:37:18.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:37:18.238 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:37:18.238 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:37:18.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T02:37:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:18.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:18 smithi100 ceph-mon[31390]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-12T02:37:19.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.000+0000 7f838ddbc640 1 -- 172.21.15.100:0/2515418844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388102d40 msgr2=0x7f8388103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.000+0000 7f838ddbc640 1 --2- 172.21.15.100:0/2515418844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388102d40 0x7f8388103120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8378009ca0 tx=0x7f837802a950 comp rx=0 tx=0).stop 2024-09-12T02:37:19.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.000+0000 7f838ddbc640 1 -- 172.21.15.100:0/2515418844 shutdown_connections 2024-09-12T02:37:19.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.000+0000 7f838ddbc640 1 --2- 172.21.15.100:0/2515418844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f838810c170 0x7f838810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 --2- 172.21.15.100:0/2515418844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8388103660 0x7f838810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 --2- 172.21.15.100:0/2515418844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388102d40 0x7f8388103120 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 -- 172.21.15.100:0/2515418844 >> 172.21.15.100:0/2515418844 conn(0x7f83880fc7a0 msgr2=0x7f83880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 -- 172.21.15.100:0/2515418844 shutdown_connections 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 -- 172.21.15.100:0/2515418844 wait complete. 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 Processor -- start 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 -- start start 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8388102d40 0x7f8388198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388103660 0x7f83881989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.001+0000 7f838ddbc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f838810c170 0x7f838819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f838ddbc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8388111f70 con 0x7f8388103660 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f838ddbc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8388111df0 con 0x7f8388102d40 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f838ddbc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83881120f0 con 0x7f838810c170 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388103660 0x7f83881989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388103660 0x7f83881989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43520/0 (socket says 172.21.15.100:43520) 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 -- 172.21.15.100:0/1164894109 learned_addr learned my addr 172.21.15.100:0/1164894109 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f83877fe640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8388102d40 0x7f8388198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 -- 172.21.15.100:0/1164894109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f838810c170 msgr2=0x7f838819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f838810c170 0x7f838819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 -- 172.21.15.100:0/1164894109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8388102d40 msgr2=0x7f8388198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8388102d40 0x7f8388198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 -- 172.21.15.100:0/1164894109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838819d420 con 0x7f8388103660 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8386ffd640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388103660 0x7f83881989b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c940 tx=0x7f837c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8384ff9640 1 -- 172.21.15.100:0/1164894109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c004220 con 0x7f8388103660 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8384ff9640 1 -- 172.21.15.100:0/1164894109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f837c0043c0 con 0x7f8388103660 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838819d710 con 0x7f8388103660 2024-09-12T02:37:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f8384ff9640 1 -- 172.21.15.100:0/1164894109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c004a00 con 0x7f8388103660 2024-09-12T02:37:19.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.002+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83881a4ff0 con 0x7f8388103660 2024-09-12T02:37:19.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.003+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8388103120 con 0x7f8388103660 2024-09-12T02:37:19.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.004+0000 7f8384ff9640 1 -- 172.21.15.100:0/1164894109 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f837c0079b0 con 0x7f8388103660 2024-09-12T02:37:19.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.005+0000 7f8384ff9640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f83700a2c10 0x7f83700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.005+0000 7f83877fe640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f83700a2c10 0x7f83700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.005+0000 7f8384ff9640 1 -- 172.21.15.100:0/1164894109 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f837c0cf0d0 con 0x7f8388103660 2024-09-12T02:37:19.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.006+0000 7f83877fe640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f83700a2c10 0x7f83700a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8378000f80 tx=0x7f837802fea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.009+0000 7f8384ff9640 1 -- 172.21.15.100:0/1164894109 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f837c014030 con 0x7f8388103660 2024-09-12T02:37:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:18 smithi189 ceph-mon[35196]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-12T02:37:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:18 smithi117 ceph-mon[34898]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-12T02:37:19.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.221+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f838802d7c0 con 0x7f8388103660 2024-09-12T02:37:19.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.226+0000 7f8384ff9640 1 -- 172.21.15.100:0/1164894109 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263208 (secure 0 0 0) 0x7f837c09c080 con 0x7f8388103660 2024-09-12T02:37:19.230 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:19.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f83700a2c10 msgr2=0x7f83700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f83700a2c10 0x7f83700a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8378000f80 tx=0x7f837802fea0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388103660 msgr2=0x7f83881989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388103660 0x7f83881989b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c940 tx=0x7f837c00ce00 comp rx=0 tx=0).stop 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 shutdown_connections 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f83700a2c10 0x7f83700a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f838810c170 0x7f838819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8388103660 0x7f83881989b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 --2- 172.21.15.100:0/1164894109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8388102d40 0x7f8388198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 >> 172.21.15.100:0/1164894109 conn(0x7f83880fc7a0 msgr2=0x7f83880fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 shutdown_connections 2024-09-12T02:37:19.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:19.228+0000 7f838ddbc640 1 -- 172.21.15.100:0/1164894109 wait complete. 2024-09-12T02:37:19.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:19 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1164894109' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:37:19.986 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2819887168},{"type":"v1","addr":"172.21.15.100:6801","nonce":2819887168}]},"active_addr":"172.21.15.100:6801/2819887168","active_change":"2024-09-12T02:29:55.443289+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.100:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2308856494}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1198113806}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1400788821}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":855163196}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":904947721}]}]} 2024-09-12T02:37:19.991 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T02:37:19.991 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T02:37:19.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:37:20.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:19 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1164894109' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:37:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:19 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1164894109' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:37:20.237 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:20.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1099021081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4100e20 msgr2=0x7fa8e4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1099021081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4100e20 0x7fa8e4101200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009900 tx=0x7fa8cc02a480 comp rx=0 tx=0).stop 2024-09-12T02:37:20.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1099021081 shutdown_connections 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1099021081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8e4102ef0 0x7fa8e410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1099021081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e4102570 0x7fa8e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1099021081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4100e20 0x7fa8e4101200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1099021081 >> 172.21.15.100:0/1099021081 conn(0x7fa8e40fc7d0 msgr2=0x7fa8e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1099021081 shutdown_connections 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1099021081 wait complete. 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 Processor -- start 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- start start 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8e4100e20 0x7fa8e4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4102570 0x7fa8e4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e4102ef0 0x7fa8e419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e4111020 con 0x7fa8e4102570 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e4110ea0 con 0x7fa8e4102ef0 2024-09-12T02:37:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.726+0000 7fa8eabfa640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e41111a0 con 0x7fa8e4100e20 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4102570 0x7fa8e4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4102570 0x7fa8e4198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43530/0 (socket says 172.21.15.100:43530) 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 -- 172.21.15.100:0/1447530422 learned_addr learned my addr 172.21.15.100:0/1447530422 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e8996640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8e4100e20 0x7fa8e4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 -- 172.21.15.100:0/1447530422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8e4100e20 msgr2=0x7fa8e4198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8e4100e20 0x7fa8e4198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 -- 172.21.15.100:0/1447530422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e4102ef0 msgr2=0x7fa8e419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e9197640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e4102ef0 0x7fa8e419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e4102ef0 0x7fa8e419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 -- 172.21.15.100:0/1447530422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e419d620 con 0x7fa8e4102570 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e3fff640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4102570 0x7fa8e4198bb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400ba50 tx=0x7fa8d400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e1ffb640 1 -- 172.21.15.100:0/1447530422 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4019070 con 0x7fa8e4102570 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e1ffb640 1 -- 172.21.15.100:0/1447530422 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d400cbe0 con 0x7fa8e4102570 2024-09-12T02:37:20.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e419d910 con 0x7fa8e4102570 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8e1ffb640 1 -- 172.21.15.100:0/1447530422 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40076e0 con 0x7fa8e4102570 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.727+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e41a51f0 con 0x7fa8e4102570 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.728+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e4101280 con 0x7fa8e4102570 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.729+0000 7fa8e1ffb640 1 -- 172.21.15.100:0/1447530422 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa8d401c070 con 0x7fa8e4102570 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.730+0000 7fa8e1ffb640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8d00a2c10 0x7fa8d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.730+0000 7fa8e8996640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8d00a2c10 0x7fa8d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.730+0000 7fa8e1ffb640 1 -- 172.21.15.100:0/1447530422 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fa8d40ce5c0 con 0x7fa8e4102570 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.731+0000 7fa8e8996640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8d00a2c10 0x7fa8d00a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005ab0 tx=0x7fa8cc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:20.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.734+0000 7fa8e1ffb640 1 -- 172.21.15.100:0/1447530422 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8d409b680 con 0x7fa8e4102570 2024-09-12T02:37:20.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:20 smithi100 ceph-mon[31390]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-12T02:37:20.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.904+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8e41a5480 con 0x7fa8e4102570 2024-09-12T02:37:20.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.906+0000 7fa8e1ffb640 1 -- 172.21.15.100:0/1447530422 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22373 (secure 0 0 0) 0x7fa8d409af80 con 0x7fa8e4102570 2024-09-12T02:37:20.906 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:20.906 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:36:49.489990+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8d00a2c10 msgr2=0x7fa8d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8d00a2c10 0x7fa8d00a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005ab0 tx=0x7fa8cc005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4102570 msgr2=0x7fa8e4198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4102570 0x7fa8e4198bb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400ba50 tx=0x7fa8d400bf10 comp rx=0 tx=0).stop 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 shutdown_connections 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8d00a2c10 0x7fa8d00a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e4102ef0 0x7fa8e419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8e4102570 0x7fa8e4198bb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 --2- 172.21.15.100:0/1447530422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8e4100e20 0x7fa8e4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 >> 172.21.15.100:0/1447530422 conn(0x7fa8e40fc7d0 msgr2=0x7fa8e4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 shutdown_connections 2024-09-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:20.908+0000 7fa8eabfa640 1 -- 172.21.15.100:0/1447530422 wait complete. 2024-09-12T02:37:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:20 smithi189 ceph-mon[35196]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-12T02:37:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:20 smithi117 ceph-mon[34898]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-12T02:37:21.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:21 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1447530422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:21.650 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T02:37:21.650 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:37:21.894 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:22.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:21 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1447530422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:22.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:21 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1447530422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 -- 172.21.15.100:0/1618031488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 msgr2=0x7fa710106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 --2- 172.21.15.100:0/1618031488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa710106e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa704009930 tx=0x7fa70402a420 comp rx=0 tx=0).stop 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 -- 172.21.15.100:0/1618031488 shutdown_connections 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 --2- 172.21.15.100:0/1618031488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa710101420 0x7fa71010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 --2- 172.21.15.100:0/1618031488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa710100a80 0x7fa710100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 --2- 172.21.15.100:0/1618031488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa710106e60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 -- 172.21.15.100:0/1618031488 >> 172.21.15.100:0/1618031488 conn(0x7fa7100fc7a0 msgr2=0x7fa7100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 -- 172.21.15.100:0/1618031488 shutdown_connections 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 -- 172.21.15.100:0/1618031488 wait complete. 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 Processor -- start 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.345+0000 7fa716f93640 1 -- start start 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa716f93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa710100a80 0x7fa710198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa716f93640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa710101420 0x7fa710198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa716f93640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa71019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa716f93640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa710112020 con 0x7fa710106a80 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa716f93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa710111ea0 con 0x7fa710100a80 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa716f93640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101121a0 con 0x7fa710101420 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa71019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa71019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43558/0 (socket says 172.21.15.100:43558) 2024-09-12T02:37:22.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 -- 172.21.15.100:0/597681435 learned_addr learned my addr 172.21.15.100:0/597681435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa714d2f640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa710100a80 0x7fa710198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 -- 172.21.15.100:0/597681435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa710101420 msgr2=0x7fa710198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa710101420 0x7fa710198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 -- 172.21.15.100:0/597681435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa710100a80 msgr2=0x7fa710198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa710100a80 0x7fa710198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 -- 172.21.15.100:0/597681435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71019d4b0 con 0x7fa710106a80 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa714d2f640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa710100a80 0x7fa710198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa715530640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa71019cdd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa70800eaa0 tx=0x7fa70800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa70dffb640 1 -- 172.21.15.100:0/597681435 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70800cdb0 con 0x7fa710106a80 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71019d7a0 con 0x7fa710106a80 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa70dffb640 1 -- 172.21.15.100:0/597681435 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa708005020 con 0x7fa710106a80 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.346+0000 7fa70dffb640 1 -- 172.21.15.100:0/597681435 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7080116b0 con 0x7fa710106a80 2024-09-12T02:37:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.347+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7101a5080 con 0x7fa710106a80 2024-09-12T02:37:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.347+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa710100ee0 con 0x7fa710106a80 2024-09-12T02:37:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.348+0000 7fa70dffb640 1 -- 172.21.15.100:0/597681435 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa708005560 con 0x7fa710106a80 2024-09-12T02:37:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.349+0000 7fa70dffb640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa7000a2c10 0x7fa7000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.349+0000 7fa70dffb640 1 -- 172.21.15.100:0/597681435 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fa7080cf300 con 0x7fa710106a80 2024-09-12T02:37:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.349+0000 7fa714d2f640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa7000a2c10 0x7fa7000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.350+0000 7fa714d2f640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa7000a2c10 0x7fa7000a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa70402a940 tx=0x7fa704005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.353+0000 7fa70dffb640 1 -- 172.21.15.100:0/597681435 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa708016030 con 0x7fa710106a80 2024-09-12T02:37:22.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.520+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa71002d7c0 con 0x7fa710106a80 2024-09-12T02:37:22.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.522+0000 7fa70dffb640 1 -- 172.21.15.100:0/597681435 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22373 (secure 0 0 0) 0x7fa70809c2b0 con 0x7fa710106a80 2024-09-12T02:37:22.523 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:22.523 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:36:49.489990+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:37:22.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa7000a2c10 msgr2=0x7fa7000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa7000a2c10 0x7fa7000a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa70402a940 tx=0x7fa704005fd0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 msgr2=0x7fa71019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa71019cdd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa70800eaa0 tx=0x7fa70800ef60 comp rx=0 tx=0).stop 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 shutdown_connections 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa7000a2c10 0x7fa7000a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa710106a80 0x7fa71019cdd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa710101420 0x7fa710198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 --2- 172.21.15.100:0/597681435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa710100a80 0x7fa710198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 >> 172.21.15.100:0/597681435 conn(0x7fa7100fc7a0 msgr2=0x7fa7100fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 shutdown_connections 2024-09-12T02:37:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:22.525+0000 7fa716f93640 1 -- 172.21.15.100:0/597681435 wait complete. 2024-09-12T02:37:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:22 smithi100 ceph-mon[31390]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-12T02:37:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:22 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/597681435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:22 smithi189 ceph-mon[35196]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-12T02:37:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:22 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/597681435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:22 smithi117 ceph-mon[34898]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-12T02:37:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:22 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/597681435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:23.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T02:37:23.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T02:37:23.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T02:37:23.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T02:37:23.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T02:37:23.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T02:37:23.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T02:37:23.202 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T02:37:23.202 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T02:37:23.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T02:37:23.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T02:37:23.204 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T02:37:23.935 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.940 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.950 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.950 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.953 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.956 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.956 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:23.976 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.600+0000 7f113ef3c640 1 -- 172.21.15.100:0/3251515629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 msgr2=0x7f113810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.600+0000 7f113ef3c640 1 --2- 172.21.15.100:0/3251515629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 0x7f113810da40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1130009ca0 tx=0x7f113002a950 comp rx=0 tx=0).stop 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- 172.21.15.100:0/3251515629 shutdown_connections 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 --2- 172.21.15.100:0/3251515629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 0x7f113810da40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 --2- 172.21.15.100:0/3251515629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1138102570 0x7f11381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 --2- 172.21.15.100:0/3251515629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1138100e20 0x7f1138101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- 172.21.15.100:0/3251515629 >> 172.21.15.100:0/3251515629 conn(0x7f11380fc7d0 msgr2=0x7f11380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- 172.21.15.100:0/3251515629 shutdown_connections 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- 172.21.15.100:0/3251515629 wait complete. 2024-09-12T02:37:24.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 Processor -- start 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- start start 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1138100e20 0x7f11381a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1138102570 0x7f11381a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 0x7f113819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1138111020 con 0x7f1138102ef0 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1138110ea0 con 0x7f1138102570 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113ef3c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11381111a0 con 0x7f1138100e20 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113d4d9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 0x7f113819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113d4d9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 0x7f113819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52874/0 (socket says 172.21.15.100:52874) 2024-09-12T02:37:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.601+0000 7f113d4d9640 1 -- 172.21.15.100:0/2493384394 learned_addr learned my addr 172.21.15.100:0/2493384394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113ccd8640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1138100e20 0x7f11381a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f1137fff640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1138102570 0x7f11381a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113d4d9640 1 -- 172.21.15.100:0/2493384394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1138100e20 msgr2=0x7f11381a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113d4d9640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1138100e20 0x7f11381a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113d4d9640 1 -- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1138102570 msgr2=0x7f11381a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113d4d9640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1138102570 0x7f11381a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113d4d9640 1 -- 172.21.15.100:0/2493384394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113819af00 con 0x7f1138102ef0 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f1137fff640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1138102570 0x7f11381a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113ccd8640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1138100e20 0x7f11381a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113d4d9640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 0x7f113819a6d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1130006010 tx=0x7f113002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130034040 con 0x7f1138102ef0 2024-09-12T02:37:24.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1130003e00 con 0x7f1138102ef0 2024-09-12T02:37:24.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113819b190 con 0x7f1138102ef0 2024-09-12T02:37:24.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130045480 con 0x7f1138102ef0 2024-09-12T02:37:24.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.602+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381a7390 con 0x7f1138102ef0 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.603+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1138106a00 con 0x7f1138102ef0 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.604+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1130037020 con 0x7f1138102ef0 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f1135ffb640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f11280a2c10 0x7f11280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f113ccd8640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f11280a2c10 0x7f11280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f11300f01a0 con 0x7f1138102ef0 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f1135ffb640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] conn(0x7f11280ac460 0x7f11280ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 --> [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11280aef30 con 0x7f11280ac460 2024-09-12T02:37:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f11300f0680 con 0x7f1138102ef0 2024-09-12T02:37:24.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f113ccd8640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f11280a2c10 0x7f11280a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f112c006fd0 tx=0x7f112c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:24.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.605+0000 7f1137fff640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] conn(0x7f11280ac460 0x7f11280ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.606+0000 7f1137fff640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] conn(0x7f11280ac460 0x7f11280ae880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:24.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.607+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== osd.4 v2:172.21.15.117:6808/3265990366 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11280aef30 con 0x7f11280ac460 2024-09-12T02:37:24.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.620+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 --> [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11381021b0 con 0x7f11280ac460 2024-09-12T02:37:24.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f1135ffb640 1 -- 172.21.15.100:0/2493384394 <== osd.4 v2:172.21.15.117:6808/3265990366 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f11381021b0 con 0x7f11280ac460 2024-09-12T02:37:24.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] conn(0x7f11280ac460 msgr2=0x7f11280ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] conn(0x7f11280ac460 0x7f11280ae880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f11280a2c10 msgr2=0x7f11280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f11280a2c10 0x7f11280a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f112c006fd0 tx=0x7f112c008040 comp rx=0 tx=0).stop 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 msgr2=0x7f113819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 --2- 172.21.15.100:0/2493384394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1138102ef0 0x7f113819a6d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1130006010 tx=0x7f113002f6f0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113d4d9640 1 -- 172.21.15.100:0/2493384394 reap_dead start 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 shutdown_connections 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 >> 172.21.15.100:0/2493384394 conn(0x7f11380fc7d0 msgr2=0x7f113806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 shutdown_connections 2024-09-12T02:37:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:24.621+0000 7f113ef3c640 1 -- 172.21.15.100:0/2493384394 wait complete. 2024-09-12T02:37:24.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:24 smithi100 ceph-mon[31390]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-12T02:37:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:24 smithi189 ceph-mon[35196]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-12T02:37:25.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:24 smithi117 ceph-mon[34898]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-12T02:37:25.421 INFO:teuthology.orchestra.run.smithi100.stdout:137438953529 2024-09-12T02:37:25.421 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T02:37:26.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 -- 172.21.15.100:0/1701234004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 msgr2=0x7f80b410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 --2- 172.21.15.100:0/1701234004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 0x7f80b410ea90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009ca0 tx=0x7f80ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 -- 172.21.15.100:0/1701234004 shutdown_connections 2024-09-12T02:37:26.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 --2- 172.21.15.100:0/1701234004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 0x7f80b410ea90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 --2- 172.21.15.100:0/1701234004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80b4102790 0x7f80b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 --2- 172.21.15.100:0/1701234004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80b4101de0 0x7f80b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 -- 172.21.15.100:0/1701234004 >> 172.21.15.100:0/1701234004 conn(0x7f80b40fd8c0 msgr2=0x7f80b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 -- 172.21.15.100:0/1701234004 shutdown_connections 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.199+0000 7f80bc348640 1 -- 172.21.15.100:0/1701234004 wait complete. 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 Processor -- start 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 -- start start 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80b4101de0 0x7f80b4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80b4102790 0x7f80b4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 0x7f80b419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4111fb0 con 0x7f80b4106f10 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4111e30 con 0x7f80b4102790 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.200+0000 7f80bc348640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4112130 con 0x7f80b4101de0 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 0x7f80b419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 0x7f80b419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52908/0 (socket says 172.21.15.100:52908) 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 -- 172.21.15.100:0/375918888 learned_addr learned my addr 172.21.15.100:0/375918888 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80b98e3640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80b4102790 0x7f80b4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba0e4640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80b4101de0 0x7f80b4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 -- 172.21.15.100:0/375918888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80b4101de0 msgr2=0x7f80b4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80b4101de0 0x7f80b4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 -- 172.21.15.100:0/375918888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80b4102790 msgr2=0x7f80b4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80b4102790 0x7f80b4198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 -- 172.21.15.100:0/375918888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b419d520 con 0x7f80b4106f10 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ba8e5640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 0x7f80b419ce40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f80ac031a20 tx=0x7f80ac031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac003b70 con 0x7f80b4106f10 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ac003d10 con 0x7f80b4106f10 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b419d7b0 con 0x7f80b4106f10 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac02fc80 con 0x7f80b4106f10 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.201+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b41a50f0 con 0x7f80b4106f10 2024-09-12T02:37:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.202+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80b4062900 con 0x7f80b4106f10 2024-09-12T02:37:26.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.204+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f80ac0046a0 con 0x7f80b4106f10 2024-09-12T02:37:26.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.204+0000 7f80ab7fe640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80a00a2c10 0x7f80a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.204+0000 7f80ba0e4640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80a00a2c10 0x7f80a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.204+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f80ac0f0400 con 0x7f80b4106f10 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.205+0000 7f80ab7fe640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] conn(0x7f80a00ac460 0x7f80a00ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.205+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 --> [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80a00aef30 con 0x7f80a00ac460 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.205+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f80ac0f08e0 con 0x7f80b4106f10 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.205+0000 7f80b98e3640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] conn(0x7f80a00ac460 0x7f80a00ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.205+0000 7f80ba0e4640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80a00a2c10 0x7f80a00a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80b0005fd0 tx=0x7f80b0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.205+0000 7f80b98e3640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] conn(0x7f80a00ac460 0x7f80a00ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.206+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== osd.0 v2:172.21.15.100:6802/1448972907 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80a00aef30 con 0x7f80a00ac460 2024-09-12T02:37:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.219+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 --> [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80b4062d00 con 0x7f80a00ac460 2024-09-12T02:37:26.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80ab7fe640 1 -- 172.21.15.100:0/375918888 <== osd.0 v2:172.21.15.100:6802/1448972907 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f80b4062d00 con 0x7f80a00ac460 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] conn(0x7f80a00ac460 msgr2=0x7f80a00ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] conn(0x7f80a00ac460 0x7f80a00ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80a00a2c10 msgr2=0x7f80a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80a00a2c10 0x7f80a00a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80b0005fd0 tx=0x7f80b0005850 comp rx=0 tx=0).stop 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 msgr2=0x7f80b419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 --2- 172.21.15.100:0/375918888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b4106f10 0x7f80b419ce40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f80ac031a20 tx=0x7f80ac031a50 comp rx=0 tx=0).stop 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80ba8e5640 1 -- 172.21.15.100:0/375918888 reap_dead start 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 shutdown_connections 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 >> 172.21.15.100:0/375918888 conn(0x7f80b40fd8c0 msgr2=0x7f80b40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 shutdown_connections 2024-09-12T02:37:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.220+0000 7f80bc348640 1 -- 172.21.15.100:0/375918888 wait complete. 2024-09-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 -- 172.21.15.100:0/2272734939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8101420 msgr2=0x7f02c810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 --2- 172.21.15.100:0/2272734939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8101420 0x7f02c810d950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009930 tx=0x7f02c002a420 comp rx=0 tx=0).stop 2024-09-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 -- 172.21.15.100:0/2272734939 shutdown_connections 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 --2- 172.21.15.100:0/2272734939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8101420 0x7f02c810d950 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 --2- 172.21.15.100:0/2272734939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8100a80 0x7f02c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 --2- 172.21.15.100:0/2272734939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8106a80 0x7f02c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 -- 172.21.15.100:0/2272734939 >> 172.21.15.100:0/2272734939 conn(0x7f02c80fc7a0 msgr2=0x7f02c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 -- 172.21.15.100:0/2272734939 shutdown_connections 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 -- 172.21.15.100:0/2272734939 wait complete. 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 Processor -- start 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.098+0000 7f02cff5e640 1 -- start start 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8100a80 0x7f02c81972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101420 0x7f02c8197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8106a80 0x7f02c819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8110e80 con 0x7f02c8100a80 2024-09-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8110d00 con 0x7f02c8106a80 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8111000 con 0x7f02c8101420 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8100a80 0x7f02c81972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8100a80 0x7f02c81972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52902/0 (socket says 172.21.15.100:52902) 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 -- 172.21.15.100:0/2772296099 learned_addr learned my addr 172.21.15.100:0/2772296099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cd4f9640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101420 0x7f02c8197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 -- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101420 msgr2=0x7f02c8197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02ce4fb640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8106a80 0x7f02c819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101420 0x7f02c8197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 -- 172.21.15.100:0/2772296099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8106a80 msgr2=0x7f02c819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8106a80 0x7f02c819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 -- 172.21.15.100:0/2772296099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c819c270 con 0x7f02c8100a80 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cd4f9640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c8101420 0x7f02c8197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02ce4fb640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c8106a80 0x7f02c819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cdcfa640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8100a80 0x7f02c81972c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c890 tx=0x7f02b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8004220 con 0x7f02c8100a80 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b80043c0 con 0x7f02c8100a80 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c819c560 con 0x7f02c8100a80 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b80049e0 con 0x7f02c8100a80 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.099+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c81a3e40 con 0x7f02c8100a80 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.100+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f02c80fe9b0 con 0x7f02c8100a80 2024-09-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.102+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f02b80079b0 con 0x7f02c8100a80 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.102+0000 7f02c6ffd640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2c90 0x7f02b00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.102+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f02b80cf200 con 0x7f02c8100a80 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.102+0000 7f02cd4f9640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2c90 0x7f02b00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.103+0000 7f02c6ffd640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] conn(0x7f02b00ac4e0 0x7f02b00ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.103+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 --> [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02b8024ea0 con 0x7f02b00ac4e0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.103+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f02b80cf6e0 con 0x7f02c8100a80 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.103+0000 7f02cd4f9640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2c90 0x7f02b00a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f02c8106050 tx=0x7f02bc0093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.103+0000 7f02ce4fb640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] conn(0x7f02b00ac4e0 0x7f02b00ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.103+0000 7f02ce4fb640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] conn(0x7f02b00ac4e0 0x7f02b00ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.104+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== osd.2 v2:172.21.15.189:6800/2928382700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f02b8024ea0 con 0x7f02b00ac4e0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.118+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 --> [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f02c81021c0 con 0x7f02b00ac4e0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02c6ffd640 1 -- 172.21.15.100:0/2772296099 <== osd.2 v2:172.21.15.189:6800/2928382700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f02c81021c0 con 0x7f02b00ac4e0 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] conn(0x7f02b00ac4e0 msgr2=0x7f02b00ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] conn(0x7f02b00ac4e0 0x7f02b00ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2c90 msgr2=0x7f02b00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f02b00a2c90 0x7f02b00a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f02c8106050 tx=0x7f02bc0093e0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8100a80 msgr2=0x7f02c81972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 --2- 172.21.15.100:0/2772296099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02c8100a80 0x7f02c81972c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c890 tx=0x7f02b800cd50 comp rx=0 tx=0).stop 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02ce4fb640 1 -- 172.21.15.100:0/2772296099 reap_dead start 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 shutdown_connections 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 >> 172.21.15.100:0/2772296099 conn(0x7f02c80fc7a0 msgr2=0x7f02c80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 shutdown_connections 2024-09-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:26.119+0000 7f02cff5e640 1 -- 172.21.15.100:0/2772296099 wait complete. 2024-09-12T02:37:26.868 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:26 smithi100 ceph-mon[31390]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T02:37:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:26 smithi189 ceph-mon[35196]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T02:37:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:26 smithi117 ceph-mon[34898]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T02:37:27.207 INFO:teuthology.orchestra.run.smithi100.stdout:77309411395 2024-09-12T02:37:27.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T02:37:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 -- 172.21.15.100:0/1687465677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 msgr2=0x7fd8d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 --2- 172.21.15.100:0/1687465677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 0x7fd8d0101200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009900 tx=0x7fd8c802a480 comp rx=0 tx=0).stop 2024-09-12T02:37:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 -- 172.21.15.100:0/1687465677 shutdown_connections 2024-09-12T02:37:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 --2- 172.21.15.100:0/1687465677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d0102ef0 0x7fd8d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 --2- 172.21.15.100:0/1687465677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d0102570 0x7fd8d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 --2- 172.21.15.100:0/1687465677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 0x7fd8d0101200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 -- 172.21.15.100:0/1687465677 >> 172.21.15.100:0/1687465677 conn(0x7fd8d00fc7d0 msgr2=0x7fd8d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 -- 172.21.15.100:0/1687465677 shutdown_connections 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 -- 172.21.15.100:0/1687465677 wait complete. 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 Processor -- start 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.465+0000 7fd8d82ec640 1 -- start start 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 0x7fd8d0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d0102570 0x7fd8d0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d0102ef0 0x7fd8d01a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d0110f80 con 0x7fd8d0100e20 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d0110e00 con 0x7fd8d0102570 2024-09-12T02:37:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d0111100 con 0x7fd8d0102ef0 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 0x7fd8d0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 0x7fd8d0199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52926/0 (socket says 172.21.15.100:52926) 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 -- 172.21.15.100:0/3512152584 learned_addr learned my addr 172.21.15.100:0/3512152584 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d5887640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d0102570 0x7fd8d0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 -- 172.21.15.100:0/3512152584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d0102ef0 msgr2=0x7fd8d01a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d0102ef0 0x7fd8d01a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 -- 172.21.15.100:0/3512152584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d0102570 msgr2=0x7fd8d0199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d0102570 0x7fd8d0199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 -- 172.21.15.100:0/3512152584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d01a48d0 con 0x7fd8d0100e20 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d5887640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d0102570 0x7fd8d0199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d6088640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 0x7fd8d0199310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006010 tx=0x7fd8c8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c803f070 con 0x7fd8d0100e20 2024-09-12T02:37:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c8031e30 con 0x7fd8d0100e20 2024-09-12T02:37:28.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d01a4aa0 con 0x7fd8d0100e20 2024-09-12T02:37:28.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8035030 con 0x7fd8d0100e20 2024-09-12T02:37:28.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.466+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d01a4ef0 con 0x7fd8d0100e20 2024-09-12T02:37:28.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.467+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8d0062980 con 0x7fd8d0100e20 2024-09-12T02:37:28.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.469+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd8c8042070 con 0x7fd8d0100e20 2024-09-12T02:37:28.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.469+0000 7fd8cf7fe640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8b80a2c10 0x7fd8b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.469+0000 7fd8d5887640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8b80a2c10 0x7fd8b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.469+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd8c80f0030 con 0x7fd8d0100e20 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.470+0000 7fd8cf7fe640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] conn(0x7fd8b80ac460 0x7fd8b80ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.470+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 --> [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8c8038e90 con 0x7fd8b80ac460 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.470+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd8c80f0510 con 0x7fd8d0100e20 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.470+0000 7fd8d5887640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8b80a2c10 0x7fd8b80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd8d006aac0 tx=0x7fd8c4005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.470+0000 7fd8d6889640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] conn(0x7fd8b80ac460 0x7fd8b80ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.470+0000 7fd8d6889640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] conn(0x7fd8b80ac460 0x7fd8b80ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.471+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== osd.11 v2:172.21.15.189:6824/2500641850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8c8038e90 con 0x7fd8b80ac460 2024-09-12T02:37:28.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 --> [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8d0062e00 con 0x7fd8b80ac460 2024-09-12T02:37:28.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8cf7fe640 1 -- 172.21.15.100:0/3512152584 <== osd.11 v2:172.21.15.189:6824/2500641850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd8d0062e00 con 0x7fd8b80ac460 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 >> [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] conn(0x7fd8b80ac460 msgr2=0x7fd8b80ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d82ec640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] conn(0x7fd8b80ac460 0x7fd8b80ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8b80a2c10 msgr2=0x7fd8b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d82ec640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8b80a2c10 0x7fd8b80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd8d006aac0 tx=0x7fd8c4005d30 comp rx=0 tx=0).stop 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 msgr2=0x7fd8d0199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d82ec640 1 --2- 172.21.15.100:0/3512152584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8d0100e20 0x7fd8d0199310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006010 tx=0x7fd8c8003c80 comp rx=0 tx=0).stop 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.485+0000 7fd8d6889640 1 -- 172.21.15.100:0/3512152584 reap_dead start 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.486+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 shutdown_connections 2024-09-12T02:37:28.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.486+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 >> 172.21.15.100:0/3512152584 conn(0x7fd8d00fc7d0 msgr2=0x7fd8d00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:28.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.486+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 shutdown_connections 2024-09-12T02:37:28.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:28.486+0000 7fd8d82ec640 1 -- 172.21.15.100:0/3512152584 wait complete. 2024-09-12T02:37:28.674 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:28 smithi100 ceph-mon[31390]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:37:29.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 -- 172.21.15.100:0/2386585194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578106a80 msgr2=0x7f6578106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 --2- 172.21.15.100:0/2386585194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578106a80 0x7f6578106e60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f656c009930 tx=0x7f656c02a420 comp rx=0 tx=0).stop 2024-09-12T02:37:29.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 -- 172.21.15.100:0/2386585194 shutdown_connections 2024-09-12T02:37:29.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 --2- 172.21.15.100:0/2386585194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6578101420 0x7f657810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 --2- 172.21.15.100:0/2386585194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6578100a80 0x7f6578100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 --2- 172.21.15.100:0/2386585194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578106a80 0x7f6578106e60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 -- 172.21.15.100:0/2386585194 >> 172.21.15.100:0/2386585194 conn(0x7f65780fc7a0 msgr2=0x7f65780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 -- 172.21.15.100:0/2386585194 shutdown_connections 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 -- 172.21.15.100:0/2386585194 wait complete. 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 Processor -- start 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.548+0000 7f657eaea640 1 -- start start 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657eaea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6578100a80 0x7f65781992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657eaea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578101420 0x7f6578199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657eaea640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6578106a80 0x7f65781a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657eaea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6578110ea0 con 0x7f6578101420 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657eaea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6578110d20 con 0x7f6578100a80 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657eaea640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6578111020 con 0x7f6578106a80 2024-09-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578101420 0x7f6578199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578101420 0x7f6578199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52918/0 (socket says 172.21.15.100:52918) 2024-09-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 -- 172.21.15.100:0/423966142 learned_addr learned my addr 172.21.15.100:0/423966142 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657c886640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6578100a80 0x7f65781992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657d087640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6578106a80 0x7f65781a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 -- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6578106a80 msgr2=0x7f65781a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6578106a80 0x7f65781a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 -- 172.21.15.100:0/423966142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6578100a80 msgr2=0x7f65781992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6578100a80 0x7f65781992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 -- 172.21.15.100:0/423966142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65781a4890 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657c886640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6578100a80 0x7f65781992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6577fff640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578101420 0x7f6578199810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f656400d950 tx=0x7f656400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564017070 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6564009c30 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65781a4a60 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.549+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400f6b0 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.550+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65781a4ff0 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.550+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65780628c0 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.551+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f65640109d0 con 0x7f6578101420 2024-09-12T02:37:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f6575ffb640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f65680a2c90 0x7f65680a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f657c886640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f65680a2c90 0x7f65680a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f65640cecc0 con 0x7f6578101420 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f6575ffb640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] conn(0x7f65680ac4e0 0x7f65680ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 --> [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6564004470 con 0x7f65680ac4e0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f65640d2020 con 0x7f6578101420 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f657c886640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f65680a2c90 0x7f65680a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f656c000c00 tx=0x7f656c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.552+0000 7f657d087640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] conn(0x7f65680ac4e0 0x7f65680ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.553+0000 7f657d087640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] conn(0x7f65680ac4e0 0x7f65680ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.554+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== osd.5 v2:172.21.15.189:6808/2955557122 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6564004470 con 0x7f65680ac4e0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.567+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 --> [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6578062cf0 con 0x7f65680ac4e0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.567+0000 7f6575ffb640 1 -- 172.21.15.100:0/423966142 <== osd.5 v2:172.21.15.189:6808/2955557122 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6578062cf0 con 0x7f65680ac4e0 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] conn(0x7f65680ac4e0 msgr2=0x7f65680ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] conn(0x7f65680ac4e0 0x7f65680ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f65680a2c90 msgr2=0x7f65680a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f65680a2c90 0x7f65680a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f656c000c00 tx=0x7f656c005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578101420 msgr2=0x7f6578199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 --2- 172.21.15.100:0/423966142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6578101420 0x7f6578199810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f656400d950 tx=0x7f656400de10 comp rx=0 tx=0).stop 2024-09-12T02:37:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657d087640 1 -- 172.21.15.100:0/423966142 reap_dead start 2024-09-12T02:37:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 shutdown_connections 2024-09-12T02:37:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 >> 172.21.15.100:0/423966142 conn(0x7f65780fc7a0 msgr2=0x7f65780fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 shutdown_connections 2024-09-12T02:37:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:27.568+0000 7f657eaea640 1 -- 172.21.15.100:0/423966142 wait complete. 2024-09-12T02:37:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:28 smithi189 ceph-mon[35196]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:37:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:28 smithi117 ceph-mon[34898]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:37:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 -- 172.21.15.100:0/3842125841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 msgr2=0x7f5558100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 --2- 172.21.15.100:0/3842125841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 0x7f5558100ee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5540009930 tx=0x7f554002a420 comp rx=0 tx=0).stop 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 -- 172.21.15.100:0/3842125841 shutdown_connections 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 --2- 172.21.15.100:0/3842125841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5558101420 0x7f555810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 --2- 172.21.15.100:0/3842125841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 0x7f5558100ee0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 --2- 172.21.15.100:0/3842125841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5558106a80 0x7f5558106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 -- 172.21.15.100:0/3842125841 >> 172.21.15.100:0/3842125841 conn(0x7f55580fc7a0 msgr2=0x7f55580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 -- 172.21.15.100:0/3842125841 shutdown_connections 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.560+0000 7f555e3cd640 1 -- 172.21.15.100:0/3842125841 wait complete. 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 Processor -- start 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 -- start start 2024-09-12T02:37:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 0x7f5558198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5558101420 0x7f5558198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5558106a80 0x7f555819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5558110e40 con 0x7f5558100a80 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5558110cc0 con 0x7f5558106a80 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555e3cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5558110fc0 con 0x7f5558101420 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 0x7f5558198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 0x7f5558198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52934/0 (socket says 172.21.15.100:52934) 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 -- 172.21.15.100:0/4156248744 learned_addr learned my addr 172.21.15.100:0/4156248744 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555c96a640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5558106a80 0x7f555819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f55577fe640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5558101420 0x7f5558198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 -- 172.21.15.100:0/4156248744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5558101420 msgr2=0x7f5558198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5558101420 0x7f5558198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 -- 172.21.15.100:0/4156248744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5558106a80 msgr2=0x7f555819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5558106a80 0x7f555819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f5557fff640 1 -- 172.21.15.100:0/4156248744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555819d3b0 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f555c96a640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5558106a80 0x7f555819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.561+0000 7f55577fe640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5558101420 0x7f5558198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.562+0000 7f5557fff640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 0x7f5558198400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f554800d950 tx=0x7f554800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.562+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548017030 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.562+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555819d6a0 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.562+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5548004020 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.562+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55581a4f80 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.562+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55480047a0 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.563+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5558062980 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.564+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f55480041d0 con 0x7f5558100a80 2024-09-12T02:37:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.564+0000 7f55557fa640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f55440a2c10 0x7f55440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f55577fe640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f55440a2c10 0x7f55440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f55480cf110 con 0x7f5558100a80 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f55557fa640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] conn(0x7f55440ac460 0x7f55440ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 --> [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f554801de50 con 0x7f55440ac460 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f55480cf5f0 con 0x7f5558100a80 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f555c96a640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] conn(0x7f55440ac460 0x7f55440ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f55577fe640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f55440a2c10 0x7f55440a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5540000c00 tx=0x7f5540032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.565+0000 7f555c96a640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] conn(0x7f55440ac460 0x7f55440ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.566+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== osd.6 v2:172.21.15.100:6818/4163564084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f554801de50 con 0x7f55440ac460 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.579+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 --> [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5558062d80 con 0x7f55440ac460 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.579+0000 7f55557fa640 1 -- 172.21.15.100:0/4156248744 <== osd.6 v2:172.21.15.100:6818/4163564084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5558062d80 con 0x7f55440ac460 2024-09-12T02:37:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] conn(0x7f55440ac460 msgr2=0x7f55440ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] conn(0x7f55440ac460 0x7f55440ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f55440a2c10 msgr2=0x7f55440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f55440a2c10 0x7f55440a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5540000c00 tx=0x7f5540032c70 comp rx=0 tx=0).stop 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 msgr2=0x7f5558198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 --2- 172.21.15.100:0/4156248744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5558100a80 0x7f5558198400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f554800d950 tx=0x7f554800de10 comp rx=0 tx=0).stop 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555c96a640 1 -- 172.21.15.100:0/4156248744 reap_dead start 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 shutdown_connections 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 >> 172.21.15.100:0/4156248744 conn(0x7f55580fc7a0 msgr2=0x7f555806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 shutdown_connections 2024-09-12T02:37:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:29.580+0000 7f555e3cd640 1 -- 172.21.15.100:0/4156248744 wait complete. 2024-09-12T02:37:30.344 INFO:teuthology.orchestra.run.smithi100.stdout:188978561071 2024-09-12T02:37:30.344 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 -- 172.21.15.100:0/4214488061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684106a80 msgr2=0x7fb684106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 --2- 172.21.15.100:0/4214488061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684106a80 0x7fb684106e60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb674009930 tx=0x7fb67402a420 comp rx=0 tx=0).stop 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 -- 172.21.15.100:0/4214488061 shutdown_connections 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 --2- 172.21.15.100:0/4214488061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb684101420 0x7fb68410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 --2- 172.21.15.100:0/4214488061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb684100a80 0x7fb684100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 --2- 172.21.15.100:0/4214488061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684106a80 0x7fb684106e60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 -- 172.21.15.100:0/4214488061 >> 172.21.15.100:0/4214488061 conn(0x7fb6840fc7a0 msgr2=0x7fb6840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 -- 172.21.15.100:0/4214488061 shutdown_connections 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.730+0000 7fb68a072640 1 -- 172.21.15.100:0/4214488061 wait complete. 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 Processor -- start 2024-09-12T02:37:30.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 -- start start 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684100a80 0x7fb684198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb684101420 0x7fb684198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb684106a80 0x7fb68419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb684111fa0 con 0x7fb684100a80 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb684111e20 con 0x7fb684106a80 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb68a072640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb684112120 con 0x7fb684101420 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684100a80 0x7fb684198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684100a80 0x7fb684198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52954/0 (socket says 172.21.15.100:52954) 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 -- 172.21.15.100:0/803225791 learned_addr learned my addr 172.21.15.100:0/803225791 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb683fff640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb684106a80 0x7fb68419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 -- 172.21.15.100:0/803225791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb684101420 msgr2=0x7fb684198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb684101420 0x7fb684198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 -- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb684106a80 msgr2=0x7fb68419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb684106a80 0x7fb68419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.731+0000 7fb6837fe640 1 -- 172.21.15.100:0/803225791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68419d4d0 con 0x7fb684100a80 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.732+0000 7fb6837fe640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684100a80 0x7fb684198520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb674009230 tx=0x7fb674004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.732+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67403f030 con 0x7fb684100a80 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.732+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb674003ad0 con 0x7fb684100a80 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.732+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68419d760 con 0x7fb684100a80 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.732+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674035070 con 0x7fb684100a80 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.732+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6841a50a0 con 0x7fb684100a80 2024-09-12T02:37:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.733+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb684062980 con 0x7fb684100a80 2024-09-12T02:37:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.734+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb674042030 con 0x7fb684100a80 2024-09-12T02:37:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb6817fa640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6700a2c10 0x7fb6700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb67affd640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6700a2c10 0x7fb6700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb6740ef9f0 con 0x7fb684100a80 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb6817fa640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] conn(0x7fb6700ac460 0x7fb6700ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 --> [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6700aef30 con 0x7fb6700ac460 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb6740efed0 con 0x7fb684100a80 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb67affd640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6700a2c10 0x7fb6700a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6840fee20 tx=0x7fb66c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.735+0000 7fb683fff640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] conn(0x7fb6700ac460 0x7fb6700ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.736+0000 7fb683fff640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] conn(0x7fb6700ac460 0x7fb6700ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.737+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== osd.7 v2:172.21.15.117:6816/3414657732 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6700aef30 con 0x7fb6700ac460 2024-09-12T02:37:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.751+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 --> [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb684062e00 con 0x7fb6700ac460 2024-09-12T02:37:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.751+0000 7fb6817fa640 1 -- 172.21.15.100:0/803225791 <== osd.7 v2:172.21.15.117:6816/3414657732 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb684062e00 con 0x7fb6700ac460 2024-09-12T02:37:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] conn(0x7fb6700ac460 msgr2=0x7fb6700ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] conn(0x7fb6700ac460 0x7fb6700ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6700a2c10 msgr2=0x7fb6700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6700a2c10 0x7fb6700a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6840fee20 tx=0x7fb66c006c90 comp rx=0 tx=0).stop 2024-09-12T02:37:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684100a80 msgr2=0x7fb684198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 --2- 172.21.15.100:0/803225791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684100a80 0x7fb684198520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb674009230 tx=0x7fb674004270 comp rx=0 tx=0).stop 2024-09-12T02:37:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb683fff640 1 -- 172.21.15.100:0/803225791 reap_dead start 2024-09-12T02:37:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 shutdown_connections 2024-09-12T02:37:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 >> 172.21.15.100:0/803225791 conn(0x7fb6840fc7a0 msgr2=0x7fb6840fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 shutdown_connections 2024-09-12T02:37:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:30.752+0000 7fb68a072640 1 -- 172.21.15.100:0/803225791 wait complete. 2024-09-12T02:37:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:30 smithi100 ceph-mon[31390]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T02:37:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:30 smithi189 ceph-mon[35196]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T02:37:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:30 smithi117 ceph-mon[34898]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 -- 172.21.15.100:0/1833093568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970102570 msgr2=0x7f59701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 --2- 172.21.15.100:0/1833093568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970102570 0x7f59701029b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f596402a480 comp rx=0 tx=0).stop 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 -- 172.21.15.100:0/1833093568 shutdown_connections 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 --2- 172.21.15.100:0/1833093568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5970102ef0 0x7f597010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 --2- 172.21.15.100:0/1833093568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970102570 0x7f59701029b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 --2- 172.21.15.100:0/1833093568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5970100e20 0x7f5970101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 -- 172.21.15.100:0/1833093568 >> 172.21.15.100:0/1833093568 conn(0x7f59700fc7d0 msgr2=0x7f59700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 -- 172.21.15.100:0/1833093568 shutdown_connections 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 -- 172.21.15.100:0/1833093568 wait complete. 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.393+0000 7f5974c60640 1 Processor -- start 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 -- start start 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970100e20 0x7f59701994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5970102570 0x7f59701999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5970102ef0 0x7f59701a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5970111020 con 0x7f5970100e20 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5970110ea0 con 0x7f5970102ef0 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59701111a0 con 0x7f5970102570 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970100e20 0x7f59701994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970100e20 0x7f59701994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52966/0 (socket says 172.21.15.100:52966) 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 -- 172.21.15.100:0/562286711 learned_addr learned my addr 172.21.15.100:0/562286711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596dd9b640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5970102570 0x7f59701999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596ed9d640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5970102ef0 0x7f59701a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 -- 172.21.15.100:0/562286711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5970102570 msgr2=0x7f59701999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5970102570 0x7f59701999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 -- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5970102ef0 msgr2=0x7f59701a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5970102ef0 0x7f59701a4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 -- 172.21.15.100:0/562286711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59701a4a70 con 0x7f5970100e20 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596ed9d640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5970102ef0 0x7f59701a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f596e59c640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970100e20 0x7f59701994b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f596000b4a0 tx=0x7f596000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960014070 con 0x7f5970100e20 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5960010af0 con 0x7f5970100e20 2024-09-12T02:37:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960017d10 con 0x7f5970100e20 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.394+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59701a4c40 con 0x7f5970100e20 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.395+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59701a5100 con 0x7f5970100e20 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.395+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5970062900 con 0x7f5970100e20 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.397+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5960017070 con 0x7f5970100e20 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.397+0000 7f595f7fe640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f59580a2c10 0x7f59580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.397+0000 7f596dd9b640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f59580a2c10 0x7f59580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.397+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f59600ce390 con 0x7f5970100e20 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.397+0000 7f595f7fe640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] conn(0x7f59580ac460 0x7f59580ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.397+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 --> [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59580aef30 con 0x7f59580ac460 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.397+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f59600d5050 con 0x7f5970100e20 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.398+0000 7f596dd9b640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f59580a2c10 0x7f59580a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f597006aac0 tx=0x7f5964005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.398+0000 7f596ed9d640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] conn(0x7f59580ac460 0x7f59580ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.398+0000 7f596ed9d640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] conn(0x7f59580ac460 0x7f59580ae880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.399+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== osd.10 v2:172.21.15.117:6824/1425929388 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59580aef30 con 0x7f59580ac460 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.412+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 --> [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5970062d80 con 0x7f59580ac460 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f595f7fe640 1 -- 172.21.15.100:0/562286711 <== osd.10 v2:172.21.15.117:6824/1425929388 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5970062d80 con 0x7f59580ac460 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] conn(0x7f59580ac460 msgr2=0x7f59580ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] conn(0x7f59580ac460 0x7f59580ae880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f59580a2c10 msgr2=0x7f59580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f59580a2c10 0x7f59580a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f597006aac0 tx=0x7f5964005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:31.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970100e20 msgr2=0x7f59701994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 --2- 172.21.15.100:0/562286711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5970100e20 0x7f59701994b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f596000b4a0 tx=0x7f596000b960 comp rx=0 tx=0).stop 2024-09-12T02:37:31.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f596ed9d640 1 -- 172.21.15.100:0/562286711 reap_dead start 2024-09-12T02:37:31.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 shutdown_connections 2024-09-12T02:37:31.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 >> 172.21.15.100:0/562286711 conn(0x7f59700fc7d0 msgr2=0x7f59700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:31.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 shutdown_connections 2024-09-12T02:37:31.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.413+0000 7f5974c60640 1 -- 172.21.15.100:0/562286711 wait complete. 2024-09-12T02:37:31.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 -- 172.21.15.100:0/3622676724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe770074510 msgr2=0x7fe7700748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 --2- 172.21.15.100:0/3622676724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe770074510 0x7fe7700748f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe760009900 tx=0x7fe76002a480 comp rx=0 tx=0).stop 2024-09-12T02:37:31.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 -- 172.21.15.100:0/3622676724 shutdown_connections 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 --2- 172.21.15.100:0/3622676724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe77010e440 0x7fe770110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 --2- 172.21.15.100:0/3622676724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe770074e30 0x7fe77010df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 --2- 172.21.15.100:0/3622676724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe770074510 0x7fe7700748f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 -- 172.21.15.100:0/3622676724 >> 172.21.15.100:0/3622676724 conn(0x7fe7700fd8c0 msgr2=0x7fe7700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 -- 172.21.15.100:0/3622676724 shutdown_connections 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 -- 172.21.15.100:0/3622676724 wait complete. 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.820+0000 7fe774ee7640 1 Processor -- start 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe774ee7640 1 -- start start 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe774ee7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe770074510 0x7fe77019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe774ee7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe770074e30 0x7fe77019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe774ee7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe77010e440 0x7fe77019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe774ee7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe7701141e0 con 0x7fe77010e440 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe774ee7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe770114060 con 0x7fe770074e30 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe774ee7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe770114360 con 0x7fe770074510 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe77010e440 0x7fe77019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe77010e440 0x7fe77019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52976/0 (socket says 172.21.15.100:52976) 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 -- 172.21.15.100:0/2055636215 learned_addr learned my addr 172.21.15.100:0/2055636215 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76dd9b640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe770074e30 0x7fe77019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76e59c640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe770074510 0x7fe77019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 -- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe770074510 msgr2=0x7fe77019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe770074510 0x7fe77019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 -- 172.21.15.100:0/2055636215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe770074e30 msgr2=0x7fe77019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe770074e30 0x7fe77019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 -- 172.21.15.100:0/2055636215 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77019f690 con 0x7fe77010e440 2024-09-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76e59c640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe770074510 0x7fe77019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.821+0000 7fe76ed9d640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe77010e440 0x7fe77019efb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe76800b9e0 tx=0x7fe76800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.822+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768019070 con 0x7fe77010e440 2024-09-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.822+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe768014440 con 0x7fe77010e440 2024-09-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.822+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7680125c0 con 0x7fe77010e440 2024-09-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.822+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77019f980 con 0x7fe77010e440 2024-09-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.822+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7701a7260 con 0x7fe77010e440 2024-09-12T02:37:31.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.823+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe770062980 con 0x7fe77010e440 2024-09-12T02:37:31.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.824+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe76801c070 con 0x7fe77010e440 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.824+0000 7fe75f7fe640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe7580a2c90 0x7fe7580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.825+0000 7fe76e59c640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe7580a2c90 0x7fe7580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.825+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe7680cebc0 con 0x7fe77010e440 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.825+0000 7fe75f7fe640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] conn(0x7fe7580ac4e0 0x7fe7580ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.825+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 --> [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7580aefb0 con 0x7fe7580ac4e0 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.825+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe7680cf0a0 con 0x7fe77010e440 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.825+0000 7fe76e59c640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe7580a2c90 0x7fe7580a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe760000c00 tx=0x7fe760032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.825+0000 7fe76dd9b640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] conn(0x7fe7580ac4e0 0x7fe7580ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.826+0000 7fe76dd9b640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] conn(0x7fe7580ac4e0 0x7fe7580ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.827+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== osd.8 v2:172.21.15.189:6816/4129547978 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7580aefb0 con 0x7fe7580ac4e0 2024-09-12T02:37:31.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.840+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 --> [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe770062d80 con 0x7fe7580ac4e0 2024-09-12T02:37:31.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.841+0000 7fe75f7fe640 1 -- 172.21.15.100:0/2055636215 <== osd.8 v2:172.21.15.189:6816/4129547978 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe770062d80 con 0x7fe7580ac4e0 2024-09-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.841+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] conn(0x7fe7580ac4e0 msgr2=0x7fe7580ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.841+0000 7fe774ee7640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] conn(0x7fe7580ac4e0 0x7fe7580ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe7580a2c90 msgr2=0x7fe7580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe7580a2c90 0x7fe7580a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe760000c00 tx=0x7fe760032c70 comp rx=0 tx=0).stop 2024-09-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe77010e440 msgr2=0x7fe77019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 --2- 172.21.15.100:0/2055636215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe77010e440 0x7fe77019efb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe76800b9e0 tx=0x7fe76800bea0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe76ed9d640 1 -- 172.21.15.100:0/2055636215 reap_dead start 2024-09-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 shutdown_connections 2024-09-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 >> 172.21.15.100:0/2055636215 conn(0x7fe7700fd8c0 msgr2=0x7fe7700fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 shutdown_connections 2024-09-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:31.842+0000 7fe774ee7640 1 -- 172.21.15.100:0/2055636215 wait complete. 2024-09-12T02:37:32.389 INFO:teuthology.orchestra.run.smithi100.stdout:34359738444 2024-09-12T02:37:32.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T02:37:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 -- 172.21.15.100:0/2857806203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb01036e0 msgr2=0x7f6bb0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 --2- 172.21.15.100:0/2857806203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb01036e0 0x7f6bb0107b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009930 tx=0x7f6bac02a420 comp rx=0 tx=0).stop 2024-09-12T02:37:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 -- 172.21.15.100:0/2857806203 shutdown_connections 2024-09-12T02:37:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 --2- 172.21.15.100:0/2857806203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb01082a0 0x7f6bb010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 --2- 172.21.15.100:0/2857806203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb01036e0 0x7f6bb0107b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 --2- 172.21.15.100:0/2857806203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb0102d30 0x7f6bb0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 -- 172.21.15.100:0/2857806203 >> 172.21.15.100:0/2857806203 conn(0x7f6bb00fc7d0 msgr2=0x7f6bb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 -- 172.21.15.100:0/2857806203 shutdown_connections 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.536+0000 7f6bb8282640 1 -- 172.21.15.100:0/2857806203 wait complete. 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 Processor -- start 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 -- start start 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb0102d30 0x7f6bb01a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb01036e0 0x7f6bb01a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb01082a0 0x7f6bb019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb01120c0 con 0x7f6bb0102d30 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0111f40 con 0x7f6bb01082a0 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb8282640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0112240 con 0x7f6bb01036e0 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb0102d30 0x7f6bb01a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb0102d30 0x7f6bb01a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53004/0 (socket says 172.21.15.100:53004) 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 -- 172.21.15.100:0/2695408951 learned_addr learned my addr 172.21.15.100:0/2695408951 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb681f640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb01082a0 0x7f6bb019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb581d640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb01036e0 0x7f6bb01a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 -- 172.21.15.100:0/2695408951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb01036e0 msgr2=0x7f6bb01a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bb01036e0 0x7f6bb01a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 -- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb01082a0 msgr2=0x7f6bb019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb01082a0 0x7f6bb019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 -- 172.21.15.100:0/2695408951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb019aea0 con 0x7f6bb0102d30 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.537+0000 7f6bb601e640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb0102d30 0x7f6bb01a0560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d950 tx=0x7f6ba400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.538+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4017030 con 0x7f6bb0102d30 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.538+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb019b190 con 0x7f6bb0102d30 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.538+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ba4004020 con 0x7f6bb0102d30 2024-09-12T02:37:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.538+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40047a0 con 0x7f6bb0102d30 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.538+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb01a74e0 con 0x7f6bb0102d30 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.538+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bb0062940 con 0x7f6bb0102d30 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.540+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6ba40041d0 con 0x7f6bb0102d30 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6ba37fe640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6b9c0a2c10 0x7f6b9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6bb581d640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6b9c0a2c10 0x7f6b9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f6ba40cf0f0 con 0x7f6bb0102d30 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6ba37fe640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] conn(0x7f6b9c0ac460 0x7f6b9c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 --> [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b9c0aef30 con 0x7f6b9c0ac460 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f6ba40cf5d0 con 0x7f6bb0102d30 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6bb581d640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6b9c0a2c10 0x7f6b9c0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009900 tx=0x7f6bac032d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6bb681f640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] conn(0x7f6b9c0ac460 0x7f6b9c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.541+0000 7f6bb681f640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] conn(0x7f6b9c0ac460 0x7f6b9c0ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.542+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== osd.1 v2:172.21.15.117:6800/3983495954 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b9c0aef30 con 0x7f6b9c0ac460 2024-09-12T02:37:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.571+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 --> [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bb0062d40 con 0x7f6b9c0ac460 2024-09-12T02:37:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.572+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2695408951 <== osd.1 v2:172.21.15.117:6800/3983495954 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6bb0062d40 con 0x7f6b9c0ac460 2024-09-12T02:37:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.574+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] conn(0x7f6b9c0ac460 msgr2=0x7f6b9c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.574+0000 7f6bb8282640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] conn(0x7f6b9c0ac460 0x7f6b9c0ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.575+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6b9c0a2c10 msgr2=0x7f6b9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.575+0000 7f6bb8282640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6b9c0a2c10 0x7f6b9c0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009900 tx=0x7f6bac032d10 comp rx=0 tx=0).stop 2024-09-12T02:37:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.575+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb0102d30 msgr2=0x7f6bb01a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.575+0000 7f6bb8282640 1 --2- 172.21.15.100:0/2695408951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb0102d30 0x7f6bb01a0560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d950 tx=0x7f6ba400de10 comp rx=0 tx=0).stop 2024-09-12T02:37:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.575+0000 7f6bb681f640 1 -- 172.21.15.100:0/2695408951 reap_dead start 2024-09-12T02:37:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.576+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 shutdown_connections 2024-09-12T02:37:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.576+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 >> 172.21.15.100:0/2695408951 conn(0x7f6bb00fc7d0 msgr2=0x7f6bb0100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.576+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 shutdown_connections 2024-09-12T02:37:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:32.576+0000 7f6bb8282640 1 -- 172.21.15.100:0/2695408951 wait complete. 2024-09-12T02:37:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:32 smithi100 ceph-mon[31390]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T02:37:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:32 smithi189 ceph-mon[35196]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T02:37:33.020 INFO:teuthology.orchestra.run.smithi100.stdout:326417514516 2024-09-12T02:37:33.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T02:37:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:32 smithi117 ceph-mon[34898]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T02:37:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/1657779910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 msgr2=0x7fd89c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 --2- 172.21.15.100:0/1657779910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 0x7fd89c1063d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd894009ca0 tx=0x7fd89402a940 comp rx=0 tx=0).stop 2024-09-12T02:37:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/1657779910 shutdown_connections 2024-09-12T02:37:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 --2- 172.21.15.100:0/1657779910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 0x7fd89c1063d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 --2- 172.21.15.100:0/1657779910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd89c101450 0x7fd89c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 --2- 172.21.15.100:0/1657779910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd89c100b30 0x7fd89c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/1657779910 >> 172.21.15.100:0/1657779910 conn(0x7fd89c0fc7a0 msgr2=0x7fd89c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/1657779910 shutdown_connections 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.238+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/1657779910 wait complete. 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 Processor -- start 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 -- start start 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd89c100b30 0x7fd89c1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd89c101450 0x7fd89c1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 0x7fd89c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c118560 con 0x7fd89c105f40 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c1183e0 con 0x7fd89c100b30 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.239+0000 7fd8a0cdd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c1186e0 con 0x7fd89c101450 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 0x7fd89c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 0x7fd89c19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53036/0 (socket says 172.21.15.100:53036) 2024-09-12T02:37:33.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 -- 172.21.15.100:0/3248697252 learned_addr learned my addr 172.21.15.100:0/3248697252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89a59c640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd89c100b30 0x7fd89c1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd893fff640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd89c101450 0x7fd89c1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 -- 172.21.15.100:0/3248697252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd89c101450 msgr2=0x7fd89c1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd89c101450 0x7fd89c1a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 -- 172.21.15.100:0/3248697252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd89c100b30 msgr2=0x7fd89c1a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd89c100b30 0x7fd89c1a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 -- 172.21.15.100:0/3248697252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c19efc0 con 0x7fd89c105f40 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd89ad9d640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 0x7fd89c19e820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd894006010 tx=0x7fd89402f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894034040 con 0x7fd89c105f40 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c19f250 con 0x7fd89c105f40 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd894003e50 con 0x7fd89c105f40 2024-09-12T02:37:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8940047c0 con 0x7fd89c105f40 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.240+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c1ab500 con 0x7fd89c105f40 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.241+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd89c1052e0 con 0x7fd89c105f40 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.242+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd894037020 con 0x7fd89c105f40 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.243+0000 7fd8937fe640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8880a2c10 0x7fd8880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.243+0000 7fd89a59c640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8880a2c10 0x7fd8880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.243+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd8940f04c0 con 0x7fd89c105f40 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.243+0000 7fd8937fe640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] conn(0x7fd8880ac460 0x7fd8880ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.243+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 --> [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8880aef30 con 0x7fd8880ac460 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.243+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd8940f0870 con 0x7fd89c105f40 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.244+0000 7fd893fff640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] conn(0x7fd8880ac460 0x7fd8880ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.244+0000 7fd89a59c640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8880a2c10 0x7fd8880a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00abe0 tx=0x7fd88c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.244+0000 7fd893fff640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] conn(0x7fd8880ac460 0x7fd8880ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.245+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== osd.3 v2:172.21.15.100:6810/379828632 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8880aef30 con 0x7fd8880ac460 2024-09-12T02:37:33.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 --> [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd89c06b070 con 0x7fd8880ac460 2024-09-12T02:37:33.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8937fe640 1 -- 172.21.15.100:0/3248697252 <== osd.3 v2:172.21.15.100:6810/379828632 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd89c06b070 con 0x7fd8880ac460 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] conn(0x7fd8880ac460 msgr2=0x7fd8880ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] conn(0x7fd8880ac460 0x7fd8880ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8880a2c10 msgr2=0x7fd8880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd8880a2c10 0x7fd8880a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00abe0 tx=0x7fd88c00a2d0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 msgr2=0x7fd89c19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 --2- 172.21.15.100:0/3248697252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd89c105f40 0x7fd89c19e820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd894006010 tx=0x7fd89402f700 comp rx=0 tx=0).stop 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd89ad9d640 1 -- 172.21.15.100:0/3248697252 reap_dead start 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 shutdown_connections 2024-09-12T02:37:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 >> 172.21.15.100:0/3248697252 conn(0x7fd89c0fc7a0 msgr2=0x7fd89c1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 shutdown_connections 2024-09-12T02:37:33.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.260+0000 7fd8a0cdd640 1 -- 172.21.15.100:0/3248697252 wait complete. 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.442+0000 7f851a629640 1 -- 172.21.15.100:0/3344854821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8514102de0 msgr2=0x7f85141031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.442+0000 7f851a629640 1 --2- 172.21.15.100:0/3344854821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8514102de0 0x7f85141031c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8504009900 tx=0x7f850402a480 comp rx=0 tx=0).stop 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- 172.21.15.100:0/3344854821 shutdown_connections 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 --2- 172.21.15.100:0/3344854821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851410c180 0x7f851410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 --2- 172.21.15.100:0/3344854821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8514103700 0x7f851410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 --2- 172.21.15.100:0/3344854821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8514102de0 0x7f85141031c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- 172.21.15.100:0/3344854821 >> 172.21.15.100:0/3344854821 conn(0x7f85140fc7a0 msgr2=0x7f85140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- 172.21.15.100:0/3344854821 shutdown_connections 2024-09-12T02:37:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- 172.21.15.100:0/3344854821 wait complete. 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 Processor -- start 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- start start 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8514102de0 0x7f85141985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8514103700 0x7f8514198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851410c180 0x7f851419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8514112030 con 0x7f851410c180 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8514111eb0 con 0x7f8514102de0 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f851a629640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85141121b0 con 0x7f8514103700 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.443+0000 7f8518bc6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851410c180 0x7f851419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851410c180 0x7f851419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53058/0 (socket says 172.21.15.100:53058) 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 -- 172.21.15.100:0/1435606074 learned_addr learned my addr 172.21.15.100:0/1435606074 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8513fff640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8514102de0 0x7f85141985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f850bfff640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8514103700 0x7f8514198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 -- 172.21.15.100:0/1435606074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8514103700 msgr2=0x7f8514198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8514103700 0x7f8514198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 -- 172.21.15.100:0/1435606074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8514102de0 msgr2=0x7f85141985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8514102de0 0x7f85141985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 -- 172.21.15.100:0/1435606074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851419d560 con 0x7f851410c180 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8518bc6640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851410c180 0x7f851419ce80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f850c00b970 tx=0x7f850c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c019070 con 0x7f851410c180 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851419d850 con 0x7f851410c180 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c014440 con 0x7f851410c180 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c0075d0 con 0x7f851410c180 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.444+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85141a5130 con 0x7f851410c180 2024-09-12T02:37:33.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.445+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8514062980 con 0x7f851410c180 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.446+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f850c01c070 con 0x7f851410c180 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f8511ffb640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85000a2c10 0x7f85000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f8513fff640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85000a2c10 0x7f85000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f850c0cec80 con 0x7f851410c180 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f8511ffb640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] conn(0x7f85000ac460 0x7f85000ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 --> [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85000aef30 con 0x7f85000ac460 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f850c0cf160 con 0x7f851410c180 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f850bfff640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] conn(0x7f85000ac460 0x7f85000ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.447+0000 7f8513fff640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85000a2c10 0x7f85000a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8504000c00 tx=0x7f85040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.448+0000 7f850bfff640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] conn(0x7f85000ac460 0x7f85000ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.448+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== osd.9 v2:172.21.15.100:6826/4123309490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85000aef30 con 0x7f85000ac460 2024-09-12T02:37:33.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 --> [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8514062e00 con 0x7f85000ac460 2024-09-12T02:37:33.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f8511ffb640 1 -- 172.21.15.100:0/1435606074 <== osd.9 v2:172.21.15.100:6826/4123309490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8514062e00 con 0x7f85000ac460 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] conn(0x7f85000ac460 msgr2=0x7f85000ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] conn(0x7f85000ac460 0x7f85000ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85000a2c10 msgr2=0x7f85000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f85000a2c10 0x7f85000a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8504000c00 tx=0x7f85040058d0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851410c180 msgr2=0x7f851419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 --2- 172.21.15.100:0/1435606074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851410c180 0x7f851419ce80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f850c00b970 tx=0x7f850c00bd70 comp rx=0 tx=0).stop 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f8518bc6640 1 -- 172.21.15.100:0/1435606074 reap_dead start 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 shutdown_connections 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 >> 172.21.15.100:0/1435606074 conn(0x7f85140fc7a0 msgr2=0x7f85140fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 shutdown_connections 2024-09-12T02:37:33.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:33.462+0000 7f851a629640 1 -- 172.21.15.100:0/1435606074 wait complete. 2024-09-12T02:37:34.503 INFO:teuthology.orchestra.run.smithi100.stdout:240518168613 2024-09-12T02:37:34.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T02:37:34.806 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:34 smithi100 ceph-mon[31390]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:34 smithi189 ceph-mon[35196]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:34 smithi117 ceph-mon[34898]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:35.163 INFO:teuthology.orchestra.run.smithi100.stdout:107374182461 2024-09-12T02:37:35.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T02:37:35.553 INFO:teuthology.orchestra.run.smithi100.stdout:210453397547 2024-09-12T02:37:35.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T02:37:36.048 INFO:teuthology.orchestra.run.smithi100.stdout:158913790003 2024-09-12T02:37:36.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T02:37:36.661 INFO:teuthology.orchestra.run.smithi100.stdout:55834574921 2024-09-12T02:37:36.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T02:37:36.895 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:36 smithi117 ceph-mon[34898]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:36 smithi189 ceph-mon[35196]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:36 smithi100 ceph-mon[31390]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi100.stdout:296352743451 2024-09-12T02:37:37.147 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T02:37:37.164 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:37.654 INFO:teuthology.orchestra.run.smithi100.stdout:274877906977 2024-09-12T02:37:37.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T02:37:37.747 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:37.752 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:37.752 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:37.753 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:37.753 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:38.787 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:38 smithi100 ceph-mon[31390]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:38 smithi189 ceph-mon[35196]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:38 smithi117 ceph-mon[34898]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 -- 172.21.15.100:0/1384773047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144102570 msgr2=0x7f01441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1384773047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144102570 0x7f01441029b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f012c009900 tx=0x7f012c02a480 comp rx=0 tx=0).stop 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 -- 172.21.15.100:0/1384773047 shutdown_connections 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1384773047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0144102ef0 0x7f014410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1384773047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144102570 0x7f01441029b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1384773047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0144100e20 0x7f0144101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 -- 172.21.15.100:0/1384773047 >> 172.21.15.100:0/1384773047 conn(0x7f01440fc7d0 msgr2=0x7f01440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 -- 172.21.15.100:0/1384773047 shutdown_connections 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.094+0000 7f0149f7c640 1 -- 172.21.15.100:0/1384773047 wait complete. 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 Processor -- start 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 -- start start 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144100e20 0x7f01440fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0144102570 0x7f01440fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0144102ef0 0x7f01440fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0144110fc0 con 0x7f0144100e20 2024-09-12T02:37:39.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0144110e40 con 0x7f0144102ef0 2024-09-12T02:37:39.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0149f7c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0144111140 con 0x7f0144102570 2024-09-12T02:37:39.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144100e20 0x7f01440fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144100e20 0x7f01440fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46042/0 (socket says 172.21.15.100:46042) 2024-09-12T02:37:39.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 -- 172.21.15.100:0/1695179932 learned_addr learned my addr 172.21.15.100:0/1695179932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:39.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0143fff640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0144102ef0 0x7f01440fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f013bfff640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0144102570 0x7f01440fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 -- 172.21.15.100:0/1695179932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0144102570 msgr2=0x7f01440fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0144102570 0x7f01440fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 -- 172.21.15.100:0/1695179932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0144102ef0 msgr2=0x7f01440fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0144102ef0 0x7f01440fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f01437fe640 1 -- 172.21.15.100:0/1695179932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01441a6a40 con 0x7f0144100e20 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.095+0000 7f0143fff640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0144102ef0 0x7f01440fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.096+0000 7f01437fe640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144100e20 0x7f01440fcc80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f013400d770 tx=0x7f013400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.096+0000 7f01417fa640 1 -- 172.21.15.100:0/1695179932 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134017070 con 0x7f0144100e20 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.096+0000 7f01417fa640 1 -- 172.21.15.100:0/1695179932 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0134005500 con 0x7f0144100e20 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.096+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01441a6d30 con 0x7f0144100e20 2024-09-12T02:37:39.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.096+0000 7f01417fa640 1 -- 172.21.15.100:0/1695179932 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134004e00 con 0x7f0144100e20 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.096+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01441a71c0 con 0x7f0144100e20 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.097+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0144101200 con 0x7f0144100e20 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.098+0000 7f01417fa640 1 -- 172.21.15.100:0/1695179932 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0134004fa0 con 0x7f0144100e20 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.099+0000 7f01417fa640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01300a2c10 0x7f01300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.099+0000 7f013bfff640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01300a2c10 0x7f01300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.099+0000 7f01417fa640 1 -- 172.21.15.100:0/1695179932 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f01340ceb50 con 0x7f0144100e20 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.099+0000 7f013bfff640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01300a2c10 0x7f01300a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01440fe710 tx=0x7f012c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.103+0000 7f01417fa640 1 -- 172.21.15.100:0/1695179932 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f013409bb00 con 0x7f0144100e20 2024-09-12T02:37:39.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.301+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f014410a0d0 con 0x7f0144100e20 2024-09-12T02:37:39.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.301+0000 7f01417fa640 1 -- 172.21.15.100:0/1695179932 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f013409b400 con 0x7f0144100e20 2024-09-12T02:37:39.303 INFO:teuthology.orchestra.run.smithi100.stdout:210453397548 2024-09-12T02:37:39.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01300a2c10 msgr2=0x7f01300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01300a2c10 0x7f01300a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01440fe710 tx=0x7f012c005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:39.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144100e20 msgr2=0x7f01440fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144100e20 0x7f01440fcc80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f013400d770 tx=0x7f013400dc30 comp rx=0 tx=0).stop 2024-09-12T02:37:39.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 shutdown_connections 2024-09-12T02:37:39.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01300a2c10 0x7f01300a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0144102ef0 0x7f01440fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0144102570 0x7f01440fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 --2- 172.21.15.100:0/1695179932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0144100e20 0x7f01440fcc80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 >> 172.21.15.100:0/1695179932 conn(0x7f01440fc7d0 msgr2=0x7f014406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 shutdown_connections 2024-09-12T02:37:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.303+0000 7f0149f7c640 1 -- 172.21.15.100:0/1695179932 wait complete. 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 -- 172.21.15.100:0/3412763867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8102ef0 msgr2=0x7fd9c810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/3412763867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8102ef0 0x7fd9c810da40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009ca0 tx=0x7fd9c002a950 comp rx=0 tx=0).stop 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 -- 172.21.15.100:0/3412763867 shutdown_connections 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/3412763867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8102ef0 0x7fd9c810da40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/3412763867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c8102570 0x7fd9c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/3412763867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8100e20 0x7fd9c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 -- 172.21.15.100:0/3412763867 >> 172.21.15.100:0/3412763867 conn(0x7fd9c80fc7d0 msgr2=0x7fd9c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 -- 172.21.15.100:0/3412763867 shutdown_connections 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.993+0000 7fd9cc89d640 1 -- 172.21.15.100:0/3412763867 wait complete. 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 Processor -- start 2024-09-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 -- start start 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8100e20 0x7fd9c8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8102570 0x7fd9c8199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c8102ef0 0x7fd9c81a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c8110fa0 con 0x7fd9c8100e20 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c8110e20 con 0x7fd9c8102ef0 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9cc89d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c8111120 con 0x7fd9c8102570 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.994+0000 7fd9c659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8100e20 0x7fd9c8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8100e20 0x7fd9c8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46010/0 (socket says 172.21.15.100:46010) 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 -- 172.21.15.100:0/2122667291 learned_addr learned my addr 172.21.15.100:0/2122667291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9bffff640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8102570 0x7fd9c8199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c6d9d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c8102ef0 0x7fd9c81a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 -- 172.21.15.100:0/2122667291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8102570 msgr2=0x7fd9c8199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8102570 0x7fd9c8199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi100.stdout:34359738447 2024-09-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 -- 172.21.15.100:0/2122667291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c8102ef0 msgr2=0x7fd9c81a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c8102ef0 0x7fd9c81a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 -- 172.21.15.100:0/2122667291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c81a4910 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9bffff640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8102570 0x7fd9c8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c6d9d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c8102ef0 0x7fd9c81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9c659c640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8100e20 0x7fd9c8199350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800b4a0 tx=0x7fd9b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9bf7fe640 1 -- 172.21.15.100:0/2122667291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8014070 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c81a4ae0 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9bf7fe640 1 -- 172.21.15.100:0/2122667291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9b8010af0 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9bf7fe640 1 -- 172.21.15.100:0/2122667291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8017d10 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.995+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c81a5020 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.996+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c8101200 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.997+0000 7fd9bf7fe640 1 -- 172.21.15.100:0/2122667291 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd9b8017070 con 0x7fd9c8100e20 2024-09-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.998+0000 7fd9bf7fe640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9b40a2c10 0x7fd9b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.998+0000 7fd9bffff640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9b40a2c10 0x7fd9b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.998+0000 7fd9bf7fe640 1 -- 172.21.15.100:0/2122667291 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd9b80ce3b0 con 0x7fd9c8100e20 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:38.998+0000 7fd9bffff640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9b40a2c10 0x7fd9b40a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0005d00 tx=0x7fd9b0009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.002+0000 7fd9bf7fe640 1 -- 172.21.15.100:0/2122667291 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9b809b3f0 con 0x7fd9c8100e20 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.179+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd9c81a5250 con 0x7fd9c8100e20 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.179+0000 7fd9bf7fe640 1 -- 172.21.15.100:0/2122667291 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd9b809acf0 con 0x7fd9c8100e20 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9b40a2c10 msgr2=0x7fd9b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9b40a2c10 0x7fd9b40a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0005d00 tx=0x7fd9b0009550 comp rx=0 tx=0).stop 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8100e20 msgr2=0x7fd9c8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8100e20 0x7fd9c8199350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800b4a0 tx=0x7fd9b800b960 comp rx=0 tx=0).stop 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 shutdown_connections 2024-09-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd9b40a2c10 0x7fd9b40a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9c8102ef0 0x7fd9c81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8102570 0x7fd9c8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 --2- 172.21.15.100:0/2122667291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9c8100e20 0x7fd9c8199350 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 >> 172.21.15.100:0/2122667291 conn(0x7fd9c80fc7d0 msgr2=0x7fd9c8106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 shutdown_connections 2024-09-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:39.181+0000 7fd9cc89d640 1 -- 172.21.15.100:0/2122667291 wait complete. 2024-09-12T02:37:39.759 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:39 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2122667291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:37:39.759 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:39 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1695179932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:37:40.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:39 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2122667291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:37:40.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:39 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1695179932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:37:40.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:39 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2122667291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:37:40.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:39 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1695179932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:37:40.386 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738447 for osd.0 2024-09-12T02:37:40.386 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 -- 172.21.15.100:0/106151935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0106a80 msgr2=0x7f3ee0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/106151935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0106a80 0x7f3ee0106e60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009930 tx=0x7f3ed402a420 comp rx=0 tx=0).stop 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 -- 172.21.15.100:0/106151935 shutdown_connections 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/106151935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee0101420 0x7f3ee010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/106151935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee0100a80 0x7f3ee0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/106151935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0106a80 0x7f3ee0106e60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 -- 172.21.15.100:0/106151935 >> 172.21.15.100:0/106151935 conn(0x7f3ee00fc7a0 msgr2=0x7f3ee00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 -- 172.21.15.100:0/106151935 shutdown_connections 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.562+0000 7f3ee6c81640 1 -- 172.21.15.100:0/106151935 wait complete. 2024-09-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 Processor -- start 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 -- start start 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee0100a80 0x7f3ee01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0101420 0x7f3ee01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee0106a80 0x7f3ee019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee0110ec0 con 0x7f3ee0101420 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee0110d40 con 0x7f3ee0106a80 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee6c81640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee0111040 con 0x7f3ee0100a80 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3edffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0101420 0x7f3ee01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3edffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0101420 0x7f3ee01989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46058/0 (socket says 172.21.15.100:46058) 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3edffff640 1 -- 172.21.15.100:0/3250580053 learned_addr learned my addr 172.21.15.100:0/3250580053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee4a1d640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee0100a80 0x7f3ee01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.563+0000 7f3ee521e640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee0106a80 0x7f3ee019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3edffff640 1 -- 172.21.15.100:0/3250580053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee0100a80 msgr2=0x7f3ee01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3edffff640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee0100a80 0x7f3ee01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3edffff640 1 -- 172.21.15.100:0/3250580053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee0106a80 msgr2=0x7f3ee019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3edffff640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee0106a80 0x7f3ee019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3edffff640 1 -- 172.21.15.100:0/3250580053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee019d450 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3edffff640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0101420 0x7f3ee01989e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00b4a0 tx=0x7f3ecc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3eddffb640 1 -- 172.21.15.100:0/3250580053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc014070 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee019d740 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3eddffb640 1 -- 172.21.15.100:0/3250580053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ecc010af0 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3eddffb640 1 -- 172.21.15.100:0/3250580053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc017d10 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.564+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee01a5020 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.565+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee0100ee0 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.566+0000 7f3eddffb640 1 -- 172.21.15.100:0/3250580053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3ecc017070 con 0x7f3ee0101420 2024-09-12T02:37:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.567+0000 7f3eddffb640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.567+0000 7f3ee4a1d640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.567+0000 7f3eddffb640 1 -- 172.21.15.100:0/3250580053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f3ecc0ce230 con 0x7f3ee0101420 2024-09-12T02:37:40.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.567+0000 7f3ee4a1d640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009900 tx=0x7f3ed40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:40.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.571+0000 7f3eddffb640 1 -- 172.21.15.100:0/3250580053 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ecc09aca0 con 0x7f3ee0101420 2024-09-12T02:37:40.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.746+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f3ee0109a70 con 0x7f3ee0101420 2024-09-12T02:37:40.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.746+0000 7f3eddffb640 1 -- 172.21.15.100:0/3250580053 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3ecc09efa0 con 0x7f3ee0101420 2024-09-12T02:37:40.748 INFO:teuthology.orchestra.run.smithi100.stdout:240518168614 2024-09-12T02:37:40.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3ed00a2c10 msgr2=0x7f3ed00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009900 tx=0x7f3ed40058d0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0101420 msgr2=0x7f3ee01989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0101420 0x7f3ee01989e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00b4a0 tx=0x7f3ecc00b960 comp rx=0 tx=0).stop 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 shutdown_connections 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee0106a80 0x7f3ee019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ee0101420 0x7f3ee01989e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 --2- 172.21.15.100:0/3250580053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ee0100a80 0x7f3ee01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.748+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 >> 172.21.15.100:0/3250580053 conn(0x7f3ee00fc7a0 msgr2=0x7f3ee006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.749+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 shutdown_connections 2024-09-12T02:37:40.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.749+0000 7f3ee6c81640 1 -- 172.21.15.100:0/3250580053 wait complete. 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 -- 172.21.15.100:0/2371018734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 msgr2=0x7ff0401067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 --2- 172.21.15.100:0/2371018734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff0401067f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff030009900 tx=0x7ff03002a410 comp rx=0 tx=0).stop 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 -- 172.21.15.100:0/2371018734 shutdown_connections 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 --2- 172.21.15.100:0/2371018734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff040106f20 0x7ff04010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 --2- 172.21.15.100:0/2371018734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff0401067f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 --2- 172.21.15.100:0/2371018734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040101df0 0x7ff0401021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 -- 172.21.15.100:0/2371018734 >> 172.21.15.100:0/2371018734 conn(0x7ff0400fd8f0 msgr2=0x7ff0400ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 -- 172.21.15.100:0/2371018734 shutdown_connections 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 -- 172.21.15.100:0/2371018734 wait complete. 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.801+0000 7ff047427640 1 Processor -- start 2024-09-12T02:37:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff047427640 1 -- start start 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff047427640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040101df0 0x7ff040198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff047427640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff040198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff047427640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff040106f20 0x7ff04019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff047427640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff040111fa0 con 0x7ff0401027a0 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff047427640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff040111e20 con 0x7ff040101df0 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff047427640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff040112120 con 0x7ff040106f20 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff040198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff040198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46064/0 (socket says 172.21.15.100:46064) 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 -- 172.21.15.100:0/215714627 learned_addr learned my addr 172.21.15.100:0/215714627 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0451c3640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040101df0 0x7ff040198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0459c4640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff040106f20 0x7ff04019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 -- 172.21.15.100:0/215714627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff040106f20 msgr2=0x7ff04019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff040106f20 0x7ff04019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 -- 172.21.15.100:0/215714627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040101df0 msgr2=0x7ff040198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040101df0 0x7ff040198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 -- 172.21.15.100:0/215714627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04019d4d0 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.802+0000 7ff0449c2640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff040198a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff030006010 tx=0x7ff0300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.803+0000 7ff0367fc640 1 -- 172.21.15.100:0/215714627 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03003f030 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.803+0000 7ff0367fc640 1 -- 172.21.15.100:0/215714627 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff030003ce0 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.803+0000 7ff0367fc640 1 -- 172.21.15.100:0/215714627 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030035070 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.803+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04019d760 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.803+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0401a50a0 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.804+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0401021d0 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.805+0000 7ff0367fc640 1 -- 172.21.15.100:0/215714627 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff030042030 con 0x7ff0401027a0 2024-09-12T02:37:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.806+0000 7ff0367fc640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff02c0a2c90 0x7ff02c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.806+0000 7ff0451c3640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff02c0a2c90 0x7ff02c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.806+0000 7ff0367fc640 1 -- 172.21.15.100:0/215714627 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7ff0300ef8f0 con 0x7ff0401027a0 2024-09-12T02:37:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.806+0000 7ff0451c3640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff02c0a2c90 0x7ff02c0a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00bbe0 tx=0x7ff03c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.809+0000 7ff0367fc640 1 -- 172.21.15.100:0/215714627 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0300bc960 con 0x7ff0401027a0 2024-09-12T02:37:40.982 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:40 smithi100 ceph-mon[31390]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.981+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff04010a160 con 0x7ff0401027a0 2024-09-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.981+0000 7ff0367fc640 1 -- 172.21.15.100:0/215714627 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff0300bc260 con 0x7ff0401027a0 2024-09-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi100.stdout:137438953531 2024-09-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff02c0a2c90 msgr2=0x7ff02c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff02c0a2c90 0x7ff02c0a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00bbe0 tx=0x7ff03c00b390 comp rx=0 tx=0).stop 2024-09-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 msgr2=0x7ff040198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff040198a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff030006010 tx=0x7ff0300042f0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 shutdown_connections 2024-09-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff02c0a2c90 0x7ff02c0a5150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff040106f20 0x7ff04019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0401027a0 0x7ff040198a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 --2- 172.21.15.100:0/215714627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040101df0 0x7ff040198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 >> 172.21.15.100:0/215714627 conn(0x7ff0400fd8f0 msgr2=0x7ff0400fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 shutdown_connections 2024-09-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:40.984+0000 7ff047427640 1 -- 172.21.15.100:0/215714627 wait complete. 2024-09-12T02:37:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:40 smithi189 ceph-mon[35196]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:40 smithi117 ceph-mon[34898]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:41.739 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953529 got 137438953531 for osd.4 2024-09-12T02:37:41.739 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:41.903 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:41 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3250580053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:37:41.903 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:41 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/215714627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:37:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 -- 172.21.15.100:0/4107063267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102ef0 msgr2=0x7f010c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 --2- 172.21.15.100:0/4107063267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102ef0 0x7f010c10da40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0104009ca0 tx=0x7f010402a950 comp rx=0 tx=0).stop 2024-09-12T02:37:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 -- 172.21.15.100:0/4107063267 shutdown_connections 2024-09-12T02:37:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 --2- 172.21.15.100:0/4107063267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102ef0 0x7f010c10da40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 --2- 172.21.15.100:0/4107063267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f010c102570 0x7f010c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 --2- 172.21.15.100:0/4107063267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010c100e20 0x7f010c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 -- 172.21.15.100:0/4107063267 >> 172.21.15.100:0/4107063267 conn(0x7f010c0fc7d0 msgr2=0x7f010c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 -- 172.21.15.100:0/4107063267 shutdown_connections 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.899+0000 7f0111f49640 1 -- 172.21.15.100:0/4107063267 wait complete. 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 Processor -- start 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 -- start start 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f010c100e20 0x7f010c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102570 0x7f010c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010c102ef0 0x7f010c1a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f010c110f80 con 0x7f010c102570 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f010c110e00 con 0x7f010c102ef0 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0111f49640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f010c111100 con 0x7f010c100e20 2024-09-12T02:37:41.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102570 0x7f010c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102570 0x7f010c1997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46082/0 (socket says 172.21.15.100:46082) 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 -- 172.21.15.100:0/3394887229 learned_addr learned my addr 172.21.15.100:0/3394887229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f010b7fe640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f010c100e20 0x7f010c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f010bfff640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010c102ef0 0x7f010c1a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 -- 172.21.15.100:0/3394887229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f010c100e20 msgr2=0x7f010c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f010c100e20 0x7f010c199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 -- 172.21.15.100:0/3394887229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010c102ef0 msgr2=0x7f010c1a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010c102ef0 0x7f010c1a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.900+0000 7f0103fff640 1 -- 172.21.15.100:0/3394887229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c1a4830 con 0x7f010c102570 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.901+0000 7f0103fff640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102570 0x7f010c1997b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c920 tx=0x7f00f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.901+0000 7f01097fa640 1 -- 172.21.15.100:0/3394887229 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4007c70 con 0x7f010c102570 2024-09-12T02:37:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.901+0000 7f01097fa640 1 -- 172.21.15.100:0/3394887229 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00f4007e10 con 0x7f010c102570 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.901+0000 7f01097fa640 1 -- 172.21.15.100:0/3394887229 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4018890 con 0x7f010c102570 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.901+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010c1a4a00 con 0x7f010c102570 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.901+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010c1a4ec0 con 0x7f010c102570 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.902+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010c101200 con 0x7f010c102570 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.903+0000 7f01097fa640 1 -- 172.21.15.100:0/3394887229 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f00f4018a70 con 0x7f010c102570 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.903+0000 7f01097fa640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f00f80a2c10 0x7f00f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.904+0000 7f010b7fe640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f00f80a2c10 0x7f00f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.904+0000 7f01097fa640 1 -- 172.21.15.100:0/3394887229 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f00f40cf1a0 con 0x7f010c102570 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.904+0000 7f010b7fe640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f00f80a2c10 0x7f00f80a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009b60 tx=0x7f00fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:41.908+0000 7f01097fa640 1 -- 172.21.15.100:0/3394887229 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00f4014030 con 0x7f010c102570 2024-09-12T02:37:42.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:41 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3250580053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:37:42.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:41 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/215714627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:37:42.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.081+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f010c1a5150 con 0x7f010c102570 2024-09-12T02:37:42.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.081+0000 7f01097fa640 1 -- 172.21.15.100:0/3394887229 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f00f409c150 con 0x7f010c102570 2024-09-12T02:37:42.083 INFO:teuthology.orchestra.run.smithi100.stdout:158913790006 2024-09-12T02:37:42.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f00f80a2c10 msgr2=0x7f00f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f00f80a2c10 0x7f00f80a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009b60 tx=0x7f00fc005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102570 msgr2=0x7f010c1997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102570 0x7f010c1997b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c920 tx=0x7f00f400cde0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 shutdown_connections 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f00f80a2c10 0x7f00f80a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010c102ef0 0x7f010c1a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f010c102570 0x7f010c1997b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 --2- 172.21.15.100:0/3394887229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f010c100e20 0x7f010c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.083+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 >> 172.21.15.100:0/3394887229 conn(0x7f010c0fc7d0 msgr2=0x7f010c1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.084+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 shutdown_connections 2024-09-12T02:37:42.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.084+0000 7f0111f49640 1 -- 172.21.15.100:0/3394887229 wait complete. 2024-09-12T02:37:42.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:41 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3250580053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:37:42.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:41 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/215714627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:37:42.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 -- 172.21.15.100:0/663362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c102da0 msgr2=0x7f7f1c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 --2- 172.21.15.100:0/663362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c102da0 0x7f7f1c103180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009900 tx=0x7f7f1402a480 comp rx=0 tx=0).stop 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 -- 172.21.15.100:0/663362 shutdown_connections 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 --2- 172.21.15.100:0/663362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c10c180 0x7f7f1c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 --2- 172.21.15.100:0/663362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1c1036c0 0x7f7f1c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 --2- 172.21.15.100:0/663362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c102da0 0x7f7f1c103180 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 -- 172.21.15.100:0/663362 >> 172.21.15.100:0/663362 conn(0x7f7f1c0fc7a0 msgr2=0x7f7f1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 -- 172.21.15.100:0/663362 shutdown_connections 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.689+0000 7f7f237b4640 1 -- 172.21.15.100:0/663362 wait complete. 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 Processor -- start 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 -- start start 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c102da0 0x7f7f1c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1c1036c0 0x7f7f1c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c10c180 0x7f7f1c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c111f60 con 0x7f7f1c10c180 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c111de0 con 0x7f7f1c102da0 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f237b4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c1120e0 con 0x7f7f1c1036c0 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f21d51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c10c180 0x7f7f1c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f21d51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c10c180 0x7f7f1c19eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46088/0 (socket says 172.21.15.100:46088) 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f21d51640 1 -- 172.21.15.100:0/2843504601 learned_addr learned my addr 172.21.15.100:0/2843504601 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f21550640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c102da0 0x7f7f1c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.690+0000 7f7f20d4f640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1c1036c0 0x7f7f1c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f21d51640 1 -- 172.21.15.100:0/2843504601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1c1036c0 msgr2=0x7f7f1c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f21d51640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1c1036c0 0x7f7f1c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f21d51640 1 -- 172.21.15.100:0/2843504601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c102da0 msgr2=0x7f7f1c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f21d51640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c102da0 0x7f7f1c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f21d51640 1 -- 172.21.15.100:0/2843504601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1c19f5b0 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f21d51640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c10c180 0x7f7f1c19eed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800cce0 tx=0x7f7f1800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f0e7fc640 1 -- 172.21.15.100:0/2843504601 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800f450 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1c19f8a0 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f0e7fc640 1 -- 172.21.15.100:0/2843504601 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f1800fad0 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1c1a7180 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.691+0000 7f7f0e7fc640 1 -- 172.21.15.100:0/2843504601 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18018c10 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.692+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1c103180 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.693+0000 7f7f0e7fc640 1 -- 172.21.15.100:0/2843504601 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7f1800f5f0 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.694+0000 7f7f0e7fc640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f080a2c10 0x7f7f080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.694+0000 7f7f0e7fc640 1 -- 172.21.15.100:0/2843504601 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7f180cf5a0 con 0x7f7f1c10c180 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.694+0000 7f7f21550640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f080a2c10 0x7f7f080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.694+0000 7f7f21550640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f080a2c10 0x7f7f080a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009230 tx=0x7f7f140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:42.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.698+0000 7f7f0e7fc640 1 -- 172.21.15.100:0/2843504601 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f18014030 con 0x7f7f1c10c180 2024-09-12T02:37:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:42 smithi100 ceph-mon[31390]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:37:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:42 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3394887229' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:37:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.883+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7f1c1a7480 con 0x7f7f1c10c180 2024-09-12T02:37:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.883+0000 7f7f0e7fc640 1 -- 172.21.15.100:0/2843504601 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7f1809c550 con 0x7f7f1c10c180 2024-09-12T02:37:42.885 INFO:teuthology.orchestra.run.smithi100.stdout:326417514519 2024-09-12T02:37:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f080a2c10 msgr2=0x7f7f080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f080a2c10 0x7f7f080a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009230 tx=0x7f7f140058d0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c10c180 msgr2=0x7f7f1c19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c10c180 0x7f7f1c19eed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800cce0 tx=0x7f7f1800a620 comp rx=0 tx=0).stop 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 shutdown_connections 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f080a2c10 0x7f7f080a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c10c180 0x7f7f1c19eed0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1c1036c0 0x7f7f1c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 --2- 172.21.15.100:0/2843504601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c102da0 0x7f7f1c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 >> 172.21.15.100:0/2843504601 conn(0x7f7f1c0fc7a0 msgr2=0x7f7f1c10d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 shutdown_connections 2024-09-12T02:37:42.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:42.885+0000 7f7f237b4640 1 -- 172.21.15.100:0/2843504601 wait complete. 2024-09-12T02:37:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:42 smithi189 ceph-mon[35196]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:37:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:42 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3394887229' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:37:43.040 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168613 got 240518168614 for osd.8 2024-09-12T02:37:43.040 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:42 smithi117 ceph-mon[34898]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:37:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:42 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3394887229' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:37:43.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514516 got 326417514519 for osd.11 2024-09-12T02:37:43.666 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 -- 172.21.15.100:0/4081587061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba8102d30 msgr2=0x7f5ba8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 --2- 172.21.15.100:0/4081587061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba8102d30 0x7f5ba8103110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009cd0 tx=0x7f5b9802a910 comp rx=0 tx=0).stop 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 -- 172.21.15.100:0/4081587061 shutdown_connections 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 --2- 172.21.15.100:0/4081587061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba81082a0 0x7f5ba810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 --2- 172.21.15.100:0/4081587061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ba81036e0 0x7f5ba8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 --2- 172.21.15.100:0/4081587061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba8102d30 0x7f5ba8103110 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 -- 172.21.15.100:0/4081587061 >> 172.21.15.100:0/4081587061 conn(0x7f5ba80fc7d0 msgr2=0x7f5ba80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:43.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 -- 172.21.15.100:0/4081587061 shutdown_connections 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 -- 172.21.15.100:0/4081587061 wait complete. 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.823+0000 7f5bb0644640 1 Processor -- start 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bb0644640 1 -- start start 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bb0644640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bb0644640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ba81036e0 0x7f5ba8198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bb0644640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bb0644640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba81120e0 con 0x7f5ba81082a0 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bb0644640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8111f60 con 0x7f5ba8102d30 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bb0644640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8112260 con 0x7f5ba81036e0 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46104/0 (socket says 172.21.15.100:46104) 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 -- 172.21.15.100:0/2682510231 learned_addr learned my addr 172.21.15.100:0/2682510231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:43.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5badbdf640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ba81036e0 0x7f5ba8198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bae3e0640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 -- 172.21.15.100:0/2682510231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ba81036e0 msgr2=0x7f5ba8198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ba81036e0 0x7f5ba8198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 -- 172.21.15.100:0/2682510231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba8102d30 msgr2=0x7f5ba8198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 -- 172.21.15.100:0/2682510231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba819d610 con 0x7f5ba81082a0 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5bae3e0640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.824+0000 7f5baebe1640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c970 tx=0x7f5ba000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.825+0000 7f5ba77fe640 1 -- 172.21.15.100:0/2682510231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000ae60 con 0x7f5ba81082a0 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.825+0000 7f5ba77fe640 1 -- 172.21.15.100:0/2682510231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ba0005500 con 0x7f5ba81082a0 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.825+0000 7f5ba77fe640 1 -- 172.21.15.100:0/2682510231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000f450 con 0x7f5ba81082a0 2024-09-12T02:37:43.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.825+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba819d900 con 0x7f5ba81082a0 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.825+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba81a51e0 con 0x7f5ba81082a0 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.826+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba806a850 con 0x7f5ba81082a0 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.827+0000 7f5ba77fe640 1 -- 172.21.15.100:0/2682510231 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ba0004ee0 con 0x7f5ba81082a0 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.827+0000 7f5ba77fe640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5b900a2c90 0x7f5b900a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.828+0000 7f5bae3e0640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5b900a2c90 0x7f5b900a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.828+0000 7f5ba77fe640 1 -- 172.21.15.100:0/2682510231 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f5ba00cf010 con 0x7f5ba81082a0 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.828+0000 7f5bae3e0640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5b900a2c90 0x7f5b900a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b98000f80 tx=0x7f5b980098a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:43.831+0000 7f5ba77fe640 1 -- 172.21.15.100:0/2682510231 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ba0014030 con 0x7f5ba81082a0 2024-09-12T02:37:43.866 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:43.988 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:43 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2843504601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:43 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2843504601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:37:44.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.035+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5ba8103110 con 0x7f5ba81082a0 2024-09-12T02:37:44.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.036+0000 7f5ba77fe640 1 -- 172.21.15.100:0/2682510231 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ba8103110 con 0x7f5ba81082a0 2024-09-12T02:37:44.037 INFO:teuthology.orchestra.run.smithi100.stdout:77309411399 2024-09-12T02:37:44.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5b900a2c90 msgr2=0x7f5b900a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5b900a2c90 0x7f5b900a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b98000f80 tx=0x7f5b980098a0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba81082a0 msgr2=0x7f5ba819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c970 tx=0x7f5ba000cd70 comp rx=0 tx=0).stop 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 shutdown_connections 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5b900a2c90 0x7f5b900a5150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cf30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ba81036e0 0x7f5ba8198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 --2- 172.21.15.100:0/2682510231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 >> 172.21.15.100:0/2682510231 conn(0x7f5ba80fc7d0 msgr2=0x7f5ba8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 shutdown_connections 2024-09-12T02:37:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:44.038+0000 7f5bb0644640 1 -- 172.21.15.100:0/2682510231 wait complete. 2024-09-12T02:37:44.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:43 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2843504601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:37:44.323 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790003 got 158913790006 for osd.5 2024-09-12T02:37:44.323 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:44.758 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397547 got 210453397548 for osd.7 2024-09-12T02:37:44.758 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:44.821 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:44 smithi189 ceph-mon[35196]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:44.821 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:44 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:44.821 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:44 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2682510231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:37:44.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:44 smithi117 ceph-mon[34898]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:44.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:44 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:44.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:44 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2682510231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:37:44.966 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:44 smithi100 ceph-mon[31390]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:44.966 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:44 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:44.966 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:44 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2682510231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:37:45.618 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:45.627 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411399 for osd.2 2024-09-12T02:37:45.627 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:45.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 -- 172.21.15.100:0/993462035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8108300 msgr2=0x7f44a810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 --2- 172.21.15.100:0/993462035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8108300 0x7f44a810ec70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009cd0 tx=0x7f44a002a8d0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 -- 172.21.15.100:0/993462035 shutdown_connections 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 --2- 172.21.15.100:0/993462035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8108300 0x7f44a810ec70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 --2- 172.21.15.100:0/993462035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a8103780 0x7f44a8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 --2- 172.21.15.100:0/993462035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a8102dd0 0x7f44a81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 -- 172.21.15.100:0/993462035 >> 172.21.15.100:0/993462035 conn(0x7f44a80fc7d0 msgr2=0x7f44a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 -- 172.21.15.100:0/993462035 shutdown_connections 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.895+0000 7f44afe1b640 1 -- 172.21.15.100:0/993462035 wait complete. 2024-09-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 Processor -- start 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 -- start start 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8102dd0 0x7f44a8100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a8103780 0x7f44a8100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a8108300 0x7f44a81014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44a81120d0 con 0x7f44a8102dd0 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f44a8111f50 con 0x7f44a8103780 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44afe1b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44a8112250 con 0x7f44a8108300 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8102dd0 0x7f44a8100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8102dd0 0x7f44a8100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32922/0 (socket says 172.21.15.100:32922) 2024-09-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 -- 172.21.15.100:0/572694733 learned_addr learned my addr 172.21.15.100:0/572694733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44ad3b6640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a8103780 0x7f44a8100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44ae3b8640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a8108300 0x7f44a81014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 -- 172.21.15.100:0/572694733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a8108300 msgr2=0x7f44a81014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a8108300 0x7f44a81014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 -- 172.21.15.100:0/572694733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a8103780 msgr2=0x7f44a8100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a8103780 0x7f44a8100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.896+0000 7f44adbb7640 1 -- 172.21.15.100:0/572694733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a81a6a40 con 0x7f44a8102dd0 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.897+0000 7f44ae3b8640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a8108300 0x7f44a81014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.897+0000 7f44adbb7640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8102dd0 0x7f44a8100a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f44a400d950 tx=0x7f44a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.897+0000 7f449effd640 1 -- 172.21.15.100:0/572694733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4017070 con 0x7f44a8102dd0 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.897+0000 7f449effd640 1 -- 172.21.15.100:0/572694733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44a4009c30 con 0x7f44a8102dd0 2024-09-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.897+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a81a6d30 con 0x7f44a8102dd0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.897+0000 7f449effd640 1 -- 172.21.15.100:0/572694733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a400f6b0 con 0x7f44a8102dd0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.897+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a81a7210 con 0x7f44a8102dd0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.898+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a81031b0 con 0x7f44a8102dd0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.899+0000 7f449effd640 1 -- 172.21.15.100:0/572694733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f44a40109d0 con 0x7f44a8102dd0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.900+0000 7f449effd640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f44940a2c10 0x7f44940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.900+0000 7f44ad3b6640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f44940a2c10 0x7f44940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.900+0000 7f449effd640 1 -- 172.21.15.100:0/572694733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f44a40cec30 con 0x7f44a8102dd0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.900+0000 7f44ad3b6640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f44940a2c10 0x7f44940a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44a81024c0 tx=0x7f449800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:45.903+0000 7f449effd640 1 -- 172.21.15.100:0/572694733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44a4009de0 con 0x7f44a8102dd0 2024-09-12T02:37:46.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.075+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f44a8101f60 con 0x7f44a8102dd0 2024-09-12T02:37:46.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.075+0000 7f449effd640 1 -- 172.21.15.100:0/572694733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f44a409bbe0 con 0x7f44a8102dd0 2024-09-12T02:37:46.077 INFO:teuthology.orchestra.run.smithi100.stdout:188978561074 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f44940a2c10 msgr2=0x7f44940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f44940a2c10 0x7f44940a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44a81024c0 tx=0x7f449800b390 comp rx=0 tx=0).stop 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8102dd0 msgr2=0x7f44a8100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8102dd0 0x7f44a8100a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f44a400d950 tx=0x7f44a400de10 comp rx=0 tx=0).stop 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 shutdown_connections 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f44940a2c10 0x7f44940a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44a8108300 0x7f44a81014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44a8103780 0x7f44a8100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 --2- 172.21.15.100:0/572694733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a8102dd0 0x7f44a8100a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 >> 172.21.15.100:0/572694733 conn(0x7f44a80fc7d0 msgr2=0x7f44a8105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 shutdown_connections 2024-09-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:46.077+0000 7f44afe1b640 1 -- 172.21.15.100:0/572694733 wait complete. 2024-09-12T02:37:46.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:46 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:46 smithi100 ceph-mon[31390]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:46.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:46 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/572694733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:37:46.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:46 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:46 smithi189 ceph-mon[35196]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:46.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:46 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/572694733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:37:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:46.802 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561071 got 188978561074 for osd.6 2024-09-12T02:37:46.803 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:46.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:46 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:46.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:46 smithi117 ceph-mon[34898]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:46.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:46 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/572694733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:37:47.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:47 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1413152337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:37:47.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 -- 172.21.15.100:0/2526347724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8102790 msgr2=0x7fd2b81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/2526347724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8102790 0x7fd2b81067e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009900 tx=0x7fd2a002a410 comp rx=0 tx=0).stop 2024-09-12T02:37:47.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 -- 172.21.15.100:0/2526347724 shutdown_connections 2024-09-12T02:37:47.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/2526347724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2b8106f10 0x7fd2b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/2526347724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8102790 0x7fd2b81067e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/2526347724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2b8101de0 0x7fd2b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 -- 172.21.15.100:0/2526347724 >> 172.21.15.100:0/2526347724 conn(0x7fd2b80fd8c0 msgr2=0x7fd2b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 -- 172.21.15.100:0/2526347724 shutdown_connections 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 -- 172.21.15.100:0/2526347724 wait complete. 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 Processor -- start 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.217+0000 7fd2bd52c640 1 -- start start 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8101de0 0x7fd2b81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2b8102790 0x7fd2b8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112010 con 0x7fd2b8101de0 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8111e90 con 0x7fd2b8102790 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112190 con 0x7fd2b8106f10 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8101de0 0x7fd2b81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8101de0 0x7fd2b81985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32944/0 (socket says 172.21.15.100:32944) 2024-09-12T02:37:47.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 -- 172.21.15.100:0/1413152337 learned_addr learned my addr 172.21.15.100:0/1413152337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:47.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b67fc640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2b8102790 0x7fd2b8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b77fe640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 -- 172.21.15.100:0/1413152337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2b8106f10 msgr2=0x7fd2b819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 -- 172.21.15.100:0/1413152337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2b8102790 msgr2=0x7fd2b8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.705 INFO:teuthology.orchestra.run.smithi100.stdout:107374182464 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2b8102790 0x7fd2b8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 -- 172.21.15.100:0/1413152337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b819d560 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2b6ffd640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8101de0 0x7fd2b81985b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000ba50 tx=0x7fd2b000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2affff640 1 -- 172.21.15.100:0/1413152337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0019070 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2affff640 1 -- 172.21.15.100:0/1413152337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b000cbe0 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b819d850 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2affff640 1 -- 172.21.15.100:0/1413152337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00076e0 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.218+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b81a5130 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.220+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b8102240 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.221+0000 7fd2affff640 1 -- 172.21.15.100:0/1413152337 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd2b001c070 con 0x7fd2b8101de0 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.222+0000 7fd2affff640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2a40a2c90 0x7fd2a40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.222+0000 7fd2b67fc640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2a40a2c90 0x7fd2a40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.222+0000 7fd2affff640 1 -- 172.21.15.100:0/1413152337 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd2b00ce9d0 con 0x7fd2b8101de0 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.222+0000 7fd2b67fc640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2a40a2c90 0x7fd2a40a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80ffe80 tx=0x7fd2a0031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.225+0000 7fd2affff640 1 -- 172.21.15.100:0/1413152337 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2b009ba90 con 0x7fd2b8101de0 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.404+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd2b8199910 con 0x7fd2b8101de0 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.405+0000 7fd2affff640 1 -- 172.21.15.100:0/1413152337 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd2b009b390 con 0x7fd2b8101de0 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2a40a2c90 msgr2=0x7fd2a40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2a40a2c90 0x7fd2a40a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80ffe80 tx=0x7fd2a0031490 comp rx=0 tx=0).stop 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8101de0 msgr2=0x7fd2b81985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8101de0 0x7fd2b81985b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000ba50 tx=0x7fd2b000bf10 comp rx=0 tx=0).stop 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 shutdown_connections 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2a40a2c90 0x7fd2a40a5150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2b8102790 0x7fd2b8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 --2- 172.21.15.100:0/1413152337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b8101de0 0x7fd2b81985b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 >> 172.21.15.100:0/1413152337 conn(0x7fd2b80fd8c0 msgr2=0x7fd2b80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 shutdown_connections 2024-09-12T02:37:47.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:47.407+0000 7fd2bd52c640 1 -- 172.21.15.100:0/1413152337 wait complete. 2024-09-12T02:37:47.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:47 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1413152337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:37:47.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:47 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1413152337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:37:48.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.116+0000 7f6257c63640 1 -- 172.21.15.100:0/3199456770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250102790 msgr2=0x7f62501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.116+0000 7f6257c63640 1 --2- 172.21.15.100:0/3199456770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250102790 0x7f62501067e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f624c009900 tx=0x7f624c02a410 comp rx=0 tx=0).stop 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.116+0000 7f6257c63640 1 -- 172.21.15.100:0/3199456770 shutdown_connections 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.116+0000 7f6257c63640 1 --2- 172.21.15.100:0/3199456770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6250106f10 0x7f625010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.116+0000 7f6257c63640 1 --2- 172.21.15.100:0/3199456770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250102790 0x7f62501067e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 --2- 172.21.15.100:0/3199456770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6250101de0 0x7f62501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 -- 172.21.15.100:0/3199456770 >> 172.21.15.100:0/3199456770 conn(0x7f62500fd8c0 msgr2=0x7f62500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 -- 172.21.15.100:0/3199456770 shutdown_connections 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 -- 172.21.15.100:0/3199456770 wait complete. 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 Processor -- start 2024-09-12T02:37:48.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 -- start start 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250101de0 0x7f6250198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6250102790 0x7f6250198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6250106f10 0x7f625019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6250111f30 con 0x7f6250101de0 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6250111db0 con 0x7f6250102790 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f6257c63640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f62501120b0 con 0x7f6250106f10 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.117+0000 7f62559ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250101de0 0x7f6250198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250101de0 0x7f6250198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32952/0 (socket says 172.21.15.100:32952) 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 -- 172.21.15.100:0/452797977 learned_addr learned my addr 172.21.15.100:0/452797977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62551fe640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6250102790 0x7f6250198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f6256200640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6250106f10 0x7f625019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 -- 172.21.15.100:0/452797977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6250106f10 msgr2=0x7f625019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6250106f10 0x7f625019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 -- 172.21.15.100:0/452797977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6250102790 msgr2=0x7f6250198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6250102790 0x7f6250198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 -- 172.21.15.100:0/452797977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625019d400 con 0x7f6250101de0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62551fe640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6250102790 0x7f6250198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f62559ff640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250101de0 0x7f6250198450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f624400c920 tx=0x7f624400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f6242ffd640 1 -- 172.21.15.100:0/452797977 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244007c70 con 0x7f6250101de0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f6242ffd640 1 -- 172.21.15.100:0/452797977 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6244007e10 con 0x7f6250101de0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625019d6f0 con 0x7f6250101de0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f6242ffd640 1 -- 172.21.15.100:0/452797977 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244018890 con 0x7f6250101de0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.118+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62501a4fd0 con 0x7f6250101de0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.119+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62501021c0 con 0x7f6250101de0 2024-09-12T02:37:48.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.120+0000 7f6242ffd640 1 -- 172.21.15.100:0/452797977 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6244018a70 con 0x7f6250101de0 2024-09-12T02:37:48.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.121+0000 7f6242ffd640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f623c0a2c10 0x7f623c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.121+0000 7f62551fe640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f623c0a2c10 0x7f623c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.121+0000 7f6242ffd640 1 -- 172.21.15.100:0/452797977 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f62440cf220 con 0x7f6250101de0 2024-09-12T02:37:48.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.122+0000 7f62551fe640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f623c0a2c10 0x7f623c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f62501087d0 tx=0x7f624c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.125+0000 7f6242ffd640 1 -- 172.21.15.100:0/452797977 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6244014030 con 0x7f6250101de0 2024-09-12T02:37:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.301+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f625010a0f0 con 0x7f6250101de0 2024-09-12T02:37:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.302+0000 7f6242ffd640 1 -- 172.21.15.100:0/452797977 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f624400de20 con 0x7f6250101de0 2024-09-12T02:37:48.303 INFO:teuthology.orchestra.run.smithi100.stdout:274877906979 2024-09-12T02:37:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f623c0a2c10 msgr2=0x7f623c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f623c0a2c10 0x7f623c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f62501087d0 tx=0x7f624c005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250101de0 msgr2=0x7f6250198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250101de0 0x7f6250198450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f624400c920 tx=0x7f624400cde0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 shutdown_connections 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f623c0a2c10 0x7f623c0a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6250106f10 0x7f625019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6250102790 0x7f6250198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 --2- 172.21.15.100:0/452797977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6250101de0 0x7f6250198450 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 >> 172.21.15.100:0/452797977 conn(0x7f62500fd8c0 msgr2=0x7f62500fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 shutdown_connections 2024-09-12T02:37:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.304+0000 7f6257c63640 1 -- 172.21.15.100:0/452797977 wait complete. 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 -- 172.21.15.100:0/1218624913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 msgr2=0x7fddfc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 --2- 172.21.15.100:0/1218624913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc101200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fddec009900 tx=0x7fddec02a480 comp rx=0 tx=0).stop 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 -- 172.21.15.100:0/1218624913 shutdown_connections 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 --2- 172.21.15.100:0/1218624913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddfc102ef0 0x7fddfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 --2- 172.21.15.100:0/1218624913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddfc102570 0x7fddfc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 --2- 172.21.15.100:0/1218624913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc101200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 -- 172.21.15.100:0/1218624913 >> 172.21.15.100:0/1218624913 conn(0x7fddfc0fc7d0 msgr2=0x7fddfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 -- 172.21.15.100:0/1218624913 shutdown_connections 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.403+0000 7fde0251b640 1 -- 172.21.15.100:0/1218624913 wait complete. 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 Processor -- start 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 -- start start 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddfc102570 0x7fddfc1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddfc102ef0 0x7fddfc19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc110ff0 con 0x7fddfc100e20 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc110e70 con 0x7fddfc102ef0 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.404+0000 7fde0251b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc111170 con 0x7fddfc102570 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32968/0 (socket says 172.21.15.100:32968) 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 -- 172.21.15.100:0/953020655 learned_addr learned my addr 172.21.15.100:0/953020655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fde00ab8640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddfc102ef0 0x7fddfc19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfb7fe640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddfc102570 0x7fddfc1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 -- 172.21.15.100:0/953020655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddfc102570 msgr2=0x7fddfc1979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddfc102570 0x7fddfc1979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 -- 172.21.15.100:0/953020655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddfc102ef0 msgr2=0x7fddfc19bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddfc102ef0 0x7fddfc19bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 -- 172.21.15.100:0/953020655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc19c420 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddfbfff640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc197470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fddec02aa70 tx=0x7fddec003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddf97fa640 1 -- 172.21.15.100:0/953020655 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec03f070 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddf97fa640 1 -- 172.21.15.100:0/953020655 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddec031c20 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fddf97fa640 1 -- 172.21.15.100:0/953020655 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec035030 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc19c6b0 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.405+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddfc1a3ff0 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.406+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddfc101200 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.408+0000 7fddf97fa640 1 -- 172.21.15.100:0/953020655 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fddec042070 con 0x7fddfc100e20 2024-09-12T02:37:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.408+0000 7fddf97fa640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdde40a2c90 0x7fdde40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.408+0000 7fddfb7fe640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdde40a2c90 0x7fdde40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.408+0000 7fddf97fa640 1 -- 172.21.15.100:0/953020655 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fddec0efce0 con 0x7fddfc100e20 2024-09-12T02:37:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.409+0000 7fddfb7fe640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdde40a2c90 0x7fdde40a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0ffdc0 tx=0x7fddf0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.416+0000 7fddf97fa640 1 -- 172.21.15.100:0/953020655 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddec0bcc90 con 0x7fddfc100e20 2024-09-12T02:37:48.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:48 smithi100 ceph-mon[31390]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:48.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/452797977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:37:48.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.590+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fddfc1a41c0 con 0x7fddfc100e20 2024-09-12T02:37:48.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.590+0000 7fddf97fa640 1 -- 172.21.15.100:0/953020655 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fddec031dd0 con 0x7fddfc100e20 2024-09-12T02:37:48.591 INFO:teuthology.orchestra.run.smithi100.stdout:296352743454 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdde40a2c90 msgr2=0x7fdde40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdde40a2c90 0x7fdde40a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0ffdc0 tx=0x7fddf0008040 comp rx=0 tx=0).stop 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 msgr2=0x7fddfc197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc197470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fddec02aa70 tx=0x7fddec003b60 comp rx=0 tx=0).stop 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 shutdown_connections 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdde40a2c90 0x7fdde40a5150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddfc102ef0 0x7fddfc19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddfc102570 0x7fddfc1979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 --2- 172.21.15.100:0/953020655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddfc100e20 0x7fddfc197470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 >> 172.21.15.100:0/953020655 conn(0x7fddfc0fc7d0 msgr2=0x7fddfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 shutdown_connections 2024-09-12T02:37:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.593+0000 7fde0251b640 1 -- 172.21.15.100:0/953020655 wait complete. 2024-09-12T02:37:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:48 smithi189 ceph-mon[35196]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/452797977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:37:48.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:48 smithi117 ceph-mon[34898]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:48.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/452797977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:37:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 -- 172.21.15.100:0/2262449174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10103780 msgr2=0x7fbe10107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 --2- 172.21.15.100:0/2262449174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10103780 0x7fbe10107bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009930 tx=0x7fbe0402a420 comp rx=0 tx=0).stop 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 -- 172.21.15.100:0/2262449174 shutdown_connections 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 --2- 172.21.15.100:0/2262449174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10108300 0x7fbe1010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 --2- 172.21.15.100:0/2262449174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10103780 0x7fbe10107bc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 --2- 172.21.15.100:0/2262449174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10102dd0 0x7fbe101031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 -- 172.21.15.100:0/2262449174 >> 172.21.15.100:0/2262449174 conn(0x7fbe100fc7d0 msgr2=0x7fbe100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 -- 172.21.15.100:0/2262449174 shutdown_connections 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 -- 172.21.15.100:0/2262449174 wait complete. 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.993+0000 7fbe183d3640 1 Processor -- start 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe183d3640 1 -- start start 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe183d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10102dd0 0x7fbe101985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe183d3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10103780 0x7fbe10198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe183d3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10108300 0x7fbe1019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe183d3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe101120d0 con 0x7fbe10108300 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe183d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10111f50 con 0x7fbe10102dd0 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe183d3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10112250 con 0x7fbe10103780 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1616f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10102dd0 0x7fbe101985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10103780 0x7fbe10198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10103780 0x7fbe10198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37976/0 (socket says 172.21.15.100:37976) 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1616f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10102dd0 0x7fbe101985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49626/0 (socket says 172.21.15.100:49626) 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 -- 172.21.15.100:0/3299662017 learned_addr learned my addr 172.21.15.100:0/3299662017 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe16970640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10108300 0x7fbe1019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 -- 172.21.15.100:0/3299662017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10102dd0 msgr2=0x7fbe101985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10102dd0 0x7fbe101985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 -- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10108300 msgr2=0x7fbe1019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10108300 0x7fbe1019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1596e640 1 -- 172.21.15.100:0/3299662017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1019d590 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.994+0000 7fbe1616f640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10102dd0 0x7fbe101985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.995+0000 7fbe1596e640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10103780 0x7fbe10198b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe04005940 tx=0x7fbe040042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.995+0000 7fbe037fe640 1 -- 172.21.15.100:0/3299662017 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0403f030 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.995+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1019d820 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.995+0000 7fbe037fe640 1 -- 172.21.15.100:0/3299662017 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe04003ce0 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.995+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe101a5160 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.995+0000 7fbe037fe640 1 -- 172.21.15.100:0/3299662017 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04049060 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.996+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe101031b0 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.997+0000 7fbe037fe640 1 -- 172.21.15.100:0/3299662017 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbe04042030 con 0x7fbe10103780 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.998+0000 7fbe037fe640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbdfc0a2c10 0x7fbdfc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:49.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.998+0000 7fbe1616f640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbdfc0a2c10 0x7fbdfc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:49.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.998+0000 7fbe037fe640 1 -- 172.21.15.100:0/3299662017 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fbe040efc60 con 0x7fbe10103780 2024-09-12T02:37:49.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:48.998+0000 7fbe1616f640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbdfc0a2c10 0x7fbdfc0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009d60 tx=0x7fbe0c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:49.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.001+0000 7fbe037fe640 1 -- 172.21.15.100:0/3299662017 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe040bcb10 con 0x7fbe10103780 2024-09-12T02:37:49.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.177+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbe10199940 con 0x7fbe10103780 2024-09-12T02:37:49.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.178+0000 7fbe037fe640 1 -- 172.21.15.100:0/3299662017 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe10199940 con 0x7fbe10103780 2024-09-12T02:37:49.178 INFO:teuthology.orchestra.run.smithi100.stdout:55834574924 2024-09-12T02:37:49.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbdfc0a2c10 msgr2=0x7fbdfc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbdfc0a2c10 0x7fbdfc0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009d60 tx=0x7fbe0c009110 comp rx=0 tx=0).stop 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10103780 msgr2=0x7fbe10198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10103780 0x7fbe10198b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe04005940 tx=0x7fbe040042f0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 shutdown_connections 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbdfc0a2c10 0x7fbdfc0a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe10108300 0x7fbe1019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe10103780 0x7fbe10198b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 --2- 172.21.15.100:0/3299662017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe10102dd0 0x7fbe101985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 >> 172.21.15.100:0/3299662017 conn(0x7fbe100fc7d0 msgr2=0x7fbe10105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 shutdown_connections 2024-09-12T02:37:49.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:49.180+0000 7fbe183d3640 1 -- 172.21.15.100:0/3299662017 wait complete. 2024-09-12T02:37:49.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743451 got 296352743454 for osd.10 2024-09-12T02:37:49.475 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:49.702 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:49 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/953020655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:37:49.702 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:49 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3299662017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:37:49.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:49 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/953020655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:37:49.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:49 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3299662017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:37:49.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:49 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/953020655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:37:49.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:49 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3299662017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:37:50.147 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906977 got 274877906979 for osd.9 2024-09-12T02:37:50.147 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:50.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:50 smithi189 ceph-mon[35196]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:50.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:50 smithi117 ceph-mon[34898]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:50.847 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:50 smithi100 ceph-mon[31390]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:50.874 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574924 for osd.1 2024-09-12T02:37:50.874 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:51.689 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182461 got 107374182464 for osd.3 2024-09-12T02:37:51.690 DEBUG:teuthology.parallel:result is None 2024-09-12T02:37:51.690 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:37:51.690 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:37:51.959 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 -- 172.21.15.100:0/3957230957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 msgr2=0x7f26dc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 --2- 172.21.15.100:0/3957230957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc101200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009900 tx=0x7f26d802a480 comp rx=0 tx=0).stop 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 -- 172.21.15.100:0/3957230957 shutdown_connections 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 --2- 172.21.15.100:0/3957230957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26dc102ef0 0x7f26dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 --2- 172.21.15.100:0/3957230957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26dc102570 0x7f26dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 --2- 172.21.15.100:0/3957230957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc101200 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 -- 172.21.15.100:0/3957230957 >> 172.21.15.100:0/3957230957 conn(0x7f26dc0fc7d0 msgr2=0x7f26dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 -- 172.21.15.100:0/3957230957 shutdown_connections 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.485+0000 7f26e3e53640 1 -- 172.21.15.100:0/3957230957 wait complete. 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 Processor -- start 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 -- start start 2024-09-12T02:37:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26dc102570 0x7f26dc1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26dc102ef0 0x7f26dc1a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc110fc0 con 0x7f26dc100e20 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc110e40 con 0x7f26dc102ef0 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e3e53640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc111140 con 0x7f26dc102570 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e1bef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e1bef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc1993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33008/0 (socket says 172.21.15.100:33008) 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.486+0000 7f26e1bef640 1 -- 172.21.15.100:0/2659720372 learned_addr learned my addr 172.21.15.100:0/2659720372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e13ee640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26dc102570 0x7f26dc1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e23f0640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26dc102ef0 0x7f26dc1a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e1bef640 1 -- 172.21.15.100:0/2659720372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26dc102570 msgr2=0x7f26dc1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e1bef640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26dc102570 0x7f26dc1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e1bef640 1 -- 172.21.15.100:0/2659720372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26dc102ef0 msgr2=0x7f26dc1a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e1bef640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26dc102ef0 0x7f26dc1a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e1bef640 1 -- 172.21.15.100:0/2659720372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc1a4960 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e1bef640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc1993a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f26d8006010 tx=0x7f26d8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26d2ffd640 1 -- 172.21.15.100:0/2659720372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d803f070 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26d2ffd640 1 -- 172.21.15.100:0/2659720372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d8031c30 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc1a4b30 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26d2ffd640 1 -- 172.21.15.100:0/2659720372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8035030 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.487+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc1a4f80 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.488+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26dc101200 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.489+0000 7f26d2ffd640 1 -- 172.21.15.100:0/2659720372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f26d8042070 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.490+0000 7f26d2ffd640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f26c80a2c10 0x7f26c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.490+0000 7f26d2ffd640 1 -- 172.21.15.100:0/2659720372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f26d80efd20 con 0x7f26dc100e20 2024-09-12T02:37:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.490+0000 7f26e13ee640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f26c80a2c10 0x7f26c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.490+0000 7f26e13ee640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f26c80a2c10 0x7f26c80a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26dc06aac0 tx=0x7f26cc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.493+0000 7f26d2ffd640 1 -- 172.21.15.100:0/2659720372 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26d8031de0 con 0x7f26dc100e20 2024-09-12T02:37:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.669+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26dc106fb0 con 0x7f26c80a2c10 2024-09-12T02:37:52.669 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:52 smithi100 ceph-mon[31390]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:37:52.669 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:52.669 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:52 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:52.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.676+0000 7f26d2ffd640 1 -- 172.21.15.100:0/2659720372 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258864 (secure 0 0 0) 0x7f26dc106fb0 con 0x7f26c80a2c10 2024-09-12T02:37:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:52.680 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f26c80a2c10 msgr2=0x7f26c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f26c80a2c10 0x7f26c80a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26dc06aac0 tx=0x7f26cc008040 comp rx=0 tx=0).stop 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 msgr2=0x7f26dc1993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc1993a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f26d8006010 tx=0x7f26d8003c10 comp rx=0 tx=0).stop 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 shutdown_connections 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f26c80a2c10 0x7f26c80a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26dc102ef0 0x7f26dc1a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26dc102570 0x7f26dc1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 --2- 172.21.15.100:0/2659720372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26dc100e20 0x7f26dc1993a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 >> 172.21.15.100:0/2659720372 conn(0x7f26dc0fc7d0 msgr2=0x7f26dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.679+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 shutdown_connections 2024-09-12T02:37:52.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:52.680+0000 7f26e3e53640 1 -- 172.21.15.100:0/2659720372 wait complete. 2024-09-12T02:37:52.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:52 smithi117 ceph-mon[34898]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:37:52.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:52.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:52 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:52 smithi189 ceph-mon[35196]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:37:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:53.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:52 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:53.396 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-12T02:37:51.538697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":465,"num_read_kb":348,"num_write":343,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355984,"kb_used_data":10896,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585840,"statfs":{"total":1151940427776,"available":1151575900160,"internally_reserved":0,"allocated":11157504,"data_stored":7065099,"data_compressed":107292,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002999"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865174+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:36:49.865174+0000","last_peered":"2024-09-12T02:36:49.865174+0000","last_clean":"2024-09-12T02:36:49.865174+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:36:49.865174+0000","last_undegraded":"2024-09-12T02:36:49.865174+0000","last_fullsized":"2024-09-12T02:36:49.865174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881410+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:36:49.881410+0000","last_peered":"2024-09-12T02:36:49.881410+0000","last_clean":"2024-09-12T02:36:49.881410+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:36:49.881410+0000","last_undegraded":"2024-09-12T02:36:49.881410+0000","last_fullsized":"2024-09-12T02:36:49.881410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881087+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:36:49.881087+0000","last_peered":"2024-09-12T02:36:49.881087+0000","last_clean":"2024-09-12T02:36:49.881087+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:36:49.881087+0000","last_undegraded":"2024-09-12T02:36:49.881087+0000","last_fullsized":"2024-09-12T02:36:49.881087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879169+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:36:49.879169+0000","last_peered":"2024-09-12T02:36:49.879169+0000","last_clean":"2024-09-12T02:36:49.879169+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:36:49.879169+0000","last_undegraded":"2024-09-12T02:36:49.879169+0000","last_fullsized":"2024-09-12T02:36:49.879169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877696+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:36:49.877696+0000","last_peered":"2024-09-12T02:36:49.877696+0000","last_clean":"2024-09-12T02:36:49.877696+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:36:49.877696+0000","last_undegraded":"2024-09-12T02:36:49.877696+0000","last_fullsized":"2024-09-12T02:36:49.877696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868052+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:36:49.868052+0000","last_peered":"2024-09-12T02:36:49.868052+0000","last_clean":"2024-09-12T02:36:49.868052+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:36:49.868052+0000","last_undegraded":"2024-09-12T02:36:49.868052+0000","last_fullsized":"2024-09-12T02:36:49.868052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881434+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:36:49.881434+0000","last_peered":"2024-09-12T02:36:49.881434+0000","last_clean":"2024-09-12T02:36:49.881434+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:36:49.881434+0000","last_undegraded":"2024-09-12T02:36:49.881434+0000","last_fullsized":"2024-09-12T02:36:49.881434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877638+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:36:49.877638+0000","last_peered":"2024-09-12T02:36:49.877638+0000","last_clean":"2024-09-12T02:36:49.877638+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:36:49.877638+0000","last_undegraded":"2024-09-12T02:36:49.877638+0000","last_fullsized":"2024-09-12T02:36:49.877638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879042+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:36:49.879042+0000","last_peered":"2024-09-12T02:36:49.879042+0000","last_clean":"2024-09-12T02:36:49.879042+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:36:49.879042+0000","last_undegraded":"2024-09-12T02:36:49.879042+0000","last_fullsized":"2024-09-12T02:36:49.879042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868407+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:36:49.868407+0000","last_peered":"2024-09-12T02:36:49.868407+0000","last_clean":"2024-09-12T02:36:49.868407+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:36:49.868407+0000","last_undegraded":"2024-09-12T02:36:49.868407+0000","last_fullsized":"2024-09-12T02:36:49.868407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881824+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:36:49.881824+0000","last_peered":"2024-09-12T02:36:49.881824+0000","last_clean":"2024-09-12T02:36:49.881824+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:36:49.881824+0000","last_undegraded":"2024-09-12T02:36:49.881824+0000","last_fullsized":"2024-09-12T02:36:49.881824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879320+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:36:49.879320+0000","last_peered":"2024-09-12T02:36:49.879320+0000","last_clean":"2024-09-12T02:36:49.879320+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:36:49.879320+0000","last_undegraded":"2024-09-12T02:36:49.879320+0000","last_fullsized":"2024-09-12T02:36:49.879320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864515+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:36:49.864515+0000","last_peered":"2024-09-12T02:36:49.864515+0000","last_clean":"2024-09-12T02:36:49.864515+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:36:49.864515+0000","last_undegraded":"2024-09-12T02:36:49.864515+0000","last_fullsized":"2024-09-12T02:36:49.864515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880520+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:36:49.880520+0000","last_peered":"2024-09-12T02:36:49.880520+0000","last_clean":"2024-09-12T02:36:49.880520+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:36:49.880520+0000","last_undegraded":"2024-09-12T02:36:49.880520+0000","last_fullsized":"2024-09-12T02:36:49.880520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880233+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:36:49.880233+0000","last_peered":"2024-09-12T02:36:49.880233+0000","last_clean":"2024-09-12T02:36:49.880233+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:36:49.880233+0000","last_undegraded":"2024-09-12T02:36:49.880233+0000","last_fullsized":"2024-09-12T02:36:49.880233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878501+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:36:49.878501+0000","last_peered":"2024-09-12T02:36:49.878501+0000","last_clean":"2024-09-12T02:36:49.878501+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:36:49.878501+0000","last_undegraded":"2024-09-12T02:36:49.878501+0000","last_fullsized":"2024-09-12T02:36:49.878501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865248+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:36:49.865248+0000","last_peered":"2024-09-12T02:36:49.865248+0000","last_clean":"2024-09-12T02:36:49.865248+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:36:49.865248+0000","last_undegraded":"2024-09-12T02:36:49.865248+0000","last_fullsized":"2024-09-12T02:36:49.865248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877874+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:36:49.877874+0000","last_peered":"2024-09-12T02:36:49.877874+0000","last_clean":"2024-09-12T02:36:49.877874+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:36:49.877874+0000","last_undegraded":"2024-09-12T02:36:49.877874+0000","last_fullsized":"2024-09-12T02:36:49.877874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878321+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:36:49.878321+0000","last_peered":"2024-09-12T02:36:49.878321+0000","last_clean":"2024-09-12T02:36:49.878321+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:36:49.878321+0000","last_undegraded":"2024-09-12T02:36:49.878321+0000","last_fullsized":"2024-09-12T02:36:49.878321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864901+0000","last_change":"2024-09-12T02:36:48.891229+0000","last_active":"2024-09-12T02:36:49.864901+0000","last_peered":"2024-09-12T02:36:49.864901+0000","last_clean":"2024-09-12T02:36:49.864901+0000","last_became_active":"2024-09-12T02:36:48.890485+0000","last_became_peered":"2024-09-12T02:36:48.890485+0000","last_unstale":"2024-09-12T02:36:49.864901+0000","last_undegraded":"2024-09-12T02:36:49.864901+0000","last_fullsized":"2024-09-12T02:36:49.864901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.290011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864576+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:36:49.864576+0000","last_peered":"2024-09-12T02:36:49.864576+0000","last_clean":"2024-09-12T02:36:49.864576+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:36:49.864576+0000","last_undegraded":"2024-09-12T02:36:49.864576+0000","last_fullsized":"2024-09-12T02:36:49.864576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878900+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:36:49.878900+0000","last_peered":"2024-09-12T02:36:49.878900+0000","last_clean":"2024-09-12T02:36:49.878900+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:36:49.878900+0000","last_undegraded":"2024-09-12T02:36:49.878900+0000","last_fullsized":"2024-09-12T02:36:49.878900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877749+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:36:49.877749+0000","last_peered":"2024-09-12T02:36:49.877749+0000","last_clean":"2024-09-12T02:36:49.877749+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:36:49.877749+0000","last_undegraded":"2024-09-12T02:36:49.877749+0000","last_fullsized":"2024-09-12T02:36:49.877749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879626+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:36:49.879626+0000","last_peered":"2024-09-12T02:36:49.879626+0000","last_clean":"2024-09-12T02:36:49.879626+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:36:49.879626+0000","last_undegraded":"2024-09-12T02:36:49.879626+0000","last_fullsized":"2024-09-12T02:36:49.879626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878296+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:36:49.878296+0000","last_peered":"2024-09-12T02:36:49.878296+0000","last_clean":"2024-09-12T02:36:49.878296+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:36:49.878296+0000","last_undegraded":"2024-09-12T02:36:49.878296+0000","last_fullsized":"2024-09-12T02:36:49.878296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878797+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:36:49.878797+0000","last_peered":"2024-09-12T02:36:49.878797+0000","last_clean":"2024-09-12T02:36:49.878797+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:36:49.878797+0000","last_undegraded":"2024-09-12T02:36:49.878797+0000","last_fullsized":"2024-09-12T02:36:49.878797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865110+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:36:49.865110+0000","last_peered":"2024-09-12T02:36:49.865110+0000","last_clean":"2024-09-12T02:36:49.865110+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:36:49.865110+0000","last_undegraded":"2024-09-12T02:36:49.865110+0000","last_fullsized":"2024-09-12T02:36:49.865110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864446+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:36:49.864446+0000","last_peered":"2024-09-12T02:36:49.864446+0000","last_clean":"2024-09-12T02:36:49.864446+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:36:49.864446+0000","last_undegraded":"2024-09-12T02:36:49.864446+0000","last_fullsized":"2024-09-12T02:36:49.864446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881494+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:36:49.881494+0000","last_peered":"2024-09-12T02:36:49.881494+0000","last_clean":"2024-09-12T02:36:49.881494+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:36:49.881494+0000","last_undegraded":"2024-09-12T02:36:49.881494+0000","last_fullsized":"2024-09-12T02:36:49.881494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878346+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:36:49.878346+0000","last_peered":"2024-09-12T02:36:49.878346+0000","last_clean":"2024-09-12T02:36:49.878346+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:36:49.878346+0000","last_undegraded":"2024-09-12T02:36:49.878346+0000","last_fullsized":"2024-09-12T02:36:49.878346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878957+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:36:49.878957+0000","last_peered":"2024-09-12T02:36:49.878957+0000","last_clean":"2024-09-12T02:36:49.878957+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:36:49.878957+0000","last_undegraded":"2024-09-12T02:36:49.878957+0000","last_fullsized":"2024-09-12T02:36:49.878957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864847+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:36:49.864847+0000","last_peered":"2024-09-12T02:36:49.864847+0000","last_clean":"2024-09-12T02:36:49.864847+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:36:49.864847+0000","last_undegraded":"2024-09-12T02:36:49.864847+0000","last_fullsized":"2024-09-12T02:36:49.864847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877481+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:36:49.877481+0000","last_peered":"2024-09-12T02:36:49.877481+0000","last_clean":"2024-09-12T02:36:49.877481+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:36:49.877481+0000","last_undegraded":"2024-09-12T02:36:49.877481+0000","last_fullsized":"2024-09-12T02:36:49.877481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:47.001728+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:37:47.001728+0000","last_peered":"2024-09-12T02:37:47.001728+0000","last_clean":"2024-09-12T02:37:47.001728+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:37:47.001728+0000","last_undegraded":"2024-09-12T02:37:47.001728+0000","last_fullsized":"2024-09-12T02:37:47.001728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878173+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:36:49.878173+0000","last_peered":"2024-09-12T02:36:49.878173+0000","last_clean":"2024-09-12T02:36:49.878173+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:36:49.878173+0000","last_undegraded":"2024-09-12T02:36:49.878173+0000","last_fullsized":"2024-09-12T02:36:49.878173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930375+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:36:57.930375+0000","last_peered":"2024-09-12T02:36:57.930375+0000","last_clean":"2024-09-12T02:36:57.930375+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:36:57.930375+0000","last_undegraded":"2024-09-12T02:36:57.930375+0000","last_fullsized":"2024-09-12T02:36:57.930375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931131+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:36:57.931131+0000","last_peered":"2024-09-12T02:36:57.931131+0000","last_clean":"2024-09-12T02:36:57.931131+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:36:57.931131+0000","last_undegraded":"2024-09-12T02:36:57.931131+0000","last_fullsized":"2024-09-12T02:36:57.931131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877682+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:36:49.877682+0000","last_peered":"2024-09-12T02:36:49.877682+0000","last_clean":"2024-09-12T02:36:49.877682+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:36:49.877682+0000","last_undegraded":"2024-09-12T02:36:49.877682+0000","last_fullsized":"2024-09-12T02:36:49.877682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880116+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:36:49.880116+0000","last_peered":"2024-09-12T02:36:49.880116+0000","last_clean":"2024-09-12T02:36:49.880116+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:36:49.880116+0000","last_undegraded":"2024-09-12T02:36:49.880116+0000","last_fullsized":"2024-09-12T02:36:49.880116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877370+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:36:49.877370+0000","last_peered":"2024-09-12T02:36:49.877370+0000","last_clean":"2024-09-12T02:36:49.877370+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:36:49.877370+0000","last_undegraded":"2024-09-12T02:36:49.877370+0000","last_fullsized":"2024-09-12T02:36:49.877370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:50.004919+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:37:50.004919+0000","last_peered":"2024-09-12T02:37:50.004919+0000","last_clean":"2024-09-12T02:37:50.004919+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:37:50.004919+0000","last_undegraded":"2024-09-12T02:37:50.004919+0000","last_fullsized":"2024-09-12T02:37:50.004919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879865+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:36:49.879865+0000","last_peered":"2024-09-12T02:36:49.879865+0000","last_clean":"2024-09-12T02:36:49.879865+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:36:49.879865+0000","last_undegraded":"2024-09-12T02:36:49.879865+0000","last_fullsized":"2024-09-12T02:36:49.879865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917915+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:36:56.917915+0000","last_peered":"2024-09-12T02:36:56.917915+0000","last_clean":"2024-09-12T02:36:56.917915+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:36:56.917915+0000","last_undegraded":"2024-09-12T02:36:56.917915+0000","last_fullsized":"2024-09-12T02:36:56.917915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880988+0000","last_change":"2024-09-12T02:36:48.887036+0000","last_active":"2024-09-12T02:36:49.880988+0000","last_peered":"2024-09-12T02:36:49.880988+0000","last_clean":"2024-09-12T02:36:49.880988+0000","last_became_active":"2024-09-12T02:36:48.886718+0000","last_became_peered":"2024-09-12T02:36:48.886718+0000","last_unstale":"2024-09-12T02:36:49.880988+0000","last_undegraded":"2024-09-12T02:36:49.880988+0000","last_fullsized":"2024-09-12T02:36:49.880988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.170078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915509+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:36:56.915509+0000","last_peered":"2024-09-12T02:36:56.915509+0000","last_clean":"2024-09-12T02:36:56.915509+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:36:56.915509+0000","last_undegraded":"2024-09-12T02:36:56.915509+0000","last_fullsized":"2024-09-12T02:36:56.915509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879557+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:36:49.879557+0000","last_peered":"2024-09-12T02:36:49.879557+0000","last_clean":"2024-09-12T02:36:49.879557+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:36:49.879557+0000","last_undegraded":"2024-09-12T02:36:49.879557+0000","last_fullsized":"2024-09-12T02:36:49.879557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":159,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:51.005905+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:37:51.005905+0000","last_peered":"2024-09-12T02:37:51.005905+0000","last_clean":"2024-09-12T02:37:51.005905+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:37:51.005905+0000","last_undegraded":"2024-09-12T02:37:51.005905+0000","last_fullsized":"2024-09-12T02:37:51.005905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":114,"num_read_kb":115,"num_write":28,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879225+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:36:49.879225+0000","last_peered":"2024-09-12T02:36:49.879225+0000","last_clean":"2024-09-12T02:36:49.879225+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:36:49.879225+0000","last_undegraded":"2024-09-12T02:36:49.879225+0000","last_fullsized":"2024-09-12T02:36:49.879225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931831+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:36:57.931831+0000","last_peered":"2024-09-12T02:36:57.931831+0000","last_clean":"2024-09-12T02:36:57.931831+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:36:57.931831+0000","last_undegraded":"2024-09-12T02:36:57.931831+0000","last_fullsized":"2024-09-12T02:36:57.931831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864187+0000","last_change":"2024-09-12T02:36:48.875478+0000","last_active":"2024-09-12T02:36:49.864187+0000","last_peered":"2024-09-12T02:36:49.864187+0000","last_clean":"2024-09-12T02:36:49.864187+0000","last_became_active":"2024-09-12T02:36:48.875194+0000","last_became_peered":"2024-09-12T02:36:48.875194+0000","last_unstale":"2024-09-12T02:36:49.864187+0000","last_undegraded":"2024-09-12T02:36:49.864187+0000","last_fullsized":"2024-09-12T02:36:49.864187+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:34.718334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918205+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:36:56.918205+0000","last_peered":"2024-09-12T02:36:56.918205+0000","last_clean":"2024-09-12T02:36:56.918205+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:36:56.918205+0000","last_undegraded":"2024-09-12T02:36:56.918205+0000","last_fullsized":"2024-09-12T02:36:56.918205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882325+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:36:49.882325+0000","last_peered":"2024-09-12T02:36:49.882325+0000","last_clean":"2024-09-12T02:36:49.882325+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:36:49.882325+0000","last_undegraded":"2024-09-12T02:36:49.882325+0000","last_fullsized":"2024-09-12T02:36:49.882325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:48.002403+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:37:48.002403+0000","last_peered":"2024-09-12T02:37:48.002403+0000","last_clean":"2024-09-12T02:37:48.002403+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:37:48.002403+0000","last_undegraded":"2024-09-12T02:37:48.002403+0000","last_fullsized":"2024-09-12T02:37:48.002403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881297+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:36:49.881297+0000","last_peered":"2024-09-12T02:36:49.881297+0000","last_clean":"2024-09-12T02:36:49.881297+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:36:49.881297+0000","last_undegraded":"2024-09-12T02:36:49.881297+0000","last_fullsized":"2024-09-12T02:36:49.881297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932773+0000","last_change":"2024-09-12T02:36:47.033201+0000","last_active":"2024-09-12T02:36:57.932773+0000","last_peered":"2024-09-12T02:36:57.932773+0000","last_clean":"2024-09-12T02:36:57.932773+0000","last_became_active":"2024-09-12T02:36:47.032847+0000","last_became_peered":"2024-09-12T02:36:47.032847+0000","last_unstale":"2024-09-12T02:36:57.932773+0000","last_undegraded":"2024-09-12T02:36:57.932773+0000","last_fullsized":"2024-09-12T02:36:57.932773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:26.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878860+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:36:49.878860+0000","last_peered":"2024-09-12T02:36:49.878860+0000","last_clean":"2024-09-12T02:36:49.878860+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:36:49.878860+0000","last_undegraded":"2024-09-12T02:36:49.878860+0000","last_fullsized":"2024-09-12T02:36:49.878860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.927108+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:36:58.927108+0000","last_peered":"2024-09-12T02:36:58.927108+0000","last_clean":"2024-09-12T02:36:58.927108+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:36:58.927108+0000","last_undegraded":"2024-09-12T02:36:58.927108+0000","last_fullsized":"2024-09-12T02:36:58.927108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864974+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:36:49.864974+0000","last_peered":"2024-09-12T02:36:49.864974+0000","last_clean":"2024-09-12T02:36:49.864974+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:36:49.864974+0000","last_undegraded":"2024-09-12T02:36:49.864974+0000","last_fullsized":"2024-09-12T02:36:49.864974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881527+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:49.881527+0000","last_peered":"2024-09-12T02:36:49.881527+0000","last_clean":"2024-09-12T02:36:49.881527+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:36:49.881527+0000","last_undegraded":"2024-09-12T02:36:49.881527+0000","last_fullsized":"2024-09-12T02:36:49.881527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882083+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:36:49.882083+0000","last_peered":"2024-09-12T02:36:49.882083+0000","last_clean":"2024-09-12T02:36:49.882083+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:36:49.882083+0000","last_undegraded":"2024-09-12T02:36:49.882083+0000","last_fullsized":"2024-09-12T02:36:49.882083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884596+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:36:49.884596+0000","last_peered":"2024-09-12T02:36:49.884596+0000","last_clean":"2024-09-12T02:36:49.884596+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:36:49.884596+0000","last_undegraded":"2024-09-12T02:36:49.884596+0000","last_fullsized":"2024-09-12T02:36:49.884596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672067+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:36:50.672067+0000","last_peered":"2024-09-12T02:36:50.672067+0000","last_clean":"2024-09-12T02:36:50.672067+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:36:50.672067+0000","last_undegraded":"2024-09-12T02:36:50.672067+0000","last_fullsized":"2024-09-12T02:36:50.672067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932449+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:36:57.932449+0000","last_peered":"2024-09-12T02:36:57.932449+0000","last_clean":"2024-09-12T02:36:57.932449+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:36:57.932449+0000","last_undegraded":"2024-09-12T02:36:57.932449+0000","last_fullsized":"2024-09-12T02:36:57.932449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881995+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:36:49.881995+0000","last_peered":"2024-09-12T02:36:49.881995+0000","last_clean":"2024-09-12T02:36:49.881995+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:36:49.881995+0000","last_undegraded":"2024-09-12T02:36:49.881995+0000","last_fullsized":"2024-09-12T02:36:49.881995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881617+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:36:49.881617+0000","last_peered":"2024-09-12T02:36:49.881617+0000","last_clean":"2024-09-12T02:36:49.881617+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:36:49.881617+0000","last_undegraded":"2024-09-12T02:36:49.881617+0000","last_fullsized":"2024-09-12T02:36:49.881617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.932283+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:36:58.932283+0000","last_peered":"2024-09-12T02:36:58.932283+0000","last_clean":"2024-09-12T02:36:58.932283+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:36:58.932283+0000","last_undegraded":"2024-09-12T02:36:58.932283+0000","last_fullsized":"2024-09-12T02:36:58.932283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878502+0000","last_change":"2024-09-12T02:36:48.881273+0000","last_active":"2024-09-12T02:36:49.878502+0000","last_peered":"2024-09-12T02:36:49.878502+0000","last_clean":"2024-09-12T02:36:49.878502+0000","last_became_active":"2024-09-12T02:36:48.880951+0000","last_became_peered":"2024-09-12T02:36:48.880951+0000","last_unstale":"2024-09-12T02:36:49.878502+0000","last_undegraded":"2024-09-12T02:36:49.878502+0000","last_fullsized":"2024-09-12T02:36:49.878502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:10.615849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930831+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:57.930831+0000","last_peered":"2024-09-12T02:36:57.930831+0000","last_clean":"2024-09-12T02:36:57.930831+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:36:57.930831+0000","last_undegraded":"2024-09-12T02:36:57.930831+0000","last_fullsized":"2024-09-12T02:36:57.930831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864151+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:36:49.864151+0000","last_peered":"2024-09-12T02:36:49.864151+0000","last_clean":"2024-09-12T02:36:49.864151+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:36:49.864151+0000","last_undegraded":"2024-09-12T02:36:49.864151+0000","last_fullsized":"2024-09-12T02:36:49.864151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:49.003357+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:49.003357+0000","last_peered":"2024-09-12T02:37:49.003357+0000","last_clean":"2024-09-12T02:37:49.003357+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:37:49.003357+0000","last_undegraded":"2024-09-12T02:37:49.003357+0000","last_fullsized":"2024-09-12T02:37:49.003357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879794+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:36:49.879794+0000","last_peered":"2024-09-12T02:36:49.879794+0000","last_clean":"2024-09-12T02:36:49.879794+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:36:49.879794+0000","last_undegraded":"2024-09-12T02:36:49.879794+0000","last_fullsized":"2024-09-12T02:36:49.879794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672038+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:36:50.672038+0000","last_peered":"2024-09-12T02:36:50.672038+0000","last_clean":"2024-09-12T02:36:50.672038+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:36:50.672038+0000","last_undegraded":"2024-09-12T02:36:50.672038+0000","last_fullsized":"2024-09-12T02:36:50.672038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868181+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:36:49.868181+0000","last_peered":"2024-09-12T02:36:49.868181+0000","last_clean":"2024-09-12T02:36:49.868181+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:36:49.868181+0000","last_undegraded":"2024-09-12T02:36:49.868181+0000","last_fullsized":"2024-09-12T02:36:49.868181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877604+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:36:49.877604+0000","last_peered":"2024-09-12T02:36:49.877604+0000","last_clean":"2024-09-12T02:36:49.877604+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:36:49.877604+0000","last_undegraded":"2024-09-12T02:36:49.877604+0000","last_fullsized":"2024-09-12T02:36:49.877604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:51.250272+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:36:51.250272+0000","last_peered":"2024-09-12T02:36:51.250272+0000","last_clean":"2024-09-12T02:36:51.250272+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:36:51.250272+0000","last_undegraded":"2024-09-12T02:36:51.250272+0000","last_fullsized":"2024-09-12T02:36:51.250272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917448+0000","last_change":"2024-09-12T02:36:47.033330+0000","last_active":"2024-09-12T02:36:56.917448+0000","last_peered":"2024-09-12T02:36:56.917448+0000","last_clean":"2024-09-12T02:36:56.917448+0000","last_became_active":"2024-09-12T02:36:47.032823+0000","last_became_peered":"2024-09-12T02:36:47.032823+0000","last_unstale":"2024-09-12T02:36:56.917448+0000","last_undegraded":"2024-09-12T02:36:56.917448+0000","last_fullsized":"2024-09-12T02:36:56.917448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:51.819661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864458+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:36:49.864458+0000","last_peered":"2024-09-12T02:36:49.864458+0000","last_clean":"2024-09-12T02:36:49.864458+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:36:49.864458+0000","last_undegraded":"2024-09-12T02:36:49.864458+0000","last_fullsized":"2024-09-12T02:36:49.864458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:13.878622+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:37:13.878622+0000","last_peered":"2024-09-12T02:37:13.878622+0000","last_clean":"2024-09-12T02:37:13.878622+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:37:13.878622+0000","last_undegraded":"2024-09-12T02:37:13.878622+0000","last_fullsized":"2024-09-12T02:37:13.878622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878434+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:36:49.878434+0000","last_peered":"2024-09-12T02:36:49.878434+0000","last_clean":"2024-09-12T02:36:49.878434+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:36:49.878434+0000","last_undegraded":"2024-09-12T02:36:49.878434+0000","last_fullsized":"2024-09-12T02:36:49.878434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917383+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:36:56.917383+0000","last_peered":"2024-09-12T02:36:56.917383+0000","last_clean":"2024-09-12T02:36:56.917383+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:36:56.917383+0000","last_undegraded":"2024-09-12T02:36:56.917383+0000","last_fullsized":"2024-09-12T02:36:56.917383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881577+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:36:49.881577+0000","last_peered":"2024-09-12T02:36:49.881577+0000","last_clean":"2024-09-12T02:36:49.881577+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:36:49.881577+0000","last_undegraded":"2024-09-12T02:36:49.881577+0000","last_fullsized":"2024-09-12T02:36:49.881577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918503+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:36:56.918503+0000","last_peered":"2024-09-12T02:36:56.918503+0000","last_clean":"2024-09-12T02:36:56.918503+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:36:56.918503+0000","last_undegraded":"2024-09-12T02:36:56.918503+0000","last_fullsized":"2024-09-12T02:36:56.918503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877329+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:36:49.877329+0000","last_peered":"2024-09-12T02:36:49.877329+0000","last_clean":"2024-09-12T02:36:49.877329+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:36:49.877329+0000","last_undegraded":"2024-09-12T02:36:49.877329+0000","last_fullsized":"2024-09-12T02:36:49.877329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915862+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:36:56.915862+0000","last_peered":"2024-09-12T02:36:56.915862+0000","last_clean":"2024-09-12T02:36:56.915862+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:36:56.915862+0000","last_undegraded":"2024-09-12T02:36:56.915862+0000","last_fullsized":"2024-09-12T02:36:56.915862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865126+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:36:49.865126+0000","last_peered":"2024-09-12T02:36:49.865126+0000","last_clean":"2024-09-12T02:36:49.865126+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:36:49.865126+0000","last_undegraded":"2024-09-12T02:36:49.865126+0000","last_fullsized":"2024-09-12T02:36:49.865126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878004+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:36:49.878004+0000","last_peered":"2024-09-12T02:36:49.878004+0000","last_clean":"2024-09-12T02:36:49.878004+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:36:49.878004+0000","last_undegraded":"2024-09-12T02:36:49.878004+0000","last_fullsized":"2024-09-12T02:36:49.878004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878241+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:36:49.878241+0000","last_peered":"2024-09-12T02:36:49.878241+0000","last_clean":"2024-09-12T02:36:49.878241+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:36:49.878241+0000","last_undegraded":"2024-09-12T02:36:49.878241+0000","last_fullsized":"2024-09-12T02:36:49.878241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918490+0000","last_change":"2024-09-12T02:36:46.857937+0000","last_active":"2024-09-12T02:36:56.918490+0000","last_peered":"2024-09-12T02:36:56.918490+0000","last_clean":"2024-09-12T02:36:56.918490+0000","last_became_active":"2024-09-12T02:36:46.857616+0000","last_became_peered":"2024-09-12T02:36:46.857616+0000","last_unstale":"2024-09-12T02:36:56.918490+0000","last_undegraded":"2024-09-12T02:36:56.918490+0000","last_fullsized":"2024-09-12T02:36:56.918490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:06.893572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881571+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:36:49.881571+0000","last_peered":"2024-09-12T02:36:49.881571+0000","last_clean":"2024-09-12T02:36:49.881571+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:36:49.881571+0000","last_undegraded":"2024-09-12T02:36:49.881571+0000","last_fullsized":"2024-09-12T02:36:49.881571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878450+0000","last_change":"2024-09-12T02:36:48.891312+0000","last_active":"2024-09-12T02:36:49.878450+0000","last_peered":"2024-09-12T02:36:49.878450+0000","last_clean":"2024-09-12T02:36:49.878450+0000","last_became_active":"2024-09-12T02:36:48.890939+0000","last_became_peered":"2024-09-12T02:36:48.890939+0000","last_unstale":"2024-09-12T02:36:49.878450+0000","last_undegraded":"2024-09-12T02:36:49.878450+0000","last_fullsized":"2024-09-12T02:36:49.878450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:55.556561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884755+0000","last_change":"2024-09-12T02:36:46.857550+0000","last_active":"2024-09-12T02:36:49.884755+0000","last_peered":"2024-09-12T02:36:49.884755+0000","last_clean":"2024-09-12T02:36:49.884755+0000","last_became_active":"2024-09-12T02:36:46.857138+0000","last_became_peered":"2024-09-12T02:36:46.857138+0000","last_unstale":"2024-09-12T02:36:49.884755+0000","last_undegraded":"2024-09-12T02:36:49.884755+0000","last_fullsized":"2024-09-12T02:36:49.884755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:44.496822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879255+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:36:49.879255+0000","last_peered":"2024-09-12T02:36:49.879255+0000","last_clean":"2024-09-12T02:36:49.879255+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:36:49.879255+0000","last_undegraded":"2024-09-12T02:36:49.879255+0000","last_fullsized":"2024-09-12T02:36:49.879255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931656+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:36:57.931656+0000","last_peered":"2024-09-12T02:36:57.931656+0000","last_clean":"2024-09-12T02:36:57.931656+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:36:57.931656+0000","last_undegraded":"2024-09-12T02:36:57.931656+0000","last_fullsized":"2024-09-12T02:36:57.931656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880904+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:36:49.880904+0000","last_peered":"2024-09-12T02:36:49.880904+0000","last_clean":"2024-09-12T02:36:49.880904+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:36:49.880904+0000","last_undegraded":"2024-09-12T02:36:49.880904+0000","last_fullsized":"2024-09-12T02:36:49.880904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881702+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:36:49.881702+0000","last_peered":"2024-09-12T02:36:49.881702+0000","last_clean":"2024-09-12T02:36:49.881702+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:36:49.881702+0000","last_undegraded":"2024-09-12T02:36:49.881702+0000","last_fullsized":"2024-09-12T02:36:49.881702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878266+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:36:49.878266+0000","last_peered":"2024-09-12T02:36:49.878266+0000","last_clean":"2024-09-12T02:36:49.878266+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:36:49.878266+0000","last_undegraded":"2024-09-12T02:36:49.878266+0000","last_fullsized":"2024-09-12T02:36:49.878266+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931839+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:36:57.931839+0000","last_peered":"2024-09-12T02:36:57.931839+0000","last_clean":"2024-09-12T02:36:57.931839+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:36:57.931839+0000","last_undegraded":"2024-09-12T02:36:57.931839+0000","last_fullsized":"2024-09-12T02:36:57.931839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":339,"num_read_kb":239,"num_write":160,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514521,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":1076993,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":425984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":425904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1017836,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":425373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1017520,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953534,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":425684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":486673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":484930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":426644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:37:53.401 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:37:53.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:53 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:37:53.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:53 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:37:53.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:53 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:53.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:53 smithi100 ceph-mon[31390]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:53.645 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:54.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:53 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:37:54.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:53 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:37:54.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:53 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:54.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:53 smithi189 ceph-mon[35196]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:54.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:53 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:37:54.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:53 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:37:54.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:53 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:37:54.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:53 smithi117 ceph-mon[34898]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:54.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 -- 172.21.15.100:0/1143000576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e81027a0 msgr2=0x7f56e81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/1143000576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e81027a0 0x7f56e81067f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009900 tx=0x7f56dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:37:54.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 -- 172.21.15.100:0/1143000576 shutdown_connections 2024-09-12T02:37:54.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/1143000576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e8106f20 0x7f56e810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/1143000576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e81027a0 0x7f56e81067f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/1143000576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e8101df0 0x7f56e81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 -- 172.21.15.100:0/1143000576 >> 172.21.15.100:0/1143000576 conn(0x7f56e80fd8b0 msgr2=0x7f56e80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 -- 172.21.15.100:0/1143000576 shutdown_connections 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.132+0000 7f56ef3e0640 1 -- 172.21.15.100:0/1143000576 wait complete. 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 Processor -- start 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 -- start start 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e8101df0 0x7f56e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e81027a0 0x7f56e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e8106f20 0x7f56e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8111f80 con 0x7f56e8101df0 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8111e00 con 0x7f56e8106f20 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ef3e0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8112100 con 0x7f56e81027a0 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e8101df0 0x7f56e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e8101df0 0x7f56e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33030/0 (socket says 172.21.15.100:33030) 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 -- 172.21.15.100:0/2118230453 learned_addr learned my addr 172.21.15.100:0/2118230453 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed97d640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e8106f20 0x7f56e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ec97b640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e81027a0 0x7f56e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 -- 172.21.15.100:0/2118230453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e81027a0 msgr2=0x7f56e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e81027a0 0x7f56e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 -- 172.21.15.100:0/2118230453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e8106f20 msgr2=0x7f56e8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e8106f20 0x7f56e8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed17c640 1 -- 172.21.15.100:0/2118230453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e81a6800 con 0x7f56e8101df0 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ed97d640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e8106f20 0x7f56e8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.133+0000 7f56ec97b640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e81027a0 0x7f56e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.134+0000 7f56ed17c640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e8101df0 0x7f56e80744f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f56e000c920 tx=0x7f56e000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.134+0000 7f56e67fc640 1 -- 172.21.15.100:0/2118230453 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0007c70 con 0x7f56e8101df0 2024-09-12T02:37:54.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.134+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e81a6af0 con 0x7f56e8101df0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.134+0000 7f56e67fc640 1 -- 172.21.15.100:0/2118230453 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e0007e10 con 0x7f56e8101df0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.134+0000 7f56e67fc640 1 -- 172.21.15.100:0/2118230453 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0018890 con 0x7f56e8101df0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.134+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e81a7030 con 0x7f56e8101df0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.135+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e81021d0 con 0x7f56e8101df0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.136+0000 7f56e67fc640 1 -- 172.21.15.100:0/2118230453 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f56e0018a70 con 0x7f56e8101df0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.137+0000 7f56e67fc640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f56d00a2c10 0x7f56d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.137+0000 7f56e67fc640 1 -- 172.21.15.100:0/2118230453 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f56e00cf220 con 0x7f56e8101df0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.137+0000 7f56ec97b640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f56d00a2c10 0x7f56d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.137+0000 7f56ec97b640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f56d00a2c10 0x7f56d00a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.141+0000 7f56e67fc640 1 -- 172.21.15.100:0/2118230453 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56e0014030 con 0x7f56e8101df0 2024-09-12T02:37:54.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.308+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56e8062630 con 0x7f56d00a2c10 2024-09-12T02:37:54.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.316+0000 7f56e67fc640 1 -- 172.21.15.100:0/2118230453 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258864 (secure 0 0 0) 0x7f56e8062630 con 0x7f56d00a2c10 2024-09-12T02:37:54.319 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:54.320 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f56d00a2c10 msgr2=0x7f56d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f56d00a2c10 0x7f56d00a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc032c70 comp rx=0 tx=0).stop 2024-09-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e8101df0 msgr2=0x7f56e80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e8101df0 0x7f56e80744f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f56e000c920 tx=0x7f56e000cde0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 shutdown_connections 2024-09-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f56d00a2c10 0x7f56d00a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e8106f20 0x7f56e8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e81027a0 0x7f56e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 --2- 172.21.15.100:0/2118230453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e8101df0 0x7f56e80744f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 >> 172.21.15.100:0/2118230453 conn(0x7f56e80fd8b0 msgr2=0x7f56e80ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 shutdown_connections 2024-09-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:54.319+0000 7f56ef3e0640 1 -- 172.21.15.100:0/2118230453 wait complete. 2024-09-12T02:37:54.961 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:54 smithi100 ceph-mon[31390]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:54.990 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-12T02:37:53.539140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":465,"num_read_kb":348,"num_write":343,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355984,"kb_used_data":10896,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585840,"statfs":{"total":1151940427776,"available":1151575900160,"internally_reserved":0,"allocated":11157504,"data_stored":7065099,"data_compressed":107292,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003019"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865174+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:36:49.865174+0000","last_peered":"2024-09-12T02:36:49.865174+0000","last_clean":"2024-09-12T02:36:49.865174+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:36:49.865174+0000","last_undegraded":"2024-09-12T02:36:49.865174+0000","last_fullsized":"2024-09-12T02:36:49.865174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881410+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:36:49.881410+0000","last_peered":"2024-09-12T02:36:49.881410+0000","last_clean":"2024-09-12T02:36:49.881410+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:36:49.881410+0000","last_undegraded":"2024-09-12T02:36:49.881410+0000","last_fullsized":"2024-09-12T02:36:49.881410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881087+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:36:49.881087+0000","last_peered":"2024-09-12T02:36:49.881087+0000","last_clean":"2024-09-12T02:36:49.881087+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:36:49.881087+0000","last_undegraded":"2024-09-12T02:36:49.881087+0000","last_fullsized":"2024-09-12T02:36:49.881087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879169+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:36:49.879169+0000","last_peered":"2024-09-12T02:36:49.879169+0000","last_clean":"2024-09-12T02:36:49.879169+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:36:49.879169+0000","last_undegraded":"2024-09-12T02:36:49.879169+0000","last_fullsized":"2024-09-12T02:36:49.879169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877696+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:36:49.877696+0000","last_peered":"2024-09-12T02:36:49.877696+0000","last_clean":"2024-09-12T02:36:49.877696+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:36:49.877696+0000","last_undegraded":"2024-09-12T02:36:49.877696+0000","last_fullsized":"2024-09-12T02:36:49.877696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868052+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:36:49.868052+0000","last_peered":"2024-09-12T02:36:49.868052+0000","last_clean":"2024-09-12T02:36:49.868052+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:36:49.868052+0000","last_undegraded":"2024-09-12T02:36:49.868052+0000","last_fullsized":"2024-09-12T02:36:49.868052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881434+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:36:49.881434+0000","last_peered":"2024-09-12T02:36:49.881434+0000","last_clean":"2024-09-12T02:36:49.881434+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:36:49.881434+0000","last_undegraded":"2024-09-12T02:36:49.881434+0000","last_fullsized":"2024-09-12T02:36:49.881434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877638+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:36:49.877638+0000","last_peered":"2024-09-12T02:36:49.877638+0000","last_clean":"2024-09-12T02:36:49.877638+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:36:49.877638+0000","last_undegraded":"2024-09-12T02:36:49.877638+0000","last_fullsized":"2024-09-12T02:36:49.877638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879042+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:36:49.879042+0000","last_peered":"2024-09-12T02:36:49.879042+0000","last_clean":"2024-09-12T02:36:49.879042+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:36:49.879042+0000","last_undegraded":"2024-09-12T02:36:49.879042+0000","last_fullsized":"2024-09-12T02:36:49.879042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868407+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:36:49.868407+0000","last_peered":"2024-09-12T02:36:49.868407+0000","last_clean":"2024-09-12T02:36:49.868407+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:36:49.868407+0000","last_undegraded":"2024-09-12T02:36:49.868407+0000","last_fullsized":"2024-09-12T02:36:49.868407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881824+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:36:49.881824+0000","last_peered":"2024-09-12T02:36:49.881824+0000","last_clean":"2024-09-12T02:36:49.881824+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:36:49.881824+0000","last_undegraded":"2024-09-12T02:36:49.881824+0000","last_fullsized":"2024-09-12T02:36:49.881824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879320+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:36:49.879320+0000","last_peered":"2024-09-12T02:36:49.879320+0000","last_clean":"2024-09-12T02:36:49.879320+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:36:49.879320+0000","last_undegraded":"2024-09-12T02:36:49.879320+0000","last_fullsized":"2024-09-12T02:36:49.879320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864515+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:36:49.864515+0000","last_peered":"2024-09-12T02:36:49.864515+0000","last_clean":"2024-09-12T02:36:49.864515+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:36:49.864515+0000","last_undegraded":"2024-09-12T02:36:49.864515+0000","last_fullsized":"2024-09-12T02:36:49.864515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880520+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:36:49.880520+0000","last_peered":"2024-09-12T02:36:49.880520+0000","last_clean":"2024-09-12T02:36:49.880520+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:36:49.880520+0000","last_undegraded":"2024-09-12T02:36:49.880520+0000","last_fullsized":"2024-09-12T02:36:49.880520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880233+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:36:49.880233+0000","last_peered":"2024-09-12T02:36:49.880233+0000","last_clean":"2024-09-12T02:36:49.880233+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:36:49.880233+0000","last_undegraded":"2024-09-12T02:36:49.880233+0000","last_fullsized":"2024-09-12T02:36:49.880233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878501+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:36:49.878501+0000","last_peered":"2024-09-12T02:36:49.878501+0000","last_clean":"2024-09-12T02:36:49.878501+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:36:49.878501+0000","last_undegraded":"2024-09-12T02:36:49.878501+0000","last_fullsized":"2024-09-12T02:36:49.878501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865248+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:36:49.865248+0000","last_peered":"2024-09-12T02:36:49.865248+0000","last_clean":"2024-09-12T02:36:49.865248+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:36:49.865248+0000","last_undegraded":"2024-09-12T02:36:49.865248+0000","last_fullsized":"2024-09-12T02:36:49.865248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877874+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:36:49.877874+0000","last_peered":"2024-09-12T02:36:49.877874+0000","last_clean":"2024-09-12T02:36:49.877874+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:36:49.877874+0000","last_undegraded":"2024-09-12T02:36:49.877874+0000","last_fullsized":"2024-09-12T02:36:49.877874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878321+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:36:49.878321+0000","last_peered":"2024-09-12T02:36:49.878321+0000","last_clean":"2024-09-12T02:36:49.878321+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:36:49.878321+0000","last_undegraded":"2024-09-12T02:36:49.878321+0000","last_fullsized":"2024-09-12T02:36:49.878321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864901+0000","last_change":"2024-09-12T02:36:48.891229+0000","last_active":"2024-09-12T02:36:49.864901+0000","last_peered":"2024-09-12T02:36:49.864901+0000","last_clean":"2024-09-12T02:36:49.864901+0000","last_became_active":"2024-09-12T02:36:48.890485+0000","last_became_peered":"2024-09-12T02:36:48.890485+0000","last_unstale":"2024-09-12T02:36:49.864901+0000","last_undegraded":"2024-09-12T02:36:49.864901+0000","last_fullsized":"2024-09-12T02:36:49.864901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.290011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864576+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:36:49.864576+0000","last_peered":"2024-09-12T02:36:49.864576+0000","last_clean":"2024-09-12T02:36:49.864576+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:36:49.864576+0000","last_undegraded":"2024-09-12T02:36:49.864576+0000","last_fullsized":"2024-09-12T02:36:49.864576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878900+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:36:49.878900+0000","last_peered":"2024-09-12T02:36:49.878900+0000","last_clean":"2024-09-12T02:36:49.878900+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:36:49.878900+0000","last_undegraded":"2024-09-12T02:36:49.878900+0000","last_fullsized":"2024-09-12T02:36:49.878900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877749+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:36:49.877749+0000","last_peered":"2024-09-12T02:36:49.877749+0000","last_clean":"2024-09-12T02:36:49.877749+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:36:49.877749+0000","last_undegraded":"2024-09-12T02:36:49.877749+0000","last_fullsized":"2024-09-12T02:36:49.877749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879626+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:36:49.879626+0000","last_peered":"2024-09-12T02:36:49.879626+0000","last_clean":"2024-09-12T02:36:49.879626+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:36:49.879626+0000","last_undegraded":"2024-09-12T02:36:49.879626+0000","last_fullsized":"2024-09-12T02:36:49.879626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878296+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:36:49.878296+0000","last_peered":"2024-09-12T02:36:49.878296+0000","last_clean":"2024-09-12T02:36:49.878296+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:36:49.878296+0000","last_undegraded":"2024-09-12T02:36:49.878296+0000","last_fullsized":"2024-09-12T02:36:49.878296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878797+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:36:49.878797+0000","last_peered":"2024-09-12T02:36:49.878797+0000","last_clean":"2024-09-12T02:36:49.878797+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:36:49.878797+0000","last_undegraded":"2024-09-12T02:36:49.878797+0000","last_fullsized":"2024-09-12T02:36:49.878797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865110+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:36:49.865110+0000","last_peered":"2024-09-12T02:36:49.865110+0000","last_clean":"2024-09-12T02:36:49.865110+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:36:49.865110+0000","last_undegraded":"2024-09-12T02:36:49.865110+0000","last_fullsized":"2024-09-12T02:36:49.865110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864446+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:36:49.864446+0000","last_peered":"2024-09-12T02:36:49.864446+0000","last_clean":"2024-09-12T02:36:49.864446+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:36:49.864446+0000","last_undegraded":"2024-09-12T02:36:49.864446+0000","last_fullsized":"2024-09-12T02:36:49.864446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881494+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:36:49.881494+0000","last_peered":"2024-09-12T02:36:49.881494+0000","last_clean":"2024-09-12T02:36:49.881494+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:36:49.881494+0000","last_undegraded":"2024-09-12T02:36:49.881494+0000","last_fullsized":"2024-09-12T02:36:49.881494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878346+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:36:49.878346+0000","last_peered":"2024-09-12T02:36:49.878346+0000","last_clean":"2024-09-12T02:36:49.878346+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:36:49.878346+0000","last_undegraded":"2024-09-12T02:36:49.878346+0000","last_fullsized":"2024-09-12T02:36:49.878346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878957+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:36:49.878957+0000","last_peered":"2024-09-12T02:36:49.878957+0000","last_clean":"2024-09-12T02:36:49.878957+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:36:49.878957+0000","last_undegraded":"2024-09-12T02:36:49.878957+0000","last_fullsized":"2024-09-12T02:36:49.878957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864847+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:36:49.864847+0000","last_peered":"2024-09-12T02:36:49.864847+0000","last_clean":"2024-09-12T02:36:49.864847+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:36:49.864847+0000","last_undegraded":"2024-09-12T02:36:49.864847+0000","last_fullsized":"2024-09-12T02:36:49.864847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877481+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:36:49.877481+0000","last_peered":"2024-09-12T02:36:49.877481+0000","last_clean":"2024-09-12T02:36:49.877481+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:36:49.877481+0000","last_undegraded":"2024-09-12T02:36:49.877481+0000","last_fullsized":"2024-09-12T02:36:49.877481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:47.001728+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:37:47.001728+0000","last_peered":"2024-09-12T02:37:47.001728+0000","last_clean":"2024-09-12T02:37:47.001728+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:37:47.001728+0000","last_undegraded":"2024-09-12T02:37:47.001728+0000","last_fullsized":"2024-09-12T02:37:47.001728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878173+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:36:49.878173+0000","last_peered":"2024-09-12T02:36:49.878173+0000","last_clean":"2024-09-12T02:36:49.878173+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:36:49.878173+0000","last_undegraded":"2024-09-12T02:36:49.878173+0000","last_fullsized":"2024-09-12T02:36:49.878173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930375+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:36:57.930375+0000","last_peered":"2024-09-12T02:36:57.930375+0000","last_clean":"2024-09-12T02:36:57.930375+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:36:57.930375+0000","last_undegraded":"2024-09-12T02:36:57.930375+0000","last_fullsized":"2024-09-12T02:36:57.930375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931131+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:36:57.931131+0000","last_peered":"2024-09-12T02:36:57.931131+0000","last_clean":"2024-09-12T02:36:57.931131+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:36:57.931131+0000","last_undegraded":"2024-09-12T02:36:57.931131+0000","last_fullsized":"2024-09-12T02:36:57.931131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877682+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:36:49.877682+0000","last_peered":"2024-09-12T02:36:49.877682+0000","last_clean":"2024-09-12T02:36:49.877682+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:36:49.877682+0000","last_undegraded":"2024-09-12T02:36:49.877682+0000","last_fullsized":"2024-09-12T02:36:49.877682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880116+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:36:49.880116+0000","last_peered":"2024-09-12T02:36:49.880116+0000","last_clean":"2024-09-12T02:36:49.880116+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:36:49.880116+0000","last_undegraded":"2024-09-12T02:36:49.880116+0000","last_fullsized":"2024-09-12T02:36:49.880116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877370+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:36:49.877370+0000","last_peered":"2024-09-12T02:36:49.877370+0000","last_clean":"2024-09-12T02:36:49.877370+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:36:49.877370+0000","last_undegraded":"2024-09-12T02:36:49.877370+0000","last_fullsized":"2024-09-12T02:36:49.877370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:50.004919+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:37:50.004919+0000","last_peered":"2024-09-12T02:37:50.004919+0000","last_clean":"2024-09-12T02:37:50.004919+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:37:50.004919+0000","last_undegraded":"2024-09-12T02:37:50.004919+0000","last_fullsized":"2024-09-12T02:37:50.004919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879865+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:36:49.879865+0000","last_peered":"2024-09-12T02:36:49.879865+0000","last_clean":"2024-09-12T02:36:49.879865+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:36:49.879865+0000","last_undegraded":"2024-09-12T02:36:49.879865+0000","last_fullsized":"2024-09-12T02:36:49.879865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917915+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:36:56.917915+0000","last_peered":"2024-09-12T02:36:56.917915+0000","last_clean":"2024-09-12T02:36:56.917915+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:36:56.917915+0000","last_undegraded":"2024-09-12T02:36:56.917915+0000","last_fullsized":"2024-09-12T02:36:56.917915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880988+0000","last_change":"2024-09-12T02:36:48.887036+0000","last_active":"2024-09-12T02:36:49.880988+0000","last_peered":"2024-09-12T02:36:49.880988+0000","last_clean":"2024-09-12T02:36:49.880988+0000","last_became_active":"2024-09-12T02:36:48.886718+0000","last_became_peered":"2024-09-12T02:36:48.886718+0000","last_unstale":"2024-09-12T02:36:49.880988+0000","last_undegraded":"2024-09-12T02:36:49.880988+0000","last_fullsized":"2024-09-12T02:36:49.880988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.170078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915509+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:36:56.915509+0000","last_peered":"2024-09-12T02:36:56.915509+0000","last_clean":"2024-09-12T02:36:56.915509+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:36:56.915509+0000","last_undegraded":"2024-09-12T02:36:56.915509+0000","last_fullsized":"2024-09-12T02:36:56.915509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879557+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:36:49.879557+0000","last_peered":"2024-09-12T02:36:49.879557+0000","last_clean":"2024-09-12T02:36:49.879557+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:36:49.879557+0000","last_undegraded":"2024-09-12T02:36:49.879557+0000","last_fullsized":"2024-09-12T02:36:49.879557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":159,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:51.005905+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:37:51.005905+0000","last_peered":"2024-09-12T02:37:51.005905+0000","last_clean":"2024-09-12T02:37:51.005905+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:37:51.005905+0000","last_undegraded":"2024-09-12T02:37:51.005905+0000","last_fullsized":"2024-09-12T02:37:51.005905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":114,"num_read_kb":115,"num_write":28,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879225+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:36:49.879225+0000","last_peered":"2024-09-12T02:36:49.879225+0000","last_clean":"2024-09-12T02:36:49.879225+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:36:49.879225+0000","last_undegraded":"2024-09-12T02:36:49.879225+0000","last_fullsized":"2024-09-12T02:36:49.879225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931831+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:36:57.931831+0000","last_peered":"2024-09-12T02:36:57.931831+0000","last_clean":"2024-09-12T02:36:57.931831+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:36:57.931831+0000","last_undegraded":"2024-09-12T02:36:57.931831+0000","last_fullsized":"2024-09-12T02:36:57.931831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864187+0000","last_change":"2024-09-12T02:36:48.875478+0000","last_active":"2024-09-12T02:36:49.864187+0000","last_peered":"2024-09-12T02:36:49.864187+0000","last_clean":"2024-09-12T02:36:49.864187+0000","last_became_active":"2024-09-12T02:36:48.875194+0000","last_became_peered":"2024-09-12T02:36:48.875194+0000","last_unstale":"2024-09-12T02:36:49.864187+0000","last_undegraded":"2024-09-12T02:36:49.864187+0000","last_fullsized":"2024-09-12T02:36:49.864187+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:34.718334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918205+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:36:56.918205+0000","last_peered":"2024-09-12T02:36:56.918205+0000","last_clean":"2024-09-12T02:36:56.918205+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:36:56.918205+0000","last_undegraded":"2024-09-12T02:36:56.918205+0000","last_fullsized":"2024-09-12T02:36:56.918205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882325+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:36:49.882325+0000","last_peered":"2024-09-12T02:36:49.882325+0000","last_clean":"2024-09-12T02:36:49.882325+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:36:49.882325+0000","last_undegraded":"2024-09-12T02:36:49.882325+0000","last_fullsized":"2024-09-12T02:36:49.882325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:48.002403+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:37:48.002403+0000","last_peered":"2024-09-12T02:37:48.002403+0000","last_clean":"2024-09-12T02:37:48.002403+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:37:48.002403+0000","last_undegraded":"2024-09-12T02:37:48.002403+0000","last_fullsized":"2024-09-12T02:37:48.002403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881297+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:36:49.881297+0000","last_peered":"2024-09-12T02:36:49.881297+0000","last_clean":"2024-09-12T02:36:49.881297+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:36:49.881297+0000","last_undegraded":"2024-09-12T02:36:49.881297+0000","last_fullsized":"2024-09-12T02:36:49.881297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932773+0000","last_change":"2024-09-12T02:36:47.033201+0000","last_active":"2024-09-12T02:36:57.932773+0000","last_peered":"2024-09-12T02:36:57.932773+0000","last_clean":"2024-09-12T02:36:57.932773+0000","last_became_active":"2024-09-12T02:36:47.032847+0000","last_became_peered":"2024-09-12T02:36:47.032847+0000","last_unstale":"2024-09-12T02:36:57.932773+0000","last_undegraded":"2024-09-12T02:36:57.932773+0000","last_fullsized":"2024-09-12T02:36:57.932773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:26.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878860+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:36:49.878860+0000","last_peered":"2024-09-12T02:36:49.878860+0000","last_clean":"2024-09-12T02:36:49.878860+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:36:49.878860+0000","last_undegraded":"2024-09-12T02:36:49.878860+0000","last_fullsized":"2024-09-12T02:36:49.878860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.927108+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:36:58.927108+0000","last_peered":"2024-09-12T02:36:58.927108+0000","last_clean":"2024-09-12T02:36:58.927108+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:36:58.927108+0000","last_undegraded":"2024-09-12T02:36:58.927108+0000","last_fullsized":"2024-09-12T02:36:58.927108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864974+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:36:49.864974+0000","last_peered":"2024-09-12T02:36:49.864974+0000","last_clean":"2024-09-12T02:36:49.864974+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:36:49.864974+0000","last_undegraded":"2024-09-12T02:36:49.864974+0000","last_fullsized":"2024-09-12T02:36:49.864974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881527+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:49.881527+0000","last_peered":"2024-09-12T02:36:49.881527+0000","last_clean":"2024-09-12T02:36:49.881527+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:36:49.881527+0000","last_undegraded":"2024-09-12T02:36:49.881527+0000","last_fullsized":"2024-09-12T02:36:49.881527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.882083+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:36:49.882083+0000","last_peered":"2024-09-12T02:36:49.882083+0000","last_clean":"2024-09-12T02:36:49.882083+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:36:49.882083+0000","last_undegraded":"2024-09-12T02:36:49.882083+0000","last_fullsized":"2024-09-12T02:36:49.882083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884596+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:36:49.884596+0000","last_peered":"2024-09-12T02:36:49.884596+0000","last_clean":"2024-09-12T02:36:49.884596+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:36:49.884596+0000","last_undegraded":"2024-09-12T02:36:49.884596+0000","last_fullsized":"2024-09-12T02:36:49.884596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672067+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:36:50.672067+0000","last_peered":"2024-09-12T02:36:50.672067+0000","last_clean":"2024-09-12T02:36:50.672067+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:36:50.672067+0000","last_undegraded":"2024-09-12T02:36:50.672067+0000","last_fullsized":"2024-09-12T02:36:50.672067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.932449+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:36:57.932449+0000","last_peered":"2024-09-12T02:36:57.932449+0000","last_clean":"2024-09-12T02:36:57.932449+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:36:57.932449+0000","last_undegraded":"2024-09-12T02:36:57.932449+0000","last_fullsized":"2024-09-12T02:36:57.932449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881995+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:36:49.881995+0000","last_peered":"2024-09-12T02:36:49.881995+0000","last_clean":"2024-09-12T02:36:49.881995+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:36:49.881995+0000","last_undegraded":"2024-09-12T02:36:49.881995+0000","last_fullsized":"2024-09-12T02:36:49.881995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881617+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:36:49.881617+0000","last_peered":"2024-09-12T02:36:49.881617+0000","last_clean":"2024-09-12T02:36:49.881617+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:36:49.881617+0000","last_undegraded":"2024-09-12T02:36:49.881617+0000","last_fullsized":"2024-09-12T02:36:49.881617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:58.932283+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:36:58.932283+0000","last_peered":"2024-09-12T02:36:58.932283+0000","last_clean":"2024-09-12T02:36:58.932283+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:36:58.932283+0000","last_undegraded":"2024-09-12T02:36:58.932283+0000","last_fullsized":"2024-09-12T02:36:58.932283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878502+0000","last_change":"2024-09-12T02:36:48.881273+0000","last_active":"2024-09-12T02:36:49.878502+0000","last_peered":"2024-09-12T02:36:49.878502+0000","last_clean":"2024-09-12T02:36:49.878502+0000","last_became_active":"2024-09-12T02:36:48.880951+0000","last_became_peered":"2024-09-12T02:36:48.880951+0000","last_unstale":"2024-09-12T02:36:49.878502+0000","last_undegraded":"2024-09-12T02:36:49.878502+0000","last_fullsized":"2024-09-12T02:36:49.878502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:10.615849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.930831+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:36:57.930831+0000","last_peered":"2024-09-12T02:36:57.930831+0000","last_clean":"2024-09-12T02:36:57.930831+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:36:57.930831+0000","last_undegraded":"2024-09-12T02:36:57.930831+0000","last_fullsized":"2024-09-12T02:36:57.930831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864151+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:36:49.864151+0000","last_peered":"2024-09-12T02:36:49.864151+0000","last_clean":"2024-09-12T02:36:49.864151+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:36:49.864151+0000","last_undegraded":"2024-09-12T02:36:49.864151+0000","last_fullsized":"2024-09-12T02:36:49.864151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:49.003357+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:49.003357+0000","last_peered":"2024-09-12T02:37:49.003357+0000","last_clean":"2024-09-12T02:37:49.003357+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:37:49.003357+0000","last_undegraded":"2024-09-12T02:37:49.003357+0000","last_fullsized":"2024-09-12T02:37:49.003357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879794+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:36:49.879794+0000","last_peered":"2024-09-12T02:36:49.879794+0000","last_clean":"2024-09-12T02:36:49.879794+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:36:49.879794+0000","last_undegraded":"2024-09-12T02:36:49.879794+0000","last_fullsized":"2024-09-12T02:36:49.879794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:50.672038+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:36:50.672038+0000","last_peered":"2024-09-12T02:36:50.672038+0000","last_clean":"2024-09-12T02:36:50.672038+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:36:50.672038+0000","last_undegraded":"2024-09-12T02:36:50.672038+0000","last_fullsized":"2024-09-12T02:36:50.672038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.868181+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:36:49.868181+0000","last_peered":"2024-09-12T02:36:49.868181+0000","last_clean":"2024-09-12T02:36:49.868181+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:36:49.868181+0000","last_undegraded":"2024-09-12T02:36:49.868181+0000","last_fullsized":"2024-09-12T02:36:49.868181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877604+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:36:49.877604+0000","last_peered":"2024-09-12T02:36:49.877604+0000","last_clean":"2024-09-12T02:36:49.877604+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:36:49.877604+0000","last_undegraded":"2024-09-12T02:36:49.877604+0000","last_fullsized":"2024-09-12T02:36:49.877604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:51.250272+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:36:51.250272+0000","last_peered":"2024-09-12T02:36:51.250272+0000","last_clean":"2024-09-12T02:36:51.250272+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:36:51.250272+0000","last_undegraded":"2024-09-12T02:36:51.250272+0000","last_fullsized":"2024-09-12T02:36:51.250272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917448+0000","last_change":"2024-09-12T02:36:47.033330+0000","last_active":"2024-09-12T02:36:56.917448+0000","last_peered":"2024-09-12T02:36:56.917448+0000","last_clean":"2024-09-12T02:36:56.917448+0000","last_became_active":"2024-09-12T02:36:47.032823+0000","last_became_peered":"2024-09-12T02:36:47.032823+0000","last_unstale":"2024-09-12T02:36:56.917448+0000","last_undegraded":"2024-09-12T02:36:56.917448+0000","last_fullsized":"2024-09-12T02:36:56.917448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:51.819661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.864458+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:36:49.864458+0000","last_peered":"2024-09-12T02:36:49.864458+0000","last_clean":"2024-09-12T02:36:49.864458+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:36:49.864458+0000","last_undegraded":"2024-09-12T02:36:49.864458+0000","last_fullsized":"2024-09-12T02:36:49.864458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:37:13.878622+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:37:13.878622+0000","last_peered":"2024-09-12T02:37:13.878622+0000","last_clean":"2024-09-12T02:37:13.878622+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:37:13.878622+0000","last_undegraded":"2024-09-12T02:37:13.878622+0000","last_fullsized":"2024-09-12T02:37:13.878622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878434+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:36:49.878434+0000","last_peered":"2024-09-12T02:36:49.878434+0000","last_clean":"2024-09-12T02:36:49.878434+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:36:49.878434+0000","last_undegraded":"2024-09-12T02:36:49.878434+0000","last_fullsized":"2024-09-12T02:36:49.878434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.917383+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:36:56.917383+0000","last_peered":"2024-09-12T02:36:56.917383+0000","last_clean":"2024-09-12T02:36:56.917383+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:36:56.917383+0000","last_undegraded":"2024-09-12T02:36:56.917383+0000","last_fullsized":"2024-09-12T02:36:56.917383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881577+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:36:49.881577+0000","last_peered":"2024-09-12T02:36:49.881577+0000","last_clean":"2024-09-12T02:36:49.881577+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:36:49.881577+0000","last_undegraded":"2024-09-12T02:36:49.881577+0000","last_fullsized":"2024-09-12T02:36:49.881577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918503+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:36:56.918503+0000","last_peered":"2024-09-12T02:36:56.918503+0000","last_clean":"2024-09-12T02:36:56.918503+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:36:56.918503+0000","last_undegraded":"2024-09-12T02:36:56.918503+0000","last_fullsized":"2024-09-12T02:36:56.918503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.877329+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:36:49.877329+0000","last_peered":"2024-09-12T02:36:49.877329+0000","last_clean":"2024-09-12T02:36:49.877329+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:36:49.877329+0000","last_undegraded":"2024-09-12T02:36:49.877329+0000","last_fullsized":"2024-09-12T02:36:49.877329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.915862+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:36:56.915862+0000","last_peered":"2024-09-12T02:36:56.915862+0000","last_clean":"2024-09-12T02:36:56.915862+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:36:56.915862+0000","last_undegraded":"2024-09-12T02:36:56.915862+0000","last_fullsized":"2024-09-12T02:36:56.915862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.865126+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:36:49.865126+0000","last_peered":"2024-09-12T02:36:49.865126+0000","last_clean":"2024-09-12T02:36:49.865126+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:36:49.865126+0000","last_undegraded":"2024-09-12T02:36:49.865126+0000","last_fullsized":"2024-09-12T02:36:49.865126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878004+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:36:49.878004+0000","last_peered":"2024-09-12T02:36:49.878004+0000","last_clean":"2024-09-12T02:36:49.878004+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:36:49.878004+0000","last_undegraded":"2024-09-12T02:36:49.878004+0000","last_fullsized":"2024-09-12T02:36:49.878004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878241+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:36:49.878241+0000","last_peered":"2024-09-12T02:36:49.878241+0000","last_clean":"2024-09-12T02:36:49.878241+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:36:49.878241+0000","last_undegraded":"2024-09-12T02:36:49.878241+0000","last_fullsized":"2024-09-12T02:36:49.878241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:56.918490+0000","last_change":"2024-09-12T02:36:46.857937+0000","last_active":"2024-09-12T02:36:56.918490+0000","last_peered":"2024-09-12T02:36:56.918490+0000","last_clean":"2024-09-12T02:36:56.918490+0000","last_became_active":"2024-09-12T02:36:46.857616+0000","last_became_peered":"2024-09-12T02:36:46.857616+0000","last_unstale":"2024-09-12T02:36:56.918490+0000","last_undegraded":"2024-09-12T02:36:56.918490+0000","last_fullsized":"2024-09-12T02:36:56.918490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:06.893572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881571+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:36:49.881571+0000","last_peered":"2024-09-12T02:36:49.881571+0000","last_clean":"2024-09-12T02:36:49.881571+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:36:49.881571+0000","last_undegraded":"2024-09-12T02:36:49.881571+0000","last_fullsized":"2024-09-12T02:36:49.881571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878450+0000","last_change":"2024-09-12T02:36:48.891312+0000","last_active":"2024-09-12T02:36:49.878450+0000","last_peered":"2024-09-12T02:36:49.878450+0000","last_clean":"2024-09-12T02:36:49.878450+0000","last_became_active":"2024-09-12T02:36:48.890939+0000","last_became_peered":"2024-09-12T02:36:48.890939+0000","last_unstale":"2024-09-12T02:36:49.878450+0000","last_undegraded":"2024-09-12T02:36:49.878450+0000","last_fullsized":"2024-09-12T02:36:49.878450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:55.556561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.884755+0000","last_change":"2024-09-12T02:36:46.857550+0000","last_active":"2024-09-12T02:36:49.884755+0000","last_peered":"2024-09-12T02:36:49.884755+0000","last_clean":"2024-09-12T02:36:49.884755+0000","last_became_active":"2024-09-12T02:36:46.857138+0000","last_became_peered":"2024-09-12T02:36:46.857138+0000","last_unstale":"2024-09-12T02:36:49.884755+0000","last_undegraded":"2024-09-12T02:36:49.884755+0000","last_fullsized":"2024-09-12T02:36:49.884755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:44.496822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.879255+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:36:49.879255+0000","last_peered":"2024-09-12T02:36:49.879255+0000","last_clean":"2024-09-12T02:36:49.879255+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:36:49.879255+0000","last_undegraded":"2024-09-12T02:36:49.879255+0000","last_fullsized":"2024-09-12T02:36:49.879255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931656+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:36:57.931656+0000","last_peered":"2024-09-12T02:36:57.931656+0000","last_clean":"2024-09-12T02:36:57.931656+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:36:57.931656+0000","last_undegraded":"2024-09-12T02:36:57.931656+0000","last_fullsized":"2024-09-12T02:36:57.931656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.880904+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:36:49.880904+0000","last_peered":"2024-09-12T02:36:49.880904+0000","last_clean":"2024-09-12T02:36:49.880904+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:36:49.880904+0000","last_undegraded":"2024-09-12T02:36:49.880904+0000","last_fullsized":"2024-09-12T02:36:49.880904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.881702+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:36:49.881702+0000","last_peered":"2024-09-12T02:36:49.881702+0000","last_clean":"2024-09-12T02:36:49.881702+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:36:49.881702+0000","last_undegraded":"2024-09-12T02:36:49.881702+0000","last_fullsized":"2024-09-12T02:36:49.881702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.878266+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:36:49.878266+0000","last_peered":"2024-09-12T02:36:49.878266+0000","last_clean":"2024-09-12T02:36:49.878266+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:36:49.878266+0000","last_undegraded":"2024-09-12T02:36:49.878266+0000","last_fullsized":"2024-09-12T02:36:49.878266+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:36:57.931839+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:36:57.931839+0000","last_peered":"2024-09-12T02:36:57.931839+0000","last_clean":"2024-09-12T02:36:57.931839+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:36:57.931839+0000","last_undegraded":"2024-09-12T02:36:57.931839+0000","last_fullsized":"2024-09-12T02:36:57.931839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":339,"num_read_kb":239,"num_write":160,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514521,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":425748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":1076993,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":425984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":425904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1017836,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":425373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1017520,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953534,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":425684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":486673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":484930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":426644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:37:54.994 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:37:54.995 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:37:54.995 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:37:54.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T02:37:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:54 smithi189 ceph-mon[35196]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:54 smithi117 ceph-mon[34898]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:37:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:55.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 -- 172.21.15.100:0/2674499712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0106a80 msgr2=0x7f66c0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 --2- 172.21.15.100:0/2674499712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0106a80 0x7f66c0106e60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009930 tx=0x7f66b002a420 comp rx=0 tx=0).stop 2024-09-12T02:37:55.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 -- 172.21.15.100:0/2674499712 shutdown_connections 2024-09-12T02:37:55.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 --2- 172.21.15.100:0/2674499712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66c0101420 0x7f66c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 --2- 172.21.15.100:0/2674499712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66c0100a80 0x7f66c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 --2- 172.21.15.100:0/2674499712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0106a80 0x7f66c0106e60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 -- 172.21.15.100:0/2674499712 >> 172.21.15.100:0/2674499712 conn(0x7f66c00fc7a0 msgr2=0x7f66c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:55.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 -- 172.21.15.100:0/2674499712 shutdown_connections 2024-09-12T02:37:55.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.723+0000 7f66c54af640 1 -- 172.21.15.100:0/2674499712 wait complete. 2024-09-12T02:37:55.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 Processor -- start 2024-09-12T02:37:55.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 -- start start 2024-09-12T02:37:55.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66c0100a80 0x7f66c00fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0101420 0x7f66c00fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66c0106a80 0x7f66c00fd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0110ef0 con 0x7f66c0101420 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0110d70 con 0x7f66c0100a80 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66c54af640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0111070 con 0x7f66c0106a80 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66be7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0101420 0x7f66c00fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66be7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0101420 0x7f66c00fd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41940/0 (socket says 172.21.15.100:41940) 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66be7fc640 1 -- 172.21.15.100:0/2330176387 learned_addr learned my addr 172.21.15.100:0/2330176387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.724+0000 7f66bf7fe640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66c0106a80 0x7f66c00fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66beffd640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66c0100a80 0x7f66c00fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66be7fc640 1 -- 172.21.15.100:0/2330176387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66c0106a80 msgr2=0x7f66c00fd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66be7fc640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66c0106a80 0x7f66c00fd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66be7fc640 1 -- 172.21.15.100:0/2330176387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66c0100a80 msgr2=0x7f66c00fcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66be7fc640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66c0100a80 0x7f66c00fcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66be7fc640 1 -- 172.21.15.100:0/2330176387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c01a69e0 con 0x7f66c0101420 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66beffd640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66c0100a80 0x7f66c00fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66be7fc640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0101420 0x7f66c00fd2e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d950 tx=0x7f66b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66a7fff640 1 -- 172.21.15.100:0/2330176387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4017070 con 0x7f66c0101420 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c01a6cd0 con 0x7f66c0101420 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66a7fff640 1 -- 172.21.15.100:0/2330176387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66b4009c30 con 0x7f66c0101420 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66a7fff640 1 -- 172.21.15.100:0/2330176387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b400f6b0 con 0x7f66c0101420 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.725+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c01a71b0 con 0x7f66c0101420 2024-09-12T02:37:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.726+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c0100ee0 con 0x7f66c0101420 2024-09-12T02:37:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.727+0000 7f66a7fff640 1 -- 172.21.15.100:0/2330176387 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f66b40109d0 con 0x7f66c0101420 2024-09-12T02:37:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.728+0000 7f66a7fff640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66a80a2c10 0x7f66a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.728+0000 7f66beffd640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66a80a2c10 0x7f66a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.728+0000 7f66a7fff640 1 -- 172.21.15.100:0/2330176387 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f66b40cee00 con 0x7f66c0101420 2024-09-12T02:37:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.729+0000 7f66beffd640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66a80a2c10 0x7f66a80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006010 tx=0x7f66b0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:55.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.732+0000 7f66a7fff640 1 -- 172.21.15.100:0/2330176387 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66b4009de0 con 0x7f66c0101420 2024-09-12T02:37:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.935+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f66c00fe2d0 con 0x7f66c0101420 2024-09-12T02:37:55.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.936+0000 7f66a7fff640 1 -- 172.21.15.100:0/2330176387 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f66b409bbf0 con 0x7f66c0101420 2024-09-12T02:37:55.936 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:55.936 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T02:37:55.936 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-12T02:37:55.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T02:37:55.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T02:37:55.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T02:37:55.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-12T02:37:55.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 6]}]: dispatch 2024-09-12T02:37:55.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-12T02:37:55.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:55 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-12T02:37:55.937 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:55.937 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:37:55.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66a80a2c10 msgr2=0x7f66a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66a80a2c10 0x7f66a80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006010 tx=0x7f66b0005a20 comp rx=0 tx=0).stop 2024-09-12T02:37:55.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0101420 msgr2=0x7f66c00fd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0101420 0x7f66c00fd2e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d950 tx=0x7f66b400de10 comp rx=0 tx=0).stop 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 shutdown_connections 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66a80a2c10 0x7f66a80a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66c0106a80 0x7f66c00fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c0101420 0x7f66c00fd2e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 --2- 172.21.15.100:0/2330176387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66c0100a80 0x7f66c00fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 >> 172.21.15.100:0/2330176387 conn(0x7f66c00fc7a0 msgr2=0x7f66c006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 shutdown_connections 2024-09-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:55.938+0000 7f66c54af640 1 -- 172.21.15.100:0/2330176387 wait complete. 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 6]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-12T02:37:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:55 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-12T02:37:56.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 6]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-12T02:37:56.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:55 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-12T02:37:56.609 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:37:56.610 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:56.863 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T02:37:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-12T02:37:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T02:37:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T02:37:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T02:37:56.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-12T02:37:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 6]}]': finished 2024-09-12T02:37:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-12T02:37:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-12T02:37:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:37:56.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:56 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2330176387' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:37:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 6]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:37:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:56 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2330176387' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:37:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 6]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:37:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:56 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2330176387' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:37:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 -- 172.21.15.100:0/3188258386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c1002d0 msgr2=0x7fc44c1006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 --2- 172.21.15.100:0/3188258386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c1002d0 0x7fc44c1006b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009930 tx=0x7fc43c02a420 comp rx=0 tx=0).stop 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 -- 172.21.15.100:0/3188258386 shutdown_connections 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 --2- 172.21.15.100:0/3188258386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c106f30 0x7fc44c10ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 --2- 172.21.15.100:0/3188258386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc44c100c80 0x7fc44c106820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 --2- 172.21.15.100:0/3188258386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c1002d0 0x7fc44c1006b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 -- 172.21.15.100:0/3188258386 >> 172.21.15.100:0/3188258386 conn(0x7fc44c0fbee0 msgr2=0x7fc44c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 -- 172.21.15.100:0/3188258386 shutdown_connections 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.296+0000 7fc4516de640 1 -- 172.21.15.100:0/3188258386 wait complete. 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 Processor -- start 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 -- start start 2024-09-12T02:37:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c1002d0 0x7fc44c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc44c100c80 0x7fc44c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c106f30 0x7fc44c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c112060 con 0x7fc44c106f30 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c111ee0 con 0x7fc44c1002d0 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc4516de640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1121e0 con 0x7fc44c100c80 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c106f30 0x7fc44c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c106f30 0x7fc44c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41952/0 (socket says 172.21.15.100:41952) 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.297+0000 7fc44b7fe640 1 -- 172.21.15.100:0/2039473895 learned_addr learned my addr 172.21.15.100:0/2039473895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc44affd640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c1002d0 0x7fc44c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc443fff640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc44c100c80 0x7fc44c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc44b7fe640 1 -- 172.21.15.100:0/2039473895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc44c100c80 msgr2=0x7fc44c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc44b7fe640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc44c100c80 0x7fc44c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc44b7fe640 1 -- 172.21.15.100:0/2039473895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c1002d0 msgr2=0x7fc44c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc44b7fe640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c1002d0 0x7fc44c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc44b7fe640 1 -- 172.21.15.100:0/2039473895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c19d5f0 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc44b7fe640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c106f30 0x7fc44c19cf10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc44400b970 tx=0x7fc44400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc448ff9640 1 -- 172.21.15.100:0/2039473895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444019070 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc448ff9640 1 -- 172.21.15.100:0/2039473895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc44400cb40 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc448ff9640 1 -- 172.21.15.100:0/2039473895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444007650 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c19d8e0 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.298+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c1a51c0 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.299+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c100730 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.300+0000 7fc448ff9640 1 -- 172.21.15.100:0/2039473895 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc44401c070 con 0x7fc44c106f30 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.301+0000 7fc448ff9640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4380a2c90 0x7fc4380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.301+0000 7fc44affd640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4380a2c90 0x7fc4380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.301+0000 7fc448ff9640 1 -- 172.21.15.100:0/2039473895 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc4440ce6b0 con 0x7fc44c106f30 2024-09-12T02:37:57.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.301+0000 7fc44affd640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4380a2c90 0x7fc4380a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009900 tx=0x7fc43c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:57.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.305+0000 7fc448ff9640 1 -- 172.21.15.100:0/2039473895 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc44409af00 con 0x7fc44c106f30 2024-09-12T02:37:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.507+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc44c02d7c0 con 0x7fc44c106f30 2024-09-12T02:37:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.508+0000 7fc448ff9640 1 -- 172.21.15.100:0/2039473895 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fc44409f200 con 0x7fc44c106f30 2024-09-12T02:37:57.508 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:57.509 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:37:00:928817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:37:00.496863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:37:57.509 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4380a2c90 msgr2=0x7fc4380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4380a2c90 0x7fc4380a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009900 tx=0x7fc43c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c106f30 msgr2=0x7fc44c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c106f30 0x7fc44c19cf10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc44400b970 tx=0x7fc44400be30 comp rx=0 tx=0).stop 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 shutdown_connections 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4380a2c90 0x7fc4380a5150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44c106f30 0x7fc44c19cf10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc44c100c80 0x7fc44c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 --2- 172.21.15.100:0/2039473895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c1002d0 0x7fc44c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 >> 172.21.15.100:0/2039473895 conn(0x7fc44c0fbee0 msgr2=0x7fc44c0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 shutdown_connections 2024-09-12T02:37:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:57.510+0000 7fc4516de640 1 -- 172.21.15.100:0/2039473895 wait complete. 2024-09-12T02:37:58.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:57 smithi189 ceph-mon[35196]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:37:58.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:57 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2039473895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:57 smithi117 ceph-mon[34898]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:37:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:57 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2039473895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:57 smithi100 ceph-mon[31390]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:37:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:57 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2039473895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:58.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:58.402 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:58 smithi100 ceph-mon[31390]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:58.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:58 smithi100 ceph-mon[31390]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-12T02:37:58.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 -- 172.21.15.100:0/302699674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 msgr2=0x7fdf1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 --2- 172.21.15.100:0/302699674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf1010da40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009900 tx=0x7fdf0002a480 comp rx=0 tx=0).stop 2024-09-12T02:37:58.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 -- 172.21.15.100:0/302699674 shutdown_connections 2024-09-12T02:37:58.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 --2- 172.21.15.100:0/302699674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf1010da40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 --2- 172.21.15.100:0/302699674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf10102570 0x7fdf101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 --2- 172.21.15.100:0/302699674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf10100e20 0x7fdf10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 -- 172.21.15.100:0/302699674 >> 172.21.15.100:0/302699674 conn(0x7fdf100fc7d0 msgr2=0x7fdf100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 -- 172.21.15.100:0/302699674 shutdown_connections 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.856+0000 7fdf148cf640 1 -- 172.21.15.100:0/302699674 wait complete. 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 Processor -- start 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 -- start start 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf10100e20 0x7fdf101992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf10102570 0x7fdf10199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf101a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf10110f80 con 0x7fdf10102ef0 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdf10110e00 con 0x7fdf10102570 2024-09-12T02:37:58.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.857+0000 7fdf148cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdf10111100 con 0x7fdf10100e20 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf101a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf101a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41966/0 (socket says 172.21.15.100:41966) 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 -- 172.21.15.100:0/4177921282 learned_addr learned my addr 172.21.15.100:0/4177921282 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0dd9b640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf10102570 0x7fdf10199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0e59c640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf10100e20 0x7fdf101992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 -- 172.21.15.100:0/4177921282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf10100e20 msgr2=0x7fdf101992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf10100e20 0x7fdf101992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 -- 172.21.15.100:0/4177921282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf10102570 msgr2=0x7fdf10199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf10102570 0x7fdf10199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 -- 172.21.15.100:0/4177921282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf101a48b0 con 0x7fdf10102ef0 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf0ed9d640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf101a4370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdf00004770 tx=0x7fdf00003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf077fe640 1 -- 172.21.15.100:0/4177921282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0003f070 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf101a4a80 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf077fe640 1 -- 172.21.15.100:0/4177921282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf00031c30 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.858+0000 7fdf077fe640 1 -- 172.21.15.100:0/4177921282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00035030 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.859+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf101a4f30 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.860+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf10101200 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.861+0000 7fdf077fe640 1 -- 172.21.15.100:0/4177921282 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fdf00042070 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.861+0000 7fdf077fe640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdefc0a2c10 0x7fdefc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.862+0000 7fdf077fe640 1 -- 172.21.15.100:0/4177921282 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdf000efa40 con 0x7fdf10102ef0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.862+0000 7fdf0e59c640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdefc0a2c10 0x7fdefc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.862+0000 7fdf0e59c640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdefc0a2c10 0x7fdefc0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005fd0 tx=0x7fdf08009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:58.866+0000 7fdf077fe640 1 -- 172.21.15.100:0/4177921282 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf000bc830 con 0x7fdf10102ef0 2024-09-12T02:37:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:58 smithi189 ceph-mon[35196]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:58 smithi189 ceph-mon[35196]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-12T02:37:59.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.069+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf101a5160 con 0x7fdf10102ef0 2024-09-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.070+0000 7fdf077fe640 1 -- 172.21.15.100:0/4177921282 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fdf000bc130 con 0x7fdf10102ef0 2024-09-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:37:59.071 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:37:00:928817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:37:00.496863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:37:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdefc0a2c10 msgr2=0x7fdefc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdefc0a2c10 0x7fdefc0a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005fd0 tx=0x7fdf08009870 comp rx=0 tx=0).stop 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 msgr2=0x7fdf101a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf101a4370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdf00004770 tx=0x7fdf00003c10 comp rx=0 tx=0).stop 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 shutdown_connections 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdefc0a2c10 0x7fdefc0a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf10102ef0 0x7fdf101a4370 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf10102570 0x7fdf10199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 --2- 172.21.15.100:0/4177921282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf10100e20 0x7fdf101992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 >> 172.21.15.100:0/4177921282 conn(0x7fdf100fc7d0 msgr2=0x7fdf10106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 shutdown_connections 2024-09-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:37:59.072+0000 7fdf148cf640 1 -- 172.21.15.100:0/4177921282 wait complete. 2024-09-12T02:37:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:58 smithi117 ceph-mon[34898]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:37:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:58 smithi117 ceph-mon[34898]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-12T02:37:59.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:37:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:37:59 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4177921282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:59.972 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:37:59 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4177921282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:37:59 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4177921282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.441+0000 7f97b273b640 1 -- 172.21.15.100:0/1838924830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac108290 msgr2=0x7f97ac10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.441+0000 7f97b273b640 1 --2- 172.21.15.100:0/1838924830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac108290 0x7f97ac10ec30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009cd0 tx=0x7f97a402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- 172.21.15.100:0/1838924830 shutdown_connections 2024-09-12T02:38:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 --2- 172.21.15.100:0/1838924830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac108290 0x7f97ac10ec30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 --2- 172.21.15.100:0/1838924830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ac103740 0x7f97ac107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 --2- 172.21.15.100:0/1838924830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ac102d90 0x7f97ac103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- 172.21.15.100:0/1838924830 >> 172.21.15.100:0/1838924830 conn(0x7f97ac0fc7d0 msgr2=0x7f97ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- 172.21.15.100:0/1838924830 shutdown_connections 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- 172.21.15.100:0/1838924830 wait complete. 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 Processor -- start 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- start start 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac102d90 0x7f97ac198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ac103740 0x7f97ac198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ac108290 0x7f97ac19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1120d0 con 0x7f97ac102d90 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac111f50 con 0x7f97ac108290 2024-09-12T02:38:00.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.442+0000 7f97b273b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac112250 con 0x7f97ac103740 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac102d90 0x7f97ac198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac102d90 0x7f97ac198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41990/0 (socket says 172.21.15.100:41990) 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 -- 172.21.15.100:0/2905412589 learned_addr learned my addr 172.21.15.100:0/2905412589 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 -- 172.21.15.100:0/2905412589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ac103740 msgr2=0x7f97ac198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ac103740 0x7f97ac198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 -- 172.21.15.100:0/2905412589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ac108290 msgr2=0x7f97ac19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ac108290 0x7f97ac19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 -- 172.21.15.100:0/2905412589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac19d4c0 con 0x7f97ac102d90 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97abfff640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac102d90 0x7f97ac198510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c920 tx=0x7f979c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97a9ffb640 1 -- 172.21.15.100:0/2905412589 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c007c70 con 0x7f97ac102d90 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac19d7b0 con 0x7f97ac102d90 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97a9ffb640 1 -- 172.21.15.100:0/2905412589 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f979c007e10 con 0x7f97ac102d90 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97a9ffb640 1 -- 172.21.15.100:0/2905412589 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c018890 con 0x7f97ac102d90 2024-09-12T02:38:00.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.443+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac100920 con 0x7f97ac102d90 2024-09-12T02:38:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.444+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ac103170 con 0x7f97ac102d90 2024-09-12T02:38:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.445+0000 7f97a9ffb640 1 -- 172.21.15.100:0/2905412589 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f979c018a50 con 0x7f97ac102d90 2024-09-12T02:38:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.446+0000 7f97a9ffb640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f97980a2c10 0x7f97980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.446+0000 7f97a3fff640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f97980a2c10 0x7f97980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.446+0000 7f97a9ffb640 1 -- 172.21.15.100:0/2905412589 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f979c0cf680 con 0x7f97ac102d90 2024-09-12T02:38:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.446+0000 7f97a3fff640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f97980a2c10 0x7f97980a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0fdbd0 tx=0x7f9794006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.449+0000 7f97a9ffb640 1 -- 172.21.15.100:0/2905412589 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f979c014030 con 0x7f97ac102d90 2024-09-12T02:38:00.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.619+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97ac199870 con 0x7f97ac102d90 2024-09-12T02:38:00.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.620+0000 7f97a9ffb640 1 -- 172.21.15.100:0/2905412589 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22871 (secure 0 0 0) 0x7f979c09c500 con 0x7f97ac102d90 2024-09-12T02:38:00.621 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:00.621 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:37:56.665591+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f97980a2c10 msgr2=0x7f97980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f97980a2c10 0x7f97980a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0fdbd0 tx=0x7f9794006c90 comp rx=0 tx=0).stop 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac102d90 msgr2=0x7f97ac198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac102d90 0x7f97ac198510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c920 tx=0x7f979c00cde0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 shutdown_connections 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f97980a2c10 0x7f97980a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ac108290 0x7f97ac19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ac103740 0x7f97ac198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 --2- 172.21.15.100:0/2905412589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ac102d90 0x7f97ac198510 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 >> 172.21.15.100:0/2905412589 conn(0x7f97ac0fc7d0 msgr2=0x7f97ac0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 shutdown_connections 2024-09-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:00.623+0000 7f97b273b640 1 -- 172.21.15.100:0/2905412589 wait complete. 2024-09-12T02:38:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:00 smithi100 ceph-mon[31390]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T02:38:00.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:00 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2905412589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:00 smithi189 ceph-mon[35196]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T02:38:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:00 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2905412589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:00 smithi117 ceph-mon[34898]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T02:38:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:00 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2905412589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:01.245 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:01.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:01 smithi100 ceph-mon[31390]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T02:38:01.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:01 smithi100 ceph-mon[31390]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-12T02:38:01.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:01 smithi100 ceph-mon[31390]: Cluster is now healthy 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 -- 172.21.15.100:0/678874700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c101420 msgr2=0x7f345c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 --2- 172.21.15.100:0/678874700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c101420 0x7f345c10d950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3454009cd0 tx=0x7f345402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 -- 172.21.15.100:0/678874700 shutdown_connections 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 --2- 172.21.15.100:0/678874700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c101420 0x7f345c10d950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 --2- 172.21.15.100:0/678874700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345c100a80 0x7f345c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 --2- 172.21.15.100:0/678874700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f345c106a80 0x7f345c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 -- 172.21.15.100:0/678874700 >> 172.21.15.100:0/678874700 conn(0x7f345c0fc7a0 msgr2=0x7f345c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 -- 172.21.15.100:0/678874700 shutdown_connections 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.966+0000 7f34626fd640 1 -- 172.21.15.100:0/678874700 wait complete. 2024-09-12T02:38:01.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 Processor -- start 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 -- start start 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345c100a80 0x7f345c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f345c101420 0x7f345c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c106a80 0x7f345c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f345c110e80 con 0x7f345c106a80 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f345c110d00 con 0x7f345c100a80 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f34626fd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f345c111000 con 0x7f345c101420 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f3460c9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c106a80 0x7f345c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f3460c9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c106a80 0x7f345c19bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42004/0 (socket says 172.21.15.100:42004) 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.967+0000 7f3460c9a640 1 -- 172.21.15.100:0/130137036 learned_addr learned my addr 172.21.15.100:0/130137036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f345b7fe640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f345c101420 0x7f345c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f345bfff640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345c100a80 0x7f345c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:01.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f3460c9a640 1 -- 172.21.15.100:0/130137036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f345c101420 msgr2=0x7f345c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f3460c9a640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f345c101420 0x7f345c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f3460c9a640 1 -- 172.21.15.100:0/130137036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345c100a80 msgr2=0x7f345c197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f3460c9a640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345c100a80 0x7f345c197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f3460c9a640 1 -- 172.21.15.100:0/130137036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c19c2b0 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f3460c9a640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c106a80 0x7f345c19bbd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3454005cc0 tx=0x7f3454003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f34597fa640 1 -- 172.21.15.100:0/130137036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454004040 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f34597fa640 1 -- 172.21.15.100:0/130137036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34540046c0 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345c19c540 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f34597fa640 1 -- 172.21.15.100:0/130137036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454046480 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.968+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345c1a3e80 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.969+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345c100ee0 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.970+0000 7f34597fa640 1 -- 172.21.15.100:0/130137036 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f34540305a0 con 0x7f345c106a80 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.971+0000 7f34597fa640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34440a2c10 0x7f34440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.971+0000 7f345bfff640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34440a2c10 0x7f34440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:01.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.971+0000 7f34597fa640 1 -- 172.21.15.100:0/130137036 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f345402e030 con 0x7f345c106a80 2024-09-12T02:38:01.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.971+0000 7f345bfff640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34440a2c10 0x7f34440a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f344c005fd0 tx=0x7f344c00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:01.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:01.975+0000 7f34597fa640 1 -- 172.21.15.100:0/130137036 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f345404b060 con 0x7f345c106a80 2024-09-12T02:38:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:01 smithi189 ceph-mon[35196]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T02:38:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:01 smithi189 ceph-mon[35196]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-12T02:38:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:01 smithi189 ceph-mon[35196]: Cluster is now healthy 2024-09-12T02:38:02.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:01 smithi117 ceph-mon[34898]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T02:38:02.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:01 smithi117 ceph-mon[34898]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-12T02:38:02.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:01 smithi117 ceph-mon[34898]: Cluster is now healthy 2024-09-12T02:38:02.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.176+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f345c109050 con 0x7f345c106a80 2024-09-12T02:38:02.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.177+0000 7f34597fa640 1 -- 172.21.15.100:0/130137036 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f34540bd7f0 con 0x7f345c106a80 2024-09-12T02:38:02.177 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:02.177 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:37:00:928817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:37:00.496863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:38:02.178 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:38:02.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34440a2c10 msgr2=0x7f34440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34440a2c10 0x7f34440a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f344c005fd0 tx=0x7f344c00b510 comp rx=0 tx=0).stop 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c106a80 msgr2=0x7f345c19bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c106a80 0x7f345c19bbd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3454005cc0 tx=0x7f3454003970 comp rx=0 tx=0).stop 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 shutdown_connections 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34440a2c10 0x7f34440a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c106a80 0x7f345c19bbd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f345c101420 0x7f345c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 --2- 172.21.15.100:0/130137036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345c100a80 0x7f345c197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 >> 172.21.15.100:0/130137036 conn(0x7f345c0fc7a0 msgr2=0x7f345c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 shutdown_connections 2024-09-12T02:38:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:02.179+0000 7f34626fd640 1 -- 172.21.15.100:0/130137036 wait complete. 2024-09-12T02:38:02.869 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:02 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/130137036' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:02.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:36:49.490181+0000', 'modified': '2024-09-12T02:37:00.496863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24473, 'mds_1': 24466, 'mds_2': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3724625594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3724625594}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3724625594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/4244197989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 4244197989}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 4244197989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6837/2625823245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 2625823245}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 2625823245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.189:6837/2893582984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 2893582984}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 2893582984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/249791432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 249791432}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 249791432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6839/801964439', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 801964439}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 801964439}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24448, 24466, 24473]} 2024-09-12T02:38:02.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:38:02.899 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:38:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:02 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/130137036' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:02 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/130137036' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:03.143 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:03.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 -- 172.21.15.100:0/1734560856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014101420 msgr2=0x7f101410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 --2- 172.21.15.100:0/1734560856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014101420 0x7f101410d950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1004009cd0 tx=0x7f100402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 -- 172.21.15.100:0/1734560856 shutdown_connections 2024-09-12T02:38:03.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 --2- 172.21.15.100:0/1734560856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014101420 0x7f101410d950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 --2- 172.21.15.100:0/1734560856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1014100a80 0x7f1014100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 --2- 172.21.15.100:0/1734560856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1014106a80 0x7f1014106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 -- 172.21.15.100:0/1734560856 >> 172.21.15.100:0/1734560856 conn(0x7f10140fc7a0 msgr2=0x7f10140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 -- 172.21.15.100:0/1734560856 shutdown_connections 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.611+0000 7f101c579640 1 -- 172.21.15.100:0/1734560856 wait complete. 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 Processor -- start 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 -- start start 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014100a80 0x7f1014197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1014101420 0x7f1014197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1014106a80 0x7f101419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1014110ea0 con 0x7f1014100a80 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1014110d20 con 0x7f1014106a80 2024-09-12T02:38:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101c579640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1014111020 con 0x7f1014101420 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101a315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014100a80 0x7f1014197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101a315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014100a80 0x7f1014197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42026/0 (socket says 172.21.15.100:42026) 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f101a315640 1 -- 172.21.15.100:0/4050794379 learned_addr learned my addr 172.21.15.100:0/4050794379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.612+0000 7f1019b14640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1014101420 0x7f1014197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101ab16640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1014106a80 0x7f101419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101a315640 1 -- 172.21.15.100:0/4050794379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1014101420 msgr2=0x7f1014197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101a315640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1014101420 0x7f1014197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101a315640 1 -- 172.21.15.100:0/4050794379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1014106a80 msgr2=0x7f101419bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101a315640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1014106a80 0x7f101419bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101a315640 1 -- 172.21.15.100:0/4050794379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101419c2f0 con 0x7f1014100a80 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101a315640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014100a80 0x7f1014197340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f100c00d990 tx=0x7f100c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f10137fe640 1 -- 172.21.15.100:0/4050794379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c01b070 con 0x7f1014100a80 2024-09-12T02:38:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f10137fe640 1 -- 172.21.15.100:0/4050794379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100c00edf0 con 0x7f1014100a80 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f10137fe640 1 -- 172.21.15.100:0/4050794379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c014870 con 0x7f1014100a80 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101419c5e0 con 0x7f1014100a80 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.613+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101406a790 con 0x7f1014100a80 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.615+0000 7f10137fe640 1 -- 172.21.15.100:0/4050794379 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f100c01e070 con 0x7f1014100a80 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 Processor -- start 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 -- start start 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f10137fe640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ffc0a2c10 0x7f0ffc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199b99d0 0x55af199b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199ba2f0 0x55af199c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55af19920090 con 0x55af199c4bb0 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55af198c7a70 con 0x55af199ba2f0 2024-09-12T02:38:03.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101e952740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55af1991c050 con 0x55af199b99d0 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101ab16640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ffc0a2c10 0x7f0ffc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f10137fe640 1 -- 172.21.15.100:0/4050794379 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f100c0d0850 con 0x7f1014100a80 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101ab16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101a315640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199b99d0 0x55af199b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101ab16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42038/0 (socket says 172.21.15.100:42038) 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f101ab16640 1 -- 172.21.15.100:0/3477337635 learned_addr learned my addr 172.21.15.100:0/3477337635 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.616+0000 7f1019b14640 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199ba2f0 0x55af199c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f101ab16640 1 -- 172.21.15.100:0/3477337635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199b99d0 msgr2=0x55af199b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f101ab16640 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199b99d0 0x55af199b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f101ab16640 1 -- 172.21.15.100:0/3477337635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199ba2f0 msgr2=0x55af199c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f101ab16640 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199ba2f0 0x55af199c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f101ab16640 1 -- 172.21.15.100:0/3477337635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af198d4130 con 0x55af199c4bb0 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f101ab16640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ffc0a2c10 0x7f0ffc0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1004006010 tx=0x7f1004009910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f101ab16640 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199c6fa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1004035000 tx=0x7f1004046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6faad166b36490 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f1010ff9640 1 -- 172.21.15.100:0/3477337635 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004004440 con 0x55af199c4bb0 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f1010ff9640 1 -- 172.21.15.100:0/3477337635 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1004036040 con 0x55af199c4bb0 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.617+0000 7f1010ff9640 1 -- 172.21.15.100:0/3477337635 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100403d420 con 0x55af199c4bb0 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- 172.21.15.100:0/3477337635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 msgr2=0x55af199c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199c6fa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1004035000 tx=0x7f1004046000 comp rx=0 tx=0).stop 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- 172.21.15.100:0/3477337635 shutdown_connections 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199c6fa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199ba2f0 0x55af199c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 --2- 172.21.15.100:0/3477337635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199b99d0 0x55af199b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- 172.21.15.100:0/3477337635 >> 172.21.15.100:0/3477337635 conn(0x55af199b5f60 msgr2=0x55af199b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- 172.21.15.100:0/3477337635 shutdown_connections 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- 172.21.15.100:0/3477337635 wait complete. 2024-09-12T02:38:03.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- start start 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 Processor -- start 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55af199cbb30 con 0x55af199b99d0 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.618+0000 7f101e952740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55af198daf20 con 0x55af199c4bb0 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101e952740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55af199cbcb0 con 0x55af199ba2f0 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101e952740 10 client.0 _ll_register_callbacks cb 0x55af198a4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42042/0 (socket says 172.21.15.100:42042) 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 -- 172.21.15.100:0/3883238603 learned_addr learned my addr 172.21.15.100:0/3883238603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 -- 172.21.15.100:0/3883238603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 msgr2=0x55af199c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 -- 172.21.15.100:0/3883238603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 msgr2=0x55af199c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101ab16640 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 -- 172.21.15.100:0/3883238603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af196912b0 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101a315640 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199c4480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f100c09cd50 tx=0x7f100c09d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348679b9ff2a16f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f0ff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/3883238603 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c0bd110 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/3883238603 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f100c016bd0 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1004036040 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/3883238603 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f100c0a5cc0 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101e952740 10 client.14979 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55af199d7530 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.619+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/3883238603 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1004036040 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/3883238603 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f100c00e040 con 0x55af199b99d0 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f101e952740 10 client.14979 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f101e952740 10 client.14979 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f101e952740 20 client.14979 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f101e952740 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af199d9be0 0x55af199db050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f101e952740 4 client.14979 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af1992d600 con 0x55af199d9be0 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f1019b14640 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af199d9be0 0x55af199db050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f0ff9ffb640 10 client.14979 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.620+0000 7f1019b14640 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af199d9be0 0x55af199db050 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47c2915fcea3344f server_cookie=a8459337be74ae56 in_seq=0 out_seq=0 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/3883238603 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af1992d600 con 0x55af199d9be0 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f0ff9ffb640 10 client.14979 handle_command_reply: tid=0 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 client.14979 shutdown 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 msgr2=0x55af199c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199c4480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f100c09cd50 tx=0x7f100c09d810 comp rx=0 tx=0).stop 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 shutdown_connections 2024-09-12T02:38:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af199d9be0 0x55af199db050 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f0ff9ffb640 0 client.14979 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 --2- 172.21.15.100:0/3883238603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199c4480 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.621+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 >> 172.21.15.100:0/3883238603 conn(0x55af199b5f60 msgr2=0x55af199bbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.622+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 shutdown_connections 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.622+0000 7f101e952740 1 -- 172.21.15.100:0/3883238603 wait complete. 2024-09-12T02:38:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.622+0000 7f101e952740 20 client.14979 trim_cache size 0 max 16384 2024-09-12T02:38:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 Processor -- start 2024-09-12T02:38:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 -- start start 2024-09-12T02:38:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199da2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55af199d9390 con 0x55af199b99d0 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55af199d9a60 con 0x55af199c4bb0 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101e952740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55af199da130 con 0x55af199ba2f0 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101a315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199da2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101a315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199da2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42054/0 (socket says 172.21.15.100:42054) 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.639+0000 7f101a315640 1 -- 172.21.15.100:0/6937836 learned_addr learned my addr 172.21.15.100:0/6937836 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101a315640 1 -- 172.21.15.100:0/6937836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 msgr2=0x55af199c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101a315640 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101a315640 1 -- 172.21.15.100:0/6937836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 msgr2=0x55af199c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101ab16640 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101a315640 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101a315640 1 -- 172.21.15.100:0/6937836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af199b6b60 con 0x55af199b99d0 2024-09-12T02:38:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101a315640 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199da2b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f100c09b580 tx=0x7f100c0a1580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69a92c8c1cdbf8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:03.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f0ffbfff640 1 -- 172.21.15.100:0/6937836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c09cb90 con 0x55af199b99d0 2024-09-12T02:38:03.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f0ffbfff640 1 -- 172.21.15.100:0/6937836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100c0bd110 con 0x55af199b99d0 2024-09-12T02:38:03.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f0ffbfff640 1 -- 172.21.15.100:0/6937836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c097e20 con 0x55af199b99d0 2024-09-12T02:38:03.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101e952740 1 -- 172.21.15.100:0/6937836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 msgr2=0x55af199da2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.640+0000 7f101e952740 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199da2b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f100c09b580 tx=0x7f100c0a1580 comp rx=0 tx=0).stop 2024-09-12T02:38:03.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- 172.21.15.100:0/6937836 shutdown_connections 2024-09-12T02:38:03.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199c4bb0 0x55af199c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 --2- 172.21.15.100:0/6937836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199b99d0 0x55af199da2b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- 172.21.15.100:0/6937836 >> 172.21.15.100:0/6937836 conn(0x55af199b5f60 msgr2=0x55af199c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- 172.21.15.100:0/6937836 shutdown_connections 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- 172.21.15.100:0/6937836 wait complete. 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- start start 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 Processor -- start 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199b99d0 0x55af199e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199bf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55af199daed0 con 0x55af199c4bb0 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55af199da800 con 0x55af199b99d0 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55af199db5a0 con 0x55af199ba2f0 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101e952740 10 client.0 _ll_register_callbacks cb 0x7f100c00d8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101ab16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101ab16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199bf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42070/0 (socket says 172.21.15.100:42070) 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101ab16640 1 -- 172.21.15.100:0/12172799 learned_addr learned my addr 172.21.15.100:0/12172799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.641+0000 7f101a315640 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199b99d0 0x55af199e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101ab16640 1 -- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 msgr2=0x55af199be8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f1019b14640 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101ab16640 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199be8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101ab16640 1 -- 172.21.15.100:0/12172799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199b99d0 msgr2=0x55af199e3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101ab16640 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199b99d0 0x55af199e3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101ab16640 1 -- 172.21.15.100:0/12172799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af199e16d0 con 0x55af199c4bb0 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101ab16640 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199bf000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f100402a920 tx=0x7f1004005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b32d82e6153ad16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f0ff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/12172799 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004004860 con 0x55af199c4bb0 2024-09-12T02:38:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/12172799 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f10040307b0 con 0x55af199c4bb0 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f100c0bd110 con 0x55af199c4bb0 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/12172799 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f10040309d0 con 0x55af199c4bb0 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101e952740 10 client.14985 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55af19a444b0 con 0x55af199c4bb0 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/12172799 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100c0bd110 con 0x55af199c4bb0 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/12172799 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1004030070 con 0x55af199c4bb0 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.642+0000 7f101e952740 10 client.14985 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101e952740 10 client.14985 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101e952740 20 client.14985 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101e952740 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af19a48ae0 0x55af19a477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101e952740 4 client.14985 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "status"}) -- 0x55af19927b10 con 0x55af19a48ae0 2024-09-12T02:38:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101a315640 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af19a48ae0 0x55af19a477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101a315640 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af19a48ae0 0x55af19a477f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bd0a90dd8d324946 server_cookie=7093ec8d3cd0437a in_seq=0 out_seq=0 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f0ff9ffb640 10 client.14985 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f0ff9ffb640 1 -- 172.21.15.100:0/12172799 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55af19927b10 con 0x55af19a48ae0 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f0ff9ffb640 10 client.14985 handle_command_reply: tid=0 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.643+0000 7f101e952740 1 client.14985 shutdown 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 msgr2=0x55af199bf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199bf000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f100402a920 tx=0x7f1004005dc0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 shutdown_connections 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55af19a48ae0 0x55af19a477f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af199c4bb0 0x55af199bf000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af199ba2f0 0x55af199be8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f0ff9ffb640 0 client.14985 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 --2- 172.21.15.100:0/12172799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55af199b99d0 0x55af199e3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 >> 172.21.15.100:0/12172799 conn(0x55af199b5f60 msgr2=0x55af199bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 shutdown_connections 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 1 -- 172.21.15.100:0/12172799 wait complete. 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101e952740 20 client.14985 trim_cache size 0 max 16384 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24448, 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:03.650 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:03.651 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 65.721569924999997, 2024-09-12T02:38:03.651 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:38:03.651 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:03.651 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:38:03.651 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 98.279091695000005 2024-09-12T02:38:03.651 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ffc0a2c10 msgr2=0x7f0ffc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ffc0a2c10 0x7f0ffc0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1004006010 tx=0x7f1004009910 comp rx=0 tx=0).stop 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014100a80 msgr2=0x7f1014197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014100a80 0x7f1014197340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f100c00d990 tx=0x7f100c00de50 comp rx=0 tx=0).stop 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 shutdown_connections 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ffc0a2c10 0x7f0ffc0a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1014106a80 0x7f101419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1014101420 0x7f1014197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 --2- 172.21.15.100:0/4050794379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1014100a80 0x7f1014197340 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 >> 172.21.15.100:0/4050794379 conn(0x7f10140fc7a0 msgr2=0x7f10140fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 shutdown_connections 2024-09-12T02:38:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:03.644+0000 7f101c579640 1 -- 172.21.15.100:0/4050794379 wait complete. 2024-09-12T02:38:03.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:03 smithi100 ceph-mon[31390]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T02:38:04.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:03 smithi189 ceph-mon[35196]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T02:38:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:03 smithi117 ceph-mon[34898]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T02:38:04.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:38:04.691 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 -- 172.21.15.100:0/1703269154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc100e20 msgr2=0x7f47dc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 --2- 172.21.15.100:0/1703269154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc100e20 0x7f47dc101200 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009900 tx=0x7f47cc02a480 comp rx=0 tx=0).stop 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 -- 172.21.15.100:0/1703269154 shutdown_connections 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 --2- 172.21.15.100:0/1703269154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47dc102ef0 0x7f47dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 --2- 172.21.15.100:0/1703269154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47dc102570 0x7f47dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 --2- 172.21.15.100:0/1703269154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc100e20 0x7f47dc101200 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 -- 172.21.15.100:0/1703269154 >> 172.21.15.100:0/1703269154 conn(0x7f47dc0fc7d0 msgr2=0x7f47dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 -- 172.21.15.100:0/1703269154 shutdown_connections 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.280+0000 7f47e1a40640 1 -- 172.21.15.100:0/1703269154 wait complete. 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 Processor -- start 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 -- start start 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47dc100e20 0x7f47dc197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc102570 0x7f47dc197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47dc102ef0 0x7f47dc19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc110fc0 con 0x7f47dc102570 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc110e40 con 0x7f47dc100e20 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47e1a40640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc111140 con 0x7f47dc102ef0 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47da7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc102570 0x7f47dc197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47da7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc102570 0x7f47dc197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41418/0 (socket says 172.21.15.100:41418) 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47da7fc640 1 -- 172.21.15.100:0/317056432 learned_addr learned my addr 172.21.15.100:0/317056432 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47db7fe640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47dc102ef0 0x7f47dc19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47daffd640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47dc100e20 0x7f47dc197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47da7fc640 1 -- 172.21.15.100:0/317056432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47dc102ef0 msgr2=0x7f47dc19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.281+0000 7f47da7fc640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47dc102ef0 0x7f47dc19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47da7fc640 1 -- 172.21.15.100:0/317056432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47dc100e20 msgr2=0x7f47dc197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47da7fc640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47dc100e20 0x7f47dc197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47da7fc640 1 -- 172.21.15.100:0/317056432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc19c3e0 con 0x7f47dc102570 2024-09-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47daffd640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47dc100e20 0x7f47dc197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47db7fe640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47dc102ef0 0x7f47dc19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47da7fc640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc102570 0x7f47dc197970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47d000d770 tx=0x7f47d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47e0a3e640 1 -- 172.21.15.100:0/317056432 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0017070 con 0x7f47dc102570 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47e0a3e640 1 -- 172.21.15.100:0/317056432 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d0005500 con 0x7f47dc102570 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47e0a3e640 1 -- 172.21.15.100:0/317056432 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0004e00 con 0x7f47dc102570 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47dc19c6d0 con 0x7f47dc102570 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.282+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47dc1a3fb0 con 0x7f47dc102570 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.284+0000 7f47e0a3e640 1 -- 172.21.15.100:0/317056432 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f47d0004fa0 con 0x7f47dc102570 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 Processor -- start 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 -- start start 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e0a3e640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47c40a2c90 0x7f47c40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed17db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed22670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed24fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d74ec7e090 con 0x55d74ed22bb0 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d74ec25a70 con 0x55d74ed179d0 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e3e19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d74ec7a050 con 0x55d74ed182f0 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47db7fe640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47c40a2c90 0x7f47c40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed24fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed24fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41428/0 (socket says 172.21.15.100:41428) 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47db7fe640 1 -- 172.21.15.100:0/2601138434 learned_addr learned my addr 172.21.15.100:0/2601138434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47daffd640 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed17db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47e0a3e640 1 -- 172.21.15.100:0/317056432 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f47d00cecc0 con 0x7f47dc102570 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.285+0000 7f47da7fc640 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed22670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47db7fe640 1 -- 172.21.15.100:0/2601138434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 msgr2=0x55d74ed22670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47db7fe640 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed22670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47db7fe640 1 -- 172.21.15.100:0/2601138434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 msgr2=0x55d74ed17db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47db7fe640 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed17db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47db7fe640 1 -- 172.21.15.100:0/2601138434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d74ec32130 con 0x55d74ed22bb0 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47daffd640 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed17db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47db7fe640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47c40a2c90 0x7f47c40a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009fd0 tx=0x7f47d4009ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47db7fe640 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed24fa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47d400a710 tx=0x7f47d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634e253531a28e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47c1ffb640 1 -- 172.21.15.100:0/2601138434 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d401f070 con 0x55d74ed22bb0 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47c1ffb640 1 -- 172.21.15.100:0/2601138434 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d4018de0 con 0x55d74ed22bb0 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.286+0000 7f47c1ffb640 1 -- 172.21.15.100:0/2601138434 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4013040 con 0x55d74ed22bb0 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 -- 172.21.15.100:0/2601138434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 msgr2=0x55d74ed24fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed24fa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47d400a710 tx=0x7f47d4019000 comp rx=0 tx=0).stop 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 -- 172.21.15.100:0/2601138434 shutdown_connections 2024-09-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed24fa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed22670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2601138434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed17db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 -- 172.21.15.100:0/2601138434 >> 172.21.15.100:0/2601138434 conn(0x55d74ed13f60 msgr2=0x55d74ed14340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 -- 172.21.15.100:0/2601138434 shutdown_connections 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 -- 172.21.15.100:0/2601138434 wait complete. 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 -- start start 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.287+0000 7f47e3e19740 1 Processor -- start 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed223f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed1f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed1fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed25720 con 0x55d74ed22bb0 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d74ec38f20 con 0x55d74ed179d0 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed258a0 con 0x55d74ed182f0 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 10 client.0 _ll_register_callbacks cb 0x55d74ec02030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed1fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed1fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41436/0 (socket says 172.21.15.100:41436) 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 -- 172.21.15.100:0/4215128661 learned_addr learned my addr 172.21.15.100:0/4215128661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47da7fc640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed1f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47daffd640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 -- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 msgr2=0x55d74ed1f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed1f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 -- 172.21.15.100:0/4215128661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 msgr2=0x55d74ed223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 -- 172.21.15.100:0/4215128661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d74e9ef2b0 con 0x55d74ed22bb0 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47daffd640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47da7fc640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47db7fe640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed1fc80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f47d4023cf0 tx=0x7f47d400aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c9bfe13d845356 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47baffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47baffd640 1 -- 172.21.15.100:0/4215128661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d401f040 con 0x55d74ed22bb0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47baffd640 1 -- 172.21.15.100:0/4215128661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f47d4029040 con 0x55d74ed22bb0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d4018de0 con 0x55d74ed22bb0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47baffd640 1 -- 172.21.15.100:0/4215128661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f47d400ae50 con 0x55d74ed22bb0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 10 client.14997 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.288+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d74ed33240 con 0x55d74ed22bb0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47baffd640 1 -- 172.21.15.100:0/4215128661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d4018de0 con 0x55d74ed22bb0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47baffd640 1 -- 172.21.15.100:0/4215128661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f47d402d070 con 0x55d74ed22bb0 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47e3e19740 10 client.14997 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47e3e19740 10 client.14997 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47e3e19740 20 client.14997 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47e3e19740 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74ed355c0 0x55d74ed36a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47e3e19740 4 client.14997 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d74ec8b600 con 0x55d74ed355c0 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47daffd640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74ed355c0 0x55d74ed36a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47baffd640 10 client.14997 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.289+0000 7f47daffd640 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74ed355c0 0x55d74ed36a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c74c925fcb30303 server_cookie=a6c0b7375178d322 in_seq=0 out_seq=0 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47baffd640 1 -- 172.21.15.100:0/4215128661 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d74ec8b600 con 0x55d74ed355c0 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47baffd640 10 client.14997 handle_command_reply: tid=0 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 client.14997 shutdown 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 msgr2=0x55d74ed1fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed1fc80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f47d4023cf0 tx=0x7f47d400aad0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 shutdown_connections 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74ed355c0 0x55d74ed36a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed22bb0 0x55d74ed1fc80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed182f0 0x55d74ed1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 --2- 172.21.15.100:0/4215128661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed179d0 0x55d74ed223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.290+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 >> 172.21.15.100:0/4215128661 conn(0x55d74ed13f60 msgr2=0x55d74ed19c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.291+0000 7f47baffd640 0 client.14997 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.291+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 shutdown_connections 2024-09-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.291+0000 7f47e3e19740 1 -- 172.21.15.100:0/4215128661 wait complete. 2024-09-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.291+0000 7f47e3e19740 20 client.14997 trim_cache size 0 max 16384 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 Processor -- start 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 -- start start 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed34ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed36360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed1ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed34d70 con 0x55d74ed179d0 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed35440 con 0x55d74ed182f0 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47e3e19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed35b10 con 0x55d74ed22bb0 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed34ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed34ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41444/0 (socket says 172.21.15.100:41444) 2024-09-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 -- 172.21.15.100:0/1549641427 learned_addr learned my addr 172.21.15.100:0/1549641427 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47db7fe640 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed1ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47da7fc640 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed36360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 -- 172.21.15.100:0/1549641427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 msgr2=0x55d74ed1ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed1ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 -- 172.21.15.100:0/1549641427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 msgr2=0x55d74ed36360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed36360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 -- 172.21.15.100:0/1549641427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d74ed1b320 con 0x55d74ed179d0 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47db7fe640 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed1ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.309+0000 7f47daffd640 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed34ef0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f47cc033000 tx=0x7f47cc0051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c56c51a97f57f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47c17fa640 1 -- 172.21.15.100:0/1549641427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc035040 con 0x55d74ed179d0 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47c17fa640 1 -- 172.21.15.100:0/1549641427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47cc0053b0 con 0x55d74ed179d0 2024-09-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47c17fa640 1 -- 172.21.15.100:0/1549641427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc003a90 con 0x55d74ed179d0 2024-09-12T02:38:05.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 -- 172.21.15.100:0/1549641427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 msgr2=0x55d74ed34ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed34ef0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f47cc033000 tx=0x7f47cc0051d0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 -- 172.21.15.100:0/1549641427 shutdown_connections 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed1ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed36360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 --2- 172.21.15.100:0/1549641427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed34ef0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 -- 172.21.15.100:0/1549641427 >> 172.21.15.100:0/1549641427 conn(0x55d74ed13f60 msgr2=0x55d74ed34650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 -- 172.21.15.100:0/1549641427 shutdown_connections 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.310+0000 7f47e3e19740 1 -- 172.21.15.100:0/1549641427 wait complete. 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 -- start start 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 Processor -- start 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed3f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed37ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed368b0 con 0x55d74ed179d0 2024-09-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed361e0 con 0x55d74ed182f0 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d74ed36f80 con 0x55d74ed22bb0 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47daffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed3f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47e3e19740 10 client.0 _ll_register_callbacks cb 0x7f47cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47daffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed3f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41452/0 (socket says 172.21.15.100:41452) 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.311+0000 7f47daffd640 1 -- 172.21.15.100:0/2628295407 learned_addr learned my addr 172.21.15.100:0/2628295407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47da7fc640 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed37ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47daffd640 1 -- 172.21.15.100:0/2628295407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 msgr2=0x55d74ed381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47daffd640 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47daffd640 1 -- 172.21.15.100:0/2628295407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 msgr2=0x55d74ed37ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47daffd640 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed37ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47daffd640 1 -- 172.21.15.100:0/2628295407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d74ed38a10 con 0x55d74ed179d0 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47da7fc640 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed37ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47daffd640 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed3f4f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f47cc000c00 tx=0x7f47cc0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101accb95e826c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47baffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47baffd640 1 -- 172.21.15.100:0/2628295407 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc04f030 con 0x55d74ed179d0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47baffd640 1 -- 172.21.15.100:0/2628295407 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f47cc042050 con 0x55d74ed179d0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47cc0053b0 con 0x55d74ed179d0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47baffd640 1 -- 172.21.15.100:0/2628295407 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f47cc035070 con 0x55d74ed179d0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47e3e19740 10 client.15003 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d74ed9ed20 con 0x55d74ed179d0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.312+0000 7f47baffd640 1 -- 172.21.15.100:0/2628295407 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47cc0053b0 con 0x55d74ed179d0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47baffd640 1 -- 172.21.15.100:0/2628295407 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f47cc031540 con 0x55d74ed179d0 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47e3e19740 10 client.15003 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47e3e19740 10 client.15003 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47e3e19740 20 client.15003 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74eda3460 0x55d74eda2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47e3e19740 4 client.15003 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "status"}) -- 0x55d74ec85b10 con 0x55d74eda3460 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47da7fc640 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74eda3460 0x55d74eda2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47da7fc640 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74eda3460 0x55d74eda2170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=727b0d7b8f79d5df server_cookie=6da3c720803ee99a in_seq=0 out_seq=0 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47baffd640 10 client.15003 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47baffd640 1 -- 172.21.15.100:0/2628295407 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d74ec85b10 con 0x55d74eda3460 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47baffd640 10 client.15003 handle_command_reply: tid=0 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.313+0000 7f47e3e19740 1 client.15003 shutdown 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 msgr2=0x55d74ed3f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed3f4f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f47cc000c00 tx=0x7f47cc0035f0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 shutdown_connections 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55d74eda3460 0x55d74eda2170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d74ed22bb0 0x55d74ed381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d74ed182f0 0x55d74ed37ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 --2- 172.21.15.100:0/2628295407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d74ed179d0 0x55d74ed3f4f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 >> 172.21.15.100:0/2628295407 conn(0x55d74ed13f60 msgr2=0x55d74ed16350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47baffd640 0 client.15003 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 shutdown_connections 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 1 -- 172.21.15.100:0/2628295407 wait complete. 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e3e19740 20 client.15003 trim_cache size 0 max 16384 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24466, 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 68.405014758999997, 2024-09-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 94.558967408000001 2024-09-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47c40a2c90 msgr2=0x7f47c40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47c40a2c90 0x7f47c40a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009fd0 tx=0x7f47d4009ec0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc102570 msgr2=0x7f47dc197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc102570 0x7f47dc197970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47d000d770 tx=0x7f47d000dc30 comp rx=0 tx=0).stop 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 shutdown_connections 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47c40a2c90 0x7f47c40a5150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47dc102ef0 0x7f47dc19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47dc102570 0x7f47dc197970 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 --2- 172.21.15.100:0/317056432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47dc100e20 0x7f47dc197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.314+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 >> 172.21.15.100:0/317056432 conn(0x7f47dc0fc7d0 msgr2=0x7f47dc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.315+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 shutdown_connections 2024-09-12T02:38:05.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:05.315+0000 7f47e1a40640 1 -- 172.21.15.100:0/317056432 wait complete. 2024-09-12T02:38:06.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:38:06.246 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:06.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:06 smithi100 ceph-mon[31390]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T02:38:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 -- 172.21.15.100:0/598439577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 msgr2=0x7fcf681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 --2- 172.21.15.100:0/598439577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf681067e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009900 tx=0x7fcf5c02a410 comp rx=0 tx=0).stop 2024-09-12T02:38:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 -- 172.21.15.100:0/598439577 shutdown_connections 2024-09-12T02:38:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 --2- 172.21.15.100:0/598439577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf68106f10 0x7fcf6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 --2- 172.21.15.100:0/598439577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf681067e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 --2- 172.21.15.100:0/598439577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf68101de0 0x7fcf681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 -- 172.21.15.100:0/598439577 >> 172.21.15.100:0/598439577 conn(0x7fcf680fd8c0 msgr2=0x7fcf680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 -- 172.21.15.100:0/598439577 shutdown_connections 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.730+0000 7fcf6e406640 1 -- 172.21.15.100:0/598439577 wait complete. 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 Processor -- start 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 -- start start 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf68101de0 0x7fcf68198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf68198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf68106f10 0x7fcf6819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68111fb0 con 0x7fcf68102790 2024-09-12T02:38:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68111e30 con 0x7fcf68101de0 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6e406640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68112130 con 0x7fcf68106f10 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf68198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf68198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41468/0 (socket says 172.21.15.100:41468) 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 -- 172.21.15.100:0/175419032 learned_addr learned my addr 172.21.15.100:0/175419032 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf67fff640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf68101de0 0x7fcf68198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 -- 172.21.15.100:0/175419032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf68106f10 msgr2=0x7fcf6819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf6c9a3640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf68106f10 0x7fcf6819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf68106f10 0x7fcf6819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 -- 172.21.15.100:0/175419032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf68101de0 msgr2=0x7fcf68198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf68101de0 0x7fcf68198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf677fe640 1 -- 172.21.15.100:0/175419032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6819d4c0 con 0x7fcf68102790 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.731+0000 7fcf67fff640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf68101de0 0x7fcf68198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.732+0000 7fcf677fe640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf68198a50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c005ab0 tx=0x7fcf5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.732+0000 7fcf657fa640 1 -- 172.21.15.100:0/175419032 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c03f030 con 0x7fcf68102790 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.732+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6819d750 con 0x7fcf68102790 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.732+0000 7fcf657fa640 1 -- 172.21.15.100:0/175419032 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf5c003ce0 con 0x7fcf68102790 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.732+0000 7fcf657fa640 1 -- 172.21.15.100:0/175419032 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c035070 con 0x7fcf68102790 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.732+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf681a5090 con 0x7fcf68102790 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.734+0000 7fcf657fa640 1 -- 172.21.15.100:0/175419032 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcf5c042030 con 0x7fcf68102790 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.734+0000 7fcf657fa640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf500a2c10 0x7fcf500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf67fff640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf500a2c10 0x7fcf500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf657fa640 1 -- 172.21.15.100:0/175419032 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcf5c0efbe0 con 0x7fcf68102790 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 Processor -- start 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 -- start start 2024-09-12T02:38:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf67fff640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf500a2c10 0x7fcf500a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006fd0 tx=0x7fcf58008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df76db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df81670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b98dedd090 con 0x55b98df769d0 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b98de84a70 con 0x55b98df81bb0 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf707df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b98ded9050 con 0x55b98df772f0 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df76db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df76db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41472/0 (socket says 172.21.15.100:41472) 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.735+0000 7fcf67fff640 1 -- 172.21.15.100:0/1762641656 learned_addr learned my addr 172.21.15.100:0/1762641656 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf67fff640 1 -- 172.21.15.100:0/1762641656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 msgr2=0x55b98df81670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1762641656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df81670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf67fff640 1 -- 172.21.15.100:0/1762641656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 msgr2=0x55b98df83fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1762641656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf67fff640 1 -- 172.21.15.100:0/1762641656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98de91130 con 0x55b98df769d0 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1762641656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df76db0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800ca80 tx=0x7fcf5800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1057a2cf94fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf4e7fc640 1 -- 172.21.15.100:0/1762641656 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58023070 con 0x55b98df769d0 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf4e7fc640 1 -- 172.21.15.100:0/1762641656 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf58013db0 con 0x55b98df769d0 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.736+0000 7fcf4e7fc640 1 -- 172.21.15.100:0/1762641656 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58011720 con 0x55b98df769d0 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- 172.21.15.100:0/1762641656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 msgr2=0x55b98df76db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 --2- 172.21.15.100:0/1762641656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df76db0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800ca80 tx=0x7fcf5800f000 comp rx=0 tx=0).stop 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- 172.21.15.100:0/1762641656 shutdown_connections 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 --2- 172.21.15.100:0/1762641656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df83fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 --2- 172.21.15.100:0/1762641656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df81670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 --2- 172.21.15.100:0/1762641656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df76db0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- 172.21.15.100:0/1762641656 >> 172.21.15.100:0/1762641656 conn(0x55b98df72f60 msgr2=0x55b98df73340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- 172.21.15.100:0/1762641656 shutdown_connections 2024-09-12T02:38:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- 172.21.15.100:0/1762641656 wait complete. 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- start start 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 Processor -- start 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df814f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df7e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df7ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b98df84780 con 0x55b98df769d0 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b98de97f20 con 0x55b98df81bb0 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.737+0000 7fcf707df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b98df84900 con 0x55b98df772f0 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf707df740 10 client.0 _ll_register_callbacks cb 0x55b98de61030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df814f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df814f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41478/0 (socket says 172.21.15.100:41478) 2024-09-12T02:38:06.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 -- 172.21.15.100:0/1804345192 learned_addr learned my addr 172.21.15.100:0/1804345192 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 -- 172.21.15.100:0/1804345192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 msgr2=0x55b98df7e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df7e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf6c9a3640 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df7ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 -- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 msgr2=0x55b98df7ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df7ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 -- 172.21.15.100:0/1804345192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b98dc4e2b0 con 0x55b98df769d0 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf6c9a3640 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df7ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df814f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcf5801ee90 tx=0x7fcf58013d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622ce47659e4190e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf477fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf477fe640 1 -- 172.21.15.100:0/1804345192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5802c020 con 0x55b98df769d0 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf477fe640 1 -- 172.21.15.100:0/1804345192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcf5801e910 con 0x55b98df769d0 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf58013db0 con 0x55b98df769d0 2024-09-12T02:38:06.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf477fe640 1 -- 172.21.15.100:0/1804345192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcf58037050 con 0x55b98df769d0 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf707df740 10 client.15015 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b98df90130 con 0x55b98df769d0 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.738+0000 7fcf477fe640 1 -- 172.21.15.100:0/1804345192 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf58013db0 con 0x55b98df769d0 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf477fe640 1 -- 172.21.15.100:0/1804345192 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcf58011510 con 0x55b98df769d0 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf707df740 10 client.15015 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf707df740 10 client.15015 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf707df740 20 client.15015 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf707df740 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98df923e0 0x55b98df93850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf707df740 4 client.15015 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b98deea600 con 0x55b98df923e0 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf677fe640 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98df923e0 0x55b98df93850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf677fe640 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98df923e0 0x55b98df93850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55718ed54eebe875 server_cookie=822b73b05cc4d1f0 in_seq=0 out_seq=0 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.739+0000 7fcf477fe640 10 client.15015 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.740+0000 7fcf477fe640 1 -- 172.21.15.100:0/1804345192 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b98deea600 con 0x55b98df923e0 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.740+0000 7fcf477fe640 10 client.15015 handle_command_reply: tid=0 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.740+0000 7fcf707df740 1 client.15015 shutdown 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.740+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 msgr2=0x55b98df814f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.740+0000 7fcf707df740 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df814f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcf5801ee90 tx=0x7fcf58013d10 comp rx=0 tx=0).stop 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 shutdown_connections 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98df923e0 0x55b98df93850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df7ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df7e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 --2- 172.21.15.100:0/1804345192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df814f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 >> 172.21.15.100:0/1804345192 conn(0x55b98df72f60 msgr2=0x55b98df78c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf477fe640 0 client.15015 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 shutdown_connections 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 1 -- 172.21.15.100:0/1804345192 wait complete. 2024-09-12T02:38:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.741+0000 7fcf707df740 20 client.15015 trim_cache size 0 max 16384 2024-09-12T02:38:06.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 Processor -- start 2024-09-12T02:38:06.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 -- start start 2024-09-12T02:38:06.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df91d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df93180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df79c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b98df91b90 con 0x55b98df769d0 2024-09-12T02:38:06.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b98df92260 con 0x55b98df81bb0 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf707df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b98df92930 con 0x55b98df772f0 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df91d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df91d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41494/0 (socket says 172.21.15.100:41494) 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 -- 172.21.15.100:0/3427740107 learned_addr learned my addr 172.21.15.100:0/3427740107 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf6c9a3640 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df79c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf677fe640 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df93180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 -- 172.21.15.100:0/3427740107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 msgr2=0x55b98df93180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df93180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 -- 172.21.15.100:0/3427740107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 msgr2=0x55b98df79c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df79c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 -- 172.21.15.100:0/3427740107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98df77120 con 0x55b98df769d0 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.759+0000 7fcf67fff640 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df91d10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c520 tx=0x7fcf5801e400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf32f02655c3952 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf4dffb640 1 -- 172.21.15.100:0/3427740107 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58040070 con 0x55b98df769d0 2024-09-12T02:38:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf4dffb640 1 -- 172.21.15.100:0/3427740107 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf58011d50 con 0x55b98df769d0 2024-09-12T02:38:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf4dffb640 1 -- 172.21.15.100:0/3427740107 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5802c040 con 0x55b98df769d0 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 -- 172.21.15.100:0/3427740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 msgr2=0x55b98df91d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df91d10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c520 tx=0x7fcf5801e400 comp rx=0 tx=0).stop 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 -- 172.21.15.100:0/3427740107 shutdown_connections 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98df79c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df772f0 0x55b98df93180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 --2- 172.21.15.100:0/3427740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df769d0 0x55b98df91d10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 -- 172.21.15.100:0/3427740107 >> 172.21.15.100:0/3427740107 conn(0x55b98df72f60 msgr2=0x55b98df79580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 -- 172.21.15.100:0/3427740107 shutdown_connections 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.760+0000 7fcf707df740 1 -- 172.21.15.100:0/3427740107 wait complete. 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 -- start start 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 Processor -- start 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df769d0 0x55b98df94b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df772f0 0x55b98df95050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98dffaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b98df936d0 con 0x55b98df772f0 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b98df93000 con 0x55b98df81bb0 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b98df93da0 con 0x55b98df769d0 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf707df740 10 client.0 _ll_register_callbacks cb 0x7fcf58021070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df772f0 0x55b98df95050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df772f0 0x55b98df95050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41500/0 (socket says 172.21.15.100:41500) 2024-09-12T02:38:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf677fe640 1 -- 172.21.15.100:0/1945040566 learned_addr learned my addr 172.21.15.100:0/1945040566 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.761+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df769d0 0x55b98df94b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf6c9a3640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98dffaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf677fe640 1 -- 172.21.15.100:0/1945040566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df769d0 msgr2=0x55b98df94b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf677fe640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df769d0 0x55b98df94b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf677fe640 1 -- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 msgr2=0x55b98dffaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf677fe640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98dffaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf677fe640 1 -- 172.21.15.100:0/1945040566 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b98df958e0 con 0x55b98df772f0 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf6c9a3640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98dffaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf677fe640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df772f0 0x55b98df95050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c005940 tx=0x7fcf5c0bc270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721d85f5981716c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf477fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf477fe640 1 -- 172.21.15.100:0/1945040566 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c049040 con 0x55b98df772f0 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf477fe640 1 -- 172.21.15.100:0/1945040566 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcf5c0ed770 con 0x55b98df772f0 2024-09-12T02:38:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf58011d50 con 0x55b98df772f0 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf477fe640 1 -- 172.21.15.100:0/1945040566 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcf5c0d5150 con 0x55b98df772f0 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf707df740 10 client.15021 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b98dffc0f0 con 0x55b98df772f0 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf477fe640 1 -- 172.21.15.100:0/1945040566 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf58011d50 con 0x55b98df772f0 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.762+0000 7fcf477fe640 1 -- 172.21.15.100:0/1945040566 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcf5c0bc4d0 con 0x55b98df772f0 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf707df740 10 client.15021 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf707df740 10 client.15021 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf707df740 20 client.15021 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf707df740 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98e000d10 0x55b98dfffa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf707df740 4 client.15021 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "status"}) -- 0x55b98dee4b10 con 0x55b98e000d10 2024-09-12T02:38:06.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98e000d10 0x55b98dfffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf477fe640 10 client.15021 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.763+0000 7fcf67fff640 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98e000d10 0x55b98dfffa20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd08993eaaecf94 server_cookie=b03d8dcff15f3018 in_seq=0 out_seq=0 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf477fe640 1 -- 172.21.15.100:0/1945040566 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b98dee4b10 con 0x55b98e000d10 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf477fe640 10 client.15021 handle_command_reply: tid=0 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 client.15021 shutdown 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df772f0 msgr2=0x55b98df95050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df772f0 0x55b98df95050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c005940 tx=0x7fcf5c0bc270 comp rx=0 tx=0).stop 2024-09-12T02:38:06.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 shutdown_connections 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b98e000d10 0x55b98dfffa20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b98df81bb0 0x55b98dffaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b98df772f0 0x55b98df95050 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf477fe640 0 client.15021 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 --2- 172.21.15.100:0/1945040566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b98df769d0 0x55b98df94b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 >> 172.21.15.100:0/1945040566 conn(0x55b98df72f60 msgr2=0x55b98df78c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 shutdown_connections 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 1 -- 172.21.15.100:0/1945040566 wait complete. 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.764+0000 7fcf707df740 20 client.15021 trim_cache size 0 max 16384 2024-09-12T02:38:06.771 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24473, 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 76.893483806999996, 2024-09-12T02:38:06.772 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:38:06.773 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:06.773 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:38:06.773 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 87.259403258000006 2024-09-12T02:38:06.773 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:06.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf500a2c10 msgr2=0x7fcf500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf500a2c10 0x7fcf500a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006fd0 tx=0x7fcf58008040 comp rx=0 tx=0).stop 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 msgr2=0x7fcf68198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf68198a50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c005ab0 tx=0x7fcf5c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 shutdown_connections 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcf500a2c10 0x7fcf500a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf68106f10 0x7fcf6819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68102790 0x7fcf68198a50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 --2- 172.21.15.100:0/175419032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf68101de0 0x7fcf68198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 >> 172.21.15.100:0/175419032 conn(0x7fcf680fd8c0 msgr2=0x7fcf680fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 shutdown_connections 2024-09-12T02:38:06.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:06.765+0000 7fcf6e406640 1 -- 172.21.15.100:0/175419032 wait complete. 2024-09-12T02:38:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:06 smithi189 ceph-mon[35196]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T02:38:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:06 smithi117 ceph-mon[34898]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T02:38:07.469 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T02:38:07.470 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:38:07.479 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:38:07.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T02:38:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:08.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 -- 172.21.15.100:0/3516802123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41026d0 msgr2=0x7f39c4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:08.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 --2- 172.21.15.100:0/3516802123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41026d0 0x7f39c4108f60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009ca0 tx=0x7f39bc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 -- 172.21.15.100:0/3516802123 shutdown_connections 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 --2- 172.21.15.100:0/3516802123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41026d0 0x7f39c4108f60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 --2- 172.21.15.100:0/3516802123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c4101d10 0x7f39c4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 --2- 172.21.15.100:0/3516802123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39c4100b10 0x7f39c4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 -- 172.21.15.100:0/3516802123 >> 172.21.15.100:0/3516802123 conn(0x7f39c40fc2a0 msgr2=0x7f39c40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 -- 172.21.15.100:0/3516802123 shutdown_connections 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 -- 172.21.15.100:0/3516802123 wait complete. 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 Processor -- start 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.243+0000 7f39caeba640 1 -- start start 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39c4100b10 0x7f39c4197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c4101d10 0x7f39c41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:08.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c41026d0 0x7f39c419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f39c410c790 con 0x7f39c4101d10 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f39c410c610 con 0x7f39c41026d0 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39c410c910 con 0x7f39c4100b10 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c4101d10 0x7f39c41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c4101d10 0x7f39c41983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41526/0 (socket says 172.21.15.100:41526) 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 -- 172.21.15.100:0/1432623637 learned_addr learned my addr 172.21.15.100:0/1432623637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c8c56640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39c4100b10 0x7f39c4197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 -- 172.21.15.100:0/1432623637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39c4100b10 msgr2=0x7f39c4197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39c4100b10 0x7f39c4197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 -- 172.21.15.100:0/1432623637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c41026d0 msgr2=0x7f39c419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c41026d0 0x7f39c419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 -- 172.21.15.100:0/1432623637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c419fad0 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c3fff640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c4101d10 0x7f39c41983e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f39b000d950 tx=0x7f39b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c1ffb640 1 -- 172.21.15.100:0/1432623637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0017030 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c1ffb640 1 -- 172.21.15.100:0/1432623637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b0004020 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c419fdc0 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39c1ffb640 1 -- 172.21.15.100:0/1432623637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00047a0 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.244+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c41a0270 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.245+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c41a0530 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.246+0000 7f39c1ffb640 1 -- 172.21.15.100:0/1432623637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f39b00041d0 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.247+0000 7f39c1ffb640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39b40a2c40 0x7f39b40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.247+0000 7f39c8c56640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39b40a2c40 0x7f39b40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.247+0000 7f39c1ffb640 1 -- 172.21.15.100:0/1432623637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f39b00ceba0 con 0x7f39c4101d10 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.248+0000 7f39c8c56640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39b40a2c40 0x7f39b40a5100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39c4101b70 tx=0x7f39b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.251+0000 7f39c1ffb640 1 -- 172.21.15.100:0/1432623637 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39b009b990 con 0x7f39c4101d10 2024-09-12T02:38:08.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.436+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f39c40fe4b0 con 0x7f39b40a2c40 2024-09-12T02:38:08.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.437+0000 7f39c1ffb640 1 -- 172.21.15.100:0/1432623637 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f39c40fe4b0 con 0x7f39b40a2c40 2024-09-12T02:38:08.437 INFO:teuthology.orchestra.run.smithi100.stdout:Backend: cephadm 2024-09-12T02:38:08.437 INFO:teuthology.orchestra.run.smithi100.stdout:Available: Yes 2024-09-12T02:38:08.438 INFO:teuthology.orchestra.run.smithi100.stdout:Paused: No 2024-09-12T02:38:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.439+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39b40a2c40 msgr2=0x7f39b40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.439+0000 7f39caeba640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39b40a2c40 0x7f39b40a5100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39c4101b70 tx=0x7f39b8005f90 comp rx=0 tx=0).stop 2024-09-12T02:38:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.439+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c4101d10 msgr2=0x7f39c41983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.439+0000 7f39caeba640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c4101d10 0x7f39c41983e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f39b000d950 tx=0x7f39b000de10 comp rx=0 tx=0).stop 2024-09-12T02:38:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.439+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 shutdown_connections 2024-09-12T02:38:08.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.440+0000 7f39caeba640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39b40a2c40 0x7f39b40a5100 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.440+0000 7f39caeba640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c41026d0 0x7f39c419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.440+0000 7f39caeba640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c4101d10 0x7f39c41983e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.440+0000 7f39caeba640 1 --2- 172.21.15.100:0/1432623637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39c4100b10 0x7f39c4197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:08.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.440+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 >> 172.21.15.100:0/1432623637 conn(0x7f39c40fc2a0 msgr2=0x7f39c40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:08.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.440+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 shutdown_connections 2024-09-12T02:38:08.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:08.440+0000 7f39caeba640 1 -- 172.21.15.100:0/1432623637 wait complete. 2024-09-12T02:38:08.846 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:08 smithi100 ceph-mon[31390]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 12 B/s, 1 objects/s recovering 2024-09-12T02:38:08.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:08 smithi189 ceph-mon[35196]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 12 B/s, 1 objects/s recovering 2024-09-12T02:38:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:08 smithi117 ceph-mon[34898]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 12 B/s, 1 objects/s recovering 2024-09-12T02:38:09.147 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T02:38:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:09.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:09 smithi100 ceph-mon[31390]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:09.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.824+0000 7fd0a459f640 1 -- 172.21.15.100:0/878108847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 msgr2=0x7fd09c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:09.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.824+0000 7fd0a459f640 1 --2- 172.21.15.100:0/878108847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c109d50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd094009ca0 tx=0x7fd09402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:09.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 -- 172.21.15.100:0/878108847 shutdown_connections 2024-09-12T02:38:09.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 --2- 172.21.15.100:0/878108847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c109d50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:09.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 --2- 172.21.15.100:0/878108847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd09c105030 0x7fd09c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:09.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 --2- 172.21.15.100:0/878108847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd09c102700 0x7fd09c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:09.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 -- 172.21.15.100:0/878108847 >> 172.21.15.100:0/878108847 conn(0x7fd09c0fc280 msgr2=0x7fd09c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 -- 172.21.15.100:0/878108847 shutdown_connections 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 -- 172.21.15.100:0/878108847 wait complete. 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 Processor -- start 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.825+0000 7fd0a459f640 1 -- start start 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a459f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd09c102700 0x7fd09c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a459f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd09c105030 0x7fd09c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a459f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a459f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c10d860 con 0x7fd09c107960 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a459f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c10d6e0 con 0x7fd09c105030 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a459f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c10d9e0 con 0x7fd09c102700 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c19f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41536/0 (socket says 172.21.15.100:41536) 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 -- 172.21.15.100:0/3797760505 learned_addr learned my addr 172.21.15.100:0/3797760505 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a233b640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd09c102700 0x7fd09c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a1b3a640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd09c105030 0x7fd09c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 -- 172.21.15.100:0/3797760505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd09c102700 msgr2=0x7fd09c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd09c102700 0x7fd09c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 -- 172.21.15.100:0/3797760505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd09c105030 msgr2=0x7fd09c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd09c105030 0x7fd09c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 -- 172.21.15.100:0/3797760505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c19fb10 con 0x7fd09c107960 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a1b3a640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd09c105030 0x7fd09c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0a2b3c640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c19f4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd094005e30 tx=0x7fd094031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0937fe640 1 -- 172.21.15.100:0/3797760505 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094003c30 con 0x7fd09c107960 2024-09-12T02:38:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0937fe640 1 -- 172.21.15.100:0/3797760505 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd094003dd0 con 0x7fd09c107960 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.826+0000 7fd0937fe640 1 -- 172.21.15.100:0/3797760505 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09402fde0 con 0x7fd09c107960 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.827+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c19fda0 con 0x7fd09c107960 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.827+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c1a0250 con 0x7fd09c107960 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.828+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09c0fdd70 con 0x7fd09c107960 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.829+0000 7fd0937fe640 1 -- 172.21.15.100:0/3797760505 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd094004050 con 0x7fd09c107960 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.829+0000 7fd0937fe640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0880a2c40 0x7fd0880a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.829+0000 7fd0a233b640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0880a2c40 0x7fd0880a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.829+0000 7fd0937fe640 1 -- 172.21.15.100:0/3797760505 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd0940f0570 con 0x7fd09c107960 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.830+0000 7fd0a233b640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0880a2c40 0x7fd0880a5100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd09800bbe0 tx=0x7fd09800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:09.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:09.832+0000 7fd0937fe640 1 -- 172.21.15.100:0/3797760505 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0940bd470 con 0x7fd09c107960 2024-09-12T02:38:10.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.008+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd09c062630 con 0x7fd0880a2c40 2024-09-12T02:38:10.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:09 smithi189 ceph-mon[35196]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.020+0000 7fd0937fe640 1 -- 172.21.15.100:0/3797760505 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fd09c062630 con 0x7fd0880a2c40 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:mds.a smithi100 running (93s) 17s ago 93s 15.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 9ed79b300c76 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:mds.b smithi117 running (90s) 24s ago 90s 28.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 2e043629fb7e 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:mds.c smithi189 running (105s) 24s ago 104s 17.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 cd1dd181a195 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:mds.d smithi100 running (113s) 17s ago 112s 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 ebb4589b0184 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:mds.e smithi117 running (110s) 24s ago 109s 16.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 71268767d9c5 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:mds.f smithi189 running (107s) 24s ago 107s 18.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 ea3d8faa13b1 2024-09-12T02:38:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:mds.g smithi100 running (96s) 17s ago 95s 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 6802c1e69047 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mds.h smithi117 running (102s) 24s ago 101s 18.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 601dab64b243 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mds.i smithi189 running (99s) 24s ago 99s 19.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 6361032910f3 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mds.j smithi100 running (116s) 17s ago 116s 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 fdcbbc8ff217 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mds.k smithi117 running (2m) 24s ago 119s 14.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 03d5629605f1 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mds.l smithi189 running (2m) 24s ago 2m 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 76bb27898b73 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.x smithi100 *:9283,8765 running (8m) 17s ago 8m 508M - 19.1.1-298-gb53b6d3e 54467abc55f8 4b275610bea7 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.y smithi117 *:8443,8765 running (7m) 24s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 b77a863990c8 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.z smithi189 *:8443,8765 running (7m) 24s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 4b00d1651fc9 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mon.a smithi100 running (8m) 17s ago 9m 51.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 91e9c64e6d83 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mon.b smithi117 running (7m) 24s ago 7m 39.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 ffbbb2359a9e 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:mon.c smithi189 running (7m) 24s ago 7m 39.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 59e872dd50d8 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (7m) 17s ago 7m 43.5M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 98953d050a29 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi117 running (6m) 24s ago 6m 45.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 f8ca2aa2f555 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi189 running (6m) 24s ago 6m 57.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 685c2125f634 2024-09-12T02:38:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi100 running (5m) 17s ago 5m 44.0M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 224b2e96ac24 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi117 running (5m) 24s ago 5m 42.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ca487f2a4577 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi189 running (4m) 24s ago 4m 43.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 597338e4ee81 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 smithi100 running (4m) 17s ago 4m 44.3M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 88429e38fd12 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 smithi117 running (4m) 24s ago 4m 43.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 89fa73d4695f 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.8 smithi189 running (3m) 24s ago 3m 54.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 fe274858f6d6 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.9 smithi100 running (3m) 17s ago 3m 54.5M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 dd8ee6bb0f87 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.10 smithi117 running (2m) 24s ago 2m 42.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 c8c4e773cc99 2024-09-12T02:38:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:osd.11 smithi189 running (2m) 24s ago 2m 40.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 a478ef9c7239 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0880a2c40 msgr2=0x7fd0880a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0880a2c40 0x7fd0880a5100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd09800bbe0 tx=0x7fd09800b390 comp rx=0 tx=0).stop 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 msgr2=0x7fd09c19f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c19f4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd094005e30 tx=0x7fd094031ee0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 shutdown_connections 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0880a2c40 0x7fd0880a5100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd09c107960 0x7fd09c19f4a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd09c105030 0x7fd09c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 --2- 172.21.15.100:0/3797760505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd09c102700 0x7fd09c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 >> 172.21.15.100:0/3797760505 conn(0x7fd09c0fc280 msgr2=0x7fd09c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:10.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 shutdown_connections 2024-09-12T02:38:10.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:10.022+0000 7fd0a459f640 1 -- 172.21.15.100:0/3797760505 wait complete. 2024-09-12T02:38:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:09 smithi117 ceph-mon[34898]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:10.811 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:10 smithi100 ceph-mon[31390]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T02:38:10.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T02:38:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:10 smithi189 ceph-mon[35196]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T02:38:11.085 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:10 smithi117 ceph-mon[34898]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T02:38:11.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 -- 172.21.15.100:0/3518468503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c100b10 msgr2=0x7fec9c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 --2- 172.21.15.100:0/3518468503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c100b10 0x7fec9c100f10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec98009900 tx=0x7fec9802a410 comp rx=0 tx=0).stop 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 -- 172.21.15.100:0/3518468503 shutdown_connections 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 --2- 172.21.15.100:0/3518468503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec9c1026d0 0x7fec9c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 --2- 172.21.15.100:0/3518468503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9c101d10 0x7fec9c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 --2- 172.21.15.100:0/3518468503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c100b10 0x7fec9c100f10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 -- 172.21.15.100:0/3518468503 >> 172.21.15.100:0/3518468503 conn(0x7fec9c0fc2a0 msgr2=0x7fec9c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 -- 172.21.15.100:0/3518468503 shutdown_connections 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.535+0000 7feca33a2640 1 -- 172.21.15.100:0/3518468503 wait complete. 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 Processor -- start 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 -- start start 2024-09-12T02:38:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9c100b10 0x7fec9c196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec9c101d10 0x7fec9c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c1026d0 0x7fec9c19e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c10c7f0 con 0x7fec9c1026d0 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c10c670 con 0x7fec9c100b10 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca33a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c10c970 con 0x7fec9c101d10 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca193f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c1026d0 0x7fec9c19e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca193f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c1026d0 0x7fec9c19e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41548/0 (socket says 172.21.15.100:41548) 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca193f640 1 -- 172.21.15.100:0/3297826159 learned_addr learned my addr 172.21.15.100:0/3297826159 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca093d640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec9c101d10 0x7fec9c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca193f640 1 -- 172.21.15.100:0/3297826159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec9c101d10 msgr2=0x7fec9c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca193f640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec9c101d10 0x7fec9c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca113e640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9c100b10 0x7fec9c196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca193f640 1 -- 172.21.15.100:0/3297826159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9c100b10 msgr2=0x7fec9c196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.536+0000 7feca193f640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9c100b10 0x7fec9c196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7feca193f640 1 -- 172.21.15.100:0/3297826159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c19ea40 con 0x7fec9c1026d0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7feca093d640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec9c101d10 0x7fec9c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7feca113e640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9c100b10 0x7fec9c196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7feca193f640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c1026d0 0x7fec9c19e3d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec94007cb0 tx=0x7fec9400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7fec927fc640 1 -- 172.21.15.100:0/3297826159 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9400eb30 con 0x7fec9c1026d0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7fec927fc640 1 -- 172.21.15.100:0/3297826159 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec9400ecd0 con 0x7fec9c1026d0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9c06a7f0 con 0x7fec9c1026d0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7fec927fc640 1 -- 172.21.15.100:0/3297826159 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94015650 con 0x7fec9c1026d0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.537+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9c06ad60 con 0x7fec9c1026d0 2024-09-12T02:38:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.538+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9c100f10 con 0x7fec9c1026d0 2024-09-12T02:38:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.539+0000 7fec927fc640 1 -- 172.21.15.100:0/3297826159 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fec94004a40 con 0x7fec9c1026d0 2024-09-12T02:38:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.540+0000 7fec927fc640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fec880a2c40 0x7fec880a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.540+0000 7feca113e640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fec880a2c40 0x7fec880a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.540+0000 7fec927fc640 1 -- 172.21.15.100:0/3297826159 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fec940d11e0 con 0x7fec9c1026d0 2024-09-12T02:38:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.541+0000 7feca113e640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fec880a2c40 0x7fec880a5100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec98000c00 tx=0x7fec98031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.544+0000 7fec927fc640 1 -- 172.21.15.100:0/3297826159 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec9409dfd0 con 0x7fec9c1026d0 2024-09-12T02:38:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.720+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fec9c06afc0 con 0x7fec880a2c40 2024-09-12T02:38:11.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:11 smithi100 ceph-mon[31390]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.725+0000 7fec927fc640 1 -- 172.21.15.100:0/3297826159 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fec9c06afc0 con 0x7fec880a2c40 2024-09-12T02:38:11.727 INFO:teuthology.orchestra.run.smithi100.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T02:38:11.727 INFO:teuthology.orchestra.run.smithi100.stdout:mds.all 12/12 26s ago 2m smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:38:11.727 INFO:teuthology.orchestra.run.smithi100.stdout:mgr 3/3 26s ago 7m smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T02:38:11.727 INFO:teuthology.orchestra.run.smithi100.stdout:mon 3/3 26s ago 7m smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c;count:3 2024-09-12T02:38:11.727 INFO:teuthology.orchestra.run.smithi100.stdout:osd 12 26s ago - 2024-09-12T02:38:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fec880a2c40 msgr2=0x7fec880a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fec880a2c40 0x7fec880a5100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec98000c00 tx=0x7fec98031400 comp rx=0 tx=0).stop 2024-09-12T02:38:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c1026d0 msgr2=0x7fec9c19e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c1026d0 0x7fec9c19e3d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec94007cb0 tx=0x7fec9400e420 comp rx=0 tx=0).stop 2024-09-12T02:38:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 shutdown_connections 2024-09-12T02:38:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fec880a2c40 0x7fec880a5100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec9c1026d0 0x7fec9c19e3d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec9c101d10 0x7fec9c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 --2- 172.21.15.100:0/3297826159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9c100b10 0x7fec9c196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.727+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 >> 172.21.15.100:0/3297826159 conn(0x7fec9c0fc2a0 msgr2=0x7fec9c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.728+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 shutdown_connections 2024-09-12T02:38:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:11.728+0000 7feca33a2640 1 -- 172.21.15.100:0/3297826159 wait complete. 2024-09-12T02:38:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:11 smithi189 ceph-mon[35196]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:12.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:11 smithi117 ceph-mon[34898]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:12.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T02:38:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:12.807 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:12 smithi100 ceph-mon[31390]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-12T02:38:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:12 smithi189 ceph-mon[35196]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-12T02:38:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:12 smithi117 ceph-mon[34898]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 -- 172.21.15.100:0/1653035784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c100ad0 msgr2=0x7efe0c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1653035784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c100ad0 0x7efe0c100ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe08009900 tx=0x7efe0802a410 comp rx=0 tx=0).stop 2024-09-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 -- 172.21.15.100:0/1653035784 shutdown_connections 2024-09-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1653035784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c102690 0x7efe0c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1653035784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c101cd0 0x7efe0c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1653035784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c100ad0 0x7efe0c100ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 -- 172.21.15.100:0/1653035784 >> 172.21.15.100:0/1653035784 conn(0x7efe0c0fc280 msgr2=0x7efe0c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 -- 172.21.15.100:0/1653035784 shutdown_connections 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.204+0000 7efe13ab4640 1 -- 172.21.15.100:0/1653035784 wait complete. 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 Processor -- start 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 -- start start 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c100ad0 0x7efe0c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c101cd0 0x7efe0c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c102690 0x7efe0c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10c830 con 0x7efe0c101cd0 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10c6b0 con 0x7efe0c100ad0 2024-09-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe13ab4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10c9b0 con 0x7efe0c102690 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe1104f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c101cd0 0x7efe0c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe1104f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c101cd0 0x7efe0c1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41576/0 (socket says 172.21.15.100:41576) 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.205+0000 7efe1104f640 1 -- 172.21.15.100:0/1937939468 learned_addr learned my addr 172.21.15.100:0/1937939468 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe11850640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c100ad0 0x7efe0c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe1104f640 1 -- 172.21.15.100:0/1937939468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c102690 msgr2=0x7efe0c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe12051640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c102690 0x7efe0c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe1104f640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c102690 0x7efe0c19f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe1104f640 1 -- 172.21.15.100:0/1937939468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c100ad0 msgr2=0x7efe0c198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe1104f640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c100ad0 0x7efe0c198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe1104f640 1 -- 172.21.15.100:0/1937939468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c19fcb0 con 0x7efe0c101cd0 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe11850640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c100ad0 0x7efe0c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe1104f640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c101cd0 0x7efe0c1985c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00b4a0 tx=0x7efdfc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe02ffd640 1 -- 172.21.15.100:0/1937939468 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc014070 con 0x7efe0c101cd0 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe02ffd640 1 -- 172.21.15.100:0/1937939468 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdfc010af0 con 0x7efe0c101cd0 2024-09-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c19ffa0 con 0x7efe0c101cd0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe02ffd640 1 -- 172.21.15.100:0/1937939468 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc017d10 con 0x7efe0c101cd0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.206+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c1a0480 con 0x7efe0c101cd0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.207+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0c1a0710 con 0x7efe0c101cd0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.208+0000 7efe02ffd640 1 -- 172.21.15.100:0/1937939468 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efdfc017070 con 0x7efe0c101cd0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.209+0000 7efe02ffd640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efdf80a2c40 0x7efdf80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.209+0000 7efe11850640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efdf80a2c40 0x7efdf80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.209+0000 7efe02ffd640 1 -- 172.21.15.100:0/1937939468 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7efdfc0ce510 con 0x7efe0c101cd0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.209+0000 7efe11850640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efdf80a2c40 0x7efdf80a5100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efe08000c00 tx=0x7efe08031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.213+0000 7efe02ffd640 1 -- 172.21.15.100:0/1937939468 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdfc09b410 con 0x7efe0c101cd0 2024-09-12T02:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.383+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7efe0c1a08e0 con 0x7efdf80a2c40 2024-09-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.385+0000 7efe02ffd640 1 -- 172.21.15.100:0/1937939468 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7efe0c1a08e0 con 0x7efdf80a2c40 2024-09-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi100.stdout:HOST ADDR LABELS STATUS 2024-09-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 172.21.15.100 2024-09-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi100.stdout:smithi117 172.21.15.117 2024-09-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi100.stdout:smithi189 172.21.15.189 2024-09-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi100.stdout:3 hosts in cluster 2024-09-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efdf80a2c40 msgr2=0x7efdf80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efdf80a2c40 0x7efdf80a5100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efe08000c00 tx=0x7efe08031400 comp rx=0 tx=0).stop 2024-09-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c101cd0 msgr2=0x7efe0c1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c101cd0 0x7efe0c1985c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00b4a0 tx=0x7efdfc00b960 comp rx=0 tx=0).stop 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 shutdown_connections 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efdf80a2c40 0x7efdf80a5100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c102690 0x7efe0c19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c101cd0 0x7efe0c1985c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 --2- 172.21.15.100:0/1937939468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c100ad0 0x7efe0c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 >> 172.21.15.100:0/1937939468 conn(0x7efe0c0fc280 msgr2=0x7efe0c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 shutdown_connections 2024-09-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:13.387+0000 7efe13ab4640 1 -- 172.21.15.100:0/1937939468 wait complete. 2024-09-12T02:38:13.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:13 smithi100 ceph-mon[31390]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:14.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:13 smithi189 ceph-mon[35196]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:14.077 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T02:38:14.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:13 smithi117 ceph-mon[34898]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:14.318 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:14.700 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:14 smithi100 ceph-mon[31390]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:14.700 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:14 smithi100 ceph-mon[31390]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 -- 172.21.15.100:0/747964872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a741026d0 msgr2=0x7f2a74108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 --2- 172.21.15.100:0/747964872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a741026d0 0x7f2a74108f60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009ca0 tx=0x7f2a6c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 -- 172.21.15.100:0/747964872 shutdown_connections 2024-09-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 --2- 172.21.15.100:0/747964872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a741026d0 0x7f2a74108f60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 --2- 172.21.15.100:0/747964872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a74101d10 0x7f2a74102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 --2- 172.21.15.100:0/747964872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a74100b10 0x7f2a74100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 -- 172.21.15.100:0/747964872 >> 172.21.15.100:0/747964872 conn(0x7f2a740fc2a0 msgr2=0x7f2a740fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 -- 172.21.15.100:0/747964872 shutdown_connections 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.781+0000 7f2a78d17640 1 -- 172.21.15.100:0/747964872 wait complete. 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 Processor -- start 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 -- start start 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a74100b10 0x7f2a74197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a74101d10 0x7f2a74198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a741026d0 0x7f2a7419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7410c790 con 0x7f2a74101d10 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7410c610 con 0x7f2a741026d0 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a78d17640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7410c910 con 0x7f2a74100b10 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a71d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a74101d10 0x7f2a74198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a71d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a74101d10 0x7f2a74198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46978/0 (socket says 172.21.15.100:46978) 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.782+0000 7f2a71d9b640 1 -- 172.21.15.100:0/2883042903 learned_addr learned my addr 172.21.15.100:0/2883042903 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a7259c640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a74100b10 0x7f2a74197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a72d9d640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a741026d0 0x7f2a7419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a71d9b640 1 -- 172.21.15.100:0/2883042903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a74100b10 msgr2=0x7f2a74197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a71d9b640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a74100b10 0x7f2a74197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a71d9b640 1 -- 172.21.15.100:0/2883042903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a741026d0 msgr2=0x7f2a7419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a71d9b640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a741026d0 0x7f2a7419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a71d9b640 1 -- 172.21.15.100:0/2883042903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7419faf0 con 0x7f2a74101d10 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a72d9d640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a741026d0 0x7f2a7419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a71d9b640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a74101d10 0x7f2a74198400 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800d770 tx=0x7f2a6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a637fe640 1 -- 172.21.15.100:0/2883042903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68017070 con 0x7f2a74101d10 2024-09-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7419fde0 con 0x7f2a74101d10 2024-09-12T02:38:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a637fe640 1 -- 172.21.15.100:0/2883042903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a68005500 con 0x7f2a74101d10 2024-09-12T02:38:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a637fe640 1 -- 172.21.15.100:0/2883042903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68004e00 con 0x7f2a74101d10 2024-09-12T02:38:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.783+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a741a0240 con 0x7f2a74101d10 2024-09-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.784+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a741a0470 con 0x7f2a74101d10 2024-09-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.785+0000 7f2a637fe640 1 -- 172.21.15.100:0/2883042903 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2a68004fa0 con 0x7f2a74101d10 2024-09-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.786+0000 7f2a637fe640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2a5c0a2c40 0x7f2a5c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.786+0000 7f2a7259c640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2a5c0a2c40 0x7f2a5c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.786+0000 7f2a637fe640 1 -- 172.21.15.100:0/2883042903 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2a680cec80 con 0x7f2a74101d10 2024-09-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.786+0000 7f2a7259c640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2a5c0a2c40 0x7f2a5c0a5100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005db0 tx=0x7f2a64005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:14.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.790+0000 7f2a637fe640 1 -- 172.21.15.100:0/2883042903 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a6809ba70 con 0x7f2a74101d10 2024-09-12T02:38:14.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.965+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f2a7406aea0 con 0x7f2a5c0a2c40 2024-09-12T02:38:14.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.967+0000 7f2a637fe640 1 -- 172.21.15.100:0/2883042903 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f2a7406aea0 con 0x7f2a5c0a2c40 2024-09-12T02:38:14.968 INFO:teuthology.orchestra.run.smithi100.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T02:38:14.969 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:38:14.969 INFO:teuthology.orchestra.run.smithi100.stdout:smithi117 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V6400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T02:38:14.969 INFO:teuthology.orchestra.run.smithi100.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.969+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2a5c0a2c40 msgr2=0x7f2a5c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.969+0000 7f2a78d17640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2a5c0a2c40 0x7f2a5c0a5100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005db0 tx=0x7f2a64005d40 comp rx=0 tx=0).stop 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.969+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a74101d10 msgr2=0x7f2a74198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.969+0000 7f2a78d17640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a74101d10 0x7f2a74198400 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800d770 tx=0x7f2a6800dc30 comp rx=0 tx=0).stop 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 shutdown_connections 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2a5c0a2c40 0x7f2a5c0a5100 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a741026d0 0x7f2a7419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a74101d10 0x7f2a74198400 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 --2- 172.21.15.100:0/2883042903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a74100b10 0x7f2a74197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 >> 172.21.15.100:0/2883042903 conn(0x7f2a740fc2a0 msgr2=0x7f2a7406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:14.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 shutdown_connections 2024-09-12T02:38:14.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:14.970+0000 7f2a78d17640 1 -- 172.21.15.100:0/2883042903 wait complete. 2024-09-12T02:38:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:14 smithi189 ceph-mon[35196]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:14 smithi189 ceph-mon[35196]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:38:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:14 smithi117 ceph-mon[34898]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:14 smithi117 ceph-mon[34898]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:38:15.667 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:38:15.676 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:38:15.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T02:38:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 -- 172.21.15.100:0/2915630231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0101cd0 msgr2=0x7f79b0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 --2- 172.21.15.100:0/2915630231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0101cd0 0x7f79b0102150 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f799c009900 tx=0x7f799c02a410 comp rx=0 tx=0).stop 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 -- 172.21.15.100:0/2915630231 shutdown_connections 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 --2- 172.21.15.100:0/2915630231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79b0102690 0x7f79b0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 --2- 172.21.15.100:0/2915630231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0101cd0 0x7f79b0102150 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 --2- 172.21.15.100:0/2915630231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b0100ad0 0x7f79b0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 -- 172.21.15.100:0/2915630231 >> 172.21.15.100:0/2915630231 conn(0x7f79b00fc280 msgr2=0x7f79b00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 -- 172.21.15.100:0/2915630231 shutdown_connections 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 -- 172.21.15.100:0/2915630231 wait complete. 2024-09-12T02:38:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.348+0000 7f79b7166640 1 Processor -- start 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b7166640 1 -- start start 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b7166640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79b0100ad0 0x7f79b0197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b7166640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b0101cd0 0x7f79b0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b7166640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0102690 0x7f79b019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b7166640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79b010c750 con 0x7f79b0102690 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b7166640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79b010c5d0 con 0x7f79b0101cd0 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b7166640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f79b010c8d0 con 0x7f79b0100ad0 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0102690 0x7f79b019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b4f02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79b0100ad0 0x7f79b0197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0102690 0x7f79b019f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46988/0 (socket says 172.21.15.100:46988) 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 -- 172.21.15.100:0/1781376755 learned_addr learned my addr 172.21.15.100:0/1781376755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b4f02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79b0100ad0 0x7f79b0197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:41932/0 (socket says 172.21.15.100:41932) 2024-09-12T02:38:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79affff640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b0101cd0 0x7f79b0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 -- 172.21.15.100:0/1781376755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79b0100ad0 msgr2=0x7f79b0197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79b0100ad0 0x7f79b0197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 -- 172.21.15.100:0/1781376755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b0101cd0 msgr2=0x7f79b0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b0101cd0 0x7f79b0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 -- 172.21.15.100:0/1781376755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b019fa70 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.349+0000 7f79b5703640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0102690 0x7f79b019f400 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f79a800eaa0 tx=0x7f79a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.350+0000 7f79adffb640 1 -- 172.21.15.100:0/1781376755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a800cdb0 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.350+0000 7f79adffb640 1 -- 172.21.15.100:0/1781376755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79a8005020 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.350+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b019fd60 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.350+0000 7f79adffb640 1 -- 172.21.15.100:0/1781376755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a80116b0 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.350+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b01a0210 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.352+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b01a04a0 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.352+0000 7f79adffb640 1 -- 172.21.15.100:0/1781376755 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f79a8005560 con 0x7f79b0102690 2024-09-12T02:38:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.353+0000 7f79adffb640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79a00a2c40 0x7f79a00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.353+0000 7f79adffb640 1 -- 172.21.15.100:0/1781376755 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f79a80cf360 con 0x7f79b0102690 2024-09-12T02:38:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.353+0000 7f79b4f02640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79a00a2c40 0x7f79a00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.354+0000 7f79b4f02640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79a00a2c40 0x7f79a00a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79b0101b30 tx=0x7f79a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.357+0000 7f79adffb640 1 -- 172.21.15.100:0/1781376755 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79a8016030 con 0x7f79b0102690 2024-09-12T02:38:16.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.568+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f79b0108970 con 0x7f79b0102690 2024-09-12T02:38:16.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.568+0000 7f79adffb640 1 -- 172.21.15.100:0/1781376755 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3093 (secure 0 0 0) 0x7f79a809bb00 con 0x7f79b0102690 2024-09-12T02:38:16.570 INFO:teuthology.orchestra.run.smithi100.stdout:e24 2024-09-12T02:38:16.570 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-12T02:37:00:928817+0000 2024-09-12T02:38:16.570 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:38:16.570 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:38:16.570 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-12T02:38:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 24 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-12T02:36:49.490181+0000 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-12T02:37:00.496863+0000 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 300 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-12T02:38:16.571 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 0 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 3 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1,2 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=24473,1=24466,2=24448} 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-12T02:38:16.572 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 0 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 24473 members: 24448,24466,24473 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b{0:24473} state up:active seq 4 addr [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.h{0:24446} state up:standby-replay seq 1 addr [v2:172.21.15.117:6836/2625823245,v1:172.21.15.117:6837/2625823245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.i{1:24466} state up:active seq 8 addr [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.573 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f{1:24442} state up:standby-replay seq 1 addr [v2:172.21.15.189:6834/4244197989,v1:172.21.15.189:6835/4244197989] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c{2:24448} state up:active seq 10 addr [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e{2:24425} state up:standby-replay seq 1 addr [v2:172.21.15.117:6834/3724625594,v1:172.21.15.117:6835/3724625594] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.j{-1:14553} state up:standby seq 1 addr [v2:172.21.15.100:6834/742594492,v1:172.21.15.100:6835/742594492] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d{-1:14565} state up:standby seq 1 addr [v2:172.21.15.100:6836/3109981916,v1:172.21.15.100:6837/3109981916] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.g{-1:14619} state up:standby seq 1 addr [v2:172.21.15.100:6838/3873069130,v1:172.21.15.100:6839/3873069130] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a{-1:14625} state up:standby seq 1 addr [v2:172.21.15.100:6840/612034998,v1:172.21.15.100:6841/612034998] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.k{-1:24404} state up:standby seq 1 addr [v2:172.21.15.117:6832/369784956,v1:172.21.15.117:6833/369784956] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.574 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.l{-1:24406} state up:standby seq 1 addr [v2:172.21.15.189:6832/244666903,v1:172.21.15.189:6833/244666903] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:38:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:38:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79a00a2c40 msgr2=0x7f79a00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79a00a2c40 0x7f79a00a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79b0101b30 tx=0x7f79a4005f90 comp rx=0 tx=0).stop 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0102690 msgr2=0x7f79b019f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0102690 0x7f79b019f400 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f79a800eaa0 tx=0x7f79a800ef60 comp rx=0 tx=0).stop 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 shutdown_connections 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79a00a2c40 0x7f79a00a5100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79b0102690 0x7f79b019f400 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b0101cd0 0x7f79b0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 --2- 172.21.15.100:0/1781376755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79b0100ad0 0x7f79b0197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.570+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 >> 172.21.15.100:0/1781376755 conn(0x7f79b00fc280 msgr2=0x7f79b00fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.571+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 shutdown_connections 2024-09-12T02:38:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:16.571+0000 7f79b7166640 1 -- 172.21.15.100:0/1781376755 wait complete. 2024-09-12T02:38:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:16 smithi100 ceph-mon[31390]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:16 smithi100 ceph-mon[31390]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:16.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:16 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1781376755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:38:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:16 smithi189 ceph-mon[35196]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:17.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:16 smithi189 ceph-mon[35196]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:17.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:16 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1781376755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:38:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:16 smithi117 ceph-mon[34898]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:17.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:16 smithi117 ceph-mon[34898]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:17.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:16 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1781376755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:38:17.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T02:38:17.511 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:18.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 -- 172.21.15.100:0/3628675284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 msgr2=0x7f7c8010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 --2- 172.21.15.100:0/3628675284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8010a050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009ca0 tx=0x7f7c7802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 -- 172.21.15.100:0/3628675284 shutdown_connections 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 --2- 172.21.15.100:0/3628675284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8010a050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 --2- 172.21.15.100:0/3628675284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c80102e00 0x7f7c80103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 --2- 172.21.15.100:0/3628675284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c80101c00 0x7f7c80102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 -- 172.21.15.100:0/3628675284 >> 172.21.15.100:0/3628675284 conn(0x7f7c800fd390 msgr2=0x7f7c800ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 -- 172.21.15.100:0/3628675284 shutdown_connections 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 -- 172.21.15.100:0/3628675284 wait complete. 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.006+0000 7f7c8851d640 1 Processor -- start 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c8851d640 1 -- start start 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c8851d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c80101c00 0x7f7c80197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:18.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c8851d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c80102e00 0x7f7c80198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c8851d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c8851d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010d880 con 0x7f7c801037c0 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c8851d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010d700 con 0x7f7c80101c00 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c8851d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010da00 con 0x7f7c80102e00 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8019f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47014/0 (socket says 172.21.15.100:47014) 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 -- 172.21.15.100:0/1140292378 learned_addr learned my addr 172.21.15.100:0/1140292378 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c862b9640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c80101c00 0x7f7c80197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c85ab8640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c80102e00 0x7f7c80198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 -- 172.21.15.100:0/1140292378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c80102e00 msgr2=0x7f7c80198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c80102e00 0x7f7c80198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 -- 172.21.15.100:0/1140292378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c80101c00 msgr2=0x7f7c80197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c80101c00 0x7f7c80197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 -- 172.21.15.100:0/1140292378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8019fa20 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c85ab8640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c80102e00 0x7f7c80198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.007+0000 7f7c86aba640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8019f3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7c780098d0 tx=0x7f7c7802f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.008+0000 7f7c777fe640 1 -- 172.21.15.100:0/1140292378 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7802fc30 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.008+0000 7f7c777fe640 1 -- 172.21.15.100:0/1140292378 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c78003e50 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.008+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8019fcb0 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.008+0000 7f7c777fe640 1 -- 172.21.15.100:0/1140292378 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c780305c0 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.008+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801a01e0 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.009+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c80108f30 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.010+0000 7f7c777fe640 1 -- 172.21.15.100:0/1140292378 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7c78004b40 con 0x7f7c801037c0 2024-09-12T02:38:18.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.010+0000 7f7c777fe640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c6c0a2d40 0x7f7c6c0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:18.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.011+0000 7f7c862b9640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c6c0a2d40 0x7f7c6c0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.011+0000 7f7c777fe640 1 -- 172.21.15.100:0/1140292378 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7c780f05d0 con 0x7f7c801037c0 2024-09-12T02:38:18.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.011+0000 7f7c862b9640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c6c0a2d40 0x7f7c6c0a5200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c80102c60 tx=0x7f7c70005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:18.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.014+0000 7f7c777fe640 1 -- 172.21.15.100:0/1140292378 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c780bd500 con 0x7f7c801037c0 2024-09-12T02:38:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.181+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f7c8002d7c0 con 0x7f7c801037c0 2024-09-12T02:38:18.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.182+0000 7f7c777fe640 1 -- 172.21.15.100:0/1140292378 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5347 (secure 0 0 0) 0x7f7c780bce00 con 0x7f7c801037c0 2024-09-12T02:38:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 84 2024-09-12T02:38:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:38:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-12T02:29:09.444773+0000 2024-09-12T02:38:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-12T02:37:56.665591+0000 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:crush_version 26 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:full_ratio 0.95 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:backfillfull_ratio 0.9 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:nearfull_ratio 0.85 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:require_min_compat_client luminous 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:min_compat_client luminous 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:require_osd_release squid 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:stretch_mode_enabled false 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T02:38:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:max_osd 12 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6802/1448972907,v1:172.21.15.100:6803/1448972907] [v2:172.21.15.100:6804/1448972907,v1:172.21.15.100:6805/1448972907] exists,up 061ede74-c965-4987-8ac2-94b01404f060 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/3983495954,v1:172.21.15.117:6801/3983495954] [v2:172.21.15.117:6802/3983495954,v1:172.21.15.117:6803/3983495954] exists,up efb6f9f2-be2b-4368-baa2-38e7cc3e27f3 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/2928382700,v1:172.21.15.189:6801/2928382700] [v2:172.21.15.189:6802/2928382700,v1:172.21.15.189:6803/2928382700] exists,up 489afc2d-f3a0-4497-b48d-f055beda717b 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6810/379828632,v1:172.21.15.100:6811/379828632] [v2:172.21.15.100:6812/379828632,v1:172.21.15.100:6813/379828632] exists,up 23f116e6-4bfa-46b5-a1a6-96f999ad3e62 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 up in weight 1 up_from 32 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6808/3265990366,v1:172.21.15.117:6809/3265990366] [v2:172.21.15.117:6810/3265990366,v1:172.21.15.117:6811/3265990366] exists,up d3e44e9c-ef09-4279-b36c-21c6221798e0 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 up in weight 1 up_from 37 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/2955557122,v1:172.21.15.189:6809/2955557122] [v2:172.21.15.189:6810/2955557122,v1:172.21.15.189:6811/2955557122] exists,up 7c5fd350-58ff-4c17-a016-49d7b9dca138 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 up in weight 1 up_from 44 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6818/4163564084,v1:172.21.15.100:6819/4163564084] [v2:172.21.15.100:6820/4163564084,v1:172.21.15.100:6821/4163564084] exists,up 1d1f711c-acc7-40e2-93fa-961388eb3fda 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 up in weight 1 up_from 49 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6816/3414657732,v1:172.21.15.117:6817/3414657732] [v2:172.21.15.117:6818/3414657732,v1:172.21.15.117:6819/3414657732] exists,up 1f867c1d-c6aa-4b5a-92b9-013474aa1c21 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.8 up in weight 1 up_from 56 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/4129547978,v1:172.21.15.189:6817/4129547978] [v2:172.21.15.189:6818/4129547978,v1:172.21.15.189:6819/4129547978] exists,up fa0583fc-c147-414e-8811-c43c590bd307 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.9 up in weight 1 up_from 64 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6826/4123309490,v1:172.21.15.100:6827/4123309490] [v2:172.21.15.100:6828/4123309490,v1:172.21.15.100:6829/4123309490] exists,up 770580c2-fe84-4438-87c8-f42c8ffc4f85 2024-09-12T02:38:18.185 INFO:teuthology.orchestra.run.smithi100.stdout:osd.10 up in weight 1 up_from 69 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6824/1425929388,v1:172.21.15.117:6825/1425929388] [v2:172.21.15.117:6826/1425929388,v1:172.21.15.117:6827/1425929388] exists,up 0c29d5aa-1979-4f2a-9e47-6a3d566dce43 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:osd.11 up in weight 1 up_from 76 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/2500641850,v1:172.21.15.189:6825/2500641850] [v2:172.21.15.189:6826/2500641850,v1:172.21.15.189:6827/2500641850] exists,up a7d1327c-e505-4aa9-b444-7d53cc8f6a03 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.5 [8,11] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.b [2,4] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.10 [2,1] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.1c [8,11] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.2 [3,9] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.12 [3,9] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.17 [4,8,5,6] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.1d [4,7] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.2c [4,9] 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/2890609660 expires 2024-09-13T02:29:55.443151+0000 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/2742281949 expires 2024-09-13T02:29:55.443151+0000 2024-09-12T02:38:18.186 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/3730537393 expires 2024-09-13T02:29:55.443151+0000 2024-09-12T02:38:18.187 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6801/3548885308 expires 2024-09-13T02:29:55.443151+0000 2024-09-12T02:38:18.187 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/274092264 expires 2024-09-13T02:29:31.443245+0000 2024-09-12T02:38:18.187 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6801/3636516515 expires 2024-09-13T02:29:31.443245+0000 2024-09-12T02:38:18.187 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6800/3636516515 expires 2024-09-13T02:29:31.443245+0000 2024-09-12T02:38:18.187 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/1503257974 expires 2024-09-13T02:29:31.443245+0000 2024-09-12T02:38:18.187 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6800/3548885308 expires 2024-09-13T02:29:55.443151+0000 2024-09-12T02:38:18.187 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/875119703 expires 2024-09-13T02:29:31.443245+0000 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c6c0a2d40 msgr2=0x7f7c6c0a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c6c0a2d40 0x7f7c6c0a5200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c80102c60 tx=0x7f7c70005f90 comp rx=0 tx=0).stop 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 msgr2=0x7f7c8019f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8019f3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7c780098d0 tx=0x7f7c7802f840 comp rx=0 tx=0).stop 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 shutdown_connections 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c6c0a2d40 0x7f7c6c0a5200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c801037c0 0x7f7c8019f3b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c80102e00 0x7f7c80198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 --2- 172.21.15.100:0/1140292378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c80101c00 0x7f7c80197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.184+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 >> 172.21.15.100:0/1140292378 conn(0x7f7c800fd390 msgr2=0x7f7c80106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.185+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 shutdown_connections 2024-09-12T02:38:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:18.185+0000 7f7c8851d640 1 -- 172.21.15.100:0/1140292378 wait complete. 2024-09-12T02:38:18.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:18 smithi189 ceph-mon[35196]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:38:18.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:18 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1140292378' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:38:18.843 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T02:38:18.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:18.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:18 smithi100 ceph-mon[31390]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:38:18.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:18 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1140292378' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:38:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:18 smithi117 ceph-mon[34898]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-12T02:38:19.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:18 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1140292378' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:38:19.095 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2701982863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102570 msgr2=0x7fad981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2701982863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102570 0x7fad981029b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fad80009900 tx=0x7fad8002a480 comp rx=0 tx=0).stop 2024-09-12T02:38:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2701982863 shutdown_connections 2024-09-12T02:38:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2701982863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad98102ef0 0x7fad9810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2701982863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102570 0x7fad981029b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2701982863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad98100e20 0x7fad98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2701982863 >> 172.21.15.100:0/2701982863 conn(0x7fad980fc7d0 msgr2=0x7fad980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2701982863 shutdown_connections 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.563+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2701982863 wait complete. 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 Processor -- start 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 -- start start 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad98100e20 0x7fad98197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad98102570 0x7fad98197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102ef0 0x7fad9819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad98110fa0 con 0x7fad98102ef0 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad98110e20 con 0x7fad98102570 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9f1c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad98111120 con 0x7fad98100e20 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9d75e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102ef0 0x7fad9819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9d75e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102ef0 0x7fad9819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47040/0 (socket says 172.21.15.100:47040) 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.564+0000 7fad9d75e640 1 -- 172.21.15.100:0/2703532189 learned_addr learned my addr 172.21.15.100:0/2703532189 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad97fff640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad98102570 0x7fad98197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9cf5d640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad98100e20 0x7fad98197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9d75e640 1 -- 172.21.15.100:0/2703532189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad98100e20 msgr2=0x7fad98197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9d75e640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad98100e20 0x7fad98197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9d75e640 1 -- 172.21.15.100:0/2703532189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad98102570 msgr2=0x7fad98197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9d75e640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad98102570 0x7fad98197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9d75e640 1 -- 172.21.15.100:0/2703532189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9819c3d0 con 0x7fad98102ef0 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad97fff640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad98102570 0x7fad98197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9d75e640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102ef0 0x7fad9819bcf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fad9000b970 tx=0x7fad9000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad95ffb640 1 -- 172.21.15.100:0/2703532189 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90019070 con 0x7fad98102ef0 2024-09-12T02:38:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9819c6c0 con 0x7fad98102ef0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad95ffb640 1 -- 172.21.15.100:0/2703532189 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad9000cb40 con 0x7fad98102ef0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad95ffb640 1 -- 172.21.15.100:0/2703532189 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90007610 con 0x7fad98102ef0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.565+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad981a3fa0 con 0x7fad98102ef0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.566+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad98101200 con 0x7fad98102ef0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.567+0000 7fad95ffb640 1 -- 172.21.15.100:0/2703532189 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fad9001c070 con 0x7fad98102ef0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.568+0000 7fad95ffb640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad840a2c10 0x7fad840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.568+0000 7fad9cf5d640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad840a2c10 0x7fad840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.568+0000 7fad95ffb640 1 -- 172.21.15.100:0/2703532189 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fad900cebc0 con 0x7fad98102ef0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.569+0000 7fad9cf5d640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad840a2c10 0x7fad840a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad88005fd0 tx=0x7fad88005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.571+0000 7fad95ffb640 1 -- 172.21.15.100:0/2703532189 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad9009bac0 con 0x7fad98102ef0 2024-09-12T02:38:19.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.775+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad98109090 con 0x7fad98102ef0 2024-09-12T02:38:19.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.776+0000 7fad95ffb640 1 -- 172.21.15.100:0/2703532189 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fad9009b3c0 con 0x7fad98102ef0 2024-09-12T02:38:19.777 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:19.778 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:37:00:928817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:37:00.496863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:38:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:38:19.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad840a2c10 msgr2=0x7fad840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad840a2c10 0x7fad840a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad88005fd0 tx=0x7fad88005850 comp rx=0 tx=0).stop 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102ef0 msgr2=0x7fad9819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102ef0 0x7fad9819bcf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fad9000b970 tx=0x7fad9000be30 comp rx=0 tx=0).stop 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 shutdown_connections 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fad840a2c10 0x7fad840a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad98102ef0 0x7fad9819bcf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad98102570 0x7fad98197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 --2- 172.21.15.100:0/2703532189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad98100e20 0x7fad98197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 >> 172.21.15.100:0/2703532189 conn(0x7fad980fc7d0 msgr2=0x7fad980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 shutdown_connections 2024-09-12T02:38:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:19.779+0000 7fad9f1c1640 1 -- 172.21.15.100:0/2703532189 wait complete. 2024-09-12T02:38:20.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:20.871 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:20.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:20 smithi100 ceph-mon[31390]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:20.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:20 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2703532189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:20 smithi189 ceph-mon[35196]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:20 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2703532189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:20 smithi117 ceph-mon[34898]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:20 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2703532189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:21.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2122862897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec100e30 msgr2=0x7fa0ec104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2122862897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec100e30 0x7fa0ec104e80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400aa10 tx=0x7fa0d402b720 comp rx=0 tx=0).stop 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2122862897 shutdown_connections 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2122862897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ec1055b0 0x7fa0ec10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2122862897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec100e30 0x7fa0ec104e80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2122862897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0ec100480 0x7fa0ec100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2122862897 >> 172.21.15.100:0/2122862897 conn(0x7fa0ec077210 msgr2=0x7fa0ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2122862897 shutdown_connections 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.324+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2122862897 wait complete. 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 Processor -- start 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 -- start start 2024-09-12T02:38:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ec100480 0x7fa0ec0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0ec100e30 0x7fa0ec0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec1055b0 0x7fa0ec0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec10fdd0 con 0x7fa0ec1055b0 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec10fc50 con 0x7fa0ec100e30 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0f1e1e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec10ff50 con 0x7fa0ec100480 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec1055b0 0x7fa0ec0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec1055b0 0x7fa0ec0fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47048/0 (socket says 172.21.15.100:47048) 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0ebfff640 1 -- 172.21.15.100:0/2140505765 learned_addr learned my addr 172.21.15.100:0/2140505765 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.325+0000 7fa0eb7fe640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ec100480 0x7fa0ec0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0e3fff640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0ec100e30 0x7fa0ec0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0ebfff640 1 -- 172.21.15.100:0/2140505765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ec100480 msgr2=0x7fa0ec0fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0ebfff640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ec100480 0x7fa0ec0fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0ebfff640 1 -- 172.21.15.100:0/2140505765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0ec100e30 msgr2=0x7fa0ec0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0ebfff640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0ec100e30 0x7fa0ec0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0ebfff640 1 -- 172.21.15.100:0/2140505765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec1a6a70 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0e3fff640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0ec100e30 0x7fa0ec0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0ebfff640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec1055b0 0x7fa0ec0fd110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400eaa0 tx=0x7fa0e400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0e97fa640 1 -- 172.21.15.100:0/2140505765 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4004d20 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ec1a6d60 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0e97fa640 1 -- 172.21.15.100:0/2140505765 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0e4005020 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0e97fa640 1 -- 172.21.15.100:0/2140505765 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40116d0 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.326+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ec1a7270 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.327+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ec100860 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.328+0000 7fa0e97fa640 1 -- 172.21.15.100:0/2140505765 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa0e40051d0 con 0x7fa0ec1055b0 2024-09-12T02:38:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.329+0000 7fa0e97fa640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0d80a2c10 0x7fa0d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.329+0000 7fa0eb7fe640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0d80a2c10 0x7fa0d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.329+0000 7fa0e97fa640 1 -- 172.21.15.100:0/2140505765 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa0e40cf3b0 con 0x7fa0ec1055b0 2024-09-12T02:38:21.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.330+0000 7fa0eb7fe640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0d80a2c10 0x7fa0d80a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009990 tx=0x7fa0dc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.333+0000 7fa0e97fa640 1 -- 172.21.15.100:0/2140505765 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0e4016030 con 0x7fa0ec1055b0 2024-09-12T02:38:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.536+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0ec10a7a0 con 0x7fa0ec1055b0 2024-09-12T02:38:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.536+0000 7fa0e97fa640 1 -- 172.21.15.100:0/2140505765 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fa0e409c1a0 con 0x7fa0ec1055b0 2024-09-12T02:38:21.538 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:21.538 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:37:00:928817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:37:00.496863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:38:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:38:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0d80a2c10 msgr2=0x7fa0d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0d80a2c10 0x7fa0d80a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009990 tx=0x7fa0dc009110 comp rx=0 tx=0).stop 2024-09-12T02:38:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec1055b0 msgr2=0x7fa0ec0fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec1055b0 0x7fa0ec0fd110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400eaa0 tx=0x7fa0e400eea0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 shutdown_connections 2024-09-12T02:38:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0d80a2c10 0x7fa0d80a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0ec1055b0 0x7fa0ec0fd110 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0ec100e30 0x7fa0ec0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 --2- 172.21.15.100:0/2140505765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ec100480 0x7fa0ec0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 >> 172.21.15.100:0/2140505765 conn(0x7fa0ec077210 msgr2=0x7fa0ec103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 shutdown_connections 2024-09-12T02:38:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:21.539+0000 7fa0f1e1e640 1 -- 172.21.15.100:0/2140505765 wait complete. 2024-09-12T02:38:21.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:21 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2140505765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:22.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:21 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2140505765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:22.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:21 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2140505765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:22.339 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:38:22.585 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:22.892 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:22 smithi100 ceph-mon[31390]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:38:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:22 smithi189 ceph-mon[35196]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:38:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:22 smithi117 ceph-mon[34898]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 -- 172.21.15.100:0/298324739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8100a70 msgr2=0x7f2ab8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 --2- 172.21.15.100:0/298324739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8100a70 0x7f2ab8100ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009930 tx=0x7f2aa002a420 comp rx=0 tx=0).stop 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 -- 172.21.15.100:0/298324739 shutdown_connections 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 --2- 172.21.15.100:0/298324739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ab8101410 0x7f2ab810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 --2- 172.21.15.100:0/298324739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8100a70 0x7f2ab8100ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 --2- 172.21.15.100:0/298324739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab8106a70 0x7f2ab8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 -- 172.21.15.100:0/298324739 >> 172.21.15.100:0/298324739 conn(0x7f2ab80fc790 msgr2=0x7f2ab80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 -- 172.21.15.100:0/298324739 shutdown_connections 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.085+0000 7f2abd739640 1 -- 172.21.15.100:0/298324739 wait complete. 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 Processor -- start 2024-09-12T02:38:23.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 -- start start 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ab8100a70 0x7f2ab81973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8101410 0x7f2ab8197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab8106a70 0x7f2ab819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8110e70 con 0x7f2ab8101410 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8110cf0 con 0x7f2ab8100a70 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2abd739640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8110ff0 con 0x7f2ab8106a70 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2aae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8101410 0x7f2ab8197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2aae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8101410 0x7f2ab8197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47076/0 (socket says 172.21.15.100:47076) 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2aae7fc640 1 -- 172.21.15.100:0/3667848399 learned_addr learned my addr 172.21.15.100:0/3667848399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.086+0000 7f2ab77fe640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab8106a70 0x7f2ab819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2ab6ffd640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ab8100a70 0x7f2ab81973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2aae7fc640 1 -- 172.21.15.100:0/3667848399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab8106a70 msgr2=0x7f2ab819bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2aae7fc640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab8106a70 0x7f2ab819bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2aae7fc640 1 -- 172.21.15.100:0/3667848399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ab8100a70 msgr2=0x7f2ab81973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2aae7fc640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ab8100a70 0x7f2ab81973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2aae7fc640 1 -- 172.21.15.100:0/3667848399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab819c380 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2ab6ffd640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ab8100a70 0x7f2ab81973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2aae7fc640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8101410 0x7f2ab8197910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009230 tx=0x7f2aa0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2ab4ff9640 1 -- 172.21.15.100:0/3667848399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa003f030 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2ab4ff9640 1 -- 172.21.15.100:0/3667848399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2aa0003ad0 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab819c610 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2ab4ff9640 1 -- 172.21.15.100:0/3667848399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0035070 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.087+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab81a3f50 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.088+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab81021b0 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.089+0000 7f2ab4ff9640 1 -- 172.21.15.100:0/3667848399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2aa0042030 con 0x7f2ab8101410 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.090+0000 7f2ab4ff9640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2aa40a2c10 0x7f2aa40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:23.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.090+0000 7f2ab6ffd640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2aa40a2c10 0x7f2aa40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:23.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.090+0000 7f2ab4ff9640 1 -- 172.21.15.100:0/3667848399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2aa00ef780 con 0x7f2ab8101410 2024-09-12T02:38:23.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.090+0000 7f2ab6ffd640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2aa40a2c10 0x7f2aa40a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80058c0 tx=0x7f2aa8005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:23.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.094+0000 7f2ab4ff9640 1 -- 172.21.15.100:0/3667848399 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2aa00bc570 con 0x7f2ab8101410 2024-09-12T02:38:23.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.261+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ab8108fe0 con 0x7f2ab8101410 2024-09-12T02:38:23.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.262+0000 7f2ab4ff9640 1 -- 172.21.15.100:0/3667848399 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22871 (secure 0 0 0) 0x7f2aa00bbe70 con 0x7f2ab8101410 2024-09-12T02:38:23.264 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:23.264 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:37:56.665591+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:38:23.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2aa40a2c10 msgr2=0x7f2aa40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:23.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2aa40a2c10 0x7f2aa40a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80058c0 tx=0x7f2aa8005cb0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8101410 msgr2=0x7f2ab8197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:23.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8101410 0x7f2ab8197910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009230 tx=0x7f2aa0004270 comp rx=0 tx=0).stop 2024-09-12T02:38:23.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 shutdown_connections 2024-09-12T02:38:23.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2aa40a2c10 0x7f2aa40a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab8106a70 0x7f2ab819bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab8101410 0x7f2ab8197910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 --2- 172.21.15.100:0/3667848399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ab8100a70 0x7f2ab81973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:23.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 >> 172.21.15.100:0/3667848399 conn(0x7f2ab80fc790 msgr2=0x7f2ab80fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:23.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 shutdown_connections 2024-09-12T02:38:23.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:23.265+0000 7f2abd739640 1 -- 172.21.15.100:0/3667848399 wait complete. 2024-09-12T02:38:23.920 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:23 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3667848399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:23.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:36:49.490181+0000', 'modified': '2024-09-12T02:37:00.496863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24473, 'mds_1': 24466, 'mds_2': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3724625594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3724625594}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3724625594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/4244197989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 4244197989}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 4244197989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6837/2625823245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 2625823245}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 2625823245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.189:6837/2893582984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 2893582984}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 2893582984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/249791432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 249791432}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 249791432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6839/801964439', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 801964439}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 801964439}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24448, 24466, 24473]} 2024-09-12T02:38:23.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:38:23.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:38:24.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:23 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3667848399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:24.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:23 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3667848399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:24.192 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 -- 172.21.15.100:0/1609624215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c106a80 msgr2=0x7f356c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 --2- 172.21.15.100:0/1609624215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c106a80 0x7f356c106e60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f355c009930 tx=0x7f355c02a420 comp rx=0 tx=0).stop 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 -- 172.21.15.100:0/1609624215 shutdown_connections 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 --2- 172.21.15.100:0/1609624215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f356c101420 0x7f356c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 --2- 172.21.15.100:0/1609624215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c100a80 0x7f356c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 --2- 172.21.15.100:0/1609624215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c106a80 0x7f356c106e60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 -- 172.21.15.100:0/1609624215 >> 172.21.15.100:0/1609624215 conn(0x7f356c0fc7a0 msgr2=0x7f356c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 -- 172.21.15.100:0/1609624215 shutdown_connections 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.702+0000 7f3572873640 1 -- 172.21.15.100:0/1609624215 wait complete. 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 Processor -- start 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 -- start start 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c100a80 0x7f356c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f356c101420 0x7f356c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c106a80 0x7f356c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f356c110ec0 con 0x7f356c100a80 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f356c110d40 con 0x7f356c106a80 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f3572873640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f356c111040 con 0x7f356c101420 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.703+0000 7f356bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c100a80 0x7f356c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c100a80 0x7f356c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54152/0 (socket says 172.21.15.100:54152) 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 -- 172.21.15.100:0/2692778290 learned_addr learned my addr 172.21.15.100:0/2692778290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f356c101420 0x7f356c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f3570e10640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c106a80 0x7f356c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 -- 172.21.15.100:0/2692778290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f356c101420 msgr2=0x7f356c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f356c101420 0x7f356c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 -- 172.21.15.100:0/2692778290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c106a80 msgr2=0x7f356c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c106a80 0x7f356c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 -- 172.21.15.100:0/2692778290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c19d490 con 0x7f356c100a80 2024-09-12T02:38:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f356bfff640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c100a80 0x7f356c1984e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f355c009230 tx=0x7f355c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f35697fa640 1 -- 172.21.15.100:0/2692778290 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c03f030 con 0x7f356c100a80 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f35697fa640 1 -- 172.21.15.100:0/2692778290 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f355c003ad0 con 0x7f356c100a80 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c19d720 con 0x7f356c100a80 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f35697fa640 1 -- 172.21.15.100:0/2692778290 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c035070 con 0x7f356c100a80 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.704+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1a5060 con 0x7f356c100a80 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.706+0000 7f35697fa640 1 -- 172.21.15.100:0/2692778290 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f355c042030 con 0x7f356c100a80 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 Processor -- start 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 -- start start 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f35697fa640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f35540a2c10 0x7f35540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842e9d0 0x56005842edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3570e10640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f35540a2c10 0x7f35540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842f2f0 0x560058439670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x56005843bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560058395090 con 0x560058439bb0 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56005833ca70 con 0x56005842e9d0 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3574c4c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560058391050 con 0x56005842f2f0 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f35697fa640 1 -- 172.21.15.100:0/2692778290 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f355c0ef610 con 0x7f356c100a80 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3570e10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x56005843bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3570e10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x56005843bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54156/0 (socket says 172.21.15.100:54156) 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f3570e10640 1 -- 172.21.15.100:0/3112995051 learned_addr learned my addr 172.21.15.100:0/3112995051 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f356bfff640 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842e9d0 0x56005842edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.707+0000 7f356b7fe640 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842f2f0 0x560058439670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f3570e10640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f35540a2c10 0x7f35540a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35640148c0 tx=0x7f3564014cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f3570e10640 1 -- 172.21.15.100:0/3112995051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842f2f0 msgr2=0x560058439670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f3570e10640 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842f2f0 0x560058439670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f3570e10640 1 -- 172.21.15.100:0/3112995051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842e9d0 msgr2=0x56005842edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f3570e10640 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842e9d0 0x56005842edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f3570e10640 1 -- 172.21.15.100:0/3112995051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560058349130 con 0x560058439bb0 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f356bfff640 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842e9d0 0x56005842edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f3570e10640 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x56005843bfa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3564014fd0 tx=0x7f356401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c9117a0e12e387 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f35527fc640 1 -- 172.21.15.100:0/3112995051 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356401ee40 con 0x560058439bb0 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f35527fc640 1 -- 172.21.15.100:0/3112995051 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3564012c50 con 0x560058439bb0 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.708+0000 7f35527fc640 1 -- 172.21.15.100:0/3112995051 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356401f6c0 con 0x560058439bb0 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 -- 172.21.15.100:0/3112995051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 msgr2=0x56005843bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x56005843bfa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3564014fd0 tx=0x7f356401e000 comp rx=0 tx=0).stop 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 -- 172.21.15.100:0/3112995051 shutdown_connections 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x56005843bfa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842f2f0 0x560058439670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 --2- 172.21.15.100:0/3112995051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842e9d0 0x56005842edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 -- 172.21.15.100:0/3112995051 >> 172.21.15.100:0/3112995051 conn(0x56005842af60 msgr2=0x56005842b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 -- 172.21.15.100:0/3112995051 shutdown_connections 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 -- 172.21.15.100:0/3112995051 wait complete. 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 -- start start 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.709+0000 7f3574c4c740 1 Processor -- start 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058439470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56005842f2f0 0x5600584367c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560058439bb0 0x560058436d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56005843c780 con 0x56005842f2f0 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56005834ff20 con 0x560058439bb0 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56005843c900 con 0x56005842e9d0 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 10 client.0 _ll_register_callbacks cb 0x560058319030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56005842f2f0 0x5600584367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56005842f2f0 0x5600584367c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54168/0 (socket says 172.21.15.100:54168) 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 -- 172.21.15.100:0/2508946079 learned_addr learned my addr 172.21.15.100:0/2508946079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356bfff640 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058439470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3570e10640 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560058439bb0 0x560058436d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 -- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 msgr2=0x560058439470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058439470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 -- 172.21.15.100:0/2508946079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560058439bb0 msgr2=0x560058436d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560058439bb0 0x560058436d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 -- 172.21.15.100:0/2508946079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600581062b0 con 0x56005842f2f0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f356b7fe640 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56005842f2f0 0x5600584367c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3560011570 tx=0x7f3560009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5a11e1df33b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f354b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f354b7fe640 1 -- 172.21.15.100:0/2508946079 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560013670 con 0x56005842f2f0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f354b7fe640 1 -- 172.21.15.100:0/2508946079 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3560013810 con 0x56005842f2f0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3564012c50 con 0x56005842f2f0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f354b7fe640 1 -- 172.21.15.100:0/2508946079 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3560013a10 con 0x56005842f2f0 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 10 client.15093 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.710+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560058448130 con 0x56005842f2f0 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f354b7fe640 1 -- 172.21.15.100:0/2508946079 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3564012c50 con 0x56005842f2f0 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f354b7fe640 1 -- 172.21.15.100:0/2508946079 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3560014440 con 0x56005842f2f0 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f3574c4c740 10 client.15093 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f3574c4c740 10 client.15093 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f3574c4c740 20 client.15093 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f3574c4c740 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56005844a740 0x56005844bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f3574c4c740 4 client.15093 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600583a2600 con 0x56005844a740 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f356bfff640 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56005844a740 0x56005844bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f354b7fe640 10 client.15093 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.711+0000 7f356bfff640 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56005844a740 0x56005844bbb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7afa29a88fa30a98 server_cookie=ff8ec90ff02e6f3 in_seq=0 out_seq=0 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.712+0000 7f354b7fe640 1 -- 172.21.15.100:0/2508946079 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600583a2600 con 0x56005844a740 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.712+0000 7f354b7fe640 10 client.15093 handle_command_reply: tid=0 2024-09-12T02:38:24.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.712+0000 7f3574c4c740 1 client.15093 shutdown 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.712+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56005842f2f0 msgr2=0x5600584367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.712+0000 7f3574c4c740 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56005842f2f0 0x5600584367c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3560011570 tx=0x7f3560009f90 comp rx=0 tx=0).stop 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 shutdown_connections 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56005844a740 0x56005844bbb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560058439bb0 0x560058436d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56005842f2f0 0x5600584367c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f354b7fe640 0 client.15093 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 --2- 172.21.15.100:0/2508946079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058439470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 >> 172.21.15.100:0/2508946079 conn(0x56005842af60 msgr2=0x560058430c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 shutdown_connections 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 1 -- 172.21.15.100:0/2508946079 wait complete. 2024-09-12T02:38:24.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.713+0000 7f3574c4c740 20 client.15093 trim_cache size 0 max 16384 2024-09-12T02:38:24.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 Processor -- start 2024-09-12T02:38:24.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 -- start start 2024-09-12T02:38:24.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058431c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058433f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560058449ef0 con 0x560058439bb0 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56005844a5c0 con 0x56005842f2f0 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3574c4c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56005844ac90 con 0x56005842e9d0 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3570e10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058433f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3570e10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058433f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54176/0 (socket says 172.21.15.100:54176) 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.730+0000 7f3570e10640 1 -- 172.21.15.100:0/270463386 learned_addr learned my addr 172.21.15.100:0/270463386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f356b7fe640 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f356bfff640 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058431c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3570e10640 1 -- 172.21.15.100:0/270463386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 msgr2=0x560058431c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3570e10640 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058431c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3570e10640 1 -- 172.21.15.100:0/270463386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 msgr2=0x560058433a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3570e10640 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3570e10640 1 -- 172.21.15.100:0/270463386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560058437800 con 0x560058439bb0 2024-09-12T02:38:24.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3570e10640 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058433f80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3564020fd0 tx=0x7f3564009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bf7c361debeaa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:24.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3551ffb640 1 -- 172.21.15.100:0/270463386 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564012c50 con 0x560058439bb0 2024-09-12T02:38:24.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3551ffb640 1 -- 172.21.15.100:0/270463386 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3564012df0 con 0x560058439bb0 2024-09-12T02:38:24.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.731+0000 7f3551ffb640 1 -- 172.21.15.100:0/270463386 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564004280 con 0x560058439bb0 2024-09-12T02:38:24.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 -- 172.21.15.100:0/270463386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 msgr2=0x560058433f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058433f80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3564020fd0 tx=0x7f3564009ad0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 -- 172.21.15.100:0/270463386 shutdown_connections 2024-09-12T02:38:24.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058433f80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 --2- 172.21.15.100:0/270463386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058431c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 -- 172.21.15.100:0/270463386 >> 172.21.15.100:0/270463386 conn(0x56005842af60 msgr2=0x560058431580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 -- 172.21.15.100:0/270463386 shutdown_connections 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 -- 172.21.15.100:0/270463386 wait complete. 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 -- start start 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.732+0000 7f3574c4c740 1 Processor -- start 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058433780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058434200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56005844ba30 con 0x560058439bb0 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56005844b360 con 0x56005842f2f0 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56005844c100 con 0x56005842e9d0 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 10 client.0 _ll_register_callbacks cb 0x7f3560009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:24.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058434200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f356b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058434200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54186/0 (socket says 172.21.15.100:54186) 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 -- 172.21.15.100:0/734471908 learned_addr learned my addr 172.21.15.100:0/734471908 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f356b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:43926/0 (socket says 172.21.15.100:43926) 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f356bfff640 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058433780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 -- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 msgr2=0x560058433780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058433780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 -- 172.21.15.100:0/734471908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 msgr2=0x560058433cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 -- 172.21.15.100:0/734471908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560058452320 con 0x560058439bb0 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3570e10640 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058434200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3564012800 tx=0x7f3564005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1a0aff932bb0ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f354b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:24.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f354b7fe640 1 -- 172.21.15.100:0/734471908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564012c50 con 0x560058439bb0 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f354b7fe640 1 -- 172.21.15.100:0/734471908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3564004220 con 0x560058439bb0 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.733+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3564012df0 con 0x560058439bb0 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f354b7fe640 1 -- 172.21.15.100:0/734471908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3564004420 con 0x560058439bb0 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 10 client.15099 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5600584b5060 con 0x560058439bb0 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f354b7fe640 1 -- 172.21.15.100:0/734471908 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3564012df0 con 0x560058439bb0 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f354b7fe640 1 -- 172.21.15.100:0/734471908 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f356400f040 con 0x560058439bb0 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 10 client.15099 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 10 client.15099 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 20 client.15099 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5600584b94b0 0x5600584b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:24.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 4 client.15099 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "status"}) -- 0x56005839cb10 con 0x5600584b94b0 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.734+0000 7f356bfff640 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5600584b94b0 0x5600584b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f356bfff640 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5600584b94b0 0x5600584b81c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3db7a9aad323c05 server_cookie=106663612277050 in_seq=0 out_seq=0 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f354b7fe640 10 client.15099 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f354b7fe640 1 -- 172.21.15.100:0/734471908 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56005839cb10 con 0x5600584b94b0 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f354b7fe640 10 client.15099 handle_command_reply: tid=0 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 client.15099 shutdown 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 msgr2=0x560058434200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058434200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3564012800 tx=0x7f3564005fd0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 shutdown_connections 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5600584b94b0 0x5600584b81c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560058439bb0 0x560058434200 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56005842f2f0 0x560058433cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 --2- 172.21.15.100:0/734471908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56005842e9d0 0x560058433780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 >> 172.21.15.100:0/734471908 conn(0x56005842af60 msgr2=0x560058430c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f354b7fe640 0 client.15099 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 shutdown_connections 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 1 -- 172.21.15.100:0/734471908 wait complete. 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.735+0000 7f3574c4c740 20 client.15099 trim_cache size 0 max 16384 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24448, 2024-09-12T02:38:24.742 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 86.814191512999997, 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 119.371711508 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:24.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f35540a2c10 msgr2=0x7f35540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f35540a2c10 0x7f35540a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35640148c0 tx=0x7f3564014cc0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c100a80 msgr2=0x7f356c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c100a80 0x7f356c1984e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f355c009230 tx=0x7f355c004270 comp rx=0 tx=0).stop 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 shutdown_connections 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f35540a2c10 0x7f35540a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c106a80 0x7f356c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f356c101420 0x7f356c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 --2- 172.21.15.100:0/2692778290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f356c100a80 0x7f356c1984e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:24.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 >> 172.21.15.100:0/2692778290 conn(0x7f356c0fc7a0 msgr2=0x7f356c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:24.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 shutdown_connections 2024-09-12T02:38:24.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:24.736+0000 7f3572873640 1 -- 172.21.15.100:0/2692778290 wait complete. 2024-09-12T02:38:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:24 smithi189 ceph-mon[35196]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:38:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:24 smithi117 ceph-mon[34898]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:38:25.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:24 smithi100 ceph-mon[31390]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:38:25.599 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:38:25.850 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 -- 172.21.15.100:0/4179688045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee01002f0 msgr2=0x7faee01006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 --2- 172.21.15.100:0/4179688045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee01002f0 0x7faee01006d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faed0009930 tx=0x7faed002a420 comp rx=0 tx=0).stop 2024-09-12T02:38:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 -- 172.21.15.100:0/4179688045 shutdown_connections 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 --2- 172.21.15.100:0/4179688045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee0106f50 0x7faee010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 --2- 172.21.15.100:0/4179688045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faee0100ca0 0x7faee0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 --2- 172.21.15.100:0/4179688045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee01002f0 0x7faee01006d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 -- 172.21.15.100:0/4179688045 >> 172.21.15.100:0/4179688045 conn(0x7faee0077210 msgr2=0x7faee00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 -- 172.21.15.100:0/4179688045 shutdown_connections 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.348+0000 7faee4b5e640 1 -- 172.21.15.100:0/4179688045 wait complete. 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 Processor -- start 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 -- start start 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee01002f0 0x7faee01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faee0100ca0 0x7faee0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0106f50 0x7faee019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faee0112050 con 0x7faee0106f50 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faee0111ed0 con 0x7faee0100ca0 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faee4b5e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faee01121d0 con 0x7faee01002f0 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faeded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0106f50 0x7faee019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faeded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0106f50 0x7faee019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54214/0 (socket says 172.21.15.100:54214) 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faeded9d640 1 -- 172.21.15.100:0/1251711752 learned_addr learned my addr 172.21.15.100:0/1251711752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faeddd9b640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faee0100ca0 0x7faee0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.349+0000 7faede59c640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee01002f0 0x7faee01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faeded9d640 1 -- 172.21.15.100:0/1251711752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee01002f0 msgr2=0x7faee01984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faeded9d640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee01002f0 0x7faee01984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faeded9d640 1 -- 172.21.15.100:0/1251711752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faee0100ca0 msgr2=0x7faee0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faeded9d640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faee0100ca0 0x7faee0198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faeded9d640 1 -- 172.21.15.100:0/1251711752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee019d4a0 con 0x7faee0106f50 2024-09-12T02:38:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faeded9d640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0106f50 0x7faee019cdc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faed800b970 tx=0x7faed800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faecf7fe640 1 -- 172.21.15.100:0/1251711752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8019070 con 0x7faee0106f50 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faecf7fe640 1 -- 172.21.15.100:0/1251711752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed800cb40 con 0x7faee0106f50 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee019d790 con 0x7faee0106f50 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faecf7fe640 1 -- 172.21.15.100:0/1251711752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8007650 con 0x7faee0106f50 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.350+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee01a5070 con 0x7faee0106f50 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.352+0000 7faecf7fe640 1 -- 172.21.15.100:0/1251711752 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7faed801c070 con 0x7faee0106f50 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 Processor -- start 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 -- start start 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faecf7fe640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7faec80a2b80 0x7faec80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee4bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4c2f0 0x55835ee56670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee58fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55835edb2090 con 0x55835ee56bb0 2024-09-12T02:38:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55835ed59a70 con 0x55835ee4b9d0 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faee6f37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55835edae050 con 0x55835ee4c2f0 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faeddd9b640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7faec80a2b80 0x7faec80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faeded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee58fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faede59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee4bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faede59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee4bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:43944/0 (socket says 172.21.15.100:43944) 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faeded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee58fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54228/0 (socket says 172.21.15.100:54228) 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faede59c640 1 -- 172.21.15.100:0/2671435378 learned_addr learned my addr 172.21.15.100:0/2671435378 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faecf7fe640 1 -- 172.21.15.100:0/1251711752 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7faed80ce640 con 0x7faee0106f50 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faeded9d640 1 -- 172.21.15.100:0/2671435378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4c2f0 msgr2=0x55835ee56670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.353+0000 7faeded9d640 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4c2f0 0x55835ee56670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeded9d640 1 -- 172.21.15.100:0/2671435378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 msgr2=0x55835ee4bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeded9d640 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee4bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeded9d640 1 -- 172.21.15.100:0/2671435378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835ed66130 con 0x55835ee56bb0 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faede59c640 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeddd9b640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7faec80a2b80 0x7faec80a5040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faed40058a0 tx=0x7faed400b770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeded9d640 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee58fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faed809aed0 tx=0x7faed8004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fce64d04f4b3ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeccff9640 1 -- 172.21.15.100:0/2671435378 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed809af40 con 0x55835ee56bb0 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeccff9640 1 -- 172.21.15.100:0/2671435378 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed809f240 con 0x55835ee56bb0 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.354+0000 7faeccff9640 1 -- 172.21.15.100:0/2671435378 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80992d0 con 0x55835ee56bb0 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- 172.21.15.100:0/2671435378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 msgr2=0x55835ee58fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee58fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faed809aed0 tx=0x7faed8004b50 comp rx=0 tx=0).stop 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- 172.21.15.100:0/2671435378 shutdown_connections 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee58fa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4c2f0 0x55835ee56670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 --2- 172.21.15.100:0/2671435378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- 172.21.15.100:0/2671435378 >> 172.21.15.100:0/2671435378 conn(0x55835ee47f60 msgr2=0x55835ee48340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- 172.21.15.100:0/2671435378 shutdown_connections 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- 172.21.15.100:0/2671435378 wait complete. 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- start start 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 Processor -- start 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4c2f0 0x55835ee53810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee53d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55835ee59780 con 0x55835ee56bb0 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55835ed6cf20 con 0x55835ee4c2f0 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55835ee59900 con 0x55835ee4b9d0 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.355+0000 7faee6f37740 10 client.0 _ll_register_callbacks cb 0x55835ed36030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee53d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee53d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54232/0 (socket says 172.21.15.100:54232) 2024-09-12T02:38:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 -- 172.21.15.100:0/4162737863 learned_addr learned my addr 172.21.15.100:0/4162737863 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeddd9b640 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4c2f0 0x55835ee53810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 -- 172.21.15.100:0/4162737863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 msgr2=0x55835ee564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 -- 172.21.15.100:0/4162737863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4c2f0 msgr2=0x55835ee53810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4c2f0 0x55835ee53810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 -- 172.21.15.100:0/4162737863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835eb232b0 con 0x55835ee56bb0 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeddd9b640 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4c2f0 0x55835ee53810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faeded9d640 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee53d50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faed80a35d0 tx=0x7faed809af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83588f6ec90153b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faec5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faec5ffb640 1 -- 172.21.15.100:0/4162737863 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80840d0 con 0x55835ee56bb0 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faec5ffb640 1 -- 172.21.15.100:0/4162737863 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7faed80a3670 con 0x55835ee56bb0 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed809f240 con 0x55835ee56bb0 2024-09-12T02:38:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faec5ffb640 1 -- 172.21.15.100:0/4162737863 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faed8084270 con 0x55835ee56bb0 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faee6f37740 10 client.15111 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55835ee65100 con 0x55835ee56bb0 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faec5ffb640 1 -- 172.21.15.100:0/4162737863 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed809f240 con 0x55835ee56bb0 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faec5ffb640 1 -- 172.21.15.100:0/4162737863 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faed8096c90 con 0x55835ee56bb0 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.356+0000 7faee6f37740 10 client.15111 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faee6f37740 10 client.15111 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faee6f37740 20 client.15111 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faee6f37740 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835ee672f0 0x55835ee68760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faee6f37740 4 client.15111 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55835edbf600 con 0x55835ee672f0 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faede59c640 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835ee672f0 0x55835ee68760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faec5ffb640 10 client.15111 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.357+0000 7faede59c640 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835ee672f0 0x55835ee68760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=399d2c209504214a server_cookie=6f34e2803532b350 in_seq=0 out_seq=0 2024-09-12T02:38:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faec5ffb640 1 -- 172.21.15.100:0/4162737863 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55835edbf600 con 0x55835ee672f0 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faec5ffb640 10 client.15111 handle_command_reply: tid=0 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 client.15111 shutdown 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 msgr2=0x55835ee53d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee53d50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faed80a35d0 tx=0x7faed809af40 comp rx=0 tx=0).stop 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 shutdown_connections 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835ee672f0 0x55835ee68760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee56bb0 0x55835ee53d50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4c2f0 0x55835ee53810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 --2- 172.21.15.100:0/4162737863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 >> 172.21.15.100:0/4162737863 conn(0x55835ee47f60 msgr2=0x55835ee4dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faec5ffb640 0 client.15111 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 shutdown_connections 2024-09-12T02:38:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 1 -- 172.21.15.100:0/4162737863 wait complete. 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.358+0000 7faee6f37740 20 client.15111 trim_cache size 0 max 16384 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 Processor -- start 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 -- start start 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee68760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee55670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee56bb0 0x55835ee62b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55835ee66aa0 con 0x55835ee4c2f0 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55835ee67170 con 0x55835ee4b9d0 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faee6f37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55835ee67840 con 0x55835ee56bb0 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee55670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee55670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54248/0 (socket says 172.21.15.100:54248) 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 -- 172.21.15.100:0/3499380148 learned_addr learned my addr 172.21.15.100:0/3499380148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faede59c640 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee68760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 -- 172.21.15.100:0/3499380148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee56bb0 msgr2=0x55835ee62b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee56bb0 0x55835ee62b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 -- 172.21.15.100:0/3499380148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 msgr2=0x55835ee68760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee68760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.376+0000 7faeddd9b640 1 -- 172.21.15.100:0/3499380148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835ee59890 con 0x55835ee4c2f0 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.377+0000 7faede59c640 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee68760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.377+0000 7faeddd9b640 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee55670 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faee0104830 tx=0x7faed4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec46d6928c560ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.377+0000 7faec7fff640 1 -- 172.21.15.100:0/3499380148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4028400 con 0x55835ee4c2f0 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.377+0000 7faec7fff640 1 -- 172.21.15.100:0/3499380148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed40208e0 con 0x55835ee4c2f0 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.377+0000 7faec7fff640 1 -- 172.21.15.100:0/3499380148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed401f9e0 con 0x55835ee4c2f0 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.377+0000 7faee6f37740 1 -- 172.21.15.100:0/3499380148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 msgr2=0x55835ee55670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee55670 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faee0104830 tx=0x7faed4015000 comp rx=0 tx=0).stop 2024-09-12T02:38:26.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- 172.21.15.100:0/3499380148 shutdown_connections 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee56bb0 0x55835ee62b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee55670 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 --2- 172.21.15.100:0/3499380148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee4b9d0 0x55835ee68760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- 172.21.15.100:0/3499380148 >> 172.21.15.100:0/3499380148 conn(0x55835ee47f60 msgr2=0x55835ee54f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- 172.21.15.100:0/3499380148 shutdown_connections 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- 172.21.15.100:0/3499380148 wait complete. 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- start start 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 Processor -- start 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee4fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee503a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee56bb0 0x55835ee6f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55835ee685e0 con 0x55835ee4c2f0 2024-09-12T02:38:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55835ee67f10 con 0x55835ee56bb0 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55835ee68cb0 con 0x55835ee4b9d0 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faee6f37740 10 client.0 _ll_register_callbacks cb 0x7faed0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faeddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faeddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54264/0 (socket says 172.21.15.100:54264) 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faeddd9b640 1 -- 172.21.15.100:0/408068655 learned_addr learned my addr 172.21.15.100:0/408068655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.378+0000 7faede59c640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee4fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeddd9b640 1 -- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 msgr2=0x55835ee4fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeddd9b640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee4fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeded9d640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee56bb0 0x55835ee6f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeddd9b640 1 -- 172.21.15.100:0/408068655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee56bb0 msgr2=0x55835ee6f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeddd9b640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee56bb0 0x55835ee6f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeddd9b640 1 -- 172.21.15.100:0/408068655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835ee6fef0 con 0x55835ee4c2f0 2024-09-12T02:38:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faede59c640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee4fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeded9d640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee56bb0 0x55835ee6f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faeddd9b640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee503a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faed400b970 tx=0x7faed4020400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409e17fe93fb73f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faec5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faec5ffb640 1 -- 172.21.15.100:0/408068655 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40206b0 con 0x55835ee4c2f0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faec5ffb640 1 -- 172.21.15.100:0/408068655 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7faed4020a90 con 0x55835ee4c2f0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed40208e0 con 0x55835ee4c2f0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faec5ffb640 1 -- 172.21.15.100:0/408068655 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faed4020d10 con 0x55835ee4c2f0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faee6f37740 10 client.15117 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55835ee71160 con 0x55835ee4c2f0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faec5ffb640 1 -- 172.21.15.100:0/408068655 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed40208e0 con 0x55835ee4c2f0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.379+0000 7faec5ffb640 1 -- 172.21.15.100:0/408068655 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faed4033710 con 0x55835ee4c2f0 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faee6f37740 10 client.15117 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faee6f37740 10 client.15117 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faee6f37740 20 client.15117 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faee6f37740 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835eed5a80 0x55835eed4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faee6f37740 4 client.15117 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "status"}) -- 0x55835edb9b10 con 0x55835eed5a80 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faede59c640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835eed5a80 0x55835eed4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faede59c640 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835eed5a80 0x55835eed4790 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b75bf7fb907e2a78 server_cookie=870019c39338d308 in_seq=0 out_seq=0 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.380+0000 7faec5ffb640 10 client.15117 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faec5ffb640 1 -- 172.21.15.100:0/408068655 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55835edb9b10 con 0x55835eed5a80 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faec5ffb640 10 client.15117 handle_command_reply: tid=0 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 client.15117 shutdown 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 msgr2=0x55835ee503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee503a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faed400b970 tx=0x7faed4020400 comp rx=0 tx=0).stop 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 shutdown_connections 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55835eed5a80 0x55835eed4790 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55835ee56bb0 0x55835ee6f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55835ee4c2f0 0x55835ee503a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 --2- 172.21.15.100:0/408068655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55835ee4b9d0 0x55835ee4fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 >> 172.21.15.100:0/408068655 conn(0x55835ee47f60 msgr2=0x55835ee4dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faec5ffb640 0 client.15117 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 shutdown_connections 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 1 -- 172.21.15.100:0/408068655 wait complete. 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee6f37740 20 client.15117 trim_cache size 0 max 16384 2024-09-12T02:38:26.397 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24466, 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 89.472133275999994, 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 115.626084863 2024-09-12T02:38:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7faec80a2b80 msgr2=0x7faec80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7faec80a2b80 0x7faec80a5040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faed40058a0 tx=0x7faed400b770 comp rx=0 tx=0).stop 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0106f50 msgr2=0x7faee019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0106f50 0x7faee019cdc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faed800b970 tx=0x7faed800be30 comp rx=0 tx=0).stop 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 shutdown_connections 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7faec80a2b80 0x7faec80a5040 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0106f50 0x7faee019cdc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faee0100ca0 0x7faee0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.381+0000 7faee4b5e640 1 --2- 172.21.15.100:0/1251711752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee01002f0 0x7faee01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.382+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 >> 172.21.15.100:0/1251711752 conn(0x7faee0077210 msgr2=0x7faee00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.382+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 shutdown_connections 2024-09-12T02:38:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:26.382+0000 7faee4b5e640 1 -- 172.21.15.100:0/1251711752 wait complete. 2024-09-12T02:38:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:26 smithi189 ceph-mon[35196]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:27.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:26 smithi189 ceph-mon[35196]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T02:38:27.023 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:26 smithi100 ceph-mon[31390]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:27.023 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:26 smithi100 ceph-mon[31390]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T02:38:27.051 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:38:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:26 smithi117 ceph-mon[34898]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:38:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:26 smithi117 ceph-mon[34898]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T02:38:27.293 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 -- 172.21.15.100:0/3996034495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 msgr2=0x7fd47c10eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3996034495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c10eac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009ca0 tx=0x7fd46c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 -- 172.21.15.100:0/3996034495 shutdown_connections 2024-09-12T02:38:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3996034495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c10eac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3996034495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47c1027c0 0x7fd47c106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3996034495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd47c101e10 0x7fd47c1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 -- 172.21.15.100:0/3996034495 >> 172.21.15.100:0/3996034495 conn(0x7fd47c0fd8d0 msgr2=0x7fd47c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 -- 172.21.15.100:0/3996034495 shutdown_connections 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 -- 172.21.15.100:0/3996034495 wait complete. 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 Processor -- start 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.743+0000 7fd4833a0640 1 -- start start 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd47c101e10 0x7fd47c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47c1027c0 0x7fd47c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c111fc0 con 0x7fd47c106f40 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c111e40 con 0x7fd47c1027c0 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c112140 con 0x7fd47c101e10 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54280/0 (socket says 172.21.15.100:54280) 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 -- 172.21.15.100:0/3785717454 learned_addr learned my addr 172.21.15.100:0/3785717454 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48093b640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47c1027c0 0x7fd47c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48113c640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd47c101e10 0x7fd47c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 -- 172.21.15.100:0/3785717454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd47c101e10 msgr2=0x7fd47c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd47c101e10 0x7fd47c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 -- 172.21.15.100:0/3785717454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47c1027c0 msgr2=0x7fd47c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47c1027c0 0x7fd47c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 -- 172.21.15.100:0/3785717454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c19d3f0 con 0x7fd47c106f40 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48113c640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd47c101e10 0x7fd47c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd48193d640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c19cd10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd46c031a60 tx=0x7fd46c031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd47a7fc640 1 -- 172.21.15.100:0/3785717454 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c003c30 con 0x7fd47c106f40 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd47a7fc640 1 -- 172.21.15.100:0/3785717454 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd46c003dd0 con 0x7fd47c106f40 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd47c19d680 con 0x7fd47c106f40 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd47a7fc640 1 -- 172.21.15.100:0/3785717454 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0047e0 con 0x7fd47c106f40 2024-09-12T02:38:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.744+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd47c1a4fc0 con 0x7fd47c106f40 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.746+0000 7fd47a7fc640 1 -- 172.21.15.100:0/3785717454 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd46c02f790 con 0x7fd47c106f40 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 Processor -- start 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 -- start start 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b65ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b660a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b660cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564b6566090 con 0x5564b66002f0 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564b650da70 con 0x5564b65ff9d0 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd485779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5564b6562050 con 0x5564b660abb0 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd47a7fc640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd4640a2b80 0x7fd4640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd48113c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b660a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd48113c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b660a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54284/0 (socket says 172.21.15.100:54284) 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd48113c640 1 -- 172.21.15.100:0/3802340250 learned_addr learned my addr 172.21.15.100:0/3802340250 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.747+0000 7fd48193d640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd4640a2b80 0x7fd4640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48093b640 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b65ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd47a7fc640 1 -- 172.21.15.100:0/3785717454 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd46c0f04e0 con 0x7fd47c106f40 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48093b640 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b660cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48113c640 1 -- 172.21.15.100:0/3802340250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 msgr2=0x5564b660cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48113c640 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b660cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48113c640 1 -- 172.21.15.100:0/3802340250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 msgr2=0x5564b65ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48113c640 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b65ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48113c640 1 -- 172.21.15.100:0/3802340250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b651a130 con 0x5564b66002f0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48193d640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd4640a2b80 0x7fd4640a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd46c006010 tx=0x7fd46c0e78c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd48113c640 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b660a670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd47400aa10 tx=0x7fd47400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debf96b16d81d8c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd4637fe640 1 -- 172.21.15.100:0/3802340250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474015070 con 0x5564b66002f0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd4637fe640 1 -- 172.21.15.100:0/3802340250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47400cc60 con 0x5564b66002f0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.748+0000 7fd4637fe640 1 -- 172.21.15.100:0/3802340250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474018700 con 0x5564b66002f0 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 -- 172.21.15.100:0/3802340250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 msgr2=0x5564b660a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b660a670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd47400aa10 tx=0x7fd47400aed0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 -- 172.21.15.100:0/3802340250 shutdown_connections 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b660cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b660a670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 --2- 172.21.15.100:0/3802340250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b65ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 -- 172.21.15.100:0/3802340250 >> 172.21.15.100:0/3802340250 conn(0x5564b65fbf60 msgr2=0x5564b65fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 -- 172.21.15.100:0/3802340250 shutdown_connections 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 -- 172.21.15.100:0/3802340250 wait complete. 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 -- start start 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.749+0000 7fd485779740 1 Processor -- start 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd485779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b660a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd485779740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b6607730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd485779740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b6607c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd485779740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564b660d780 con 0x5564b660abb0 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd485779740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564b6520f20 con 0x5564b66002f0 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd485779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5564b660d900 con 0x5564b65ff9d0 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd485779740 10 client.0 _ll_register_callbacks cb 0x5564b64ea030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b6607c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b6607c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54298/0 (socket says 172.21.15.100:54298) 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 -- 172.21.15.100:0/3021844366 learned_addr learned my addr 172.21.15.100:0/3021844366 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48113c640 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b6607730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b660a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 -- 172.21.15.100:0/3021844366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 msgr2=0x5564b660a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b660a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 -- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 msgr2=0x5564b6607730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b6607730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 -- 172.21.15.100:0/3021844366 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b62d72b0 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd48093b640 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b6607c70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd470011ec0 tx=0x7fd470015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6c1fa9497848c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.750+0000 7fd460ff9640 1 -- 172.21.15.100:0/3021844366 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470004020 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd460ff9640 1 -- 172.21.15.100:0/3021844366 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd47001c040 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd47400cc60 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd460ff9640 1 -- 172.21.15.100:0/3021844366 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd470027050 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 10 client.15129 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5564b6619030 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd460ff9640 1 -- 172.21.15.100:0/3021844366 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47400cc60 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd460ff9640 1 -- 172.21.15.100:0/3021844366 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd47000e5c0 con 0x5564b660abb0 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 10 client.15129 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 10 client.15129 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 20 client.15129 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:27.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b661b620 0x5564b661ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 4 client.15129 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.751+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564b6573600 con 0x5564b661b620 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.752+0000 7fd48113c640 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b661b620 0x5564b661ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.752+0000 7fd48113c640 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b661b620 0x5564b661ca90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b11fe3d084f1f3d server_cookie=5775ed16206a2aab in_seq=0 out_seq=0 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.752+0000 7fd460ff9640 10 client.15129 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd460ff9640 1 -- 172.21.15.100:0/3021844366 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564b6573600 con 0x5564b661b620 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd460ff9640 10 client.15129 handle_command_reply: tid=0 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 client.15129 shutdown 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 msgr2=0x5564b6607c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b6607c70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd470011ec0 tx=0x7fd470015040 comp rx=0 tx=0).stop 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 shutdown_connections 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b661b620 0x5564b661ca90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd460ff9640 0 client.15129 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b6607c70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b6607730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 --2- 172.21.15.100:0/3021844366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b660a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 >> 172.21.15.100:0/3021844366 conn(0x5564b65fbf60 msgr2=0x5564b6601c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 shutdown_connections 2024-09-12T02:38:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 1 -- 172.21.15.100:0/3021844366 wait complete. 2024-09-12T02:38:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.753+0000 7fd485779740 20 client.15129 trim_cache size 0 max 16384 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 Processor -- start 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 -- start start 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b6607010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b65fc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b65faef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564b661add0 con 0x5564b660abb0 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564b661b4a0 con 0x5564b66002f0 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd485779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5564b661bb70 con 0x5564b65ff9d0 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b65faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b65faef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54300/0 (socket says 172.21.15.100:54300) 2024-09-12T02:38:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 -- 172.21.15.100:0/3757738475 learned_addr learned my addr 172.21.15.100:0/3757738475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b6607010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 -- 172.21.15.100:0/3757738475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 msgr2=0x5564b6607010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b6607010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48113c640 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b65fc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 -- 172.21.15.100:0/3757738475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 msgr2=0x5564b65fc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b65fc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 -- 172.21.15.100:0/3757738475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b660a750 con 0x5564b660abb0 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.771+0000 7fd48093b640 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b65faef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4700058c0 tx=0x7fd47000dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2e906d17609973 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd462ffd640 1 -- 172.21.15.100:0/3757738475 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47000ec50 con 0x5564b660abb0 2024-09-12T02:38:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd462ffd640 1 -- 172.21.15.100:0/3757738475 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd470005500 con 0x5564b660abb0 2024-09-12T02:38:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd462ffd640 1 -- 172.21.15.100:0/3757738475 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470004a00 con 0x5564b660abb0 2024-09-12T02:38:27.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 -- 172.21.15.100:0/3757738475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 msgr2=0x5564b65faef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b65faef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4700058c0 tx=0x7fd47000dcb0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 -- 172.21.15.100:0/3757738475 shutdown_connections 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b660abb0 0x5564b65faef0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b66002f0 0x5564b65fc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 --2- 172.21.15.100:0/3757738475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b65ff9d0 0x5564b6607010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 -- 172.21.15.100:0/3757738475 >> 172.21.15.100:0/3757738475 conn(0x5564b65fbf60 msgr2=0x5564b65fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 -- 172.21.15.100:0/3757738475 shutdown_connections 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.772+0000 7fd485779740 1 -- 172.21.15.100:0/3757738475 wait complete. 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 -- start start 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 Processor -- start 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b661f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b661de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b661e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564b661c910 con 0x5564b66002f0 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5564b661c240 con 0x5564b65ff9d0 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5564b661cfe0 con 0x5564b660abb0 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd485779740 10 client.0 _ll_register_callbacks cb 0x7fd47000d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b661de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b661de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54310/0 (socket says 172.21.15.100:54310) 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 -- 172.21.15.100:0/1103370775 learned_addr learned my addr 172.21.15.100:0/1103370775 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48093b640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b661e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48093b640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b661f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 -- 172.21.15.100:0/1103370775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 msgr2=0x5564b661e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b661e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 -- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 msgr2=0x5564b661f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b661f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48113c640 1 -- 172.21.15.100:0/1103370775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b661e8f0 con 0x5564b66002f0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.773+0000 7fd48093b640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b661e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd48113c640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b661de70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5564b65fcdc0 tx=0x7fd47400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c2999c96dcc6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd460ff9640 1 -- 172.21.15.100:0/1103370775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47402b070 con 0x5564b66002f0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd460ff9640 1 -- 172.21.15.100:0/1103370775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd47400cd60 con 0x5564b66002f0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd470005500 con 0x5564b66002f0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd460ff9640 1 -- 172.21.15.100:0/1103370775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd474015040 con 0x5564b66002f0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 10 client.15135 fetch_fsmap learned FSMap version 24 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5564b6689a70 con 0x5564b66002f0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd460ff9640 1 -- 172.21.15.100:0/1103370775 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd470005500 con 0x5564b66002f0 2024-09-12T02:38:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd460ff9640 1 -- 172.21.15.100:0/1103370775 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd4740307c0 con 0x5564b66002f0 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 10 client.15135 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 20 client.15135 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b668e2f0 0x5564b668d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 4 client.15135 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.774+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "status"}) -- 0x5564b656db10 con 0x5564b668e2f0 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd48093b640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b668e2f0 0x5564b668d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd48093b640 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b668e2f0 0x5564b668d000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d44fa638a1186019 server_cookie=1c800bdd4316256a in_seq=0 out_seq=0 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd460ff9640 10 client.15135 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd460ff9640 1 -- 172.21.15.100:0/1103370775 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5564b656db10 con 0x5564b668e2f0 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd460ff9640 10 client.15135 handle_command_reply: tid=0 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd485779740 1 client.15135 shutdown 2024-09-12T02:38:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 msgr2=0x5564b661de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.775+0000 7fd485779740 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b661de70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5564b65fcdc0 tx=0x7fd47400a620 comp rx=0 tx=0).stop 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 shutdown_connections 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5564b668e2f0 0x5564b668d000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564b660abb0 0x5564b661e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564b66002f0 0x5564b661de70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd460ff9640 0 client.15135 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 --2- 172.21.15.100:0/1103370775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5564b65ff9d0 0x5564b661f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 >> 172.21.15.100:0/1103370775 conn(0x5564b65fbf60 msgr2=0x5564b65fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 shutdown_connections 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 1 -- 172.21.15.100:0/1103370775 wait complete. 2024-09-12T02:38:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd485779740 20 client.15135 trim_cache size 0 max 16384 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24473, 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 97.905248755000002, 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:38:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 108.27116837600001 2024-09-12T02:38:27.784 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd4640a2b80 msgr2=0x7fd4640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd4640a2b80 0x7fd4640a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd46c006010 tx=0x7fd46c0e78c0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 msgr2=0x7fd47c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c19cd10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd46c031a60 tx=0x7fd46c031a90 comp rx=0 tx=0).stop 2024-09-12T02:38:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 shutdown_connections 2024-09-12T02:38:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd4640a2b80 0x7fd4640a5040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd47c106f40 0x7fd47c19cd10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47c1027c0 0x7fd47c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 --2- 172.21.15.100:0/3785717454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd47c101e10 0x7fd47c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 >> 172.21.15.100:0/3785717454 conn(0x7fd47c0fd8d0 msgr2=0x7fd47c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.776+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 shutdown_connections 2024-09-12T02:38:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:27.777+0000 7fd4833a0640 1 -- 172.21.15.100:0/3785717454 wait complete. 2024-09-12T02:38:28.537 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:38:28.547 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:38:28.547 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:38:28.547 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:38:28.547 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:38:28.571 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:38:28.571 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T02:38:28.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:28.571 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-12T02:38:28.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:28.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-12T02:38:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-09-12T02:38:28.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:38:28.659 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-12T02:38:28.659 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:38:28.659 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-12T02:38:28.659 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-12T02:38:28.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:38:28.806 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:28 smithi100 ceph-mon[31390]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-12T02:38:28.954 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:28 smithi189 ceph-mon[35196]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-12T02:38:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:28 smithi117 ceph-mon[34898]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 -- 172.21.15.100:0/3720515569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c801082a0 msgr2=0x7f0c8010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 --2- 172.21.15.100:0/3720515569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c801082a0 0x7f0c8010ec40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009cd0 tx=0x7f0c7802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 -- 172.21.15.100:0/3720515569 shutdown_connections 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 --2- 172.21.15.100:0/3720515569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c801082a0 0x7f0c8010ec40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 --2- 172.21.15.100:0/3720515569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c801036e0 0x7f0c80107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 --2- 172.21.15.100:0/3720515569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c80102d30 0x7f0c80103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 -- 172.21.15.100:0/3720515569 >> 172.21.15.100:0/3720515569 conn(0x7f0c800fc7d0 msgr2=0x7f0c800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 -- 172.21.15.100:0/3720515569 shutdown_connections 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.461+0000 7f0c863c1640 1 -- 172.21.15.100:0/3720515569 wait complete. 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 Processor -- start 2024-09-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 -- start start 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c80102d30 0x7f0c801984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c801036e0 0x7f0c80198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c801082a0 0x7f0c8019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801120a0 con 0x7f0c80102d30 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80111f20 con 0x7f0c801082a0 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c863c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80112220 con 0x7f0c801036e0 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c80102d30 0x7f0c801984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c80102d30 0x7f0c801984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54324/0 (socket says 172.21.15.100:54324) 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c7ffff640 1 -- 172.21.15.100:0/2102529119 learned_addr learned my addr 172.21.15.100:0/2102529119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.462+0000 7f0c77fff640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c801036e0 0x7f0c80198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c8495e640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c801082a0 0x7f0c8019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7ffff640 1 -- 172.21.15.100:0/2102529119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c801036e0 msgr2=0x7f0c80198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7ffff640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c801036e0 0x7f0c80198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7ffff640 1 -- 172.21.15.100:0/2102529119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c801082a0 msgr2=0x7f0c8019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7ffff640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c801082a0 0x7f0c8019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7ffff640 1 -- 172.21.15.100:0/2102529119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8019d470 con 0x7f0c80102d30 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c77fff640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c801036e0 0x7f0c80198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c8495e640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c801082a0 0x7f0c8019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7ffff640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c80102d30 0x7f0c801984c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000d950 tx=0x7f0c7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7dffb640 1 -- 172.21.15.100:0/2102529119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70017030 con 0x7f0c80102d30 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7dffb640 1 -- 172.21.15.100:0/2102529119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c70004020 con 0x7f0c80102d30 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8019d760 con 0x7f0c80102d30 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c7dffb640 1 -- 172.21.15.100:0/2102529119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c700047a0 con 0x7f0c80102d30 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.463+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c801a5040 con 0x7f0c80102d30 2024-09-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.465+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c80103110 con 0x7f0c80102d30 2024-09-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.465+0000 7f0c7dffb640 1 -- 172.21.15.100:0/2102529119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0c70004940 con 0x7f0c80102d30 2024-09-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.466+0000 7f0c7dffb640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0c6c0a2c00 0x7f0c6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.466+0000 7f0c77fff640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0c6c0a2c00 0x7f0c6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.466+0000 7f0c7dffb640 1 -- 172.21.15.100:0/2102529119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f0c700cead0 con 0x7f0c80102d30 2024-09-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.466+0000 7f0c77fff640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0c6c0a2c00 0x7f0c6c0a50c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005e10 tx=0x7f0c68005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.470+0000 7f0c7dffb640 1 -- 172.21.15.100:0/2102529119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c7009ba20 con 0x7f0c80102d30 2024-09-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.681+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0c8010a2b0 con 0x7f0c80102d30 2024-09-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.681+0000 7f0c7dffb640 1 -- 172.21.15.100:0/2102529119 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f0c7009b320 con 0x7f0c80102d30 2024-09-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0c6c0a2c00 msgr2=0x7f0c6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0c6c0a2c00 0x7f0c6c0a50c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005e10 tx=0x7f0c68005da0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c80102d30 msgr2=0x7f0c801984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c80102d30 0x7f0c801984c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000d950 tx=0x7f0c7000de10 comp rx=0 tx=0).stop 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 shutdown_connections 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0c6c0a2c00 0x7f0c6c0a50c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c801082a0 0x7f0c8019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c801036e0 0x7f0c80198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 --2- 172.21.15.100:0/2102529119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c80102d30 0x7f0c801984c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 >> 172.21.15.100:0/2102529119 conn(0x7f0c800fc7d0 msgr2=0x7f0c80106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 shutdown_connections 2024-09-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:29.683+0000 7f0c863c1640 1 -- 172.21.15.100:0/2102529119 wait complete. 2024-09-12T02:38:30.361 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:38:30.361 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:38:30.361 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-12T02:38:30.361 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:38:30.361 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-12T02:38:30.362 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:38:30.362 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:38:30.362 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:38:30.362 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-12T02:38:30.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:30.362 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-12T02:38:30.378 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:38:30.378 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:38:30.379 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:38:30.380 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:38:30.380 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:38:30.380 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:38:30.380 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42220sec preferred_lft 42220sec 2024-09-12T02:38:30.380 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-12T02:38:30.380 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:38:30.380 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:38:30.380 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:38:30.381 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:38:30.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:38:30.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-12T02:38:30.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-12T02:38:30.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:38:30.381 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:38:30.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:38:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:30.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:30.594 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:38:30.619 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-12T02:38:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:30.621 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-12T02:38:30.688 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-12T02:38:30.688 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:38:30.688 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:38:30.689 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:38:30.689 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:38:30.689 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:38:30.689 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:38:30.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:38:30.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:38:30.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:38:30.690 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:38:30.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:38:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:30 smithi100 ceph-mon[31390]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T02:38:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:30 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2102529119' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:38:30.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:30.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:30.979 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-12T02:38:30.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:30.995 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-12T02:38:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:30 smithi189 ceph-mon[35196]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T02:38:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:30 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2102529119' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:38:31.049 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:38:31.049 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:38:31.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-12T02:38:31.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-12T02:38:31.050 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:38:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:30 smithi117 ceph-mon[34898]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T02:38:31.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:30 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2102529119' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:38:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:38:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:31.168 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-12T02:38:31.168 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:38:31.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:38:31.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:31.291 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:38:31.291 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:38:31.291 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-12T02:38:31.291 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:38:31.291 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:38:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:38:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:31.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:38:31.367 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /tmp/cephfs 2024-09-12T02:38:31.387 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-12T02:38:31.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:38:31.388 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /tmp/cephfs 2024-09-12T02:38:31.443 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T02:38:31.444 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T02:38:31.444 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/9048c5c6-a64a-4258-a68c-278de7233f01 2024-09-12T02:38:31.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:31.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/9048c5c6-a64a-4258-a68c-278de7233f01 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context=system_u:object_r:postgresql_db_t:s0 2024-09-12T02:38:31.551 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-12T02:38:31.551 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-12T02:38:31.551 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-12T02:38:31.686 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-12T02:38:31.686 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-12T02:38:31.686 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-12T02:38:31.686 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.117:3300,172.21.15.189:3300" 2024-09-12T02:38:31.686 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:3300,172.21.15.117:3300,172.21.15.189:3300:/volumes/qa/sv_1/9048c5c6-a64a-4258-a68c-278de7233f01 2024-09-12T02:38:31.686 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=a7cd2c8a-70ae-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T02:38:31.689 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:38:31.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:38:31.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /tmp/cephfs 2024-09-12T02:38:31.715 DEBUG:teuthology.orchestra.run.smithi100:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:38:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:38:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:31.811 INFO:teuthology.orchestra.run.smithi100.stdout:client15144 2024-09-12T02:38:31.812 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:38:31.812 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:38:31.829 DEBUG:teuthology.orchestra.run.smithi100:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:38:31.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:38:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:31.924 INFO:teuthology.orchestra.run.smithi100.stdout:client15144 2024-09-12T02:38:31.925 DEBUG:teuthology.orchestra.run.smithi100:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:38:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:38:31.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:31.980 INFO:teuthology.orchestra.run.smithi100.stdout:client15144 2024-09-12T02:38:31.980 DEBUG:teuthology.orchestra.run.smithi100:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968.client15144/status') 2024-09-12T02:38:32.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:38:32.039 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.15144 (3)192.168.0.1:0/2942189475 2024-09-12T02:38:32.039 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-09-12T02:38:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-09-12T02:38:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-09-12T02:38:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:70 bytes copied, 2.182e-05 s, 3.2 MB/s 2024-09-12T02:38:32.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:38:32.046 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:38:32.056 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:38:32.057 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:38:32.057 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1138446998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4101b60 msgr2=0x7f7bc4101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1138446998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4101b60 0x7f7bc4101f60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009900 tx=0x7f7bb402a410 comp rx=0 tx=0).stop 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1138446998 shutdown_connections 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1138446998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bc4103710 0x7f7bc4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1138446998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc4102d50 0x7f7bc41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1138446998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4101b60 0x7f7bc4101f60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1138446998 >> 172.21.15.100:0/1138446998 conn(0x7f7bc40fd2e0 msgr2=0x7f7bc40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1138446998 shutdown_connections 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.158+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1138446998 wait complete. 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 Processor -- start 2024-09-12T02:38:32.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 -- start start 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc4101b60 0x7f7bc4197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4102d50 0x7f7bc4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bc4103710 0x7f7bc419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc410d860 con 0x7f7bc4102d50 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc410d6e0 con 0x7f7bc4101b60 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc95f6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc410d9e0 con 0x7f7bc4103710 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4102d50 0x7f7bc4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4102d50 0x7f7bc4198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54338/0 (socket says 172.21.15.100:54338) 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.159+0000 7f7bc27fc640 1 -- 172.21.15.100:0/1938939715 learned_addr learned my addr 172.21.15.100:0/1938939715 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc2ffd640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc4101b60 0x7f7bc4197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc27fc640 1 -- 172.21.15.100:0/1938939715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bc4103710 msgr2=0x7f7bc419f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc27fc640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bc4103710 0x7f7bc419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc27fc640 1 -- 172.21.15.100:0/1938939715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc4101b60 msgr2=0x7f7bc4197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc27fc640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc4101b60 0x7f7bc4197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc27fc640 1 -- 172.21.15.100:0/1938939715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc419fa70 con 0x7f7bc4102d50 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc2ffd640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc4101b60 0x7f7bc4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc27fc640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4102d50 0x7f7bc4198390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b4a0 tx=0x7f7bb800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7babfff640 1 -- 172.21.15.100:0/1938939715 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8014070 con 0x7f7bc4102d50 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7babfff640 1 -- 172.21.15.100:0/1938939715 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb8010af0 con 0x7f7bc4102d50 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc419fd60 con 0x7f7bc4102d50 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7babfff640 1 -- 172.21.15.100:0/1938939715 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8017d10 con 0x7f7bc4102d50 2024-09-12T02:38:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.160+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc41a02d0 con 0x7f7bc4102d50 2024-09-12T02:38:32.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.161+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc4108f00 con 0x7f7bc4102d50 2024-09-12T02:38:32.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.162+0000 7f7babfff640 1 -- 172.21.15.100:0/1938939715 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7bb8017070 con 0x7f7bc4102d50 2024-09-12T02:38:32.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.163+0000 7f7babfff640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bac0a2c30 0x7f7bac0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.163+0000 7f7bc2ffd640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bac0a2c30 0x7f7bac0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:32.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.163+0000 7f7babfff640 1 -- 172.21.15.100:0/1938939715 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7bb80ce470 con 0x7f7bc4102d50 2024-09-12T02:38:32.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.163+0000 7f7bc2ffd640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bac0a2c30 0x7f7bac0a50f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4006010 tx=0x7f7bb4032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:32.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.167+0000 7f7babfff640 1 -- 172.21.15.100:0/1938939715 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bb809b3c0 con 0x7f7bc4102d50 2024-09-12T02:38:32.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.369+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f7bc4062ef0 con 0x7f7bc4102d50 2024-09-12T02:38:32.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.652+0000 7f7babfff640 1 -- 172.21.15.100:0/1938939715 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f7bb809acc0 con 0x7f7bc4102d50 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bac0a2c30 msgr2=0x7f7bac0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bac0a2c30 0x7f7bac0a50f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4006010 tx=0x7f7bb4032dd0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4102d50 msgr2=0x7f7bc4198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4102d50 0x7f7bc4198390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b4a0 tx=0x7f7bb800b960 comp rx=0 tx=0).stop 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 shutdown_connections 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bac0a2c30 0x7f7bac0a50f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bc4103710 0x7f7bc419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4102d50 0x7f7bc4198390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 --2- 172.21.15.100:0/1938939715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc4101b60 0x7f7bc4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 >> 172.21.15.100:0/1938939715 conn(0x7f7bc40fd2e0 msgr2=0x7f7bc41060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 shutdown_connections 2024-09-12T02:38:32.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.654+0000 7f7bc95f6640 1 -- 172.21.15.100:0/1938939715 wait complete. 2024-09-12T02:38:32.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-12T02:38:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 -- 172.21.15.100:0/1615297674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 msgr2=0x7f8adc100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 --2- 172.21.15.100:0/1615297674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc100e50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009900 tx=0x7f8acc02a410 comp rx=0 tx=0).stop 2024-09-12T02:38:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 -- 172.21.15.100:0/1615297674 shutdown_connections 2024-09-12T02:38:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 --2- 172.21.15.100:0/1615297674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8adc102600 0x7f8adc108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 --2- 172.21.15.100:0/1615297674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8adc101c40 0x7f8adc1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 --2- 172.21.15.100:0/1615297674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc100e50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 -- 172.21.15.100:0/1615297674 >> 172.21.15.100:0/1615297674 conn(0x7f8adc0fc1b0 msgr2=0x7f8adc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 -- 172.21.15.100:0/1615297674 shutdown_connections 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 -- 172.21.15.100:0/1615297674 wait complete. 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.769+0000 7f8ae1511640 1 Processor -- start 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ae1511640 1 -- start start 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ae1511640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ae1511640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8adc101c40 0x7f8adc197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ae1511640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8adc102600 0x7f8adc19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ae1511640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc10c6d0 con 0x7f8adc100a50 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ae1511640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc10c550 con 0x7f8adc102600 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ae1511640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc10c850 con 0x7f8adc101c40 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54358/0 (socket says 172.21.15.100:54358) 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 -- 172.21.15.100:0/4115741317 learned_addr learned my addr 172.21.15.100:0/4115741317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adb7fe640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8adc102600 0x7f8adc19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8ada7fc640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8adc101c40 0x7f8adc197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 -- 172.21.15.100:0/4115741317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8adc101c40 msgr2=0x7f8adc197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8adc101c40 0x7f8adc197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 -- 172.21.15.100:0/4115741317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8adc102600 msgr2=0x7f8adc19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8adc102600 0x7f8adc19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 -- 172.21.15.100:0/4115741317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc19e910 con 0x7f8adc100a50 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.770+0000 7f8adaffd640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc196d00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8acc031610 tx=0x7f8acc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.771+0000 7f8ac3fff640 1 -- 172.21.15.100:0/4115741317 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc03f030 con 0x7f8adc100a50 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.771+0000 7f8ac3fff640 1 -- 172.21.15.100:0/4115741317 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8acc003ce0 con 0x7f8adc100a50 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.771+0000 7f8ac3fff640 1 -- 172.21.15.100:0/4115741317 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc035070 con 0x7f8adc100a50 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.771+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8adc19eba0 con 0x7f8adc100a50 2024-09-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.771+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8adc19f040 con 0x7f8adc100a50 2024-09-12T02:38:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.772+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8adc107e40 con 0x7f8adc100a50 2024-09-12T02:38:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.773+0000 7f8ac3fff640 1 -- 172.21.15.100:0/4115741317 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8acc042030 con 0x7f8adc100a50 2024-09-12T02:38:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.774+0000 7f8ac3fff640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8ac40a2c30 0x7f8ac40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.774+0000 7f8ada7fc640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8ac40a2c30 0x7f8ac40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:32.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.774+0000 7f8ac3fff640 1 -- 172.21.15.100:0/4115741317 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8acc0ef2a0 con 0x7f8adc100a50 2024-09-12T02:38:32.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.774+0000 7f8ada7fc640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8ac40a2c30 0x7f8ac40a50f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0005fd0 tx=0x7f8ad000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:32.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.778+0000 7f8ac3fff640 1 -- 172.21.15.100:0/4115741317 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8acc0bbba0 con 0x7f8adc100a50 2024-09-12T02:38:32.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.972+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f8adc0626d0 con 0x7f8ac40a2c30 2024-09-12T02:38:32.978 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:32 smithi100 ceph-mon[31390]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T02:38:32.978 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:32 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1938939715' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.990+0000 7f8ac3fff640 1 -- 172.21.15.100:0/4115741317 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f8adc0626d0 con 0x7f8ac40a2c30 2024-09-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi100.stdout:{} 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8ac40a2c30 msgr2=0x7f8ac40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8ac40a2c30 0x7f8ac40a50f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0005fd0 tx=0x7f8ad000b390 comp rx=0 tx=0).stop 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 msgr2=0x7f8adc196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc196d00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8acc031610 tx=0x7f8acc0043b0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 shutdown_connections 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8ac40a2c30 0x7f8ac40a50f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8adc102600 0x7f8adc19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8adc101c40 0x7f8adc197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 --2- 172.21.15.100:0/4115741317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8adc100a50 0x7f8adc196d00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 >> 172.21.15.100:0/4115741317 conn(0x7f8adc0fc1b0 msgr2=0x7f8adc105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 shutdown_connections 2024-09-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:32.992+0000 7f8ae1511640 1 -- 172.21.15.100:0/4115741317 wait complete. 2024-09-12T02:38:33.003 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T02:38:33.014 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T02:38:33.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:38:33.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:32 smithi189 ceph-mon[35196]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T02:38:33.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:32 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1938939715' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:38:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:32 smithi117 ceph-mon[34898]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T02:38:33.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:32 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1938939715' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 -- 172.21.15.100:0/2065636138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 msgr2=0x7f276c1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 --2- 172.21.15.100:0/2065636138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 0x7f276c1020a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2754009900 tx=0x7f275402a410 comp rx=0 tx=0).stop 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 -- 172.21.15.100:0/2065636138 shutdown_connections 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 --2- 172.21.15.100:0/2065636138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c1025e0 0x7f276c108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 --2- 172.21.15.100:0/2065636138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 0x7f276c1020a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 --2- 172.21.15.100:0/2065636138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c100a30 0x7f276c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 -- 172.21.15.100:0/2065636138 >> 172.21.15.100:0/2065636138 conn(0x7f276c0fc1b0 msgr2=0x7f276c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 -- 172.21.15.100:0/2065636138 shutdown_connections 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.125+0000 7f2772f91640 1 -- 172.21.15.100:0/2065636138 wait complete. 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 Processor -- start 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 -- start start 2024-09-12T02:38:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c100a30 0x7f276c06af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 0x7f276c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c1025e0 0x7f276c19f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f276c10c6b0 con 0x7f276c101c20 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f276c10c530 con 0x7f276c1025e0 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2772f91640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f276c10c830 con 0x7f276c100a30 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2770d2d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c100a30 0x7f276c06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f277152e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c1025e0 0x7f276c19f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2770d2d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c100a30 0x7f276c06af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38352/0 (socket says 172.21.15.100:38352) 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2770d2d640 1 -- 172.21.15.100:0/3845598227 learned_addr learned my addr 172.21.15.100:0/3845598227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f276bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 0x7f276c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2770d2d640 1 -- 172.21.15.100:0/3845598227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c1025e0 msgr2=0x7f276c19f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.126+0000 7f2770d2d640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c1025e0 0x7f276c19f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2770d2d640 1 -- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 msgr2=0x7f276c19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2770d2d640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 0x7f276c19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2770d2d640 1 -- 172.21.15.100:0/3845598227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c19fb20 con 0x7f276c100a30 2024-09-12T02:38:33.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f276bfff640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 0x7f276c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:33.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2770d2d640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c100a30 0x7f276c06af70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f275c00d770 tx=0x7f275c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2769ffb640 1 -- 172.21.15.100:0/3845598227 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c017070 con 0x7f276c100a30 2024-09-12T02:38:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c19fdb0 con 0x7f276c100a30 2024-09-12T02:38:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2769ffb640 1 -- 172.21.15.100:0/3845598227 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f275c009c30 con 0x7f276c100a30 2024-09-12T02:38:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2769ffb640 1 -- 172.21.15.100:0/3845598227 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c003dd0 con 0x7f276c100a30 2024-09-12T02:38:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.127+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c1a0220 con 0x7f276c100a30 2024-09-12T02:38:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.128+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c107e70 con 0x7f276c100a30 2024-09-12T02:38:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.129+0000 7f2769ffb640 1 -- 172.21.15.100:0/3845598227 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f275c004000 con 0x7f276c100a30 2024-09-12T02:38:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.130+0000 7f2769ffb640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27580a2b90 0x7f27580a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.130+0000 7f276bfff640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27580a2b90 0x7f27580a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.130+0000 7f2769ffb640 1 -- 172.21.15.100:0/3845598227 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f275c0ce9b0 con 0x7f276c100a30 2024-09-12T02:38:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.131+0000 7f276bfff640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27580a2b90 0x7f27580a5050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2754000c00 tx=0x7f27540315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.134+0000 7f2769ffb640 1 -- 172.21.15.100:0/3845598227 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f275c009de0 con 0x7f276c100a30 2024-09-12T02:38:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.300+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f276c02da70 con 0x7f276c100a30 2024-09-12T02:38:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.302+0000 7f2769ffb640 1 -- 172.21.15.100:0/3845598227 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22871 (secure 0 0 0) 0x7f275c09b250 con 0x7f276c100a30 2024-09-12T02:38:33.303 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:33.303 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:37:56.665591+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:38:33.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.304+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27580a2b90 msgr2=0x7f27580a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.304+0000 7f2772f91640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27580a2b90 0x7f27580a5050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2754000c00 tx=0x7f27540315b0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.304+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c100a30 msgr2=0x7f276c06af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.304+0000 7f2772f91640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c100a30 0x7f276c06af70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f275c00d770 tx=0x7f275c00dc30 comp rx=0 tx=0).stop 2024-09-12T02:38:33.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 shutdown_connections 2024-09-12T02:38:33.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27580a2b90 0x7f27580a5050 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f276c1025e0 0x7f276c19f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276c101c20 0x7f276c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 --2- 172.21.15.100:0/3845598227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c100a30 0x7f276c06af70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 >> 172.21.15.100:0/3845598227 conn(0x7f276c0fc1b0 msgr2=0x7f276c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 shutdown_connections 2024-09-12T02:38:33.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.305+0000 7f2772f91640 1 -- 172.21.15.100:0/3845598227 wait complete. 2024-09-12T02:38:33.314 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:38:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:38:32.977+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:33.314 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:38:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:38:32.977+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:33.314 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:38:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:38:32.977+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:33.315 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:38:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:38:32.977+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:33.315 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:38:32 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:38:32.977+0000 7fe5a4151640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:33.316 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:32:09.751769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:36:45.679784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:36:47.737140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:38:33.317 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 -- 172.21.15.100:0/3778021987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8101b10 msgr2=0x7fc2d8101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3778021987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8101b10 0x7fc2d8101f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009900 tx=0x7fc2c802a410 comp rx=0 tx=0).stop 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 -- 172.21.15.100:0/3778021987 shutdown_connections 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3778021987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d81036c0 0x7fc2d8109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3778021987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d8102d00 0x7fc2d8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3778021987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8101b10 0x7fc2d8101f10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 -- 172.21.15.100:0/3778021987 >> 172.21.15.100:0/3778021987 conn(0x7fc2d80fd2b0 msgr2=0x7fc2d80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 -- 172.21.15.100:0/3778021987 shutdown_connections 2024-09-12T02:38:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.419+0000 7fc2df65c640 1 -- 172.21.15.100:0/3778021987 wait complete. 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 Processor -- start 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 -- start start 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d8101b10 0x7fc2d8197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8102d00 0x7fc2d8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d81036c0 0x7fc2d819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d810d7f0 con 0x7fc2d8102d00 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d810d670 con 0x7fc2d8101b10 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2df65c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d810d970 con 0x7fc2d81036c0 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8102d00 0x7fc2d8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8102d00 0x7fc2d8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54432/0 (socket says 172.21.15.100:54432) 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 -- 172.21.15.100:0/3082489646 learned_addr learned my addr 172.21.15.100:0/3082489646 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2ddbf9640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d81036c0 0x7fc2d819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dd3f8640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d8101b10 0x7fc2d8197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 -- 172.21.15.100:0/3082489646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d81036c0 msgr2=0x7fc2d819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d81036c0 0x7fc2d819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 -- 172.21.15.100:0/3082489646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d8101b10 msgr2=0x7fc2d8197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d8101b10 0x7fc2d8197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 -- 172.21.15.100:0/3082489646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d819fb50 con 0x7fc2d8102d00 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dd3f8640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d8101b10 0x7fc2d8197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.420+0000 7fc2dcbf7640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8102d00 0x7fc2d8198470 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b4a0 tx=0x7fc2d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.421+0000 7fc2ce7fc640 1 -- 172.21.15.100:0/3082489646 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4014070 con 0x7fc2d8102d00 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.421+0000 7fc2ce7fc640 1 -- 172.21.15.100:0/3082489646 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2d4010af0 con 0x7fc2d8102d00 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.421+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d819fe40 con 0x7fc2d8102d00 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.421+0000 7fc2ce7fc640 1 -- 172.21.15.100:0/3082489646 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4017d10 con 0x7fc2d8102d00 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.421+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d81a0380 con 0x7fc2d8102d00 2024-09-12T02:38:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.422+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d8108fc0 con 0x7fc2d8102d00 2024-09-12T02:38:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.423+0000 7fc2ce7fc640 1 -- 172.21.15.100:0/3082489646 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc2d4017070 con 0x7fc2d8102d00 2024-09-12T02:38:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.423+0000 7fc2ce7fc640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc2c40a2b90 0x7fc2c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.423+0000 7fc2dd3f8640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc2c40a2b90 0x7fc2c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.423+0000 7fc2ce7fc640 1 -- 172.21.15.100:0/3082489646 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc2d40ce3b0 con 0x7fc2d8102d00 2024-09-12T02:38:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.424+0000 7fc2dd3f8640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc2c40a2b90 0x7fc2c40a5050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8000c00 tx=0x7fc2c8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.428+0000 7fc2ce7fc640 1 -- 172.21.15.100:0/3082489646 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2d409b300 con 0x7fc2d8102d00 2024-09-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.593+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc2d8062e90 con 0x7fc2d8102d00 2024-09-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.594+0000 7fc2ce7fc640 1 -- 172.21.15.100:0/3082489646 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fc2d409ac00 con 0x7fc2d8102d00 2024-09-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc2c40a2b90 msgr2=0x7fc2c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc2c40a2b90 0x7fc2c40a5050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8000c00 tx=0x7fc2c8031400 comp rx=0 tx=0).stop 2024-09-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8102d00 msgr2=0x7fc2d8198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8102d00 0x7fc2d8198470 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b4a0 tx=0x7fc2d400b960 comp rx=0 tx=0).stop 2024-09-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 shutdown_connections 2024-09-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc2c40a2b90 0x7fc2c40a5050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d81036c0 0x7fc2d819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d8102d00 0x7fc2d8198470 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 --2- 172.21.15.100:0/3082489646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d8101b10 0x7fc2d8197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 >> 172.21.15.100:0/3082489646 conn(0x7fc2d80fd2b0 msgr2=0x7fc2d8106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 shutdown_connections 2024-09-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.596+0000 7fc2df65c640 1 -- 172.21.15.100:0/3082489646 wait complete. 2024-09-12T02:38:33.607 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 -- 172.21.15.100:0/2647129704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 msgr2=0x7f7b10109ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 --2- 172.21.15.100:0/2647129704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b10109ff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009ca0 tx=0x7f7b0802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 -- 172.21.15.100:0/2647129704 shutdown_connections 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 --2- 172.21.15.100:0/2647129704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b10109ff0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 --2- 172.21.15.100:0/2647129704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b10102da0 0x7f7b10103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 --2- 172.21.15.100:0/2647129704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b100ffdd0 0x7f7b101001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 -- 172.21.15.100:0/2647129704 >> 172.21.15.100:0/2647129704 conn(0x7f7b100fb910 msgr2=0x7f7b100fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 -- 172.21.15.100:0/2647129704 shutdown_connections 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.714+0000 7f7b156f1640 1 -- 172.21.15.100:0/2647129704 wait complete. 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 Processor -- start 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 -- start start 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b100ffdd0 0x7f7b10197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b10102da0 0x7f7b10198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b1019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1010d7f0 con 0x7f7b10103760 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1010d670 con 0x7f7b100ffdd0 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b156f1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1010d970 con 0x7f7b10102da0 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b0f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b1019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.715+0000 7f7b0f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b1019f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54452/0 (socket says 172.21.15.100:54452) 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0f7fe640 1 -- 172.21.15.100:0/1178717504 learned_addr learned my addr 172.21.15.100:0/1178717504 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0effd640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b100ffdd0 0x7f7b10197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0e7fc640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b10102da0 0x7f7b10198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0f7fe640 1 -- 172.21.15.100:0/1178717504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b10102da0 msgr2=0x7f7b10198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0f7fe640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b10102da0 0x7f7b10198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0f7fe640 1 -- 172.21.15.100:0/1178717504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b100ffdd0 msgr2=0x7f7b10197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0f7fe640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b100ffdd0 0x7f7b10197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0f7fe640 1 -- 172.21.15.100:0/1178717504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1019fa30 con 0x7f7b10103760 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b0f7fe640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b1019f3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b080319f0 tx=0x7f7b0802f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b07fff640 1 -- 172.21.15.100:0/1178717504 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08003c70 con 0x7f7b10103760 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b07fff640 1 -- 172.21.15.100:0/1178717504 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b08003e10 con 0x7f7b10103760 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b07fff640 1 -- 172.21.15.100:0/1178717504 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0802fd30 con 0x7f7b10103760 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1019fcc0 con 0x7f7b10103760 2024-09-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.716+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b101a0200 con 0x7f7b10103760 2024-09-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.717+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b101a0430 con 0x7f7b10103760 2024-09-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.718+0000 7f7b07fff640 1 -- 172.21.15.100:0/1178717504 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f7b08004040 con 0x7f7b10103760 2024-09-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.719+0000 7f7b07fff640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7afc0a2ca0 0x7f7afc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.719+0000 7f7b0effd640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7afc0a2ca0 0x7f7afc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.719+0000 7f7b07fff640 1 -- 172.21.15.100:0/1178717504 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7b080f05e0 con 0x7f7b10103760 2024-09-12T02:38:33.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.719+0000 7f7b0effd640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7afc0a2ca0 0x7f7afc0a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b00005fd0 tx=0x7f7b0000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.723+0000 7f7b07fff640 1 -- 172.21.15.100:0/1178717504 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b080bd4e0 con 0x7f7b10103760 2024-09-12T02:38:33.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:33 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1938939715' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:38:33.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:33 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:38:33.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:33 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3845598227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:33.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:33 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3082489646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:38:33.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.892+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7b101a0850 con 0x7f7b10103760 2024-09-12T02:38:33.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.892+0000 7f7b07fff640 1 -- 172.21.15.100:0/1178717504 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f7b080bcde0 con 0x7f7b10103760 2024-09-12T02:38:33.892 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-12T02:38:33.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7afc0a2ca0 msgr2=0x7f7afc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7afc0a2ca0 0x7f7afc0a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b00005fd0 tx=0x7f7b0000b410 comp rx=0 tx=0).stop 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 msgr2=0x7f7b1019f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b1019f3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b080319f0 tx=0x7f7b0802f450 comp rx=0 tx=0).stop 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 shutdown_connections 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7afc0a2ca0 0x7f7afc0a5160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10103760 0x7f7b1019f3c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b10102da0 0x7f7b10198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 --2- 172.21.15.100:0/1178717504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b100ffdd0 0x7f7b10197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 >> 172.21.15.100:0/1178717504 conn(0x7f7b100fb910 msgr2=0x7f7b100fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 shutdown_connections 2024-09-12T02:38:33.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:33.894+0000 7f7b156f1640 1 -- 172.21.15.100:0/1178717504 wait complete. 2024-09-12T02:38:33.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 -- 172.21.15.100:0/1707872020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 msgr2=0x7efc541072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 --2- 172.21.15.100:0/1707872020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc541072a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009900 tx=0x7efc3c02a410 comp rx=0 tx=0).stop 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 -- 172.21.15.100:0/1707872020 shutdown_connections 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 --2- 172.21.15.100:0/1707872020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc541077e0 0x7efc54109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 --2- 172.21.15.100:0/1707872020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc541072a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 --2- 172.21.15.100:0/1707872020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc54102580 0x7efc54104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 -- 172.21.15.100:0/1707872020 >> 172.21.15.100:0/1707872020 conn(0x7efc540fc140 msgr2=0x7efc540fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 -- 172.21.15.100:0/1707872020 shutdown_connections 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 -- 172.21.15.100:0/1707872020 wait complete. 2024-09-12T02:38:34.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 Processor -- start 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.008+0000 7efc588ac640 1 -- start start 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc588ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc54102580 0x7efc54101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc588ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc54100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc588ac640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc541077e0 0x7efc54100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc588ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc5410d810 con 0x7efc54104eb0 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc588ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc5410d690 con 0x7efc54102580 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc588ac640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efc5410d990 con 0x7efc541077e0 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc54100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc54100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54470/0 (socket says 172.21.15.100:54470) 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 -- 172.21.15.100:0/2971964931 learned_addr learned my addr 172.21.15.100:0/2971964931 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc5259c640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc54102580 0x7efc54101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 -- 172.21.15.100:0/2971964931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc541077e0 msgr2=0x7efc54100a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc541077e0 0x7efc54100a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 -- 172.21.15.100:0/2971964931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc54102580 msgr2=0x7efc54101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc54102580 0x7efc54101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 -- 172.21.15.100:0/2971964931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc54101300 con 0x7efc54104eb0 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc5259c640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc54102580 0x7efc54101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.009+0000 7efc51d9b640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc54100530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efc3c031610 tx=0x7efc3c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.010+0000 7efc4b7fe640 1 -- 172.21.15.100:0/2971964931 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c03f030 con 0x7efc54104eb0 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.010+0000 7efc4b7fe640 1 -- 172.21.15.100:0/2971964931 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc3c003ce0 con 0x7efc54104eb0 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.010+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc541a1fc0 con 0x7efc54104eb0 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.010+0000 7efc4b7fe640 1 -- 172.21.15.100:0/2971964931 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c035070 con 0x7efc54104eb0 2024-09-12T02:38:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.010+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc541a24a0 con 0x7efc54104eb0 2024-09-12T02:38:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.011+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc540fdc30 con 0x7efc54104eb0 2024-09-12T02:38:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.012+0000 7efc4b7fe640 1 -- 172.21.15.100:0/2971964931 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7efc3c042030 con 0x7efc54104eb0 2024-09-12T02:38:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.012+0000 7efc4b7fe640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efc400a2c20 0x7efc400a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.012+0000 7efc4b7fe640 1 -- 172.21.15.100:0/2971964931 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7efc3c0ef7c0 con 0x7efc54104eb0 2024-09-12T02:38:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.012+0000 7efc5259c640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efc400a2c20 0x7efc400a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.013+0000 7efc5259c640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efc400a2c20 0x7efc400a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009b40 tx=0x7efc4c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:33 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1938939715' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:38:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:33 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:38:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:33 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3845598227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:34.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:33 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3082489646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:38:34.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.016+0000 7efc4b7fe640 1 -- 172.21.15.100:0/2971964931 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc3c0bc5b0 con 0x7efc54104eb0 2024-09-12T02:38:34.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:33 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1938939715' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:38:34.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:33 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:38:34.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:33 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3845598227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:34.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:33 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3082489646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:38:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.185+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efc54062e90 con 0x7efc54104eb0 2024-09-12T02:38:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.185+0000 7efc4b7fe640 1 -- 172.21.15.100:0/2971964931 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7efc3c0bbeb0 con 0x7efc54104eb0 2024-09-12T02:38:34.185 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-09-12T02:38:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efc400a2c20 msgr2=0x7efc400a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efc400a2c20 0x7efc400a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009b40 tx=0x7efc4c005e50 comp rx=0 tx=0).stop 2024-09-12T02:38:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 msgr2=0x7efc54100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc54100530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efc3c031610 tx=0x7efc3c0043b0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 shutdown_connections 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7efc400a2c20 0x7efc400a50e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc541077e0 0x7efc54100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc54104eb0 0x7efc54100530 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 --2- 172.21.15.100:0/2971964931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc54102580 0x7efc54101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 >> 172.21.15.100:0/2971964931 conn(0x7efc540fc140 msgr2=0x7efc54102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 shutdown_connections 2024-09-12T02:38:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.187+0000 7efc588ac640 1 -- 172.21.15.100:0/2971964931 wait complete. 2024-09-12T02:38:34.198 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T02:38:34.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:34.866 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:34 smithi100 ceph-mon[31390]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:34.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:34 smithi100 ceph-mon[31390]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T02:38:34.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:34 smithi100 ceph-mon[31390]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T02:38:34.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1178717504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:38:34.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2971964931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:38:34.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 -- 172.21.15.100:0/1832311286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102570 msgr2=0x7f7dd81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:34.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1832311286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102570 0x7f7dd81029b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0009900 tx=0x7f7dc002a480 comp rx=0 tx=0).stop 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 -- 172.21.15.100:0/1832311286 shutdown_connections 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1832311286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd8102ef0 0x7f7dd810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1832311286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102570 0x7f7dd81029b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1832311286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dd8100e20 0x7f7dd8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 -- 172.21.15.100:0/1832311286 >> 172.21.15.100:0/1832311286 conn(0x7f7dd80fc7d0 msgr2=0x7f7dd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 -- 172.21.15.100:0/1832311286 shutdown_connections 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.947+0000 7f7dddc96640 1 -- 172.21.15.100:0/1832311286 wait complete. 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 Processor -- start 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 -- start start 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dd8100e20 0x7f7dd8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd8102570 0x7f7dd8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102ef0 0x7f7dd819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8110fa0 con 0x7f7dd8102ef0 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8110e20 con 0x7f7dd8100e20 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dddc96640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8111120 con 0x7f7dd8102570 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102ef0 0x7f7dd819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102ef0 0x7f7dd819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39364/0 (socket says 172.21.15.100:39364) 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 -- 172.21.15.100:0/1759170880 learned_addr learned my addr 172.21.15.100:0/1759170880 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dd8100e20 0x7f7dd8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dcffff640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd8102570 0x7f7dd8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 -- 172.21.15.100:0/1759170880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd8102570 msgr2=0x7f7dd8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd8102570 0x7f7dd8198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 -- 172.21.15.100:0/1759170880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dd8100e20 msgr2=0x7f7dd8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dd8100e20 0x7f7dd8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.948+0000 7f7dd7fff640 1 -- 172.21.15.100:0/1759170880 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd819d4b0 con 0x7f7dd8102ef0 2024-09-12T02:38:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.949+0000 7f7dd7fff640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102ef0 0x7f7dd819cdd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000cce0 tx=0x7f7dd000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.949+0000 7f7dd57fa640 1 -- 172.21.15.100:0/1759170880 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000f450 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.949+0000 7f7dd57fa640 1 -- 172.21.15.100:0/1759170880 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dd000fad0 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.949+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd819d7a0 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.949+0000 7f7dd57fa640 1 -- 172.21.15.100:0/1759170880 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0018b60 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.949+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd81a5080 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.950+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd8101200 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.951+0000 7f7dd57fa640 1 -- 172.21.15.100:0/1759170880 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f7dd000fc80 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.952+0000 7f7dd57fa640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7dc40a2c10 0x7f7dc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.952+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7dc40a2c10 0x7f7dc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.952+0000 7f7dd57fa640 1 -- 172.21.15.100:0/1759170880 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7dd00cfac0 con 0x7f7dd8102ef0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.952+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7dc40a2c10 0x7f7dc40a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009990 tx=0x7f7dc8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:34.955+0000 7f7dd57fa640 1 -- 172.21.15.100:0/1759170880 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7dd0014030 con 0x7f7dd8102ef0 2024-09-12T02:38:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:34 smithi189 ceph-mon[35196]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:34 smithi189 ceph-mon[35196]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T02:38:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:34 smithi189 ceph-mon[35196]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T02:38:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1178717504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:38:35.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2971964931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:38:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:34 smithi117 ceph-mon[34898]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:34 smithi117 ceph-mon[34898]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T02:38:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:34 smithi117 ceph-mon[34898]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T02:38:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:34 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1178717504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:38:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:34 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2971964931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:38:35.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.156+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dd810a0a0 con 0x7f7dd8102ef0 2024-09-12T02:38:35.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.157+0000 7f7dd57fa640 1 -- 172.21.15.100:0/1759170880 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f7dd009c8b0 con 0x7f7dd8102ef0 2024-09-12T02:38:35.157 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:35.157 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":25,"btime":"2024-09-12T02:38:32:651439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:32.370844+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:38:35.158 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 25 2024-09-12T02:38:35.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7dc40a2c10 msgr2=0x7f7dc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7dc40a2c10 0x7f7dc40a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009990 tx=0x7f7dc8009110 comp rx=0 tx=0).stop 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102ef0 msgr2=0x7f7dd819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102ef0 0x7f7dd819cdd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000cce0 tx=0x7f7dd000a620 comp rx=0 tx=0).stop 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 shutdown_connections 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7dc40a2c10 0x7f7dc40a50d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102ef0 0x7f7dd819cdd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd8102570 0x7f7dd8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 --2- 172.21.15.100:0/1759170880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dd8100e20 0x7f7dd8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 >> 172.21.15.100:0/1759170880 conn(0x7f7dd80fc7d0 msgr2=0x7f7dd806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 shutdown_connections 2024-09-12T02:38:35.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:35.159+0000 7f7dddc96640 1 -- 172.21.15.100:0/1759170880 wait complete. 2024-09-12T02:38:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:35 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1759170880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:36.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:35 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1759170880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:36.072 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T02:38:36.072 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T02:38:36.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:38:36.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:35 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1759170880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 -- 172.21.15.100:0/3131050370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec101c20 msgr2=0x7fc4ec1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 --2- 172.21.15.100:0/3131050370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec101c20 0x7fc4ec1020a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009900 tx=0x7fc4d402a410 comp rx=0 tx=0).stop 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 -- 172.21.15.100:0/3131050370 shutdown_connections 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 --2- 172.21.15.100:0/3131050370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ec1025e0 0x7fc4ec108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 --2- 172.21.15.100:0/3131050370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec101c20 0x7fc4ec1020a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 --2- 172.21.15.100:0/3131050370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec100a30 0x7fc4ec100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 -- 172.21.15.100:0/3131050370 >> 172.21.15.100:0/3131050370 conn(0x7fc4ec0fc1b0 msgr2=0x7fc4ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 -- 172.21.15.100:0/3131050370 shutdown_connections 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.178+0000 7fc4f1798640 1 -- 172.21.15.100:0/3131050370 wait complete. 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 Processor -- start 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 -- start start 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ec100a30 0x7fc4ec196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec101c20 0x7fc4ec197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec1025e0 0x7fc4ec19e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec10c6b0 con 0x7fc4ec1025e0 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec10c530 con 0x7fc4ec101c20 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4f1798640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec10c830 con 0x7fc4ec100a30 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec1025e0 0x7fc4ec19e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec1025e0 0x7fc4ec19e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39390/0 (socket says 172.21.15.100:39390) 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 -- 172.21.15.100:0/116508482 learned_addr learned my addr 172.21.15.100:0/116508482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eaffd640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ec100a30 0x7fc4ec196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4e27fc640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec101c20 0x7fc4ec197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 -- 172.21.15.100:0/116508482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ec100a30 msgr2=0x7fc4ec196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ec100a30 0x7fc4ec196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 -- 172.21.15.100:0/116508482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec101c20 msgr2=0x7fc4ec197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec101c20 0x7fc4ec197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.179+0000 7fc4eb7fe640 1 -- 172.21.15.100:0/116508482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec19e9d0 con 0x7fc4ec1025e0 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.180+0000 7fc4eb7fe640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec1025e0 0x7fc4ec19e330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400cad0 tx=0x7fc4e400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.180+0000 7fc4e8ff9640 1 -- 172.21.15.100:0/116508482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400ae20 con 0x7fc4ec1025e0 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.180+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec19ecc0 con 0x7fc4ec1025e0 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.180+0000 7fc4e8ff9640 1 -- 172.21.15.100:0/116508482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e4005020 con 0x7fc4ec1025e0 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.180+0000 7fc4e8ff9640 1 -- 172.21.15.100:0/116508482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400f6f0 con 0x7fc4ec1025e0 2024-09-12T02:38:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.180+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec19f1c0 con 0x7fc4ec1025e0 2024-09-12T02:38:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.181+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec107e20 con 0x7fc4ec1025e0 2024-09-12T02:38:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.182+0000 7fc4e8ff9640 1 -- 172.21.15.100:0/116508482 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fc4e40051d0 con 0x7fc4ec1025e0 2024-09-12T02:38:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.182+0000 7fc4e8ff9640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4d80a2c20 0x7fc4d80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.182+0000 7fc4eaffd640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4d80a2c20 0x7fc4d80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.183+0000 7fc4e8ff9640 1 -- 172.21.15.100:0/116508482 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc4e40cf4a0 con 0x7fc4ec1025e0 2024-09-12T02:38:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.183+0000 7fc4eaffd640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4d80a2c20 0x7fc4d80a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec198290 tx=0x7fc4dc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.187+0000 7fc4e8ff9640 1 -- 172.21.15.100:0/116508482 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4e4014030 con 0x7fc4ec1025e0 2024-09-12T02:38:36.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.351+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4ec062630 con 0x7fc4d80a2c20 2024-09-12T02:38:36.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.357+0000 7fc4e8ff9640 1 -- 172.21.15.100:0/116508482 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259085 (secure 0 0 0) 0x7fc4ec062630 con 0x7fc4d80a2c20 2024-09-12T02:38:36.360 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:36.361 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4d80a2c20 msgr2=0x7fc4d80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4d80a2c20 0x7fc4d80a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec198290 tx=0x7fc4dc00b410 comp rx=0 tx=0).stop 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec1025e0 msgr2=0x7fc4ec19e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec1025e0 0x7fc4ec19e330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400cad0 tx=0x7fc4e400cf90 comp rx=0 tx=0).stop 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 shutdown_connections 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4d80a2c20 0x7fc4d80a50e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec1025e0 0x7fc4ec19e330 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec101c20 0x7fc4ec197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 --2- 172.21.15.100:0/116508482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ec100a30 0x7fc4ec196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 >> 172.21.15.100:0/116508482 conn(0x7fc4ec0fc1b0 msgr2=0x7fc4ec104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 shutdown_connections 2024-09-12T02:38:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.360+0000 7fc4f1798640 1 -- 172.21.15.100:0/116508482 wait complete. 2024-09-12T02:38:36.371 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-12T02:38:35.548254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655460,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":718,"num_read_kb":471,"num_write":354,"num_write_kb":3055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":784,"ondisk_log_size":784,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356276,"kb_used_data":11188,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585548,"statfs":{"total":1151940427776,"available":1151575601152,"internally_reserved":0,"allocated":11456512,"data_stored":7280216,"data_compressed":176832,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1091,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002617"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538892+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:38:25.538892+0000","last_peered":"2024-09-12T02:38:25.538892+0000","last_clean":"2024-09-12T02:38:25.538892+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:38:25.538892+0000","last_undegraded":"2024-09-12T02:38:25.538892+0000","last_fullsized":"2024-09-12T02:38:25.538892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537706+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:38:25.537706+0000","last_peered":"2024-09-12T02:38:25.537706+0000","last_clean":"2024-09-12T02:38:25.537706+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:38:25.537706+0000","last_undegraded":"2024-09-12T02:38:25.537706+0000","last_fullsized":"2024-09-12T02:38:25.537706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544892+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:38:25.544892+0000","last_peered":"2024-09-12T02:38:25.544892+0000","last_clean":"2024-09-12T02:38:25.544892+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:38:25.544892+0000","last_undegraded":"2024-09-12T02:38:25.544892+0000","last_fullsized":"2024-09-12T02:38:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526152+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:38:25.526152+0000","last_peered":"2024-09-12T02:38:25.526152+0000","last_clean":"2024-09-12T02:38:25.526152+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:38:25.526152+0000","last_undegraded":"2024-09-12T02:38:25.526152+0000","last_fullsized":"2024-09-12T02:38:25.526152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526205+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:38:25.526205+0000","last_peered":"2024-09-12T02:38:25.526205+0000","last_clean":"2024-09-12T02:38:25.526205+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:38:25.526205+0000","last_undegraded":"2024-09-12T02:38:25.526205+0000","last_fullsized":"2024-09-12T02:38:25.526205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536028+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:38:25.536028+0000","last_peered":"2024-09-12T02:38:25.536028+0000","last_clean":"2024-09-12T02:38:25.536028+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:38:25.536028+0000","last_undegraded":"2024-09-12T02:38:25.536028+0000","last_fullsized":"2024-09-12T02:38:25.536028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540044+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:38:25.540044+0000","last_peered":"2024-09-12T02:38:25.540044+0000","last_clean":"2024-09-12T02:38:25.540044+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:38:25.540044+0000","last_undegraded":"2024-09-12T02:38:25.540044+0000","last_fullsized":"2024-09-12T02:38:25.540044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533451+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:38:25.533451+0000","last_peered":"2024-09-12T02:38:25.533451+0000","last_clean":"2024-09-12T02:38:25.533451+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:38:25.533451+0000","last_undegraded":"2024-09-12T02:38:25.533451+0000","last_fullsized":"2024-09-12T02:38:25.533451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548353+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:38:25.548353+0000","last_peered":"2024-09-12T02:38:25.548353+0000","last_clean":"2024-09-12T02:38:25.548353+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:38:25.548353+0000","last_undegraded":"2024-09-12T02:38:25.548353+0000","last_fullsized":"2024-09-12T02:38:25.548353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540355+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:38:25.540355+0000","last_peered":"2024-09-12T02:38:25.540355+0000","last_clean":"2024-09-12T02:38:25.540355+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:38:25.540355+0000","last_undegraded":"2024-09-12T02:38:25.540355+0000","last_fullsized":"2024-09-12T02:38:25.540355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545641+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:38:25.545641+0000","last_peered":"2024-09-12T02:38:25.545641+0000","last_clean":"2024-09-12T02:38:25.545641+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:38:25.545641+0000","last_undegraded":"2024-09-12T02:38:25.545641+0000","last_fullsized":"2024-09-12T02:38:25.545641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524741+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:38:25.524741+0000","last_peered":"2024-09-12T02:38:25.524741+0000","last_clean":"2024-09-12T02:38:25.524741+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:38:25.524741+0000","last_undegraded":"2024-09-12T02:38:25.524741+0000","last_fullsized":"2024-09-12T02:38:25.524741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535897+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:38:25.535897+0000","last_peered":"2024-09-12T02:38:25.535897+0000","last_clean":"2024-09-12T02:38:25.535897+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:38:25.535897+0000","last_undegraded":"2024-09-12T02:38:25.535897+0000","last_fullsized":"2024-09-12T02:38:25.535897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538014+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:38:25.538014+0000","last_peered":"2024-09-12T02:38:25.538014+0000","last_clean":"2024-09-12T02:38:25.538014+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:38:25.538014+0000","last_undegraded":"2024-09-12T02:38:25.538014+0000","last_fullsized":"2024-09-12T02:38:25.538014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535913+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:38:25.535913+0000","last_peered":"2024-09-12T02:38:25.535913+0000","last_clean":"2024-09-12T02:38:25.535913+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:38:25.535913+0000","last_undegraded":"2024-09-12T02:38:25.535913+0000","last_fullsized":"2024-09-12T02:38:25.535913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549559+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:38:25.549559+0000","last_peered":"2024-09-12T02:38:25.549559+0000","last_clean":"2024-09-12T02:38:25.549559+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:38:25.549559+0000","last_undegraded":"2024-09-12T02:38:25.549559+0000","last_fullsized":"2024-09-12T02:38:25.549559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544656+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:38:25.544656+0000","last_peered":"2024-09-12T02:38:25.544656+0000","last_clean":"2024-09-12T02:38:25.544656+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:38:25.544656+0000","last_undegraded":"2024-09-12T02:38:25.544656+0000","last_fullsized":"2024-09-12T02:38:25.544656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550740+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:38:25.550740+0000","last_peered":"2024-09-12T02:38:25.550740+0000","last_clean":"2024-09-12T02:38:25.550740+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:38:25.550740+0000","last_undegraded":"2024-09-12T02:38:25.550740+0000","last_fullsized":"2024-09-12T02:38:25.550740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537295+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:38:25.537295+0000","last_peered":"2024-09-12T02:38:25.537295+0000","last_clean":"2024-09-12T02:38:25.537295+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:38:25.537295+0000","last_undegraded":"2024-09-12T02:38:25.537295+0000","last_fullsized":"2024-09-12T02:38:25.537295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.531643+0000","last_change":"2024-09-12T02:37:56.677503+0000","last_active":"2024-09-12T02:38:25.531643+0000","last_peered":"2024-09-12T02:38:25.531643+0000","last_clean":"2024-09-12T02:38:25.531643+0000","last_became_active":"2024-09-12T02:37:56.677082+0000","last_became_peered":"2024-09-12T02:37:56.677082+0000","last_unstale":"2024-09-12T02:38:25.531643+0000","last_undegraded":"2024-09-12T02:38:25.531643+0000","last_fullsized":"2024-09-12T02:38:25.531643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:10.331298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542061+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:38:25.542061+0000","last_peered":"2024-09-12T02:38:25.542061+0000","last_clean":"2024-09-12T02:38:25.542061+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:38:25.542061+0000","last_undegraded":"2024-09-12T02:38:25.542061+0000","last_fullsized":"2024-09-12T02:38:25.542061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549255+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:38:25.549255+0000","last_peered":"2024-09-12T02:38:25.549255+0000","last_clean":"2024-09-12T02:38:25.549255+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:38:25.549255+0000","last_undegraded":"2024-09-12T02:38:25.549255+0000","last_fullsized":"2024-09-12T02:38:25.549255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532406+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:38:25.532406+0000","last_peered":"2024-09-12T02:38:25.532406+0000","last_clean":"2024-09-12T02:38:25.532406+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:38:25.532406+0000","last_undegraded":"2024-09-12T02:38:25.532406+0000","last_fullsized":"2024-09-12T02:38:25.532406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537351+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:38:25.537351+0000","last_peered":"2024-09-12T02:38:25.537351+0000","last_clean":"2024-09-12T02:38:25.537351+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:38:25.537351+0000","last_undegraded":"2024-09-12T02:38:25.537351+0000","last_fullsized":"2024-09-12T02:38:25.537351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524406+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:38:25.524406+0000","last_peered":"2024-09-12T02:38:25.524406+0000","last_clean":"2024-09-12T02:38:25.524406+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:38:25.524406+0000","last_undegraded":"2024-09-12T02:38:25.524406+0000","last_fullsized":"2024-09-12T02:38:25.524406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.551180+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:38:25.551180+0000","last_peered":"2024-09-12T02:38:25.551180+0000","last_clean":"2024-09-12T02:38:25.551180+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:38:25.551180+0000","last_undegraded":"2024-09-12T02:38:25.551180+0000","last_fullsized":"2024-09-12T02:38:25.551180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.530680+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:38:25.530680+0000","last_peered":"2024-09-12T02:38:25.530680+0000","last_clean":"2024-09-12T02:38:25.530680+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:38:25.530680+0000","last_undegraded":"2024-09-12T02:38:25.530680+0000","last_fullsized":"2024-09-12T02:38:25.530680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540212+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:38:25.540212+0000","last_peered":"2024-09-12T02:38:25.540212+0000","last_clean":"2024-09-12T02:38:25.540212+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:38:25.540212+0000","last_undegraded":"2024-09-12T02:38:25.540212+0000","last_fullsized":"2024-09-12T02:38:25.540212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537408+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:38:25.537408+0000","last_peered":"2024-09-12T02:38:25.537408+0000","last_clean":"2024-09-12T02:38:25.537408+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:38:25.537408+0000","last_undegraded":"2024-09-12T02:38:25.537408+0000","last_fullsized":"2024-09-12T02:38:25.537408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.534838+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:38:25.534838+0000","last_peered":"2024-09-12T02:38:25.534838+0000","last_clean":"2024-09-12T02:38:25.534838+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:38:25.534838+0000","last_undegraded":"2024-09-12T02:38:25.534838+0000","last_fullsized":"2024-09-12T02:38:25.534838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538471+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:38:25.538471+0000","last_peered":"2024-09-12T02:38:25.538471+0000","last_clean":"2024-09-12T02:38:25.538471+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:38:25.538471+0000","last_undegraded":"2024-09-12T02:38:25.538471+0000","last_fullsized":"2024-09-12T02:38:25.538471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527368+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:38:25.527368+0000","last_peered":"2024-09-12T02:38:25.527368+0000","last_clean":"2024-09-12T02:38:25.527368+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:38:25.527368+0000","last_undegraded":"2024-09-12T02:38:25.527368+0000","last_fullsized":"2024-09-12T02:38:25.527368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529505+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:38:25.529505+0000","last_peered":"2024-09-12T02:38:25.529505+0000","last_clean":"2024-09-12T02:38:25.529505+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:38:25.529505+0000","last_undegraded":"2024-09-12T02:38:25.529505+0000","last_fullsized":"2024-09-12T02:38:25.529505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:32.064443+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:38:32.064443+0000","last_peered":"2024-09-12T02:38:32.064443+0000","last_clean":"2024-09-12T02:38:32.064443+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:38:32.064443+0000","last_undegraded":"2024-09-12T02:38:32.064443+0000","last_fullsized":"2024-09-12T02:38:32.064443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539985+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:38:25.539985+0000","last_peered":"2024-09-12T02:38:25.539985+0000","last_clean":"2024-09-12T02:38:25.539985+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:38:25.539985+0000","last_undegraded":"2024-09-12T02:38:25.539985+0000","last_fullsized":"2024-09-12T02:38:25.539985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.755048+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:37:56.755048+0000","last_peered":"2024-09-12T02:37:56.755048+0000","last_clean":"2024-09-12T02:37:56.755048+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:37:56.755048+0000","last_undegraded":"2024-09-12T02:37:56.755048+0000","last_fullsized":"2024-09-12T02:37:56.755048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.668877+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:37:56.668877+0000","last_peered":"2024-09-12T02:37:56.668877+0000","last_clean":"2024-09-12T02:37:56.668877+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:37:56.668877+0000","last_undegraded":"2024-09-12T02:37:56.668877+0000","last_fullsized":"2024-09-12T02:37:56.668877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527196+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:38:25.527196+0000","last_peered":"2024-09-12T02:38:25.527196+0000","last_clean":"2024-09-12T02:38:25.527196+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:38:25.527196+0000","last_undegraded":"2024-09-12T02:38:25.527196+0000","last_fullsized":"2024-09-12T02:38:25.527196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670102+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:37:56.670102+0000","last_peered":"2024-09-12T02:37:56.670102+0000","last_clean":"2024-09-12T02:37:56.670102+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:37:56.670102+0000","last_undegraded":"2024-09-12T02:37:56.670102+0000","last_fullsized":"2024-09-12T02:37:56.670102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529360+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:38:25.529360+0000","last_peered":"2024-09-12T02:38:25.529360+0000","last_clean":"2024-09-12T02:38:25.529360+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:38:25.529360+0000","last_undegraded":"2024-09-12T02:38:25.529360+0000","last_fullsized":"2024-09-12T02:38:25.529360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":119,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:30.060812+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:38:30.060812+0000","last_peered":"2024-09-12T02:38:30.060812+0000","last_clean":"2024-09-12T02:38:30.060812+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:38:30.060812+0000","last_undegraded":"2024-09-12T02:38:30.060812+0000","last_fullsized":"2024-09-12T02:38:30.060812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548745+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:38:25.548745+0000","last_peered":"2024-09-12T02:38:25.548745+0000","last_clean":"2024-09-12T02:38:25.548745+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:38:25.548745+0000","last_undegraded":"2024-09-12T02:38:25.548745+0000","last_fullsized":"2024-09-12T02:38:25.548745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678605+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:37:56.678605+0000","last_peered":"2024-09-12T02:37:56.678605+0000","last_clean":"2024-09-12T02:37:56.678605+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:37:56.678605+0000","last_undegraded":"2024-09-12T02:37:56.678605+0000","last_fullsized":"2024-09-12T02:37:56.678605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538240+0000","last_change":"2024-09-12T02:37:56.677344+0000","last_active":"2024-09-12T02:38:25.538240+0000","last_peered":"2024-09-12T02:38:25.538240+0000","last_clean":"2024-09-12T02:38:25.538240+0000","last_became_active":"2024-09-12T02:37:56.676990+0000","last_became_peered":"2024-09-12T02:37:56.676990+0000","last_unstale":"2024-09-12T02:38:25.538240+0000","last_undegraded":"2024-09-12T02:38:25.538240+0000","last_fullsized":"2024-09-12T02:38:25.538240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,6],"acting":[0,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670363+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:37:56.670363+0000","last_peered":"2024-09-12T02:37:56.670363+0000","last_clean":"2024-09-12T02:37:56.670363+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:37:56.670363+0000","last_undegraded":"2024-09-12T02:37:56.670363+0000","last_fullsized":"2024-09-12T02:37:56.670363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550767+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:38:25.550767+0000","last_peered":"2024-09-12T02:38:25.550767+0000","last_clean":"2024-09-12T02:38:25.550767+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:38:25.550767+0000","last_undegraded":"2024-09-12T02:38:25.550767+0000","last_fullsized":"2024-09-12T02:38:25.550767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'30","reported_seq":247,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:31.061633+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:38:31.061633+0000","last_peered":"2024-09-12T02:38:31.061633+0000","last_clean":"2024-09-12T02:38:31.061633+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:38:31.061633+0000","last_undegraded":"2024-09-12T02:38:31.061633+0000","last_fullsized":"2024-09-12T02:38:31.061633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60013,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":156,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540622+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:38:25.540622+0000","last_peered":"2024-09-12T02:38:25.540622+0000","last_clean":"2024-09-12T02:38:25.540622+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:38:25.540622+0000","last_undegraded":"2024-09-12T02:38:25.540622+0000","last_fullsized":"2024-09-12T02:38:25.540622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678192+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:37:56.678192+0000","last_peered":"2024-09-12T02:37:56.678192+0000","last_clean":"2024-09-12T02:37:56.678192+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:37:56.678192+0000","last_undegraded":"2024-09-12T02:37:56.678192+0000","last_fullsized":"2024-09-12T02:37:56.678192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.522890+0000","last_change":"2024-09-12T02:37:56.679320+0000","last_active":"2024-09-12T02:38:25.522890+0000","last_peered":"2024-09-12T02:38:25.522890+0000","last_clean":"2024-09-12T02:38:25.522890+0000","last_became_active":"2024-09-12T02:37:56.678956+0000","last_became_peered":"2024-09-12T02:37:56.678956+0000","last_unstale":"2024-09-12T02:38:25.522890+0000","last_undegraded":"2024-09-12T02:38:25.522890+0000","last_fullsized":"2024-09-12T02:38:25.522890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:48.238065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669916+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:37:56.669916+0000","last_peered":"2024-09-12T02:37:56.669916+0000","last_clean":"2024-09-12T02:37:56.669916+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:37:56.669916+0000","last_undegraded":"2024-09-12T02:37:56.669916+0000","last_fullsized":"2024-09-12T02:37:56.669916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542029+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:38:25.542029+0000","last_peered":"2024-09-12T02:38:25.542029+0000","last_clean":"2024-09-12T02:38:25.542029+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:38:25.542029+0000","last_undegraded":"2024-09-12T02:38:25.542029+0000","last_fullsized":"2024-09-12T02:38:25.542029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:33.066097+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:38:33.066097+0000","last_peered":"2024-09-12T02:38:33.066097+0000","last_clean":"2024-09-12T02:38:33.066097+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:38:33.066097+0000","last_undegraded":"2024-09-12T02:38:33.066097+0000","last_fullsized":"2024-09-12T02:38:33.066097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.541072+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:38:25.541072+0000","last_peered":"2024-09-12T02:38:25.541072+0000","last_clean":"2024-09-12T02:38:25.541072+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:38:25.541072+0000","last_undegraded":"2024-09-12T02:38:25.541072+0000","last_fullsized":"2024-09-12T02:38:25.541072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.692441+0000","last_change":"2024-09-12T02:37:56.692441+0000","last_active":"2024-09-12T02:37:56.692441+0000","last_peered":"2024-09-12T02:37:56.692441+0000","last_clean":"2024-09-12T02:37:56.692441+0000","last_became_active":"2024-09-12T02:37:56.676982+0000","last_became_peered":"2024-09-12T02:37:56.676982+0000","last_unstale":"2024-09-12T02:37:56.692441+0000","last_undegraded":"2024-09-12T02:37:56.692441+0000","last_fullsized":"2024-09-12T02:37:56.692441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.324488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545588+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:38:25.545588+0000","last_peered":"2024-09-12T02:38:25.545588+0000","last_clean":"2024-09-12T02:38:25.545588+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:38:25.545588+0000","last_undegraded":"2024-09-12T02:38:25.545588+0000","last_fullsized":"2024-09-12T02:38:25.545588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676260+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:37:56.676260+0000","last_peered":"2024-09-12T02:37:56.676260+0000","last_clean":"2024-09-12T02:37:56.676260+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:37:56.676260+0000","last_undegraded":"2024-09-12T02:37:56.676260+0000","last_fullsized":"2024-09-12T02:37:56.676260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524802+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:38:25.524802+0000","last_peered":"2024-09-12T02:38:25.524802+0000","last_clean":"2024-09-12T02:38:25.524802+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:38:25.524802+0000","last_undegraded":"2024-09-12T02:38:25.524802+0000","last_fullsized":"2024-09-12T02:38:25.524802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669147+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.669147+0000","last_peered":"2024-09-12T02:37:56.669147+0000","last_clean":"2024-09-12T02:37:56.669147+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:37:56.669147+0000","last_undegraded":"2024-09-12T02:37:56.669147+0000","last_fullsized":"2024-09-12T02:37:56.669147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542172+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:38:25.542172+0000","last_peered":"2024-09-12T02:38:25.542172+0000","last_clean":"2024-09-12T02:38:25.542172+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:38:25.542172+0000","last_undegraded":"2024-09-12T02:38:25.542172+0000","last_fullsized":"2024-09-12T02:38:25.542172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670750+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:37:56.670750+0000","last_peered":"2024-09-12T02:37:56.670750+0000","last_clean":"2024-09-12T02:37:56.670750+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:37:56.670750+0000","last_undegraded":"2024-09-12T02:37:56.670750+0000","last_fullsized":"2024-09-12T02:37:56.670750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539778+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:38:25.539778+0000","last_peered":"2024-09-12T02:38:25.539778+0000","last_clean":"2024-09-12T02:38:25.539778+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:38:25.539778+0000","last_undegraded":"2024-09-12T02:38:25.539778+0000","last_fullsized":"2024-09-12T02:38:25.539778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677938+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:37:56.677938+0000","last_peered":"2024-09-12T02:37:56.677938+0000","last_clean":"2024-09-12T02:37:56.677938+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:37:56.677938+0000","last_undegraded":"2024-09-12T02:37:56.677938+0000","last_fullsized":"2024-09-12T02:37:56.677938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549470+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:38:25.549470+0000","last_peered":"2024-09-12T02:38:25.549470+0000","last_clean":"2024-09-12T02:38:25.549470+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:38:25.549470+0000","last_undegraded":"2024-09-12T02:38:25.549470+0000","last_fullsized":"2024-09-12T02:38:25.549470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678427+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:37:56.678427+0000","last_peered":"2024-09-12T02:37:56.678427+0000","last_clean":"2024-09-12T02:37:56.678427+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:37:56.678427+0000","last_undegraded":"2024-09-12T02:37:56.678427+0000","last_fullsized":"2024-09-12T02:37:56.678427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793192+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:37:56.793192+0000","last_peered":"2024-09-12T02:37:56.793192+0000","last_clean":"2024-09-12T02:37:56.793192+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:37:56.793192+0000","last_undegraded":"2024-09-12T02:37:56.793192+0000","last_fullsized":"2024-09-12T02:37:56.793192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550428+0000","last_change":"2024-09-12T02:37:56.674162+0000","last_active":"2024-09-12T02:38:25.550428+0000","last_peered":"2024-09-12T02:38:25.550428+0000","last_clean":"2024-09-12T02:38:25.550428+0000","last_became_active":"2024-09-12T02:37:56.673786+0000","last_became_peered":"2024-09-12T02:37:56.673786+0000","last_unstale":"2024-09-12T02:38:25.550428+0000","last_undegraded":"2024-09-12T02:38:25.550428+0000","last_fullsized":"2024-09-12T02:38:25.550428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:46.189919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678298+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.678298+0000","last_peered":"2024-09-12T02:37:56.678298+0000","last_clean":"2024-09-12T02:37:56.678298+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:37:56.678298+0000","last_undegraded":"2024-09-12T02:37:56.678298+0000","last_fullsized":"2024-09-12T02:37:56.678298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.523493+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:38:25.523493+0000","last_peered":"2024-09-12T02:38:25.523493+0000","last_clean":"2024-09-12T02:38:25.523493+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:38:25.523493+0000","last_undegraded":"2024-09-12T02:38:25.523493+0000","last_fullsized":"2024-09-12T02:38:25.523493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":118,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:29.058793+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:38:29.058793+0000","last_peered":"2024-09-12T02:38:29.058793+0000","last_clean":"2024-09-12T02:38:29.058793+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:38:29.058793+0000","last_undegraded":"2024-09-12T02:38:29.058793+0000","last_fullsized":"2024-09-12T02:38:29.058793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536855+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:38:25.536855+0000","last_peered":"2024-09-12T02:38:25.536855+0000","last_clean":"2024-09-12T02:38:25.536855+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:38:25.536855+0000","last_undegraded":"2024-09-12T02:38:25.536855+0000","last_fullsized":"2024-09-12T02:38:25.536855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678486+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:37:56.678486+0000","last_peered":"2024-09-12T02:37:56.678486+0000","last_clean":"2024-09-12T02:37:56.678486+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:37:56.678486+0000","last_undegraded":"2024-09-12T02:37:56.678486+0000","last_fullsized":"2024-09-12T02:37:56.678486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535307+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:38:25.535307+0000","last_peered":"2024-09-12T02:38:25.535307+0000","last_clean":"2024-09-12T02:38:25.535307+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:38:25.535307+0000","last_undegraded":"2024-09-12T02:38:25.535307+0000","last_fullsized":"2024-09-12T02:38:25.535307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672207+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:37:56.672207+0000","last_peered":"2024-09-12T02:37:56.672207+0000","last_clean":"2024-09-12T02:37:56.672207+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:37:56.672207+0000","last_undegraded":"2024-09-12T02:37:56.672207+0000","last_fullsized":"2024-09-12T02:37:56.672207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535973+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:38:25.535973+0000","last_peered":"2024-09-12T02:38:25.535973+0000","last_clean":"2024-09-12T02:38:25.535973+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:38:25.535973+0000","last_undegraded":"2024-09-12T02:38:25.535973+0000","last_fullsized":"2024-09-12T02:38:25.535973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.695307+0000","last_change":"2024-09-12T02:37:56.694966+0000","last_active":"2024-09-12T02:37:56.695307+0000","last_peered":"2024-09-12T02:37:56.695307+0000","last_clean":"2024-09-12T02:37:56.695307+0000","last_became_active":"2024-09-12T02:37:56.674729+0000","last_became_peered":"2024-09-12T02:37:56.674729+0000","last_unstale":"2024-09-12T02:37:56.695307+0000","last_undegraded":"2024-09-12T02:37:56.695307+0000","last_fullsized":"2024-09-12T02:37:56.695307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:51.673970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.528703+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:38:25.528703+0000","last_peered":"2024-09-12T02:38:25.528703+0000","last_clean":"2024-09-12T02:38:25.528703+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:38:25.528703+0000","last_undegraded":"2024-09-12T02:38:25.528703+0000","last_fullsized":"2024-09-12T02:38:25.528703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'11","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672284+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:37:56.672284+0000","last_peered":"2024-09-12T02:37:56.672284+0000","last_clean":"2024-09-12T02:37:56.672284+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:37:56.672284+0000","last_undegraded":"2024-09-12T02:37:56.672284+0000","last_fullsized":"2024-09-12T02:37:56.672284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533951+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:38:25.533951+0000","last_peered":"2024-09-12T02:38:25.533951+0000","last_clean":"2024-09-12T02:38:25.533951+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:38:25.533951+0000","last_undegraded":"2024-09-12T02:38:25.533951+0000","last_fullsized":"2024-09-12T02:38:25.533951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793081+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:37:56.793081+0000","last_peered":"2024-09-12T02:37:56.793081+0000","last_clean":"2024-09-12T02:37:56.793081+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:37:56.793081+0000","last_undegraded":"2024-09-12T02:37:56.793081+0000","last_fullsized":"2024-09-12T02:37:56.793081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540129+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:38:25.540129+0000","last_peered":"2024-09-12T02:38:25.540129+0000","last_clean":"2024-09-12T02:38:25.540129+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:38:25.540129+0000","last_undegraded":"2024-09-12T02:38:25.540129+0000","last_fullsized":"2024-09-12T02:38:25.540129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669652+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:37:56.669652+0000","last_peered":"2024-09-12T02:37:56.669652+0000","last_clean":"2024-09-12T02:37:56.669652+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:37:56.669652+0000","last_undegraded":"2024-09-12T02:37:56.669652+0000","last_fullsized":"2024-09-12T02:37:56.669652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.500557+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:38:25.500557+0000","last_peered":"2024-09-12T02:38:25.500557+0000","last_clean":"2024-09-12T02:38:25.500557+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:38:25.500557+0000","last_undegraded":"2024-09-12T02:38:25.500557+0000","last_fullsized":"2024-09-12T02:38:25.500557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792234+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:37:56.792234+0000","last_peered":"2024-09-12T02:37:56.792234+0000","last_clean":"2024-09-12T02:37:56.792234+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:37:56.792234+0000","last_undegraded":"2024-09-12T02:37:56.792234+0000","last_fullsized":"2024-09-12T02:37:56.792234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538185+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:38:25.538185+0000","last_peered":"2024-09-12T02:38:25.538185+0000","last_clean":"2024-09-12T02:38:25.538185+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:38:25.538185+0000","last_undegraded":"2024-09-12T02:38:25.538185+0000","last_fullsized":"2024-09-12T02:38:25.538185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677722+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:37:56.677722+0000","last_peered":"2024-09-12T02:37:56.677722+0000","last_clean":"2024-09-12T02:37:56.677722+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:37:56.677722+0000","last_undegraded":"2024-09-12T02:37:56.677722+0000","last_fullsized":"2024-09-12T02:37:56.677722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532431+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:38:25.532431+0000","last_peered":"2024-09-12T02:38:25.532431+0000","last_clean":"2024-09-12T02:38:25.532431+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:38:25.532431+0000","last_undegraded":"2024-09-12T02:38:25.532431+0000","last_fullsized":"2024-09-12T02:38:25.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.797632+0000","last_change":"2024-09-12T02:37:56.797632+0000","last_active":"2024-09-12T02:37:56.797632+0000","last_peered":"2024-09-12T02:37:56.797632+0000","last_clean":"2024-09-12T02:37:56.797632+0000","last_became_active":"2024-09-12T02:37:56.794171+0000","last_became_peered":"2024-09-12T02:37:56.794171+0000","last_unstale":"2024-09-12T02:37:56.797632+0000","last_undegraded":"2024-09-12T02:37:56.797632+0000","last_fullsized":"2024-09-12T02:37:56.797632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:34.468518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550218+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:38:25.550218+0000","last_peered":"2024-09-12T02:38:25.550218+0000","last_clean":"2024-09-12T02:38:25.550218+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:38:25.550218+0000","last_undegraded":"2024-09-12T02:38:25.550218+0000","last_fullsized":"2024-09-12T02:38:25.550218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549244+0000","last_change":"2024-09-12T02:37:56.680042+0000","last_active":"2024-09-12T02:38:25.549244+0000","last_peered":"2024-09-12T02:38:25.549244+0000","last_clean":"2024-09-12T02:38:25.549244+0000","last_became_active":"2024-09-12T02:37:56.679618+0000","last_became_peered":"2024-09-12T02:37:56.679618+0000","last_unstale":"2024-09-12T02:38:25.549244+0000","last_undegraded":"2024-09-12T02:38:25.549244+0000","last_fullsized":"2024-09-12T02:38:25.549244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:53.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.682015+0000","last_change":"2024-09-12T02:37:56.681606+0000","last_active":"2024-09-12T02:37:56.682015+0000","last_peered":"2024-09-12T02:37:56.682015+0000","last_clean":"2024-09-12T02:37:56.682015+0000","last_became_active":"2024-09-12T02:37:56.674499+0000","last_became_peered":"2024-09-12T02:37:56.674499+0000","last_unstale":"2024-09-12T02:37:56.682015+0000","last_undegraded":"2024-09-12T02:37:56.682015+0000","last_fullsized":"2024-09-12T02:37:56.682015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:02.803838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550254+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:38:25.550254+0000","last_peered":"2024-09-12T02:38:25.550254+0000","last_clean":"2024-09-12T02:38:25.550254+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:38:25.550254+0000","last_undegraded":"2024-09-12T02:38:25.550254+0000","last_fullsized":"2024-09-12T02:38:25.550254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676382+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:37:56.676382+0000","last_peered":"2024-09-12T02:37:56.676382+0000","last_clean":"2024-09-12T02:37:56.676382+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:37:56.676382+0000","last_undegraded":"2024-09-12T02:37:56.676382+0000","last_fullsized":"2024-09-12T02:37:56.676382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549684+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:38:25.549684+0000","last_peered":"2024-09-12T02:38:25.549684+0000","last_clean":"2024-09-12T02:38:25.549684+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:38:25.549684+0000","last_undegraded":"2024-09-12T02:38:25.549684+0000","last_fullsized":"2024-09-12T02:38:25.549684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792826+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:56.792826+0000","last_peered":"2024-09-12T02:37:56.792826+0000","last_clean":"2024-09-12T02:37:56.792826+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:37:56.792826+0000","last_undegraded":"2024-09-12T02:37:56.792826+0000","last_fullsized":"2024-09-12T02:37:56.792826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524640+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:38:25.524640+0000","last_peered":"2024-09-12T02:38:25.524640+0000","last_clean":"2024-09-12T02:38:25.524640+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:38:25.524640+0000","last_undegraded":"2024-09-12T02:38:25.524640+0000","last_fullsized":"2024-09-12T02:38:25.524640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672690+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:37:56.672690+0000","last_peered":"2024-09-12T02:37:56.672690+0000","last_clean":"2024-09-12T02:37:56.672690+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:37:56.672690+0000","last_undegraded":"2024-09-12T02:37:56.672690+0000","last_fullsized":"2024-09-12T02:37:56.672690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64858,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":592,"num_read_kb":362,"num_write":171,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":205628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514530,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442983,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1094455,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":443197,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443095,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1035190,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442586,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1035182,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":443416,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":442897,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":504780,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":508578,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":443857,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:38:36.375 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 -- 172.21.15.100:0/364644920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62081025e0 msgr2=0x7f6208108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 --2- 172.21.15.100:0/364644920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62081025e0 0x7f6208108e70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6200009ca0 tx=0x7f620002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 -- 172.21.15.100:0/364644920 shutdown_connections 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 --2- 172.21.15.100:0/364644920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62081025e0 0x7f6208108e70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 --2- 172.21.15.100:0/364644920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6208101c20 0x7f62081020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 --2- 172.21.15.100:0/364644920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6208100a30 0x7f6208100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 -- 172.21.15.100:0/364644920 >> 172.21.15.100:0/364644920 conn(0x7f62080fc1b0 msgr2=0x7f62080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 -- 172.21.15.100:0/364644920 shutdown_connections 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.511+0000 7f620fe1e640 1 -- 172.21.15.100:0/364644920 wait complete. 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 Processor -- start 2024-09-12T02:38:36.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 -- start start 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208100a30 0x7f6208197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6208101c20 0x7f6208198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62081025e0 0x7f620819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f620810d800 con 0x7f6208100a30 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f620810d680 con 0x7f62081025e0 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620fe1e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f620810d980 con 0x7f6208101c20 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208100a30 0x7f6208197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208100a30 0x7f6208197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39404/0 (socket says 172.21.15.100:39404) 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 -- 172.21.15.100:0/1470827896 learned_addr learned my addr 172.21.15.100:0/1470827896 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620e3bb640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62081025e0 0x7f620819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620d3b9640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6208101c20 0x7f6208198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 -- 172.21.15.100:0/1470827896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6208101c20 msgr2=0x7f6208198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6208101c20 0x7f6208198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 -- 172.21.15.100:0/1470827896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62081025e0 msgr2=0x7f620819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62081025e0 0x7f620819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 -- 172.21.15.100:0/1470827896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620819fa40 con 0x7f6208100a30 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620d3b9640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6208101c20 0x7f6208198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620e3bb640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62081025e0 0x7f620819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f620dbba640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208100a30 0x7f6208197e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00d770 tx=0x7f61fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.512+0000 7f61faffd640 1 -- 172.21.15.100:0/1470827896 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc017070 con 0x7f6208100a30 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.513+0000 7f61faffd640 1 -- 172.21.15.100:0/1470827896 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61fc009c30 con 0x7f6208100a30 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.513+0000 7f61faffd640 1 -- 172.21.15.100:0/1470827896 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc003dd0 con 0x7f6208100a30 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.513+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620819fd30 con 0x7f6208100a30 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.513+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62081a01d0 con 0x7f6208100a30 2024-09-12T02:38:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.513+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6208107e20 con 0x7f6208100a30 2024-09-12T02:38:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.515+0000 7f61faffd640 1 -- 172.21.15.100:0/1470827896 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f61fc003f70 con 0x7f6208100a30 2024-09-12T02:38:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.515+0000 7f61faffd640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f40a2c20 0x7f61f40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.515+0000 7f620d3b9640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f40a2c20 0x7f61f40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.515+0000 7f61faffd640 1 -- 172.21.15.100:0/1470827896 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f61fc0cefc0 con 0x7f6208100a30 2024-09-12T02:38:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.516+0000 7f620d3b9640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f40a2c20 0x7f61f40a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6208199330 tx=0x7f6204005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.519+0000 7f61faffd640 1 -- 172.21.15.100:0/1470827896 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61fc009de0 con 0x7f6208100a30 2024-09-12T02:38:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.684+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6208062630 con 0x7f61f40a2c20 2024-09-12T02:38:36.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.690+0000 7f61faffd640 1 -- 172.21.15.100:0/1470827896 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259085 (secure 0 0 0) 0x7f6208062630 con 0x7f61f40a2c20 2024-09-12T02:38:36.693 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:38:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f40a2c20 msgr2=0x7f61f40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f40a2c20 0x7f61f40a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6208199330 tx=0x7f6204005d30 comp rx=0 tx=0).stop 2024-09-12T02:38:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208100a30 msgr2=0x7f6208197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208100a30 0x7f6208197e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00d770 tx=0x7f61fc00dc30 comp rx=0 tx=0).stop 2024-09-12T02:38:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 shutdown_connections 2024-09-12T02:38:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61f40a2c20 0x7f61f40a50e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62081025e0 0x7f620819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6208101c20 0x7f6208198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 --2- 172.21.15.100:0/1470827896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208100a30 0x7f6208197e20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.693+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 >> 172.21.15.100:0/1470827896 conn(0x7f62080fc1b0 msgr2=0x7f6208104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.694+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 shutdown_connections 2024-09-12T02:38:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.694+0000 7f620fe1e640 1 -- 172.21.15.100:0/1470827896 wait complete. 2024-09-12T02:38:36.705 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-12T02:38:35.548254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655460,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":718,"num_read_kb":471,"num_write":354,"num_write_kb":3055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":784,"ondisk_log_size":784,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356276,"kb_used_data":11188,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585548,"statfs":{"total":1151940427776,"available":1151575601152,"internally_reserved":0,"allocated":11456512,"data_stored":7280216,"data_compressed":176832,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1091,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002617"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538892+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:38:25.538892+0000","last_peered":"2024-09-12T02:38:25.538892+0000","last_clean":"2024-09-12T02:38:25.538892+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:38:25.538892+0000","last_undegraded":"2024-09-12T02:38:25.538892+0000","last_fullsized":"2024-09-12T02:38:25.538892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537706+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:38:25.537706+0000","last_peered":"2024-09-12T02:38:25.537706+0000","last_clean":"2024-09-12T02:38:25.537706+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:38:25.537706+0000","last_undegraded":"2024-09-12T02:38:25.537706+0000","last_fullsized":"2024-09-12T02:38:25.537706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544892+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:38:25.544892+0000","last_peered":"2024-09-12T02:38:25.544892+0000","last_clean":"2024-09-12T02:38:25.544892+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:38:25.544892+0000","last_undegraded":"2024-09-12T02:38:25.544892+0000","last_fullsized":"2024-09-12T02:38:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526152+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:38:25.526152+0000","last_peered":"2024-09-12T02:38:25.526152+0000","last_clean":"2024-09-12T02:38:25.526152+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:38:25.526152+0000","last_undegraded":"2024-09-12T02:38:25.526152+0000","last_fullsized":"2024-09-12T02:38:25.526152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526205+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:38:25.526205+0000","last_peered":"2024-09-12T02:38:25.526205+0000","last_clean":"2024-09-12T02:38:25.526205+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:38:25.526205+0000","last_undegraded":"2024-09-12T02:38:25.526205+0000","last_fullsized":"2024-09-12T02:38:25.526205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536028+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:38:25.536028+0000","last_peered":"2024-09-12T02:38:25.536028+0000","last_clean":"2024-09-12T02:38:25.536028+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:38:25.536028+0000","last_undegraded":"2024-09-12T02:38:25.536028+0000","last_fullsized":"2024-09-12T02:38:25.536028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540044+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:38:25.540044+0000","last_peered":"2024-09-12T02:38:25.540044+0000","last_clean":"2024-09-12T02:38:25.540044+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:38:25.540044+0000","last_undegraded":"2024-09-12T02:38:25.540044+0000","last_fullsized":"2024-09-12T02:38:25.540044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533451+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:38:25.533451+0000","last_peered":"2024-09-12T02:38:25.533451+0000","last_clean":"2024-09-12T02:38:25.533451+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:38:25.533451+0000","last_undegraded":"2024-09-12T02:38:25.533451+0000","last_fullsized":"2024-09-12T02:38:25.533451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548353+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:38:25.548353+0000","last_peered":"2024-09-12T02:38:25.548353+0000","last_clean":"2024-09-12T02:38:25.548353+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:38:25.548353+0000","last_undegraded":"2024-09-12T02:38:25.548353+0000","last_fullsized":"2024-09-12T02:38:25.548353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540355+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:38:25.540355+0000","last_peered":"2024-09-12T02:38:25.540355+0000","last_clean":"2024-09-12T02:38:25.540355+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:38:25.540355+0000","last_undegraded":"2024-09-12T02:38:25.540355+0000","last_fullsized":"2024-09-12T02:38:25.540355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545641+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:38:25.545641+0000","last_peered":"2024-09-12T02:38:25.545641+0000","last_clean":"2024-09-12T02:38:25.545641+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:38:25.545641+0000","last_undegraded":"2024-09-12T02:38:25.545641+0000","last_fullsized":"2024-09-12T02:38:25.545641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524741+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:38:25.524741+0000","last_peered":"2024-09-12T02:38:25.524741+0000","last_clean":"2024-09-12T02:38:25.524741+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:38:25.524741+0000","last_undegraded":"2024-09-12T02:38:25.524741+0000","last_fullsized":"2024-09-12T02:38:25.524741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535897+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:38:25.535897+0000","last_peered":"2024-09-12T02:38:25.535897+0000","last_clean":"2024-09-12T02:38:25.535897+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:38:25.535897+0000","last_undegraded":"2024-09-12T02:38:25.535897+0000","last_fullsized":"2024-09-12T02:38:25.535897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538014+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:38:25.538014+0000","last_peered":"2024-09-12T02:38:25.538014+0000","last_clean":"2024-09-12T02:38:25.538014+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:38:25.538014+0000","last_undegraded":"2024-09-12T02:38:25.538014+0000","last_fullsized":"2024-09-12T02:38:25.538014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535913+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:38:25.535913+0000","last_peered":"2024-09-12T02:38:25.535913+0000","last_clean":"2024-09-12T02:38:25.535913+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:38:25.535913+0000","last_undegraded":"2024-09-12T02:38:25.535913+0000","last_fullsized":"2024-09-12T02:38:25.535913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549559+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:38:25.549559+0000","last_peered":"2024-09-12T02:38:25.549559+0000","last_clean":"2024-09-12T02:38:25.549559+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:38:25.549559+0000","last_undegraded":"2024-09-12T02:38:25.549559+0000","last_fullsized":"2024-09-12T02:38:25.549559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544656+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:38:25.544656+0000","last_peered":"2024-09-12T02:38:25.544656+0000","last_clean":"2024-09-12T02:38:25.544656+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:38:25.544656+0000","last_undegraded":"2024-09-12T02:38:25.544656+0000","last_fullsized":"2024-09-12T02:38:25.544656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550740+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:38:25.550740+0000","last_peered":"2024-09-12T02:38:25.550740+0000","last_clean":"2024-09-12T02:38:25.550740+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:38:25.550740+0000","last_undegraded":"2024-09-12T02:38:25.550740+0000","last_fullsized":"2024-09-12T02:38:25.550740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537295+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:38:25.537295+0000","last_peered":"2024-09-12T02:38:25.537295+0000","last_clean":"2024-09-12T02:38:25.537295+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:38:25.537295+0000","last_undegraded":"2024-09-12T02:38:25.537295+0000","last_fullsized":"2024-09-12T02:38:25.537295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.531643+0000","last_change":"2024-09-12T02:37:56.677503+0000","last_active":"2024-09-12T02:38:25.531643+0000","last_peered":"2024-09-12T02:38:25.531643+0000","last_clean":"2024-09-12T02:38:25.531643+0000","last_became_active":"2024-09-12T02:37:56.677082+0000","last_became_peered":"2024-09-12T02:37:56.677082+0000","last_unstale":"2024-09-12T02:38:25.531643+0000","last_undegraded":"2024-09-12T02:38:25.531643+0000","last_fullsized":"2024-09-12T02:38:25.531643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:10.331298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542061+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:38:25.542061+0000","last_peered":"2024-09-12T02:38:25.542061+0000","last_clean":"2024-09-12T02:38:25.542061+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:38:25.542061+0000","last_undegraded":"2024-09-12T02:38:25.542061+0000","last_fullsized":"2024-09-12T02:38:25.542061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549255+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:38:25.549255+0000","last_peered":"2024-09-12T02:38:25.549255+0000","last_clean":"2024-09-12T02:38:25.549255+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:38:25.549255+0000","last_undegraded":"2024-09-12T02:38:25.549255+0000","last_fullsized":"2024-09-12T02:38:25.549255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532406+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:38:25.532406+0000","last_peered":"2024-09-12T02:38:25.532406+0000","last_clean":"2024-09-12T02:38:25.532406+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:38:25.532406+0000","last_undegraded":"2024-09-12T02:38:25.532406+0000","last_fullsized":"2024-09-12T02:38:25.532406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537351+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:38:25.537351+0000","last_peered":"2024-09-12T02:38:25.537351+0000","last_clean":"2024-09-12T02:38:25.537351+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:38:25.537351+0000","last_undegraded":"2024-09-12T02:38:25.537351+0000","last_fullsized":"2024-09-12T02:38:25.537351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524406+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:38:25.524406+0000","last_peered":"2024-09-12T02:38:25.524406+0000","last_clean":"2024-09-12T02:38:25.524406+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:38:25.524406+0000","last_undegraded":"2024-09-12T02:38:25.524406+0000","last_fullsized":"2024-09-12T02:38:25.524406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.551180+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:38:25.551180+0000","last_peered":"2024-09-12T02:38:25.551180+0000","last_clean":"2024-09-12T02:38:25.551180+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:38:25.551180+0000","last_undegraded":"2024-09-12T02:38:25.551180+0000","last_fullsized":"2024-09-12T02:38:25.551180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.530680+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:38:25.530680+0000","last_peered":"2024-09-12T02:38:25.530680+0000","last_clean":"2024-09-12T02:38:25.530680+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:38:25.530680+0000","last_undegraded":"2024-09-12T02:38:25.530680+0000","last_fullsized":"2024-09-12T02:38:25.530680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540212+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:38:25.540212+0000","last_peered":"2024-09-12T02:38:25.540212+0000","last_clean":"2024-09-12T02:38:25.540212+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:38:25.540212+0000","last_undegraded":"2024-09-12T02:38:25.540212+0000","last_fullsized":"2024-09-12T02:38:25.540212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537408+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:38:25.537408+0000","last_peered":"2024-09-12T02:38:25.537408+0000","last_clean":"2024-09-12T02:38:25.537408+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:38:25.537408+0000","last_undegraded":"2024-09-12T02:38:25.537408+0000","last_fullsized":"2024-09-12T02:38:25.537408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.534838+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:38:25.534838+0000","last_peered":"2024-09-12T02:38:25.534838+0000","last_clean":"2024-09-12T02:38:25.534838+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:38:25.534838+0000","last_undegraded":"2024-09-12T02:38:25.534838+0000","last_fullsized":"2024-09-12T02:38:25.534838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538471+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:38:25.538471+0000","last_peered":"2024-09-12T02:38:25.538471+0000","last_clean":"2024-09-12T02:38:25.538471+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:38:25.538471+0000","last_undegraded":"2024-09-12T02:38:25.538471+0000","last_fullsized":"2024-09-12T02:38:25.538471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527368+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:38:25.527368+0000","last_peered":"2024-09-12T02:38:25.527368+0000","last_clean":"2024-09-12T02:38:25.527368+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:38:25.527368+0000","last_undegraded":"2024-09-12T02:38:25.527368+0000","last_fullsized":"2024-09-12T02:38:25.527368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529505+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:38:25.529505+0000","last_peered":"2024-09-12T02:38:25.529505+0000","last_clean":"2024-09-12T02:38:25.529505+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:38:25.529505+0000","last_undegraded":"2024-09-12T02:38:25.529505+0000","last_fullsized":"2024-09-12T02:38:25.529505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:32.064443+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:38:32.064443+0000","last_peered":"2024-09-12T02:38:32.064443+0000","last_clean":"2024-09-12T02:38:32.064443+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:38:32.064443+0000","last_undegraded":"2024-09-12T02:38:32.064443+0000","last_fullsized":"2024-09-12T02:38:32.064443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539985+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:38:25.539985+0000","last_peered":"2024-09-12T02:38:25.539985+0000","last_clean":"2024-09-12T02:38:25.539985+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:38:25.539985+0000","last_undegraded":"2024-09-12T02:38:25.539985+0000","last_fullsized":"2024-09-12T02:38:25.539985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.755048+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:37:56.755048+0000","last_peered":"2024-09-12T02:37:56.755048+0000","last_clean":"2024-09-12T02:37:56.755048+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:37:56.755048+0000","last_undegraded":"2024-09-12T02:37:56.755048+0000","last_fullsized":"2024-09-12T02:37:56.755048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.668877+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:37:56.668877+0000","last_peered":"2024-09-12T02:37:56.668877+0000","last_clean":"2024-09-12T02:37:56.668877+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:37:56.668877+0000","last_undegraded":"2024-09-12T02:37:56.668877+0000","last_fullsized":"2024-09-12T02:37:56.668877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527196+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:38:25.527196+0000","last_peered":"2024-09-12T02:38:25.527196+0000","last_clean":"2024-09-12T02:38:25.527196+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:38:25.527196+0000","last_undegraded":"2024-09-12T02:38:25.527196+0000","last_fullsized":"2024-09-12T02:38:25.527196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670102+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:37:56.670102+0000","last_peered":"2024-09-12T02:37:56.670102+0000","last_clean":"2024-09-12T02:37:56.670102+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:37:56.670102+0000","last_undegraded":"2024-09-12T02:37:56.670102+0000","last_fullsized":"2024-09-12T02:37:56.670102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529360+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:38:25.529360+0000","last_peered":"2024-09-12T02:38:25.529360+0000","last_clean":"2024-09-12T02:38:25.529360+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:38:25.529360+0000","last_undegraded":"2024-09-12T02:38:25.529360+0000","last_fullsized":"2024-09-12T02:38:25.529360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":119,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:30.060812+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:38:30.060812+0000","last_peered":"2024-09-12T02:38:30.060812+0000","last_clean":"2024-09-12T02:38:30.060812+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:38:30.060812+0000","last_undegraded":"2024-09-12T02:38:30.060812+0000","last_fullsized":"2024-09-12T02:38:30.060812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548745+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:38:25.548745+0000","last_peered":"2024-09-12T02:38:25.548745+0000","last_clean":"2024-09-12T02:38:25.548745+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:38:25.548745+0000","last_undegraded":"2024-09-12T02:38:25.548745+0000","last_fullsized":"2024-09-12T02:38:25.548745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678605+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:37:56.678605+0000","last_peered":"2024-09-12T02:37:56.678605+0000","last_clean":"2024-09-12T02:37:56.678605+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:37:56.678605+0000","last_undegraded":"2024-09-12T02:37:56.678605+0000","last_fullsized":"2024-09-12T02:37:56.678605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538240+0000","last_change":"2024-09-12T02:37:56.677344+0000","last_active":"2024-09-12T02:38:25.538240+0000","last_peered":"2024-09-12T02:38:25.538240+0000","last_clean":"2024-09-12T02:38:25.538240+0000","last_became_active":"2024-09-12T02:37:56.676990+0000","last_became_peered":"2024-09-12T02:37:56.676990+0000","last_unstale":"2024-09-12T02:38:25.538240+0000","last_undegraded":"2024-09-12T02:38:25.538240+0000","last_fullsized":"2024-09-12T02:38:25.538240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,6],"acting":[0,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670363+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:37:56.670363+0000","last_peered":"2024-09-12T02:37:56.670363+0000","last_clean":"2024-09-12T02:37:56.670363+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:37:56.670363+0000","last_undegraded":"2024-09-12T02:37:56.670363+0000","last_fullsized":"2024-09-12T02:37:56.670363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550767+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:38:25.550767+0000","last_peered":"2024-09-12T02:38:25.550767+0000","last_clean":"2024-09-12T02:38:25.550767+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:38:25.550767+0000","last_undegraded":"2024-09-12T02:38:25.550767+0000","last_fullsized":"2024-09-12T02:38:25.550767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'30","reported_seq":247,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:31.061633+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:38:31.061633+0000","last_peered":"2024-09-12T02:38:31.061633+0000","last_clean":"2024-09-12T02:38:31.061633+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:38:31.061633+0000","last_undegraded":"2024-09-12T02:38:31.061633+0000","last_fullsized":"2024-09-12T02:38:31.061633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60013,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":156,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540622+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:38:25.540622+0000","last_peered":"2024-09-12T02:38:25.540622+0000","last_clean":"2024-09-12T02:38:25.540622+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:38:25.540622+0000","last_undegraded":"2024-09-12T02:38:25.540622+0000","last_fullsized":"2024-09-12T02:38:25.540622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678192+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:37:56.678192+0000","last_peered":"2024-09-12T02:37:56.678192+0000","last_clean":"2024-09-12T02:37:56.678192+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:37:56.678192+0000","last_undegraded":"2024-09-12T02:37:56.678192+0000","last_fullsized":"2024-09-12T02:37:56.678192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.522890+0000","last_change":"2024-09-12T02:37:56.679320+0000","last_active":"2024-09-12T02:38:25.522890+0000","last_peered":"2024-09-12T02:38:25.522890+0000","last_clean":"2024-09-12T02:38:25.522890+0000","last_became_active":"2024-09-12T02:37:56.678956+0000","last_became_peered":"2024-09-12T02:37:56.678956+0000","last_unstale":"2024-09-12T02:38:25.522890+0000","last_undegraded":"2024-09-12T02:38:25.522890+0000","last_fullsized":"2024-09-12T02:38:25.522890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:48.238065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669916+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:37:56.669916+0000","last_peered":"2024-09-12T02:37:56.669916+0000","last_clean":"2024-09-12T02:37:56.669916+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:37:56.669916+0000","last_undegraded":"2024-09-12T02:37:56.669916+0000","last_fullsized":"2024-09-12T02:37:56.669916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542029+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:38:25.542029+0000","last_peered":"2024-09-12T02:38:25.542029+0000","last_clean":"2024-09-12T02:38:25.542029+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:38:25.542029+0000","last_undegraded":"2024-09-12T02:38:25.542029+0000","last_fullsized":"2024-09-12T02:38:25.542029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:33.066097+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:38:33.066097+0000","last_peered":"2024-09-12T02:38:33.066097+0000","last_clean":"2024-09-12T02:38:33.066097+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:38:33.066097+0000","last_undegraded":"2024-09-12T02:38:33.066097+0000","last_fullsized":"2024-09-12T02:38:33.066097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.541072+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:38:25.541072+0000","last_peered":"2024-09-12T02:38:25.541072+0000","last_clean":"2024-09-12T02:38:25.541072+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:38:25.541072+0000","last_undegraded":"2024-09-12T02:38:25.541072+0000","last_fullsized":"2024-09-12T02:38:25.541072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.692441+0000","last_change":"2024-09-12T02:37:56.692441+0000","last_active":"2024-09-12T02:37:56.692441+0000","last_peered":"2024-09-12T02:37:56.692441+0000","last_clean":"2024-09-12T02:37:56.692441+0000","last_became_active":"2024-09-12T02:37:56.676982+0000","last_became_peered":"2024-09-12T02:37:56.676982+0000","last_unstale":"2024-09-12T02:37:56.692441+0000","last_undegraded":"2024-09-12T02:37:56.692441+0000","last_fullsized":"2024-09-12T02:37:56.692441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.324488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545588+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:38:25.545588+0000","last_peered":"2024-09-12T02:38:25.545588+0000","last_clean":"2024-09-12T02:38:25.545588+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:38:25.545588+0000","last_undegraded":"2024-09-12T02:38:25.545588+0000","last_fullsized":"2024-09-12T02:38:25.545588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676260+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:37:56.676260+0000","last_peered":"2024-09-12T02:37:56.676260+0000","last_clean":"2024-09-12T02:37:56.676260+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:37:56.676260+0000","last_undegraded":"2024-09-12T02:37:56.676260+0000","last_fullsized":"2024-09-12T02:37:56.676260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524802+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:38:25.524802+0000","last_peered":"2024-09-12T02:38:25.524802+0000","last_clean":"2024-09-12T02:38:25.524802+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:38:25.524802+0000","last_undegraded":"2024-09-12T02:38:25.524802+0000","last_fullsized":"2024-09-12T02:38:25.524802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669147+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.669147+0000","last_peered":"2024-09-12T02:37:56.669147+0000","last_clean":"2024-09-12T02:37:56.669147+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:37:56.669147+0000","last_undegraded":"2024-09-12T02:37:56.669147+0000","last_fullsized":"2024-09-12T02:37:56.669147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542172+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:38:25.542172+0000","last_peered":"2024-09-12T02:38:25.542172+0000","last_clean":"2024-09-12T02:38:25.542172+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:38:25.542172+0000","last_undegraded":"2024-09-12T02:38:25.542172+0000","last_fullsized":"2024-09-12T02:38:25.542172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670750+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:37:56.670750+0000","last_peered":"2024-09-12T02:37:56.670750+0000","last_clean":"2024-09-12T02:37:56.670750+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:37:56.670750+0000","last_undegraded":"2024-09-12T02:37:56.670750+0000","last_fullsized":"2024-09-12T02:37:56.670750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539778+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:38:25.539778+0000","last_peered":"2024-09-12T02:38:25.539778+0000","last_clean":"2024-09-12T02:38:25.539778+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:38:25.539778+0000","last_undegraded":"2024-09-12T02:38:25.539778+0000","last_fullsized":"2024-09-12T02:38:25.539778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677938+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:37:56.677938+0000","last_peered":"2024-09-12T02:37:56.677938+0000","last_clean":"2024-09-12T02:37:56.677938+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:37:56.677938+0000","last_undegraded":"2024-09-12T02:37:56.677938+0000","last_fullsized":"2024-09-12T02:37:56.677938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549470+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:38:25.549470+0000","last_peered":"2024-09-12T02:38:25.549470+0000","last_clean":"2024-09-12T02:38:25.549470+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:38:25.549470+0000","last_undegraded":"2024-09-12T02:38:25.549470+0000","last_fullsized":"2024-09-12T02:38:25.549470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678427+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:37:56.678427+0000","last_peered":"2024-09-12T02:37:56.678427+0000","last_clean":"2024-09-12T02:37:56.678427+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:37:56.678427+0000","last_undegraded":"2024-09-12T02:37:56.678427+0000","last_fullsized":"2024-09-12T02:37:56.678427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793192+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:37:56.793192+0000","last_peered":"2024-09-12T02:37:56.793192+0000","last_clean":"2024-09-12T02:37:56.793192+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:37:56.793192+0000","last_undegraded":"2024-09-12T02:37:56.793192+0000","last_fullsized":"2024-09-12T02:37:56.793192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550428+0000","last_change":"2024-09-12T02:37:56.674162+0000","last_active":"2024-09-12T02:38:25.550428+0000","last_peered":"2024-09-12T02:38:25.550428+0000","last_clean":"2024-09-12T02:38:25.550428+0000","last_became_active":"2024-09-12T02:37:56.673786+0000","last_became_peered":"2024-09-12T02:37:56.673786+0000","last_unstale":"2024-09-12T02:38:25.550428+0000","last_undegraded":"2024-09-12T02:38:25.550428+0000","last_fullsized":"2024-09-12T02:38:25.550428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:46.189919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678298+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.678298+0000","last_peered":"2024-09-12T02:37:56.678298+0000","last_clean":"2024-09-12T02:37:56.678298+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:37:56.678298+0000","last_undegraded":"2024-09-12T02:37:56.678298+0000","last_fullsized":"2024-09-12T02:37:56.678298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.523493+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:38:25.523493+0000","last_peered":"2024-09-12T02:38:25.523493+0000","last_clean":"2024-09-12T02:38:25.523493+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:38:25.523493+0000","last_undegraded":"2024-09-12T02:38:25.523493+0000","last_fullsized":"2024-09-12T02:38:25.523493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":118,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:29.058793+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:38:29.058793+0000","last_peered":"2024-09-12T02:38:29.058793+0000","last_clean":"2024-09-12T02:38:29.058793+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:38:29.058793+0000","last_undegraded":"2024-09-12T02:38:29.058793+0000","last_fullsized":"2024-09-12T02:38:29.058793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536855+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:38:25.536855+0000","last_peered":"2024-09-12T02:38:25.536855+0000","last_clean":"2024-09-12T02:38:25.536855+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:38:25.536855+0000","last_undegraded":"2024-09-12T02:38:25.536855+0000","last_fullsized":"2024-09-12T02:38:25.536855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678486+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:37:56.678486+0000","last_peered":"2024-09-12T02:37:56.678486+0000","last_clean":"2024-09-12T02:37:56.678486+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:37:56.678486+0000","last_undegraded":"2024-09-12T02:37:56.678486+0000","last_fullsized":"2024-09-12T02:37:56.678486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535307+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:38:25.535307+0000","last_peered":"2024-09-12T02:38:25.535307+0000","last_clean":"2024-09-12T02:38:25.535307+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:38:25.535307+0000","last_undegraded":"2024-09-12T02:38:25.535307+0000","last_fullsized":"2024-09-12T02:38:25.535307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672207+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:37:56.672207+0000","last_peered":"2024-09-12T02:37:56.672207+0000","last_clean":"2024-09-12T02:37:56.672207+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:37:56.672207+0000","last_undegraded":"2024-09-12T02:37:56.672207+0000","last_fullsized":"2024-09-12T02:37:56.672207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535973+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:38:25.535973+0000","last_peered":"2024-09-12T02:38:25.535973+0000","last_clean":"2024-09-12T02:38:25.535973+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:38:25.535973+0000","last_undegraded":"2024-09-12T02:38:25.535973+0000","last_fullsized":"2024-09-12T02:38:25.535973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.695307+0000","last_change":"2024-09-12T02:37:56.694966+0000","last_active":"2024-09-12T02:37:56.695307+0000","last_peered":"2024-09-12T02:37:56.695307+0000","last_clean":"2024-09-12T02:37:56.695307+0000","last_became_active":"2024-09-12T02:37:56.674729+0000","last_became_peered":"2024-09-12T02:37:56.674729+0000","last_unstale":"2024-09-12T02:37:56.695307+0000","last_undegraded":"2024-09-12T02:37:56.695307+0000","last_fullsized":"2024-09-12T02:37:56.695307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:51.673970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.528703+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:38:25.528703+0000","last_peered":"2024-09-12T02:38:25.528703+0000","last_clean":"2024-09-12T02:38:25.528703+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:38:25.528703+0000","last_undegraded":"2024-09-12T02:38:25.528703+0000","last_fullsized":"2024-09-12T02:38:25.528703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'11","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672284+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:37:56.672284+0000","last_peered":"2024-09-12T02:37:56.672284+0000","last_clean":"2024-09-12T02:37:56.672284+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:37:56.672284+0000","last_undegraded":"2024-09-12T02:37:56.672284+0000","last_fullsized":"2024-09-12T02:37:56.672284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533951+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:38:25.533951+0000","last_peered":"2024-09-12T02:38:25.533951+0000","last_clean":"2024-09-12T02:38:25.533951+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:38:25.533951+0000","last_undegraded":"2024-09-12T02:38:25.533951+0000","last_fullsized":"2024-09-12T02:38:25.533951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793081+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:37:56.793081+0000","last_peered":"2024-09-12T02:37:56.793081+0000","last_clean":"2024-09-12T02:37:56.793081+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:37:56.793081+0000","last_undegraded":"2024-09-12T02:37:56.793081+0000","last_fullsized":"2024-09-12T02:37:56.793081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540129+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:38:25.540129+0000","last_peered":"2024-09-12T02:38:25.540129+0000","last_clean":"2024-09-12T02:38:25.540129+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:38:25.540129+0000","last_undegraded":"2024-09-12T02:38:25.540129+0000","last_fullsized":"2024-09-12T02:38:25.540129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669652+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:37:56.669652+0000","last_peered":"2024-09-12T02:37:56.669652+0000","last_clean":"2024-09-12T02:37:56.669652+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:37:56.669652+0000","last_undegraded":"2024-09-12T02:37:56.669652+0000","last_fullsized":"2024-09-12T02:37:56.669652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.500557+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:38:25.500557+0000","last_peered":"2024-09-12T02:38:25.500557+0000","last_clean":"2024-09-12T02:38:25.500557+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:38:25.500557+0000","last_undegraded":"2024-09-12T02:38:25.500557+0000","last_fullsized":"2024-09-12T02:38:25.500557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792234+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:37:56.792234+0000","last_peered":"2024-09-12T02:37:56.792234+0000","last_clean":"2024-09-12T02:37:56.792234+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:37:56.792234+0000","last_undegraded":"2024-09-12T02:37:56.792234+0000","last_fullsized":"2024-09-12T02:37:56.792234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538185+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:38:25.538185+0000","last_peered":"2024-09-12T02:38:25.538185+0000","last_clean":"2024-09-12T02:38:25.538185+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:38:25.538185+0000","last_undegraded":"2024-09-12T02:38:25.538185+0000","last_fullsized":"2024-09-12T02:38:25.538185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677722+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:37:56.677722+0000","last_peered":"2024-09-12T02:37:56.677722+0000","last_clean":"2024-09-12T02:37:56.677722+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:37:56.677722+0000","last_undegraded":"2024-09-12T02:37:56.677722+0000","last_fullsized":"2024-09-12T02:37:56.677722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532431+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:38:25.532431+0000","last_peered":"2024-09-12T02:38:25.532431+0000","last_clean":"2024-09-12T02:38:25.532431+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:38:25.532431+0000","last_undegraded":"2024-09-12T02:38:25.532431+0000","last_fullsized":"2024-09-12T02:38:25.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.797632+0000","last_change":"2024-09-12T02:37:56.797632+0000","last_active":"2024-09-12T02:37:56.797632+0000","last_peered":"2024-09-12T02:37:56.797632+0000","last_clean":"2024-09-12T02:37:56.797632+0000","last_became_active":"2024-09-12T02:37:56.794171+0000","last_became_peered":"2024-09-12T02:37:56.794171+0000","last_unstale":"2024-09-12T02:37:56.797632+0000","last_undegraded":"2024-09-12T02:37:56.797632+0000","last_fullsized":"2024-09-12T02:37:56.797632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:34.468518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550218+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:38:25.550218+0000","last_peered":"2024-09-12T02:38:25.550218+0000","last_clean":"2024-09-12T02:38:25.550218+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:38:25.550218+0000","last_undegraded":"2024-09-12T02:38:25.550218+0000","last_fullsized":"2024-09-12T02:38:25.550218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549244+0000","last_change":"2024-09-12T02:37:56.680042+0000","last_active":"2024-09-12T02:38:25.549244+0000","last_peered":"2024-09-12T02:38:25.549244+0000","last_clean":"2024-09-12T02:38:25.549244+0000","last_became_active":"2024-09-12T02:37:56.679618+0000","last_became_peered":"2024-09-12T02:37:56.679618+0000","last_unstale":"2024-09-12T02:38:25.549244+0000","last_undegraded":"2024-09-12T02:38:25.549244+0000","last_fullsized":"2024-09-12T02:38:25.549244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:53.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.682015+0000","last_change":"2024-09-12T02:37:56.681606+0000","last_active":"2024-09-12T02:37:56.682015+0000","last_peered":"2024-09-12T02:37:56.682015+0000","last_clean":"2024-09-12T02:37:56.682015+0000","last_became_active":"2024-09-12T02:37:56.674499+0000","last_became_peered":"2024-09-12T02:37:56.674499+0000","last_unstale":"2024-09-12T02:37:56.682015+0000","last_undegraded":"2024-09-12T02:37:56.682015+0000","last_fullsized":"2024-09-12T02:37:56.682015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:02.803838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550254+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:38:25.550254+0000","last_peered":"2024-09-12T02:38:25.550254+0000","last_clean":"2024-09-12T02:38:25.550254+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:38:25.550254+0000","last_undegraded":"2024-09-12T02:38:25.550254+0000","last_fullsized":"2024-09-12T02:38:25.550254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676382+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:37:56.676382+0000","last_peered":"2024-09-12T02:37:56.676382+0000","last_clean":"2024-09-12T02:37:56.676382+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:37:56.676382+0000","last_undegraded":"2024-09-12T02:37:56.676382+0000","last_fullsized":"2024-09-12T02:37:56.676382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549684+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:38:25.549684+0000","last_peered":"2024-09-12T02:38:25.549684+0000","last_clean":"2024-09-12T02:38:25.549684+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:38:25.549684+0000","last_undegraded":"2024-09-12T02:38:25.549684+0000","last_fullsized":"2024-09-12T02:38:25.549684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792826+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:56.792826+0000","last_peered":"2024-09-12T02:37:56.792826+0000","last_clean":"2024-09-12T02:37:56.792826+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:37:56.792826+0000","last_undegraded":"2024-09-12T02:37:56.792826+0000","last_fullsized":"2024-09-12T02:37:56.792826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524640+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:38:25.524640+0000","last_peered":"2024-09-12T02:38:25.524640+0000","last_clean":"2024-09-12T02:38:25.524640+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:38:25.524640+0000","last_undegraded":"2024-09-12T02:38:25.524640+0000","last_fullsized":"2024-09-12T02:38:25.524640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672690+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:37:56.672690+0000","last_peered":"2024-09-12T02:37:56.672690+0000","last_clean":"2024-09-12T02:37:56.672690+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:37:56.672690+0000","last_undegraded":"2024-09-12T02:37:56.672690+0000","last_fullsized":"2024-09-12T02:37:56.672690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64858,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":592,"num_read_kb":362,"num_write":171,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":205628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514530,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442983,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1094455,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":443197,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443095,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1035190,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442586,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1035182,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":443416,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":442897,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":504780,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":508578,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":443857,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:38:36.709 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T02:38:36.709 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.844+0000 7f709c4a6640 1 -- 172.21.15.100:0/1976172650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70941025c0 msgr2=0x7f7094108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.844+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1976172650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70941025c0 0x7f7094108e50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f708c009900 tx=0x7f708c02a410 comp rx=0 tx=0).stop 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.844+0000 7f709c4a6640 1 -- 172.21.15.100:0/1976172650 shutdown_connections 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.844+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1976172650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70941025c0 0x7f7094108e50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.844+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1976172650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094101c00 0x7f7094102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.844+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1976172650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7094100a10 0x7f7094100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.844+0000 7f709c4a6640 1 -- 172.21.15.100:0/1976172650 >> 172.21.15.100:0/1976172650 conn(0x7f70940fc170 msgr2=0x7f70940fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 -- 172.21.15.100:0/1976172650 shutdown_connections 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 -- 172.21.15.100:0/1976172650 wait complete. 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 Processor -- start 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 -- start start 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7094100a10 0x7f7094197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7094101c00 0x7f7094198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70941025c0 0x7f709419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f709410d7e0 con 0x7f7094101c00 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f709410d660 con 0x7f70941025c0 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709c4a6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f709410d960 con 0x7f7094100a10 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f7099a41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7094101c00 0x7f7094198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f7099a41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7094101c00 0x7f7094198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39434/0 (socket says 172.21.15.100:39434) 2024-09-12T02:38:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f7099a41640 1 -- 172.21.15.100:0/1298377400 learned_addr learned my addr 172.21.15.100:0/1298377400 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709a242640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7094100a10 0x7f7094197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.845+0000 7f709aa43640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70941025c0 0x7f709419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f7099a41640 1 -- 172.21.15.100:0/1298377400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7094100a10 msgr2=0x7f7094197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f7099a41640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7094100a10 0x7f7094197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f7099a41640 1 -- 172.21.15.100:0/1298377400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70941025c0 msgr2=0x7f709419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f7099a41640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70941025c0 0x7f709419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f7099a41640 1 -- 172.21.15.100:0/1298377400 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709419fa20 con 0x7f7094101c00 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f709a242640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7094100a10 0x7f7094197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f709aa43640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70941025c0 0x7f709419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f7099a41640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7094101c00 0x7f7094198340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f708800d950 tx=0x7f708800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f70937fe640 1 -- 172.21.15.100:0/1298377400 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088017070 con 0x7f7094101c00 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f70937fe640 1 -- 172.21.15.100:0/1298377400 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7088009c30 con 0x7f7094101c00 2024-09-12T02:38:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709419fd10 con 0x7f7094101c00 2024-09-12T02:38:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f70937fe640 1 -- 172.21.15.100:0/1298377400 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708800f6b0 con 0x7f7094101c00 2024-09-12T02:38:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.846+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941a0250 con 0x7f7094101c00 2024-09-12T02:38:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.847+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7094107e00 con 0x7f7094101c00 2024-09-12T02:38:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.848+0000 7f70937fe640 1 -- 172.21.15.100:0/1298377400 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f70880109d0 con 0x7f7094101c00 2024-09-12T02:38:36.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.849+0000 7f70937fe640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f707c0a2ca0 0x7f707c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:36.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.849+0000 7f709a242640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f707c0a2ca0 0x7f707c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:36.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.849+0000 7f70937fe640 1 -- 172.21.15.100:0/1298377400 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f70880cf140 con 0x7f7094101c00 2024-09-12T02:38:36.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.849+0000 7f709a242640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f707c0a2ca0 0x7f707c0a5160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7094101a60 tx=0x7f7084009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:36.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:36.852+0000 7f70937fe640 1 -- 172.21.15.100:0/1298377400 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7088009de0 con 0x7f7094101c00 2024-09-12T02:38:36.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:36 smithi117 ceph-mon[34898]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T02:38:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:36 smithi189 ceph-mon[35196]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T02:38:37.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.014+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7094062630 con 0x7f707c0a2ca0 2024-09-12T02:38:37.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.020+0000 7f70937fe640 1 -- 172.21.15.100:0/1298377400 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259085 (secure 0 0 0) 0x7f7094062630 con 0x7f707c0a2ca0 2024-09-12T02:38:37.023 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:38:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f707c0a2ca0 msgr2=0x7f707c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f707c0a2ca0 0x7f707c0a5160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7094101a60 tx=0x7f7084009520 comp rx=0 tx=0).stop 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7094101c00 msgr2=0x7f7094198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7094101c00 0x7f7094198340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f708800d950 tx=0x7f708800de10 comp rx=0 tx=0).stop 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 shutdown_connections 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f707c0a2ca0 0x7f707c0a5160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70941025c0 0x7f709419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7094101c00 0x7f7094198340 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 --2- 172.21.15.100:0/1298377400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7094100a10 0x7f7094197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 >> 172.21.15.100:0/1298377400 conn(0x7f70940fc170 msgr2=0x7f7094104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 shutdown_connections 2024-09-12T02:38:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.023+0000 7f709c4a6640 1 -- 172.21.15.100:0/1298377400 wait complete. 2024-09-12T02:38:37.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:36 smithi100 ceph-mon[31390]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T02:38:37.034 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-12T02:38:35.548254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655460,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":718,"num_read_kb":471,"num_write":354,"num_write_kb":3055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":784,"ondisk_log_size":784,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356276,"kb_used_data":11188,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585548,"statfs":{"total":1151940427776,"available":1151575601152,"internally_reserved":0,"allocated":11456512,"data_stored":7280216,"data_compressed":176832,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1091,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":34,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002617"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538892+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:38:25.538892+0000","last_peered":"2024-09-12T02:38:25.538892+0000","last_clean":"2024-09-12T02:38:25.538892+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:38:25.538892+0000","last_undegraded":"2024-09-12T02:38:25.538892+0000","last_fullsized":"2024-09-12T02:38:25.538892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537706+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:38:25.537706+0000","last_peered":"2024-09-12T02:38:25.537706+0000","last_clean":"2024-09-12T02:38:25.537706+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:38:25.537706+0000","last_undegraded":"2024-09-12T02:38:25.537706+0000","last_fullsized":"2024-09-12T02:38:25.537706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544892+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:38:25.544892+0000","last_peered":"2024-09-12T02:38:25.544892+0000","last_clean":"2024-09-12T02:38:25.544892+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:38:25.544892+0000","last_undegraded":"2024-09-12T02:38:25.544892+0000","last_fullsized":"2024-09-12T02:38:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526152+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:38:25.526152+0000","last_peered":"2024-09-12T02:38:25.526152+0000","last_clean":"2024-09-12T02:38:25.526152+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:38:25.526152+0000","last_undegraded":"2024-09-12T02:38:25.526152+0000","last_fullsized":"2024-09-12T02:38:25.526152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526205+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:38:25.526205+0000","last_peered":"2024-09-12T02:38:25.526205+0000","last_clean":"2024-09-12T02:38:25.526205+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:38:25.526205+0000","last_undegraded":"2024-09-12T02:38:25.526205+0000","last_fullsized":"2024-09-12T02:38:25.526205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536028+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:38:25.536028+0000","last_peered":"2024-09-12T02:38:25.536028+0000","last_clean":"2024-09-12T02:38:25.536028+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:38:25.536028+0000","last_undegraded":"2024-09-12T02:38:25.536028+0000","last_fullsized":"2024-09-12T02:38:25.536028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540044+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:38:25.540044+0000","last_peered":"2024-09-12T02:38:25.540044+0000","last_clean":"2024-09-12T02:38:25.540044+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:38:25.540044+0000","last_undegraded":"2024-09-12T02:38:25.540044+0000","last_fullsized":"2024-09-12T02:38:25.540044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533451+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:38:25.533451+0000","last_peered":"2024-09-12T02:38:25.533451+0000","last_clean":"2024-09-12T02:38:25.533451+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:38:25.533451+0000","last_undegraded":"2024-09-12T02:38:25.533451+0000","last_fullsized":"2024-09-12T02:38:25.533451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548353+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:38:25.548353+0000","last_peered":"2024-09-12T02:38:25.548353+0000","last_clean":"2024-09-12T02:38:25.548353+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:38:25.548353+0000","last_undegraded":"2024-09-12T02:38:25.548353+0000","last_fullsized":"2024-09-12T02:38:25.548353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540355+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:38:25.540355+0000","last_peered":"2024-09-12T02:38:25.540355+0000","last_clean":"2024-09-12T02:38:25.540355+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:38:25.540355+0000","last_undegraded":"2024-09-12T02:38:25.540355+0000","last_fullsized":"2024-09-12T02:38:25.540355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545641+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:38:25.545641+0000","last_peered":"2024-09-12T02:38:25.545641+0000","last_clean":"2024-09-12T02:38:25.545641+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:38:25.545641+0000","last_undegraded":"2024-09-12T02:38:25.545641+0000","last_fullsized":"2024-09-12T02:38:25.545641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524741+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:38:25.524741+0000","last_peered":"2024-09-12T02:38:25.524741+0000","last_clean":"2024-09-12T02:38:25.524741+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:38:25.524741+0000","last_undegraded":"2024-09-12T02:38:25.524741+0000","last_fullsized":"2024-09-12T02:38:25.524741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535897+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:38:25.535897+0000","last_peered":"2024-09-12T02:38:25.535897+0000","last_clean":"2024-09-12T02:38:25.535897+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:38:25.535897+0000","last_undegraded":"2024-09-12T02:38:25.535897+0000","last_fullsized":"2024-09-12T02:38:25.535897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538014+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:38:25.538014+0000","last_peered":"2024-09-12T02:38:25.538014+0000","last_clean":"2024-09-12T02:38:25.538014+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:38:25.538014+0000","last_undegraded":"2024-09-12T02:38:25.538014+0000","last_fullsized":"2024-09-12T02:38:25.538014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535913+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:38:25.535913+0000","last_peered":"2024-09-12T02:38:25.535913+0000","last_clean":"2024-09-12T02:38:25.535913+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:38:25.535913+0000","last_undegraded":"2024-09-12T02:38:25.535913+0000","last_fullsized":"2024-09-12T02:38:25.535913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549559+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:38:25.549559+0000","last_peered":"2024-09-12T02:38:25.549559+0000","last_clean":"2024-09-12T02:38:25.549559+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:38:25.549559+0000","last_undegraded":"2024-09-12T02:38:25.549559+0000","last_fullsized":"2024-09-12T02:38:25.549559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544656+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:38:25.544656+0000","last_peered":"2024-09-12T02:38:25.544656+0000","last_clean":"2024-09-12T02:38:25.544656+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:38:25.544656+0000","last_undegraded":"2024-09-12T02:38:25.544656+0000","last_fullsized":"2024-09-12T02:38:25.544656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550740+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:38:25.550740+0000","last_peered":"2024-09-12T02:38:25.550740+0000","last_clean":"2024-09-12T02:38:25.550740+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:38:25.550740+0000","last_undegraded":"2024-09-12T02:38:25.550740+0000","last_fullsized":"2024-09-12T02:38:25.550740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537295+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:38:25.537295+0000","last_peered":"2024-09-12T02:38:25.537295+0000","last_clean":"2024-09-12T02:38:25.537295+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:38:25.537295+0000","last_undegraded":"2024-09-12T02:38:25.537295+0000","last_fullsized":"2024-09-12T02:38:25.537295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.531643+0000","last_change":"2024-09-12T02:37:56.677503+0000","last_active":"2024-09-12T02:38:25.531643+0000","last_peered":"2024-09-12T02:38:25.531643+0000","last_clean":"2024-09-12T02:38:25.531643+0000","last_became_active":"2024-09-12T02:37:56.677082+0000","last_became_peered":"2024-09-12T02:37:56.677082+0000","last_unstale":"2024-09-12T02:38:25.531643+0000","last_undegraded":"2024-09-12T02:38:25.531643+0000","last_fullsized":"2024-09-12T02:38:25.531643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:10.331298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542061+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:38:25.542061+0000","last_peered":"2024-09-12T02:38:25.542061+0000","last_clean":"2024-09-12T02:38:25.542061+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:38:25.542061+0000","last_undegraded":"2024-09-12T02:38:25.542061+0000","last_fullsized":"2024-09-12T02:38:25.542061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549255+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:38:25.549255+0000","last_peered":"2024-09-12T02:38:25.549255+0000","last_clean":"2024-09-12T02:38:25.549255+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:38:25.549255+0000","last_undegraded":"2024-09-12T02:38:25.549255+0000","last_fullsized":"2024-09-12T02:38:25.549255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532406+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:38:25.532406+0000","last_peered":"2024-09-12T02:38:25.532406+0000","last_clean":"2024-09-12T02:38:25.532406+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:38:25.532406+0000","last_undegraded":"2024-09-12T02:38:25.532406+0000","last_fullsized":"2024-09-12T02:38:25.532406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537351+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:38:25.537351+0000","last_peered":"2024-09-12T02:38:25.537351+0000","last_clean":"2024-09-12T02:38:25.537351+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:38:25.537351+0000","last_undegraded":"2024-09-12T02:38:25.537351+0000","last_fullsized":"2024-09-12T02:38:25.537351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524406+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:38:25.524406+0000","last_peered":"2024-09-12T02:38:25.524406+0000","last_clean":"2024-09-12T02:38:25.524406+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:38:25.524406+0000","last_undegraded":"2024-09-12T02:38:25.524406+0000","last_fullsized":"2024-09-12T02:38:25.524406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.551180+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:38:25.551180+0000","last_peered":"2024-09-12T02:38:25.551180+0000","last_clean":"2024-09-12T02:38:25.551180+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:38:25.551180+0000","last_undegraded":"2024-09-12T02:38:25.551180+0000","last_fullsized":"2024-09-12T02:38:25.551180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.530680+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:38:25.530680+0000","last_peered":"2024-09-12T02:38:25.530680+0000","last_clean":"2024-09-12T02:38:25.530680+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:38:25.530680+0000","last_undegraded":"2024-09-12T02:38:25.530680+0000","last_fullsized":"2024-09-12T02:38:25.530680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540212+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:38:25.540212+0000","last_peered":"2024-09-12T02:38:25.540212+0000","last_clean":"2024-09-12T02:38:25.540212+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:38:25.540212+0000","last_undegraded":"2024-09-12T02:38:25.540212+0000","last_fullsized":"2024-09-12T02:38:25.540212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537408+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:38:25.537408+0000","last_peered":"2024-09-12T02:38:25.537408+0000","last_clean":"2024-09-12T02:38:25.537408+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:38:25.537408+0000","last_undegraded":"2024-09-12T02:38:25.537408+0000","last_fullsized":"2024-09-12T02:38:25.537408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.534838+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:38:25.534838+0000","last_peered":"2024-09-12T02:38:25.534838+0000","last_clean":"2024-09-12T02:38:25.534838+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:38:25.534838+0000","last_undegraded":"2024-09-12T02:38:25.534838+0000","last_fullsized":"2024-09-12T02:38:25.534838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538471+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:38:25.538471+0000","last_peered":"2024-09-12T02:38:25.538471+0000","last_clean":"2024-09-12T02:38:25.538471+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:38:25.538471+0000","last_undegraded":"2024-09-12T02:38:25.538471+0000","last_fullsized":"2024-09-12T02:38:25.538471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527368+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:38:25.527368+0000","last_peered":"2024-09-12T02:38:25.527368+0000","last_clean":"2024-09-12T02:38:25.527368+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:38:25.527368+0000","last_undegraded":"2024-09-12T02:38:25.527368+0000","last_fullsized":"2024-09-12T02:38:25.527368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529505+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:38:25.529505+0000","last_peered":"2024-09-12T02:38:25.529505+0000","last_clean":"2024-09-12T02:38:25.529505+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:38:25.529505+0000","last_undegraded":"2024-09-12T02:38:25.529505+0000","last_fullsized":"2024-09-12T02:38:25.529505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:32.064443+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:38:32.064443+0000","last_peered":"2024-09-12T02:38:32.064443+0000","last_clean":"2024-09-12T02:38:32.064443+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:38:32.064443+0000","last_undegraded":"2024-09-12T02:38:32.064443+0000","last_fullsized":"2024-09-12T02:38:32.064443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539985+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:38:25.539985+0000","last_peered":"2024-09-12T02:38:25.539985+0000","last_clean":"2024-09-12T02:38:25.539985+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:38:25.539985+0000","last_undegraded":"2024-09-12T02:38:25.539985+0000","last_fullsized":"2024-09-12T02:38:25.539985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.755048+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:37:56.755048+0000","last_peered":"2024-09-12T02:37:56.755048+0000","last_clean":"2024-09-12T02:37:56.755048+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:37:56.755048+0000","last_undegraded":"2024-09-12T02:37:56.755048+0000","last_fullsized":"2024-09-12T02:37:56.755048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.668877+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:37:56.668877+0000","last_peered":"2024-09-12T02:37:56.668877+0000","last_clean":"2024-09-12T02:37:56.668877+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:37:56.668877+0000","last_undegraded":"2024-09-12T02:37:56.668877+0000","last_fullsized":"2024-09-12T02:37:56.668877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527196+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:38:25.527196+0000","last_peered":"2024-09-12T02:38:25.527196+0000","last_clean":"2024-09-12T02:38:25.527196+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:38:25.527196+0000","last_undegraded":"2024-09-12T02:38:25.527196+0000","last_fullsized":"2024-09-12T02:38:25.527196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670102+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:37:56.670102+0000","last_peered":"2024-09-12T02:37:56.670102+0000","last_clean":"2024-09-12T02:37:56.670102+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:37:56.670102+0000","last_undegraded":"2024-09-12T02:37:56.670102+0000","last_fullsized":"2024-09-12T02:37:56.670102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529360+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:38:25.529360+0000","last_peered":"2024-09-12T02:38:25.529360+0000","last_clean":"2024-09-12T02:38:25.529360+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:38:25.529360+0000","last_undegraded":"2024-09-12T02:38:25.529360+0000","last_fullsized":"2024-09-12T02:38:25.529360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":119,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:30.060812+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:38:30.060812+0000","last_peered":"2024-09-12T02:38:30.060812+0000","last_clean":"2024-09-12T02:38:30.060812+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:38:30.060812+0000","last_undegraded":"2024-09-12T02:38:30.060812+0000","last_fullsized":"2024-09-12T02:38:30.060812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548745+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:38:25.548745+0000","last_peered":"2024-09-12T02:38:25.548745+0000","last_clean":"2024-09-12T02:38:25.548745+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:38:25.548745+0000","last_undegraded":"2024-09-12T02:38:25.548745+0000","last_fullsized":"2024-09-12T02:38:25.548745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678605+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:37:56.678605+0000","last_peered":"2024-09-12T02:37:56.678605+0000","last_clean":"2024-09-12T02:37:56.678605+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:37:56.678605+0000","last_undegraded":"2024-09-12T02:37:56.678605+0000","last_fullsized":"2024-09-12T02:37:56.678605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538240+0000","last_change":"2024-09-12T02:37:56.677344+0000","last_active":"2024-09-12T02:38:25.538240+0000","last_peered":"2024-09-12T02:38:25.538240+0000","last_clean":"2024-09-12T02:38:25.538240+0000","last_became_active":"2024-09-12T02:37:56.676990+0000","last_became_peered":"2024-09-12T02:37:56.676990+0000","last_unstale":"2024-09-12T02:38:25.538240+0000","last_undegraded":"2024-09-12T02:38:25.538240+0000","last_fullsized":"2024-09-12T02:38:25.538240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,6],"acting":[0,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670363+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:37:56.670363+0000","last_peered":"2024-09-12T02:37:56.670363+0000","last_clean":"2024-09-12T02:37:56.670363+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:37:56.670363+0000","last_undegraded":"2024-09-12T02:37:56.670363+0000","last_fullsized":"2024-09-12T02:37:56.670363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550767+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:38:25.550767+0000","last_peered":"2024-09-12T02:38:25.550767+0000","last_clean":"2024-09-12T02:38:25.550767+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:38:25.550767+0000","last_undegraded":"2024-09-12T02:38:25.550767+0000","last_fullsized":"2024-09-12T02:38:25.550767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'30","reported_seq":247,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:31.061633+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:38:31.061633+0000","last_peered":"2024-09-12T02:38:31.061633+0000","last_clean":"2024-09-12T02:38:31.061633+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:38:31.061633+0000","last_undegraded":"2024-09-12T02:38:31.061633+0000","last_fullsized":"2024-09-12T02:38:31.061633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60013,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":156,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540622+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:38:25.540622+0000","last_peered":"2024-09-12T02:38:25.540622+0000","last_clean":"2024-09-12T02:38:25.540622+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:38:25.540622+0000","last_undegraded":"2024-09-12T02:38:25.540622+0000","last_fullsized":"2024-09-12T02:38:25.540622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678192+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:37:56.678192+0000","last_peered":"2024-09-12T02:37:56.678192+0000","last_clean":"2024-09-12T02:37:56.678192+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:37:56.678192+0000","last_undegraded":"2024-09-12T02:37:56.678192+0000","last_fullsized":"2024-09-12T02:37:56.678192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.522890+0000","last_change":"2024-09-12T02:37:56.679320+0000","last_active":"2024-09-12T02:38:25.522890+0000","last_peered":"2024-09-12T02:38:25.522890+0000","last_clean":"2024-09-12T02:38:25.522890+0000","last_became_active":"2024-09-12T02:37:56.678956+0000","last_became_peered":"2024-09-12T02:37:56.678956+0000","last_unstale":"2024-09-12T02:38:25.522890+0000","last_undegraded":"2024-09-12T02:38:25.522890+0000","last_fullsized":"2024-09-12T02:38:25.522890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:48.238065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669916+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:37:56.669916+0000","last_peered":"2024-09-12T02:37:56.669916+0000","last_clean":"2024-09-12T02:37:56.669916+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:37:56.669916+0000","last_undegraded":"2024-09-12T02:37:56.669916+0000","last_fullsized":"2024-09-12T02:37:56.669916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542029+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:38:25.542029+0000","last_peered":"2024-09-12T02:38:25.542029+0000","last_clean":"2024-09-12T02:38:25.542029+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:38:25.542029+0000","last_undegraded":"2024-09-12T02:38:25.542029+0000","last_fullsized":"2024-09-12T02:38:25.542029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:33.066097+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:38:33.066097+0000","last_peered":"2024-09-12T02:38:33.066097+0000","last_clean":"2024-09-12T02:38:33.066097+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:38:33.066097+0000","last_undegraded":"2024-09-12T02:38:33.066097+0000","last_fullsized":"2024-09-12T02:38:33.066097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.541072+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:38:25.541072+0000","last_peered":"2024-09-12T02:38:25.541072+0000","last_clean":"2024-09-12T02:38:25.541072+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:38:25.541072+0000","last_undegraded":"2024-09-12T02:38:25.541072+0000","last_fullsized":"2024-09-12T02:38:25.541072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.692441+0000","last_change":"2024-09-12T02:37:56.692441+0000","last_active":"2024-09-12T02:37:56.692441+0000","last_peered":"2024-09-12T02:37:56.692441+0000","last_clean":"2024-09-12T02:37:56.692441+0000","last_became_active":"2024-09-12T02:37:56.676982+0000","last_became_peered":"2024-09-12T02:37:56.676982+0000","last_unstale":"2024-09-12T02:37:56.692441+0000","last_undegraded":"2024-09-12T02:37:56.692441+0000","last_fullsized":"2024-09-12T02:37:56.692441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.324488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545588+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:38:25.545588+0000","last_peered":"2024-09-12T02:38:25.545588+0000","last_clean":"2024-09-12T02:38:25.545588+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:38:25.545588+0000","last_undegraded":"2024-09-12T02:38:25.545588+0000","last_fullsized":"2024-09-12T02:38:25.545588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676260+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:37:56.676260+0000","last_peered":"2024-09-12T02:37:56.676260+0000","last_clean":"2024-09-12T02:37:56.676260+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:37:56.676260+0000","last_undegraded":"2024-09-12T02:37:56.676260+0000","last_fullsized":"2024-09-12T02:37:56.676260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524802+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:38:25.524802+0000","last_peered":"2024-09-12T02:38:25.524802+0000","last_clean":"2024-09-12T02:38:25.524802+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:38:25.524802+0000","last_undegraded":"2024-09-12T02:38:25.524802+0000","last_fullsized":"2024-09-12T02:38:25.524802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669147+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.669147+0000","last_peered":"2024-09-12T02:37:56.669147+0000","last_clean":"2024-09-12T02:37:56.669147+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:37:56.669147+0000","last_undegraded":"2024-09-12T02:37:56.669147+0000","last_fullsized":"2024-09-12T02:37:56.669147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542172+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:38:25.542172+0000","last_peered":"2024-09-12T02:38:25.542172+0000","last_clean":"2024-09-12T02:38:25.542172+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:38:25.542172+0000","last_undegraded":"2024-09-12T02:38:25.542172+0000","last_fullsized":"2024-09-12T02:38:25.542172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670750+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:37:56.670750+0000","last_peered":"2024-09-12T02:37:56.670750+0000","last_clean":"2024-09-12T02:37:56.670750+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:37:56.670750+0000","last_undegraded":"2024-09-12T02:37:56.670750+0000","last_fullsized":"2024-09-12T02:37:56.670750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539778+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:38:25.539778+0000","last_peered":"2024-09-12T02:38:25.539778+0000","last_clean":"2024-09-12T02:38:25.539778+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:38:25.539778+0000","last_undegraded":"2024-09-12T02:38:25.539778+0000","last_fullsized":"2024-09-12T02:38:25.539778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677938+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:37:56.677938+0000","last_peered":"2024-09-12T02:37:56.677938+0000","last_clean":"2024-09-12T02:37:56.677938+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:37:56.677938+0000","last_undegraded":"2024-09-12T02:37:56.677938+0000","last_fullsized":"2024-09-12T02:37:56.677938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549470+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:38:25.549470+0000","last_peered":"2024-09-12T02:38:25.549470+0000","last_clean":"2024-09-12T02:38:25.549470+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:38:25.549470+0000","last_undegraded":"2024-09-12T02:38:25.549470+0000","last_fullsized":"2024-09-12T02:38:25.549470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678427+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:37:56.678427+0000","last_peered":"2024-09-12T02:37:56.678427+0000","last_clean":"2024-09-12T02:37:56.678427+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:37:56.678427+0000","last_undegraded":"2024-09-12T02:37:56.678427+0000","last_fullsized":"2024-09-12T02:37:56.678427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793192+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:37:56.793192+0000","last_peered":"2024-09-12T02:37:56.793192+0000","last_clean":"2024-09-12T02:37:56.793192+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:37:56.793192+0000","last_undegraded":"2024-09-12T02:37:56.793192+0000","last_fullsized":"2024-09-12T02:37:56.793192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550428+0000","last_change":"2024-09-12T02:37:56.674162+0000","last_active":"2024-09-12T02:38:25.550428+0000","last_peered":"2024-09-12T02:38:25.550428+0000","last_clean":"2024-09-12T02:38:25.550428+0000","last_became_active":"2024-09-12T02:37:56.673786+0000","last_became_peered":"2024-09-12T02:37:56.673786+0000","last_unstale":"2024-09-12T02:38:25.550428+0000","last_undegraded":"2024-09-12T02:38:25.550428+0000","last_fullsized":"2024-09-12T02:38:25.550428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:46.189919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678298+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.678298+0000","last_peered":"2024-09-12T02:37:56.678298+0000","last_clean":"2024-09-12T02:37:56.678298+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:37:56.678298+0000","last_undegraded":"2024-09-12T02:37:56.678298+0000","last_fullsized":"2024-09-12T02:37:56.678298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.523493+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:38:25.523493+0000","last_peered":"2024-09-12T02:38:25.523493+0000","last_clean":"2024-09-12T02:38:25.523493+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:38:25.523493+0000","last_undegraded":"2024-09-12T02:38:25.523493+0000","last_fullsized":"2024-09-12T02:38:25.523493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":118,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:29.058793+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:38:29.058793+0000","last_peered":"2024-09-12T02:38:29.058793+0000","last_clean":"2024-09-12T02:38:29.058793+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:38:29.058793+0000","last_undegraded":"2024-09-12T02:38:29.058793+0000","last_fullsized":"2024-09-12T02:38:29.058793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536855+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:38:25.536855+0000","last_peered":"2024-09-12T02:38:25.536855+0000","last_clean":"2024-09-12T02:38:25.536855+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:38:25.536855+0000","last_undegraded":"2024-09-12T02:38:25.536855+0000","last_fullsized":"2024-09-12T02:38:25.536855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678486+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:37:56.678486+0000","last_peered":"2024-09-12T02:37:56.678486+0000","last_clean":"2024-09-12T02:37:56.678486+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:37:56.678486+0000","last_undegraded":"2024-09-12T02:37:56.678486+0000","last_fullsized":"2024-09-12T02:37:56.678486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535307+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:38:25.535307+0000","last_peered":"2024-09-12T02:38:25.535307+0000","last_clean":"2024-09-12T02:38:25.535307+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:38:25.535307+0000","last_undegraded":"2024-09-12T02:38:25.535307+0000","last_fullsized":"2024-09-12T02:38:25.535307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672207+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:37:56.672207+0000","last_peered":"2024-09-12T02:37:56.672207+0000","last_clean":"2024-09-12T02:37:56.672207+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:37:56.672207+0000","last_undegraded":"2024-09-12T02:37:56.672207+0000","last_fullsized":"2024-09-12T02:37:56.672207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535973+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:38:25.535973+0000","last_peered":"2024-09-12T02:38:25.535973+0000","last_clean":"2024-09-12T02:38:25.535973+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:38:25.535973+0000","last_undegraded":"2024-09-12T02:38:25.535973+0000","last_fullsized":"2024-09-12T02:38:25.535973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.695307+0000","last_change":"2024-09-12T02:37:56.694966+0000","last_active":"2024-09-12T02:37:56.695307+0000","last_peered":"2024-09-12T02:37:56.695307+0000","last_clean":"2024-09-12T02:37:56.695307+0000","last_became_active":"2024-09-12T02:37:56.674729+0000","last_became_peered":"2024-09-12T02:37:56.674729+0000","last_unstale":"2024-09-12T02:37:56.695307+0000","last_undegraded":"2024-09-12T02:37:56.695307+0000","last_fullsized":"2024-09-12T02:37:56.695307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:51.673970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.528703+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:38:25.528703+0000","last_peered":"2024-09-12T02:38:25.528703+0000","last_clean":"2024-09-12T02:38:25.528703+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:38:25.528703+0000","last_undegraded":"2024-09-12T02:38:25.528703+0000","last_fullsized":"2024-09-12T02:38:25.528703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'11","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672284+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:37:56.672284+0000","last_peered":"2024-09-12T02:37:56.672284+0000","last_clean":"2024-09-12T02:37:56.672284+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:37:56.672284+0000","last_undegraded":"2024-09-12T02:37:56.672284+0000","last_fullsized":"2024-09-12T02:37:56.672284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533951+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:38:25.533951+0000","last_peered":"2024-09-12T02:38:25.533951+0000","last_clean":"2024-09-12T02:38:25.533951+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:38:25.533951+0000","last_undegraded":"2024-09-12T02:38:25.533951+0000","last_fullsized":"2024-09-12T02:38:25.533951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793081+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:37:56.793081+0000","last_peered":"2024-09-12T02:37:56.793081+0000","last_clean":"2024-09-12T02:37:56.793081+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:37:56.793081+0000","last_undegraded":"2024-09-12T02:37:56.793081+0000","last_fullsized":"2024-09-12T02:37:56.793081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540129+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:38:25.540129+0000","last_peered":"2024-09-12T02:38:25.540129+0000","last_clean":"2024-09-12T02:38:25.540129+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:38:25.540129+0000","last_undegraded":"2024-09-12T02:38:25.540129+0000","last_fullsized":"2024-09-12T02:38:25.540129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669652+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:37:56.669652+0000","last_peered":"2024-09-12T02:37:56.669652+0000","last_clean":"2024-09-12T02:37:56.669652+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:37:56.669652+0000","last_undegraded":"2024-09-12T02:37:56.669652+0000","last_fullsized":"2024-09-12T02:37:56.669652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.500557+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:38:25.500557+0000","last_peered":"2024-09-12T02:38:25.500557+0000","last_clean":"2024-09-12T02:38:25.500557+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:38:25.500557+0000","last_undegraded":"2024-09-12T02:38:25.500557+0000","last_fullsized":"2024-09-12T02:38:25.500557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792234+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:37:56.792234+0000","last_peered":"2024-09-12T02:37:56.792234+0000","last_clean":"2024-09-12T02:37:56.792234+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:37:56.792234+0000","last_undegraded":"2024-09-12T02:37:56.792234+0000","last_fullsized":"2024-09-12T02:37:56.792234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538185+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:38:25.538185+0000","last_peered":"2024-09-12T02:38:25.538185+0000","last_clean":"2024-09-12T02:38:25.538185+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:38:25.538185+0000","last_undegraded":"2024-09-12T02:38:25.538185+0000","last_fullsized":"2024-09-12T02:38:25.538185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677722+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:37:56.677722+0000","last_peered":"2024-09-12T02:37:56.677722+0000","last_clean":"2024-09-12T02:37:56.677722+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:37:56.677722+0000","last_undegraded":"2024-09-12T02:37:56.677722+0000","last_fullsized":"2024-09-12T02:37:56.677722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532431+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:38:25.532431+0000","last_peered":"2024-09-12T02:38:25.532431+0000","last_clean":"2024-09-12T02:38:25.532431+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:38:25.532431+0000","last_undegraded":"2024-09-12T02:38:25.532431+0000","last_fullsized":"2024-09-12T02:38:25.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.797632+0000","last_change":"2024-09-12T02:37:56.797632+0000","last_active":"2024-09-12T02:37:56.797632+0000","last_peered":"2024-09-12T02:37:56.797632+0000","last_clean":"2024-09-12T02:37:56.797632+0000","last_became_active":"2024-09-12T02:37:56.794171+0000","last_became_peered":"2024-09-12T02:37:56.794171+0000","last_unstale":"2024-09-12T02:37:56.797632+0000","last_undegraded":"2024-09-12T02:37:56.797632+0000","last_fullsized":"2024-09-12T02:37:56.797632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:34.468518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550218+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:38:25.550218+0000","last_peered":"2024-09-12T02:38:25.550218+0000","last_clean":"2024-09-12T02:38:25.550218+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:38:25.550218+0000","last_undegraded":"2024-09-12T02:38:25.550218+0000","last_fullsized":"2024-09-12T02:38:25.550218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549244+0000","last_change":"2024-09-12T02:37:56.680042+0000","last_active":"2024-09-12T02:38:25.549244+0000","last_peered":"2024-09-12T02:38:25.549244+0000","last_clean":"2024-09-12T02:38:25.549244+0000","last_became_active":"2024-09-12T02:37:56.679618+0000","last_became_peered":"2024-09-12T02:37:56.679618+0000","last_unstale":"2024-09-12T02:38:25.549244+0000","last_undegraded":"2024-09-12T02:38:25.549244+0000","last_fullsized":"2024-09-12T02:38:25.549244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:53.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.682015+0000","last_change":"2024-09-12T02:37:56.681606+0000","last_active":"2024-09-12T02:37:56.682015+0000","last_peered":"2024-09-12T02:37:56.682015+0000","last_clean":"2024-09-12T02:37:56.682015+0000","last_became_active":"2024-09-12T02:37:56.674499+0000","last_became_peered":"2024-09-12T02:37:56.674499+0000","last_unstale":"2024-09-12T02:37:56.682015+0000","last_undegraded":"2024-09-12T02:37:56.682015+0000","last_fullsized":"2024-09-12T02:37:56.682015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:02.803838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550254+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:38:25.550254+0000","last_peered":"2024-09-12T02:38:25.550254+0000","last_clean":"2024-09-12T02:38:25.550254+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:38:25.550254+0000","last_undegraded":"2024-09-12T02:38:25.550254+0000","last_fullsized":"2024-09-12T02:38:25.550254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676382+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:37:56.676382+0000","last_peered":"2024-09-12T02:37:56.676382+0000","last_clean":"2024-09-12T02:37:56.676382+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:37:56.676382+0000","last_undegraded":"2024-09-12T02:37:56.676382+0000","last_fullsized":"2024-09-12T02:37:56.676382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549684+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:38:25.549684+0000","last_peered":"2024-09-12T02:38:25.549684+0000","last_clean":"2024-09-12T02:38:25.549684+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:38:25.549684+0000","last_undegraded":"2024-09-12T02:38:25.549684+0000","last_fullsized":"2024-09-12T02:38:25.549684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792826+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:56.792826+0000","last_peered":"2024-09-12T02:37:56.792826+0000","last_clean":"2024-09-12T02:37:56.792826+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:37:56.792826+0000","last_undegraded":"2024-09-12T02:37:56.792826+0000","last_fullsized":"2024-09-12T02:37:56.792826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524640+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:38:25.524640+0000","last_peered":"2024-09-12T02:38:25.524640+0000","last_clean":"2024-09-12T02:38:25.524640+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:38:25.524640+0000","last_undegraded":"2024-09-12T02:38:25.524640+0000","last_fullsized":"2024-09-12T02:38:25.524640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672690+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:37:56.672690+0000","last_peered":"2024-09-12T02:37:56.672690+0000","last_clean":"2024-09-12T02:37:56.672690+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:37:56.672690+0000","last_undegraded":"2024-09-12T02:37:56.672690+0000","last_fullsized":"2024-09-12T02:37:56.672690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64858,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":592,"num_read_kb":362,"num_write":171,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":205628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514530,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442983,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1094455,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":443197,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443095,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1035190,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442586,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1035182,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":443416,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":442897,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":504780,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":508578,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":443857,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:38:37.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:37.320 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:37.709 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:37 smithi100 ceph-mon[31390]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:37.709 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:37 smithi100 ceph-mon[31390]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:37.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 -- 172.21.15.100:0/2203255372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6341027a0 msgr2=0x7fd6341067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:37.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/2203255372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6341027a0 0x7fd6341067f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd628009900 tx=0x7fd62802a410 comp rx=0 tx=0).stop 2024-09-12T02:38:37.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 -- 172.21.15.100:0/2203255372 shutdown_connections 2024-09-12T02:38:37.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/2203255372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd634106f20 0x7fd63410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/2203255372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6341027a0 0x7fd6341067f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/2203255372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd634101df0 0x7fd6341021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 -- 172.21.15.100:0/2203255372 >> 172.21.15.100:0/2203255372 conn(0x7fd6340fd8b0 msgr2=0x7fd6340ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 -- 172.21.15.100:0/2203255372 shutdown_connections 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.789+0000 7fd63a5b7640 1 -- 172.21.15.100:0/2203255372 wait complete. 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 Processor -- start 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 -- start start 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd634101df0 0x7fd6340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6341027a0 0x7fd634074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd634106f20 0x7fd634074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd634111f80 con 0x7fd634106f20 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd634111e00 con 0x7fd634101df0 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd63a5b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd634112100 con 0x7fd6341027a0 2024-09-12T02:38:37.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd634106f20 0x7fd634074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd634106f20 0x7fd634074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39442/0 (socket says 172.21.15.100:39442) 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 -- 172.21.15.100:0/1464464821 learned_addr learned my addr 172.21.15.100:0/1464464821 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd633fff640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd634101df0 0x7fd6340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd6337fe640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6341027a0 0x7fd634074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 -- 172.21.15.100:0/1464464821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6341027a0 msgr2=0x7fd634074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6341027a0 0x7fd634074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 -- 172.21.15.100:0/1464464821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd634101df0 msgr2=0x7fd6340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd634101df0 0x7fd6340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.790+0000 7fd638b54640 1 -- 172.21.15.100:0/1464464821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6341a6940 con 0x7fd634106f20 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.791+0000 7fd638b54640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd634106f20 0x7fd634074f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00eaa0 tx=0x7fd62c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.791+0000 7fd6317fa640 1 -- 172.21.15.100:0/1464464821 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00cdb0 con 0x7fd634106f20 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.791+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6341a6c30 con 0x7fd634106f20 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.791+0000 7fd6317fa640 1 -- 172.21.15.100:0/1464464821 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd62c005020 con 0x7fd634106f20 2024-09-12T02:38:37.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.791+0000 7fd6317fa640 1 -- 172.21.15.100:0/1464464821 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0116d0 con 0x7fd634106f20 2024-09-12T02:38:37.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.791+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6341a7170 con 0x7fd634106f20 2024-09-12T02:38:37.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.792+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6341021d0 con 0x7fd634106f20 2024-09-12T02:38:37.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.793+0000 7fd6317fa640 1 -- 172.21.15.100:0/1464464821 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fd62c0054d0 con 0x7fd634106f20 2024-09-12T02:38:37.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.794+0000 7fd6317fa640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd61c0a2c10 0x7fd61c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:37.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.794+0000 7fd6317fa640 1 -- 172.21.15.100:0/1464464821 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd62c0cf3c0 con 0x7fd634106f20 2024-09-12T02:38:37.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.794+0000 7fd633fff640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd61c0a2c10 0x7fd61c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:37.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.794+0000 7fd633fff640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd61c0a2c10 0x7fd61c0a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6240058c0 tx=0x7fd62400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:37.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:37.798+0000 7fd6317fa640 1 -- 172.21.15.100:0/1464464821 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd62c016030 con 0x7fd634106f20 2024-09-12T02:38:38.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.000+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd63410a160 con 0x7fd634106f20 2024-09-12T02:38:38.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.000+0000 7fd6317fa640 1 -- 172.21.15.100:0/1464464821 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7fd62c09c1b0 con 0x7fd634106f20 2024-09-12T02:38:38.001 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:38.001 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":25,"btime":"2024-09-12T02:38:32:651439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:32.370844+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:38:38.001 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 25 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.002+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd61c0a2c10 msgr2=0x7fd61c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.002+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd61c0a2c10 0x7fd61c0a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6240058c0 tx=0x7fd62400a250 comp rx=0 tx=0).stop 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.002+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd634106f20 msgr2=0x7fd634074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.002+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd634106f20 0x7fd634074f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00eaa0 tx=0x7fd62c00ef60 comp rx=0 tx=0).stop 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 shutdown_connections 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd61c0a2c10 0x7fd61c0a50d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd634106f20 0x7fd634074f70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6341027a0 0x7fd634074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 --2- 172.21.15.100:0/1464464821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd634101df0 0x7fd6340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 >> 172.21.15.100:0/1464464821 conn(0x7fd6340fd8b0 msgr2=0x7fd6340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 shutdown_connections 2024-09-12T02:38:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:38.003+0000 7fd63a5b7640 1 -- 172.21.15.100:0/1464464821 wait complete. 2024-09-12T02:38:38.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:37 smithi189 ceph-mon[35196]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:38.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:37 smithi189 ceph-mon[35196]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:38.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:37 smithi117 ceph-mon[34898]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:38.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:37 smithi117 ceph-mon[34898]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:38.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:38 smithi100 ceph-mon[31390]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:38.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:38 smithi100 ceph-mon[31390]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:38:38.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:38 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1464464821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:38.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:38:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:38 smithi189 ceph-mon[35196]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:39.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:38 smithi189 ceph-mon[35196]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:38:39.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:38 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1464464821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:38 smithi117 ceph-mon[34898]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:38 smithi117 ceph-mon[34898]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:38:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:38 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1464464821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:39.099 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:39.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 -- 172.21.15.100:0/2761181005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494102ef0 msgr2=0x7ff49410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:39.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2761181005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494102ef0 0x7ff49410da40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009900 tx=0x7ff48c02a480 comp rx=0 tx=0).stop 2024-09-12T02:38:39.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 -- 172.21.15.100:0/2761181005 shutdown_connections 2024-09-12T02:38:39.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2761181005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494102ef0 0x7ff49410da40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2761181005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff494102570 0x7ff4941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2761181005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff494100e20 0x7ff494101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 -- 172.21.15.100:0/2761181005 >> 172.21.15.100:0/2761181005 conn(0x7ff4940fc7d0 msgr2=0x7ff4940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 -- 172.21.15.100:0/2761181005 shutdown_connections 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.547+0000 7ff49c03c640 1 -- 172.21.15.100:0/2761181005 wait complete. 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 Processor -- start 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 -- start start 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494100e20 0x7ff4941992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff494102570 0x7ff4941997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff494102ef0 0x7ff4941a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff494110f80 con 0x7ff494100e20 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff494110e00 con 0x7ff494102ef0 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49c03c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff494111100 con 0x7ff494102570 2024-09-12T02:38:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff499dd8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494100e20 0x7ff4941992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff499dd8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494100e20 0x7ff4941992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39454/0 (socket says 172.21.15.100:39454) 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff499dd8640 1 -- 172.21.15.100:0/2884835349 learned_addr learned my addr 172.21.15.100:0/2884835349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff49a5d9640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff494102ef0 0x7ff4941a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.548+0000 7ff4995d7640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff494102570 0x7ff4941997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff499dd8640 1 -- 172.21.15.100:0/2884835349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff494102570 msgr2=0x7ff4941997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff499dd8640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff494102570 0x7ff4941997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff499dd8640 1 -- 172.21.15.100:0/2884835349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff494102ef0 msgr2=0x7ff4941a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff499dd8640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff494102ef0 0x7ff4941a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff499dd8640 1 -- 172.21.15.100:0/2884835349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4941a4870 con 0x7ff494100e20 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff499dd8640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494100e20 0x7ff4941992b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d950 tx=0x7ff48400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff492ffd640 1 -- 172.21.15.100:0/2884835349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484017030 con 0x7ff494100e20 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff492ffd640 1 -- 172.21.15.100:0/2884835349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff484004020 con 0x7ff494100e20 2024-09-12T02:38:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4941a4a40 con 0x7ff494100e20 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff492ffd640 1 -- 172.21.15.100:0/2884835349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840047a0 con 0x7ff494100e20 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.549+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4941a4f50 con 0x7ff494100e20 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.550+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff494101200 con 0x7ff494100e20 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.551+0000 7ff492ffd640 1 -- 172.21.15.100:0/2884835349 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7ff4840041d0 con 0x7ff494100e20 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.552+0000 7ff492ffd640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff47c0a2c10 0x7ff47c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.552+0000 7ff4995d7640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff47c0a2c10 0x7ff47c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.552+0000 7ff492ffd640 1 -- 172.21.15.100:0/2884835349 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff4840cebc0 con 0x7ff494100e20 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.552+0000 7ff4995d7640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff47c0a2c10 0x7ff47c0a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff49406aac0 tx=0x7ff488009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.556+0000 7ff492ffd640 1 -- 172.21.15.100:0/2884835349 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff48409b9b0 con 0x7ff494100e20 2024-09-12T02:38:39.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.725+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4941a5240 con 0x7ff494100e20 2024-09-12T02:38:39.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.726+0000 7ff492ffd640 1 -- 172.21.15.100:0/2884835349 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22871 (secure 0 0 0) 0x7ff484095e20 con 0x7ff494100e20 2024-09-12T02:38:39.727 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:39.727 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:37:56.665591+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.728+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff47c0a2c10 msgr2=0x7ff47c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.728+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff47c0a2c10 0x7ff47c0a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff49406aac0 tx=0x7ff488009500 comp rx=0 tx=0).stop 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.728+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494100e20 msgr2=0x7ff4941992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494100e20 0x7ff4941992b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff48400d950 tx=0x7ff48400de10 comp rx=0 tx=0).stop 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 shutdown_connections 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff47c0a2c10 0x7ff47c0a50d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff494102ef0 0x7ff4941a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff494102570 0x7ff4941997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 --2- 172.21.15.100:0/2884835349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff494100e20 0x7ff4941992b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 >> 172.21.15.100:0/2884835349 conn(0x7ff4940fc7d0 msgr2=0x7ff494106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:39.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 shutdown_connections 2024-09-12T02:38:39.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:39.729+0000 7ff49c03c640 1 -- 172.21.15.100:0/2884835349 wait complete. 2024-09-12T02:38:40.539 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T02:38:40.539 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T02:38:40.553 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:38:40.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:38:40.554 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T02:38:40.554 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:38:40.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:38:40.830 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:40.831 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:40 smithi100 ceph-mon[31390]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-12T02:38:40.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:40 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2884835349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:40 smithi189 ceph-mon[35196]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-12T02:38:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:40 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2884835349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:40 smithi117 ceph-mon[34898]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-12T02:38:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:40 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2884835349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:41.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 -- 172.21.15.100:0/475478122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4100e20 msgr2=0x7f68c4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/475478122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4100e20 0x7f68c4101200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009ca0 tx=0x7f68bc02a950 comp rx=0 tx=0).stop 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 -- 172.21.15.100:0/475478122 shutdown_connections 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/475478122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c4102ef0 0x7f68c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/475478122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c4102570 0x7f68c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/475478122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4100e20 0x7f68c4101200 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 -- 172.21.15.100:0/475478122 >> 172.21.15.100:0/475478122 conn(0x7f68c40fc7d0 msgr2=0x7f68c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 -- 172.21.15.100:0/475478122 shutdown_connections 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.553+0000 7f68c8a3b640 1 -- 172.21.15.100:0/475478122 wait complete. 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 Processor -- start 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 -- start start 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c4100e20 0x7f68c40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c4102570 0x7f68c40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4102ef0 0x7f68c40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4111020 con 0x7f68c4102ef0 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4110ea0 con 0x7f68c4102570 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c8a3b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41111a0 con 0x7f68c4100e20 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4102ef0 0x7f68c40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4102ef0 0x7f68c40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39468/0 (socket says 172.21.15.100:39468) 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 -- 172.21.15.100:0/1605523476 learned_addr learned my addr 172.21.15.100:0/1605523476 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c259c640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c4100e20 0x7f68c40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c1d9b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c4102570 0x7f68c40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 -- 172.21.15.100:0/1605523476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c4100e20 msgr2=0x7f68c40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c4100e20 0x7f68c40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 -- 172.21.15.100:0/1605523476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c4102570 msgr2=0x7f68c40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c4102570 0x7f68c40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c2d9d640 1 -- 172.21.15.100:0/1605523476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41a6b30 con 0x7f68c4102ef0 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.554+0000 7f68c1d9b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c4102570 0x7f68c40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:41.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.555+0000 7f68c2d9d640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4102ef0 0x7f68c40fd700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009fd0 tx=0x7f68b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.555+0000 7f68bb7fe640 1 -- 172.21.15.100:0/1605523476 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4011830 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.555+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c41a6e20 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.555+0000 7f68bb7fe640 1 -- 172.21.15.100:0/1605523476 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68b4016070 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.555+0000 7f68bb7fe640 1 -- 172.21.15.100:0/1605523476 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b400f2e0 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.555+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c41a72e0 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.556+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c4101280 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.557+0000 7f68bb7fe640 1 -- 172.21.15.100:0/1605523476 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f68b40119d0 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.558+0000 7f68bb7fe640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f68b00a2c10 0x7f68b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.558+0000 7f68c259c640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f68b00a2c10 0x7f68b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.558+0000 7f68bb7fe640 1 -- 172.21.15.100:0/1605523476 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f68b40ce760 con 0x7f68c4102ef0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.558+0000 7f68c259c640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f68b00a2c10 0x7f68b00a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0093d0 tx=0x7f68bc009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.562+0000 7f68bb7fe640 1 -- 172.21.15.100:0/1605523476 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68b409b660 con 0x7f68c4102ef0 2024-09-12T02:38:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.729+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68c4106f10 con 0x7f68b00a2c10 2024-09-12T02:38:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.735+0000 7f68bb7fe640 1 -- 172.21.15.100:0/1605523476 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259090 (secure 0 0 0) 0x7f68c4106f10 con 0x7f68b00a2c10 2024-09-12T02:38:41.738 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f68b00a2c10 msgr2=0x7f68b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f68b00a2c10 0x7f68b00a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0093d0 tx=0x7f68bc009360 comp rx=0 tx=0).stop 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4102ef0 msgr2=0x7f68c40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4102ef0 0x7f68c40fd700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009fd0 tx=0x7f68b400b8e0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 shutdown_connections 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f68b00a2c10 0x7f68b00a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c4102ef0 0x7f68c40fd700 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c4102570 0x7f68c40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 --2- 172.21.15.100:0/1605523476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c4100e20 0x7f68c40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 >> 172.21.15.100:0/1605523476 conn(0x7f68c40fc7d0 msgr2=0x7f68c4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 shutdown_connections 2024-09-12T02:38:41.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.739+0000 7f68c8a3b640 1 -- 172.21.15.100:0/1605523476 wait complete. 2024-09-12T02:38:41.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3316954117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c106a80 msgr2=0x7ffa8c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3316954117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c106a80 0x7ffa8c106e60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009930 tx=0x7ffa7c02a420 comp rx=0 tx=0).stop 2024-09-12T02:38:41.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3316954117 shutdown_connections 2024-09-12T02:38:41.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3316954117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8c101420 0x7ffa8c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3316954117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa8c100a80 0x7ffa8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3316954117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c106a80 0x7ffa8c106e60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3316954117 >> 172.21.15.100:0/3316954117 conn(0x7ffa8c0fc7a0 msgr2=0x7ffa8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3316954117 shutdown_connections 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.796+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3316954117 wait complete. 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 Processor -- start 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 -- start start 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8c100a80 0x7ffa8c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c101420 0x7ffa8c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa8c106a80 0x7ffa8c1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c110e40 con 0x7ffa8c101420 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c110cc0 con 0x7ffa8c100a80 2024-09-12T02:38:41.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa90cb5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c110fc0 con 0x7ffa8c106a80 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa81d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c101420 0x7ffa8c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa81d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c101420 0x7ffa8c199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39488/0 (socket says 172.21.15.100:39488) 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa8a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8c100a80 0x7ffa8c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3802584302 learned_addr learned my addr 172.21.15.100:0/3802584302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.797+0000 7ffa8ad9d640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa8c106a80 0x7ffa8c1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3802584302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa8c106a80 msgr2=0x7ffa8c1a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa8c106a80 0x7ffa8c1a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3802584302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8c100a80 msgr2=0x7ffa8c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8c100a80 0x7ffa8c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3802584302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c1a48d0 con 0x7ffa8c101420 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c101420 0x7ffa8c199850 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400d950 tx=0x7ffa7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa83fff640 1 -- 172.21.15.100:0/3802584302 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74017030 con 0x7ffa8c101420 2024-09-12T02:38:41.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa83fff640 1 -- 172.21.15.100:0/3802584302 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa74004020 con 0x7ffa8c101420 2024-09-12T02:38:41.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c1a4aa0 con 0x7ffa8c101420 2024-09-12T02:38:41.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa83fff640 1 -- 172.21.15.100:0/3802584302 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa740047a0 con 0x7ffa8c101420 2024-09-12T02:38:41.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.798+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c1a4fb0 con 0x7ffa8c101420 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.801+0000 7ffa83fff640 1 -- 172.21.15.100:0/3802584302 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7ffa740041d0 con 0x7ffa8c101420 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.801+0000 7ffa9308e740 1 Processor -- start 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.801+0000 7ffa9308e740 1 -- start start 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.801+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.801+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.801+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2bb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.801+0000 7ffa9308e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b68c20f280 con 0x55b68c2aa380 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa9308e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b68c1b6b10 con 0x55b68c2a9a60 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa9308e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b68c20b240 con 0x55b68c2b9150 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39498/0 (socket says 172.21.15.100:39498) 2024-09-12T02:38:41.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 -- 172.21.15.100:0/2200783359 learned_addr learned my addr 172.21.15.100:0/2200783359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8ad9d640 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 -- 172.21.15.100:0/2200783359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 msgr2=0x55b68c2bb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2bb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 -- 172.21.15.100:0/2200783359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 msgr2=0x55b68c2a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 -- 172.21.15.100:0/2200783359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68c1c31f0 con 0x55b68c2aa380 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa83fff640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa780a2c10 0x7ffa780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8ad9d640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa780a2c10 0x7ffa780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa83fff640 1 -- 172.21.15.100:0/3802584302 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa740ceb10 con 0x7ffa8c101420 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.802+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2b8c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009930 tx=0x7ffa7c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3534913647819721 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.803+0000 7ffa80d99640 1 -- 172.21.15.100:0/2200783359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c040070 con 0x55b68c2aa380 2024-09-12T02:38:41.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.803+0000 7ffa80d99640 1 -- 172.21.15.100:0/2200783359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7c005020 con 0x55b68c2aa380 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.803+0000 7ffa8ad9d640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa780a2c10 0x7ffa780a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ae40 tx=0x7ffa8400a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.803+0000 7ffa80d99640 1 -- 172.21.15.100:0/2200783359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c035040 con 0x55b68c2aa380 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 -- 172.21.15.100:0/2200783359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 msgr2=0x55b68c2b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2b8c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009930 tx=0x7ffa7c031630 comp rx=0 tx=0).stop 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 -- 172.21.15.100:0/2200783359 shutdown_connections 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2bb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2b8c10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2200783359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 -- 172.21.15.100:0/2200783359 >> 172.21.15.100:0/2200783359 conn(0x55b68c2a60f0 msgr2=0x55b68c2a64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 -- 172.21.15.100:0/2200783359 shutdown_connections 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 -- 172.21.15.100:0/2200783359 wait complete. 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 -- start start 2024-09-12T02:38:41.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.804+0000 7ffa9308e740 1 Processor -- start 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2b8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2aa380 0x55b68c2b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2b9150 0x55b68c2b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa9308e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b68c2bbdc0 con 0x55b68c2b9150 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa9308e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b68c1c9f10 con 0x55b68c2a9a60 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa9308e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b68c2bbf40 con 0x55b68c2aa380 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa9308e740 10 client.0 _ll_register_callbacks cb 0x55b68c192a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2aa380 0x55b68c2b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa8ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2b9150 0x55b68c2b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa8a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2aa380 0x55b68c2b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:40114/0 (socket says 172.21.15.100:40114) 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa8ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2b9150 0x55b68c2b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39510/0 (socket says 172.21.15.100:39510) 2024-09-12T02:38:41.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3323127511 learned_addr learned my addr 172.21.15.100:0/3323127511 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3323127511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 msgr2=0x55b68c2b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3323127511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2b9150 msgr2=0x55b68c2b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2b9150 0x55b68c2b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.805+0000 7ffa81d9b640 1 -- 172.21.15.100:0/3323127511 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b68bf806a0 con 0x55b68c2aa380 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2aa380 0x55b68c2b1b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009610 tx=0x7ffa7409b0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3c46efcdbb6911 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3323127511 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7409b200 con 0x55b68c2aa380 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa7c005020 con 0x55b68c2aa380 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3323127511 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa74097870 con 0x55b68c2aa380 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3323127511 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa7409f5b0 con 0x55b68c2aa380 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 10 client.24808 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:41.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b68c2cbd90 con 0x55b68c2aa380 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3323127511 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7c005020 con 0x55b68c2aa380 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3323127511 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa740bb0c0 con 0x55b68c2aa380 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 10 client.24808 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 10 client.24808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 20 client.24808 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c2cd1a0 0x55b68c2cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 4 client.24808 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.806+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b68c21c7f0 con 0x55b68c2cd1a0 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.807+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c2cd1a0 0x55b68c2cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.807+0000 7ffa71ffb640 10 client.24808 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.807+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c2cd1a0 0x55b68c2cf590 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3070e4f1c5ff8c9 server_cookie=6395dabc78415e62 in_seq=0 out_seq=0 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3323127511 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b68c21c7f0 con 0x55b68c2cd1a0 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa71ffb640 10 client.24808 handle_command_reply: tid=0 2024-09-12T02:38:41.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 client.24808 shutdown 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2aa380 msgr2=0x55b68c2b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2aa380 0x55b68c2b1b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009610 tx=0x7ffa7409b0d0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 shutdown_connections 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c2cd1a0 0x55b68c2cf590 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2b9150 0x55b68c2b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2aa380 0x55b68c2b1b40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa71ffb640 0 client.24808 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3323127511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 >> 172.21.15.100:0/3323127511 conn(0x55b68c2a60f0 msgr2=0x55b68c2abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 shutdown_connections 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.808+0000 7ffa9308e740 1 -- 172.21.15.100:0/3323127511 wait complete. 2024-09-12T02:38:41.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.809+0000 7ffa9308e740 20 client.24808 trim_cache size 0 max 16384 2024-09-12T02:38:41.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 Processor -- start 2024-09-12T02:38:41.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 -- start start 2024-09-12T02:38:41.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2d5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1adb90 con 0x55b68c2aa380 2024-09-12T02:38:41.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1ab460 con 0x55b68c2a9a60 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa9308e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1a92b0 con 0x55b68c2b9150 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2d5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39520/0 (socket says 172.21.15.100:39520) 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 -- 172.21.15.100:0/2433363503 learned_addr learned my addr 172.21.15.100:0/2433363503 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 -- 172.21.15.100:0/2433363503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 msgr2=0x55b68c2aeda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2aeda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 -- 172.21.15.100:0/2433363503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 msgr2=0x55b68c2d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2d4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa81d9b640 1 -- 172.21.15.100:0/2433363503 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68c2cfbc0 con 0x55b68c2aa380 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.826+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2d4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2d5330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffa740a3940 tx=0x7ffa740057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd83ca5fb8ab75ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa73fff640 1 -- 172.21.15.100:0/2433363503 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7409ab60 con 0x55b68c2aa380 2024-09-12T02:38:41.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa73fff640 1 -- 172.21.15.100:0/2433363503 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7409b200 con 0x55b68c2aa380 2024-09-12T02:38:41.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa73fff640 1 -- 172.21.15.100:0/2433363503 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7409f180 con 0x55b68c2aa380 2024-09-12T02:38:41.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa9308e740 1 -- 172.21.15.100:0/2433363503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 msgr2=0x55b68c2d5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2d5330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffa740a3940 tx=0x7ffa740057b0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa9308e740 1 -- 172.21.15.100:0/2433363503 shutdown_connections 2024-09-12T02:38:41.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2aa380 0x55b68c2d5330 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa9308e740 1 --2- 172.21.15.100:0/2433363503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2a9a60 0x55b68c2d4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.827+0000 7ffa9308e740 1 -- 172.21.15.100:0/2433363503 >> 172.21.15.100:0/2433363503 conn(0x55b68c2a60f0 msgr2=0x55b68c2abe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 -- 172.21.15.100:0/2433363503 shutdown_connections 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 -- 172.21.15.100:0/2433363503 wait complete. 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 -- start start 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 Processor -- start 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2a9a60 0x55b68c2ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2aa380 0x55b68c2ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1a9920 con 0x55b68c2a9a60 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1aad90 con 0x55b68c2aa380 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1a9ff0 con 0x55b68c2b9150 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa9308e740 10 client.0 _ll_register_callbacks cb 0x7ffa74005130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa8a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2a9a60 0x55b68c2ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa8a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2a9a60 0x55b68c2ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39528/0 (socket says 172.21.15.100:39528) 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.828+0000 7ffa8a59c640 1 -- 172.21.15.100:0/3081926244 learned_addr learned my addr 172.21.15.100:0/3081926244 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa8a59c640 1 -- 172.21.15.100:0/3081926244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 msgr2=0x55b68c2c4c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2c4c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa8a59c640 1 -- 172.21.15.100:0/3081926244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2aa380 msgr2=0x55b68c2ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2aa380 0x55b68c2ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa8a59c640 1 -- 172.21.15.100:0/3081926244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b68c2a5f20 con 0x55b68c2a9a60 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa8a59c640 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2a9a60 0x55b68c2ca000 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c000c00 tx=0x7ffa7c02ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e78410eb819d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3081926244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c040040 con 0x55b68c2a9a60 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3081926244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa7c04f670 con 0x55b68c2a9a60 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa7409b200 con 0x55b68c2a9a60 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3081926244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa7c035040 con 0x55b68c2a9a60 2024-09-12T02:38:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa9308e740 10 client.15246 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b68c338870 con 0x55b68c2a9a60 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3081926244 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7409b200 con 0x55b68c2a9a60 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.829+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3081926244 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa7c03ca20 con 0x55b68c2a9a60 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa9308e740 10 client.15246 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa9308e740 10 client.15246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa9308e740 20 client.15246 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c338cc0 0x55b68c33b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa9308e740 4 client.15246 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b68c216d00 con 0x55b68c338cc0 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c338cc0 0x55b68c33b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa81d9b640 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c338cc0 0x55b68c33b0b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eecfe291e90bfb4d server_cookie=22c70aaee80108e9 in_seq=0 out_seq=0 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.830+0000 7ffa71ffb640 10 client.15246 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa71ffb640 1 -- 172.21.15.100:0/3081926244 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b68c216d00 con 0x55b68c338cc0 2024-09-12T02:38:41.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa71ffb640 10 client.15246 handle_command_reply: tid=0 2024-09-12T02:38:41.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 client.15246 shutdown 2024-09-12T02:38:41.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2a9a60 msgr2=0x55b68c2ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2a9a60 0x55b68c2ca000 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c000c00 tx=0x7ffa7c02ab90 comp rx=0 tx=0).stop 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 shutdown_connections 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b68c338cc0 0x55b68c33b0b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b68c2b9150 0x55b68c2c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b68c2aa380 0x55b68c2ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 --2- 172.21.15.100:0/3081926244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b68c2a9a60 0x55b68c2ca000 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 >> 172.21.15.100:0/3081926244 conn(0x55b68c2a60f0 msgr2=0x55b68c2ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.831+0000 7ffa71ffb640 0 client.15246 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 shutdown_connections 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa9308e740 1 -- 172.21.15.100:0/3081926244 wait complete. 2024-09-12T02:38:41.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa9308e740 20 client.15246 trim_cache size 0 max 16384 2024-09-12T02:38:41.837 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:41.837 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:38:41.837 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "61d6dce3-491d-4e2e-b231-70959cc0bb11", 2024-09-12T02:38:41.837 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:38:41.837 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa780a2c10 msgr2=0x7ffa780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa780a2c10 0x7ffa780a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ae40 tx=0x7ffa8400a4d0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c101420 msgr2=0x7ffa8c199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c101420 0x7ffa8c199850 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400d950 tx=0x7ffa7400de10 comp rx=0 tx=0).stop 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 shutdown_connections 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa780a2c10 0x7ffa780a50d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa8c106a80 0x7ffa8c1a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa8c101420 0x7ffa8c199850 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 --2- 172.21.15.100:0/3802584302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa8c100a80 0x7ffa8c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 >> 172.21.15.100:0/3802584302 conn(0x7ffa8c0fc7a0 msgr2=0x7ffa8c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 shutdown_connections 2024-09-12T02:38:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:41.832+0000 7ffa90cb5640 1 -- 172.21.15.100:0/3802584302 wait complete. 2024-09-12T02:38:42.652 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-12T02:38:41.549619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664054,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":771,"num_read_kb":511,"num_write":362,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":790,"ondisk_log_size":790,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356296,"kb_used_data":11208,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585528,"statfs":{"total":1151940427776,"available":1151575580672,"internally_reserved":0,"allocated":11476992,"data_stored":7300710,"data_compressed":176832,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9295,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":57,"num_write":12,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002762"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538892+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:38:25.538892+0000","last_peered":"2024-09-12T02:38:25.538892+0000","last_clean":"2024-09-12T02:38:25.538892+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:38:25.538892+0000","last_undegraded":"2024-09-12T02:38:25.538892+0000","last_fullsized":"2024-09-12T02:38:25.538892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537706+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:38:25.537706+0000","last_peered":"2024-09-12T02:38:25.537706+0000","last_clean":"2024-09-12T02:38:25.537706+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:38:25.537706+0000","last_undegraded":"2024-09-12T02:38:25.537706+0000","last_fullsized":"2024-09-12T02:38:25.537706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544892+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:38:25.544892+0000","last_peered":"2024-09-12T02:38:25.544892+0000","last_clean":"2024-09-12T02:38:25.544892+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:38:25.544892+0000","last_undegraded":"2024-09-12T02:38:25.544892+0000","last_fullsized":"2024-09-12T02:38:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526152+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:38:25.526152+0000","last_peered":"2024-09-12T02:38:25.526152+0000","last_clean":"2024-09-12T02:38:25.526152+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:38:25.526152+0000","last_undegraded":"2024-09-12T02:38:25.526152+0000","last_fullsized":"2024-09-12T02:38:25.526152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526205+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:38:25.526205+0000","last_peered":"2024-09-12T02:38:25.526205+0000","last_clean":"2024-09-12T02:38:25.526205+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:38:25.526205+0000","last_undegraded":"2024-09-12T02:38:25.526205+0000","last_fullsized":"2024-09-12T02:38:25.526205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536028+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:38:25.536028+0000","last_peered":"2024-09-12T02:38:25.536028+0000","last_clean":"2024-09-12T02:38:25.536028+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:38:25.536028+0000","last_undegraded":"2024-09-12T02:38:25.536028+0000","last_fullsized":"2024-09-12T02:38:25.536028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540044+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:38:25.540044+0000","last_peered":"2024-09-12T02:38:25.540044+0000","last_clean":"2024-09-12T02:38:25.540044+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:38:25.540044+0000","last_undegraded":"2024-09-12T02:38:25.540044+0000","last_fullsized":"2024-09-12T02:38:25.540044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533451+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:38:25.533451+0000","last_peered":"2024-09-12T02:38:25.533451+0000","last_clean":"2024-09-12T02:38:25.533451+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:38:25.533451+0000","last_undegraded":"2024-09-12T02:38:25.533451+0000","last_fullsized":"2024-09-12T02:38:25.533451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548353+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:38:25.548353+0000","last_peered":"2024-09-12T02:38:25.548353+0000","last_clean":"2024-09-12T02:38:25.548353+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:38:25.548353+0000","last_undegraded":"2024-09-12T02:38:25.548353+0000","last_fullsized":"2024-09-12T02:38:25.548353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540355+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:38:25.540355+0000","last_peered":"2024-09-12T02:38:25.540355+0000","last_clean":"2024-09-12T02:38:25.540355+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:38:25.540355+0000","last_undegraded":"2024-09-12T02:38:25.540355+0000","last_fullsized":"2024-09-12T02:38:25.540355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545641+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:38:25.545641+0000","last_peered":"2024-09-12T02:38:25.545641+0000","last_clean":"2024-09-12T02:38:25.545641+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:38:25.545641+0000","last_undegraded":"2024-09-12T02:38:25.545641+0000","last_fullsized":"2024-09-12T02:38:25.545641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524741+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:38:25.524741+0000","last_peered":"2024-09-12T02:38:25.524741+0000","last_clean":"2024-09-12T02:38:25.524741+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:38:25.524741+0000","last_undegraded":"2024-09-12T02:38:25.524741+0000","last_fullsized":"2024-09-12T02:38:25.524741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535897+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:38:25.535897+0000","last_peered":"2024-09-12T02:38:25.535897+0000","last_clean":"2024-09-12T02:38:25.535897+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:38:25.535897+0000","last_undegraded":"2024-09-12T02:38:25.535897+0000","last_fullsized":"2024-09-12T02:38:25.535897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538014+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:38:25.538014+0000","last_peered":"2024-09-12T02:38:25.538014+0000","last_clean":"2024-09-12T02:38:25.538014+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:38:25.538014+0000","last_undegraded":"2024-09-12T02:38:25.538014+0000","last_fullsized":"2024-09-12T02:38:25.538014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535913+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:38:25.535913+0000","last_peered":"2024-09-12T02:38:25.535913+0000","last_clean":"2024-09-12T02:38:25.535913+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:38:25.535913+0000","last_undegraded":"2024-09-12T02:38:25.535913+0000","last_fullsized":"2024-09-12T02:38:25.535913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549559+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:38:25.549559+0000","last_peered":"2024-09-12T02:38:25.549559+0000","last_clean":"2024-09-12T02:38:25.549559+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:38:25.549559+0000","last_undegraded":"2024-09-12T02:38:25.549559+0000","last_fullsized":"2024-09-12T02:38:25.549559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544656+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:38:25.544656+0000","last_peered":"2024-09-12T02:38:25.544656+0000","last_clean":"2024-09-12T02:38:25.544656+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:38:25.544656+0000","last_undegraded":"2024-09-12T02:38:25.544656+0000","last_fullsized":"2024-09-12T02:38:25.544656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550740+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:38:25.550740+0000","last_peered":"2024-09-12T02:38:25.550740+0000","last_clean":"2024-09-12T02:38:25.550740+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:38:25.550740+0000","last_undegraded":"2024-09-12T02:38:25.550740+0000","last_fullsized":"2024-09-12T02:38:25.550740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537295+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:38:25.537295+0000","last_peered":"2024-09-12T02:38:25.537295+0000","last_clean":"2024-09-12T02:38:25.537295+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:38:25.537295+0000","last_undegraded":"2024-09-12T02:38:25.537295+0000","last_fullsized":"2024-09-12T02:38:25.537295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.531643+0000","last_change":"2024-09-12T02:37:56.677503+0000","last_active":"2024-09-12T02:38:25.531643+0000","last_peered":"2024-09-12T02:38:25.531643+0000","last_clean":"2024-09-12T02:38:25.531643+0000","last_became_active":"2024-09-12T02:37:56.677082+0000","last_became_peered":"2024-09-12T02:37:56.677082+0000","last_unstale":"2024-09-12T02:38:25.531643+0000","last_undegraded":"2024-09-12T02:38:25.531643+0000","last_fullsized":"2024-09-12T02:38:25.531643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:10.331298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542061+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:38:25.542061+0000","last_peered":"2024-09-12T02:38:25.542061+0000","last_clean":"2024-09-12T02:38:25.542061+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:38:25.542061+0000","last_undegraded":"2024-09-12T02:38:25.542061+0000","last_fullsized":"2024-09-12T02:38:25.542061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549255+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:38:25.549255+0000","last_peered":"2024-09-12T02:38:25.549255+0000","last_clean":"2024-09-12T02:38:25.549255+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:38:25.549255+0000","last_undegraded":"2024-09-12T02:38:25.549255+0000","last_fullsized":"2024-09-12T02:38:25.549255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532406+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:38:25.532406+0000","last_peered":"2024-09-12T02:38:25.532406+0000","last_clean":"2024-09-12T02:38:25.532406+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:38:25.532406+0000","last_undegraded":"2024-09-12T02:38:25.532406+0000","last_fullsized":"2024-09-12T02:38:25.532406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537351+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:38:25.537351+0000","last_peered":"2024-09-12T02:38:25.537351+0000","last_clean":"2024-09-12T02:38:25.537351+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:38:25.537351+0000","last_undegraded":"2024-09-12T02:38:25.537351+0000","last_fullsized":"2024-09-12T02:38:25.537351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524406+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:38:25.524406+0000","last_peered":"2024-09-12T02:38:25.524406+0000","last_clean":"2024-09-12T02:38:25.524406+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:38:25.524406+0000","last_undegraded":"2024-09-12T02:38:25.524406+0000","last_fullsized":"2024-09-12T02:38:25.524406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.551180+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:38:25.551180+0000","last_peered":"2024-09-12T02:38:25.551180+0000","last_clean":"2024-09-12T02:38:25.551180+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:38:25.551180+0000","last_undegraded":"2024-09-12T02:38:25.551180+0000","last_fullsized":"2024-09-12T02:38:25.551180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.530680+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:38:25.530680+0000","last_peered":"2024-09-12T02:38:25.530680+0000","last_clean":"2024-09-12T02:38:25.530680+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:38:25.530680+0000","last_undegraded":"2024-09-12T02:38:25.530680+0000","last_fullsized":"2024-09-12T02:38:25.530680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540212+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:38:25.540212+0000","last_peered":"2024-09-12T02:38:25.540212+0000","last_clean":"2024-09-12T02:38:25.540212+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:38:25.540212+0000","last_undegraded":"2024-09-12T02:38:25.540212+0000","last_fullsized":"2024-09-12T02:38:25.540212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537408+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:38:25.537408+0000","last_peered":"2024-09-12T02:38:25.537408+0000","last_clean":"2024-09-12T02:38:25.537408+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:38:25.537408+0000","last_undegraded":"2024-09-12T02:38:25.537408+0000","last_fullsized":"2024-09-12T02:38:25.537408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.534838+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:38:25.534838+0000","last_peered":"2024-09-12T02:38:25.534838+0000","last_clean":"2024-09-12T02:38:25.534838+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:38:25.534838+0000","last_undegraded":"2024-09-12T02:38:25.534838+0000","last_fullsized":"2024-09-12T02:38:25.534838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538471+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:38:25.538471+0000","last_peered":"2024-09-12T02:38:25.538471+0000","last_clean":"2024-09-12T02:38:25.538471+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:38:25.538471+0000","last_undegraded":"2024-09-12T02:38:25.538471+0000","last_fullsized":"2024-09-12T02:38:25.538471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527368+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:38:25.527368+0000","last_peered":"2024-09-12T02:38:25.527368+0000","last_clean":"2024-09-12T02:38:25.527368+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:38:25.527368+0000","last_undegraded":"2024-09-12T02:38:25.527368+0000","last_fullsized":"2024-09-12T02:38:25.527368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529505+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:38:25.529505+0000","last_peered":"2024-09-12T02:38:25.529505+0000","last_clean":"2024-09-12T02:38:25.529505+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:38:25.529505+0000","last_undegraded":"2024-09-12T02:38:25.529505+0000","last_fullsized":"2024-09-12T02:38:25.529505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:37.071787+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:38:37.071787+0000","last_peered":"2024-09-12T02:38:37.071787+0000","last_clean":"2024-09-12T02:38:37.071787+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:38:37.071787+0000","last_undegraded":"2024-09-12T02:38:37.071787+0000","last_fullsized":"2024-09-12T02:38:37.071787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539985+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:38:25.539985+0000","last_peered":"2024-09-12T02:38:25.539985+0000","last_clean":"2024-09-12T02:38:25.539985+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:38:25.539985+0000","last_undegraded":"2024-09-12T02:38:25.539985+0000","last_fullsized":"2024-09-12T02:38:25.539985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.755048+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:37:56.755048+0000","last_peered":"2024-09-12T02:37:56.755048+0000","last_clean":"2024-09-12T02:37:56.755048+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:37:56.755048+0000","last_undegraded":"2024-09-12T02:37:56.755048+0000","last_fullsized":"2024-09-12T02:37:56.755048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.668877+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:37:56.668877+0000","last_peered":"2024-09-12T02:37:56.668877+0000","last_clean":"2024-09-12T02:37:56.668877+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:37:56.668877+0000","last_undegraded":"2024-09-12T02:37:56.668877+0000","last_fullsized":"2024-09-12T02:37:56.668877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527196+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:38:25.527196+0000","last_peered":"2024-09-12T02:38:25.527196+0000","last_clean":"2024-09-12T02:38:25.527196+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:38:25.527196+0000","last_undegraded":"2024-09-12T02:38:25.527196+0000","last_fullsized":"2024-09-12T02:38:25.527196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670102+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:37:56.670102+0000","last_peered":"2024-09-12T02:37:56.670102+0000","last_clean":"2024-09-12T02:37:56.670102+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:37:56.670102+0000","last_undegraded":"2024-09-12T02:37:56.670102+0000","last_fullsized":"2024-09-12T02:37:56.670102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529360+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:38:25.529360+0000","last_peered":"2024-09-12T02:38:25.529360+0000","last_clean":"2024-09-12T02:38:25.529360+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:38:25.529360+0000","last_undegraded":"2024-09-12T02:38:25.529360+0000","last_fullsized":"2024-09-12T02:38:25.529360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:40.075147+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:38:40.075147+0000","last_peered":"2024-09-12T02:38:40.075147+0000","last_clean":"2024-09-12T02:38:40.075147+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:38:40.075147+0000","last_undegraded":"2024-09-12T02:38:40.075147+0000","last_fullsized":"2024-09-12T02:38:40.075147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548745+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:38:25.548745+0000","last_peered":"2024-09-12T02:38:25.548745+0000","last_clean":"2024-09-12T02:38:25.548745+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:38:25.548745+0000","last_undegraded":"2024-09-12T02:38:25.548745+0000","last_fullsized":"2024-09-12T02:38:25.548745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678605+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:37:56.678605+0000","last_peered":"2024-09-12T02:37:56.678605+0000","last_clean":"2024-09-12T02:37:56.678605+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:37:56.678605+0000","last_undegraded":"2024-09-12T02:37:56.678605+0000","last_fullsized":"2024-09-12T02:37:56.678605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538240+0000","last_change":"2024-09-12T02:37:56.677344+0000","last_active":"2024-09-12T02:38:25.538240+0000","last_peered":"2024-09-12T02:38:25.538240+0000","last_clean":"2024-09-12T02:38:25.538240+0000","last_became_active":"2024-09-12T02:37:56.676990+0000","last_became_peered":"2024-09-12T02:37:56.676990+0000","last_unstale":"2024-09-12T02:38:25.538240+0000","last_undegraded":"2024-09-12T02:38:25.538240+0000","last_fullsized":"2024-09-12T02:38:25.538240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,6],"acting":[0,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670363+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:37:56.670363+0000","last_peered":"2024-09-12T02:37:56.670363+0000","last_clean":"2024-09-12T02:37:56.670363+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:37:56.670363+0000","last_undegraded":"2024-09-12T02:37:56.670363+0000","last_fullsized":"2024-09-12T02:37:56.670363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550767+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:38:25.550767+0000","last_peered":"2024-09-12T02:38:25.550767+0000","last_clean":"2024-09-12T02:38:25.550767+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:38:25.550767+0000","last_undegraded":"2024-09-12T02:38:25.550767+0000","last_fullsized":"2024-09-12T02:38:25.550767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:41.076086+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:38:41.076086+0000","last_peered":"2024-09-12T02:38:41.076086+0000","last_clean":"2024-09-12T02:38:41.076086+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:38:41.076086+0000","last_undegraded":"2024-09-12T02:38:41.076086+0000","last_fullsized":"2024-09-12T02:38:41.076086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68607,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":176,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540622+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:38:25.540622+0000","last_peered":"2024-09-12T02:38:25.540622+0000","last_clean":"2024-09-12T02:38:25.540622+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:38:25.540622+0000","last_undegraded":"2024-09-12T02:38:25.540622+0000","last_fullsized":"2024-09-12T02:38:25.540622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678192+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:37:56.678192+0000","last_peered":"2024-09-12T02:37:56.678192+0000","last_clean":"2024-09-12T02:37:56.678192+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:37:56.678192+0000","last_undegraded":"2024-09-12T02:37:56.678192+0000","last_fullsized":"2024-09-12T02:37:56.678192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.522890+0000","last_change":"2024-09-12T02:37:56.679320+0000","last_active":"2024-09-12T02:38:25.522890+0000","last_peered":"2024-09-12T02:38:25.522890+0000","last_clean":"2024-09-12T02:38:25.522890+0000","last_became_active":"2024-09-12T02:37:56.678956+0000","last_became_peered":"2024-09-12T02:37:56.678956+0000","last_unstale":"2024-09-12T02:38:25.522890+0000","last_undegraded":"2024-09-12T02:38:25.522890+0000","last_fullsized":"2024-09-12T02:38:25.522890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:48.238065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669916+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:37:56.669916+0000","last_peered":"2024-09-12T02:37:56.669916+0000","last_clean":"2024-09-12T02:37:56.669916+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:37:56.669916+0000","last_undegraded":"2024-09-12T02:37:56.669916+0000","last_fullsized":"2024-09-12T02:37:56.669916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542029+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:38:25.542029+0000","last_peered":"2024-09-12T02:38:25.542029+0000","last_clean":"2024-09-12T02:38:25.542029+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:38:25.542029+0000","last_undegraded":"2024-09-12T02:38:25.542029+0000","last_fullsized":"2024-09-12T02:38:25.542029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:38.072584+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:38:38.072584+0000","last_peered":"2024-09-12T02:38:38.072584+0000","last_clean":"2024-09-12T02:38:38.072584+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:38:38.072584+0000","last_undegraded":"2024-09-12T02:38:38.072584+0000","last_fullsized":"2024-09-12T02:38:38.072584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.541072+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:38:25.541072+0000","last_peered":"2024-09-12T02:38:25.541072+0000","last_clean":"2024-09-12T02:38:25.541072+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:38:25.541072+0000","last_undegraded":"2024-09-12T02:38:25.541072+0000","last_fullsized":"2024-09-12T02:38:25.541072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.692441+0000","last_change":"2024-09-12T02:37:56.692441+0000","last_active":"2024-09-12T02:37:56.692441+0000","last_peered":"2024-09-12T02:37:56.692441+0000","last_clean":"2024-09-12T02:37:56.692441+0000","last_became_active":"2024-09-12T02:37:56.676982+0000","last_became_peered":"2024-09-12T02:37:56.676982+0000","last_unstale":"2024-09-12T02:37:56.692441+0000","last_undegraded":"2024-09-12T02:37:56.692441+0000","last_fullsized":"2024-09-12T02:37:56.692441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.324488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545588+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:38:25.545588+0000","last_peered":"2024-09-12T02:38:25.545588+0000","last_clean":"2024-09-12T02:38:25.545588+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:38:25.545588+0000","last_undegraded":"2024-09-12T02:38:25.545588+0000","last_fullsized":"2024-09-12T02:38:25.545588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676260+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:37:56.676260+0000","last_peered":"2024-09-12T02:37:56.676260+0000","last_clean":"2024-09-12T02:37:56.676260+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:37:56.676260+0000","last_undegraded":"2024-09-12T02:37:56.676260+0000","last_fullsized":"2024-09-12T02:37:56.676260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524802+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:38:25.524802+0000","last_peered":"2024-09-12T02:38:25.524802+0000","last_clean":"2024-09-12T02:38:25.524802+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:38:25.524802+0000","last_undegraded":"2024-09-12T02:38:25.524802+0000","last_fullsized":"2024-09-12T02:38:25.524802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669147+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.669147+0000","last_peered":"2024-09-12T02:37:56.669147+0000","last_clean":"2024-09-12T02:37:56.669147+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:37:56.669147+0000","last_undegraded":"2024-09-12T02:37:56.669147+0000","last_fullsized":"2024-09-12T02:37:56.669147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542172+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:38:25.542172+0000","last_peered":"2024-09-12T02:38:25.542172+0000","last_clean":"2024-09-12T02:38:25.542172+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:38:25.542172+0000","last_undegraded":"2024-09-12T02:38:25.542172+0000","last_fullsized":"2024-09-12T02:38:25.542172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670750+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:37:56.670750+0000","last_peered":"2024-09-12T02:37:56.670750+0000","last_clean":"2024-09-12T02:37:56.670750+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:37:56.670750+0000","last_undegraded":"2024-09-12T02:37:56.670750+0000","last_fullsized":"2024-09-12T02:37:56.670750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539778+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:38:25.539778+0000","last_peered":"2024-09-12T02:38:25.539778+0000","last_clean":"2024-09-12T02:38:25.539778+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:38:25.539778+0000","last_undegraded":"2024-09-12T02:38:25.539778+0000","last_fullsized":"2024-09-12T02:38:25.539778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677938+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:37:56.677938+0000","last_peered":"2024-09-12T02:37:56.677938+0000","last_clean":"2024-09-12T02:37:56.677938+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:37:56.677938+0000","last_undegraded":"2024-09-12T02:37:56.677938+0000","last_fullsized":"2024-09-12T02:37:56.677938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549470+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:38:25.549470+0000","last_peered":"2024-09-12T02:38:25.549470+0000","last_clean":"2024-09-12T02:38:25.549470+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:38:25.549470+0000","last_undegraded":"2024-09-12T02:38:25.549470+0000","last_fullsized":"2024-09-12T02:38:25.549470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678427+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:37:56.678427+0000","last_peered":"2024-09-12T02:37:56.678427+0000","last_clean":"2024-09-12T02:37:56.678427+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:37:56.678427+0000","last_undegraded":"2024-09-12T02:37:56.678427+0000","last_fullsized":"2024-09-12T02:37:56.678427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793192+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:37:56.793192+0000","last_peered":"2024-09-12T02:37:56.793192+0000","last_clean":"2024-09-12T02:37:56.793192+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:37:56.793192+0000","last_undegraded":"2024-09-12T02:37:56.793192+0000","last_fullsized":"2024-09-12T02:37:56.793192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550428+0000","last_change":"2024-09-12T02:37:56.674162+0000","last_active":"2024-09-12T02:38:25.550428+0000","last_peered":"2024-09-12T02:38:25.550428+0000","last_clean":"2024-09-12T02:38:25.550428+0000","last_became_active":"2024-09-12T02:37:56.673786+0000","last_became_peered":"2024-09-12T02:37:56.673786+0000","last_unstale":"2024-09-12T02:38:25.550428+0000","last_undegraded":"2024-09-12T02:38:25.550428+0000","last_fullsized":"2024-09-12T02:38:25.550428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:46.189919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678298+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.678298+0000","last_peered":"2024-09-12T02:37:56.678298+0000","last_clean":"2024-09-12T02:37:56.678298+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:37:56.678298+0000","last_undegraded":"2024-09-12T02:37:56.678298+0000","last_fullsized":"2024-09-12T02:37:56.678298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.523493+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:38:25.523493+0000","last_peered":"2024-09-12T02:38:25.523493+0000","last_clean":"2024-09-12T02:38:25.523493+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:38:25.523493+0000","last_undegraded":"2024-09-12T02:38:25.523493+0000","last_fullsized":"2024-09-12T02:38:25.523493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:39.073426+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:38:39.073426+0000","last_peered":"2024-09-12T02:38:39.073426+0000","last_clean":"2024-09-12T02:38:39.073426+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:38:39.073426+0000","last_undegraded":"2024-09-12T02:38:39.073426+0000","last_fullsized":"2024-09-12T02:38:39.073426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536855+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:38:25.536855+0000","last_peered":"2024-09-12T02:38:25.536855+0000","last_clean":"2024-09-12T02:38:25.536855+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:38:25.536855+0000","last_undegraded":"2024-09-12T02:38:25.536855+0000","last_fullsized":"2024-09-12T02:38:25.536855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678486+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:37:56.678486+0000","last_peered":"2024-09-12T02:37:56.678486+0000","last_clean":"2024-09-12T02:37:56.678486+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:37:56.678486+0000","last_undegraded":"2024-09-12T02:37:56.678486+0000","last_fullsized":"2024-09-12T02:37:56.678486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535307+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:38:25.535307+0000","last_peered":"2024-09-12T02:38:25.535307+0000","last_clean":"2024-09-12T02:38:25.535307+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:38:25.535307+0000","last_undegraded":"2024-09-12T02:38:25.535307+0000","last_fullsized":"2024-09-12T02:38:25.535307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672207+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:37:56.672207+0000","last_peered":"2024-09-12T02:37:56.672207+0000","last_clean":"2024-09-12T02:37:56.672207+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:37:56.672207+0000","last_undegraded":"2024-09-12T02:37:56.672207+0000","last_fullsized":"2024-09-12T02:37:56.672207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535973+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:38:25.535973+0000","last_peered":"2024-09-12T02:38:25.535973+0000","last_clean":"2024-09-12T02:38:25.535973+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:38:25.535973+0000","last_undegraded":"2024-09-12T02:38:25.535973+0000","last_fullsized":"2024-09-12T02:38:25.535973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.695307+0000","last_change":"2024-09-12T02:37:56.694966+0000","last_active":"2024-09-12T02:37:56.695307+0000","last_peered":"2024-09-12T02:37:56.695307+0000","last_clean":"2024-09-12T02:37:56.695307+0000","last_became_active":"2024-09-12T02:37:56.674729+0000","last_became_peered":"2024-09-12T02:37:56.674729+0000","last_unstale":"2024-09-12T02:37:56.695307+0000","last_undegraded":"2024-09-12T02:37:56.695307+0000","last_fullsized":"2024-09-12T02:37:56.695307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:51.673970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.528703+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:38:25.528703+0000","last_peered":"2024-09-12T02:38:25.528703+0000","last_clean":"2024-09-12T02:38:25.528703+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:38:25.528703+0000","last_undegraded":"2024-09-12T02:38:25.528703+0000","last_fullsized":"2024-09-12T02:38:25.528703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'13","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:31.889524+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:38:31.889524+0000","last_peered":"2024-09-12T02:38:31.889524+0000","last_clean":"2024-09-12T02:38:31.889524+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:38:31.889524+0000","last_undegraded":"2024-09-12T02:38:31.889524+0000","last_fullsized":"2024-09-12T02:38:31.889524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533951+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:38:25.533951+0000","last_peered":"2024-09-12T02:38:25.533951+0000","last_clean":"2024-09-12T02:38:25.533951+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:38:25.533951+0000","last_undegraded":"2024-09-12T02:38:25.533951+0000","last_fullsized":"2024-09-12T02:38:25.533951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793081+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:37:56.793081+0000","last_peered":"2024-09-12T02:37:56.793081+0000","last_clean":"2024-09-12T02:37:56.793081+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:37:56.793081+0000","last_undegraded":"2024-09-12T02:37:56.793081+0000","last_fullsized":"2024-09-12T02:37:56.793081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540129+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:38:25.540129+0000","last_peered":"2024-09-12T02:38:25.540129+0000","last_clean":"2024-09-12T02:38:25.540129+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:38:25.540129+0000","last_undegraded":"2024-09-12T02:38:25.540129+0000","last_fullsized":"2024-09-12T02:38:25.540129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669652+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:37:56.669652+0000","last_peered":"2024-09-12T02:37:56.669652+0000","last_clean":"2024-09-12T02:37:56.669652+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:37:56.669652+0000","last_undegraded":"2024-09-12T02:37:56.669652+0000","last_fullsized":"2024-09-12T02:37:56.669652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.500557+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:38:25.500557+0000","last_peered":"2024-09-12T02:38:25.500557+0000","last_clean":"2024-09-12T02:38:25.500557+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:38:25.500557+0000","last_undegraded":"2024-09-12T02:38:25.500557+0000","last_fullsized":"2024-09-12T02:38:25.500557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792234+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:37:56.792234+0000","last_peered":"2024-09-12T02:37:56.792234+0000","last_clean":"2024-09-12T02:37:56.792234+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:37:56.792234+0000","last_undegraded":"2024-09-12T02:37:56.792234+0000","last_fullsized":"2024-09-12T02:37:56.792234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538185+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:38:25.538185+0000","last_peered":"2024-09-12T02:38:25.538185+0000","last_clean":"2024-09-12T02:38:25.538185+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:38:25.538185+0000","last_undegraded":"2024-09-12T02:38:25.538185+0000","last_fullsized":"2024-09-12T02:38:25.538185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677722+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:37:56.677722+0000","last_peered":"2024-09-12T02:37:56.677722+0000","last_clean":"2024-09-12T02:37:56.677722+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:37:56.677722+0000","last_undegraded":"2024-09-12T02:37:56.677722+0000","last_fullsized":"2024-09-12T02:37:56.677722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532431+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:38:25.532431+0000","last_peered":"2024-09-12T02:38:25.532431+0000","last_clean":"2024-09-12T02:38:25.532431+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:38:25.532431+0000","last_undegraded":"2024-09-12T02:38:25.532431+0000","last_fullsized":"2024-09-12T02:38:25.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.797632+0000","last_change":"2024-09-12T02:37:56.797632+0000","last_active":"2024-09-12T02:37:56.797632+0000","last_peered":"2024-09-12T02:37:56.797632+0000","last_clean":"2024-09-12T02:37:56.797632+0000","last_became_active":"2024-09-12T02:37:56.794171+0000","last_became_peered":"2024-09-12T02:37:56.794171+0000","last_unstale":"2024-09-12T02:37:56.797632+0000","last_undegraded":"2024-09-12T02:37:56.797632+0000","last_fullsized":"2024-09-12T02:37:56.797632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:34.468518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550218+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:38:25.550218+0000","last_peered":"2024-09-12T02:38:25.550218+0000","last_clean":"2024-09-12T02:38:25.550218+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:38:25.550218+0000","last_undegraded":"2024-09-12T02:38:25.550218+0000","last_fullsized":"2024-09-12T02:38:25.550218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549244+0000","last_change":"2024-09-12T02:37:56.680042+0000","last_active":"2024-09-12T02:38:25.549244+0000","last_peered":"2024-09-12T02:38:25.549244+0000","last_clean":"2024-09-12T02:38:25.549244+0000","last_became_active":"2024-09-12T02:37:56.679618+0000","last_became_peered":"2024-09-12T02:37:56.679618+0000","last_unstale":"2024-09-12T02:38:25.549244+0000","last_undegraded":"2024-09-12T02:38:25.549244+0000","last_fullsized":"2024-09-12T02:38:25.549244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:53.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.682015+0000","last_change":"2024-09-12T02:37:56.681606+0000","last_active":"2024-09-12T02:37:56.682015+0000","last_peered":"2024-09-12T02:37:56.682015+0000","last_clean":"2024-09-12T02:37:56.682015+0000","last_became_active":"2024-09-12T02:37:56.674499+0000","last_became_peered":"2024-09-12T02:37:56.674499+0000","last_unstale":"2024-09-12T02:37:56.682015+0000","last_undegraded":"2024-09-12T02:37:56.682015+0000","last_fullsized":"2024-09-12T02:37:56.682015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:02.803838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550254+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:38:25.550254+0000","last_peered":"2024-09-12T02:38:25.550254+0000","last_clean":"2024-09-12T02:38:25.550254+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:38:25.550254+0000","last_undegraded":"2024-09-12T02:38:25.550254+0000","last_fullsized":"2024-09-12T02:38:25.550254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676382+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:37:56.676382+0000","last_peered":"2024-09-12T02:37:56.676382+0000","last_clean":"2024-09-12T02:37:56.676382+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:37:56.676382+0000","last_undegraded":"2024-09-12T02:37:56.676382+0000","last_fullsized":"2024-09-12T02:37:56.676382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549684+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:38:25.549684+0000","last_peered":"2024-09-12T02:38:25.549684+0000","last_clean":"2024-09-12T02:38:25.549684+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:38:25.549684+0000","last_undegraded":"2024-09-12T02:38:25.549684+0000","last_fullsized":"2024-09-12T02:38:25.549684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792826+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:56.792826+0000","last_peered":"2024-09-12T02:37:56.792826+0000","last_clean":"2024-09-12T02:37:56.792826+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:37:56.792826+0000","last_undegraded":"2024-09-12T02:37:56.792826+0000","last_fullsized":"2024-09-12T02:37:56.792826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524640+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:38:25.524640+0000","last_peered":"2024-09-12T02:38:25.524640+0000","last_clean":"2024-09-12T02:38:25.524640+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:38:25.524640+0000","last_undegraded":"2024-09-12T02:38:25.524640+0000","last_fullsized":"2024-09-12T02:38:25.524640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672690+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:37:56.672690+0000","last_peered":"2024-09-12T02:37:56.672690+0000","last_clean":"2024-09-12T02:37:56.672690+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:37:56.672690+0000","last_undegraded":"2024-09-12T02:37:56.672690+0000","last_fullsized":"2024-09-12T02:37:56.672690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73452,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":645,"num_read_kb":402,"num_write":179,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":220356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442983,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1103442,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":443197,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443095,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1035891,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561086,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442586,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1035182,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":443416,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":442897,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":513066,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":511098,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":443857,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:38:42.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:38:42.994 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:42 smithi100 ceph-mon[31390]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-12T02:38:42.994 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:42 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:38:42.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:42 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:38:42.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:42 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:38:42.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:42 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:38:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:42 smithi189 ceph-mon[35196]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-12T02:38:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:42 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:38:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:42 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:38:43.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:42 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:38:43.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:42 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:38:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:42 smithi117 ceph-mon[34898]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-12T02:38:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:42 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:38:43.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:42 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:38:43.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:42 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:38:43.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:42 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:38:43.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:38:43.470 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:43.955 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:43 smithi100 ceph-mon[31390]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 -- 172.21.15.100:0/1965692715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568106a80 msgr2=0x7fa568106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 --2- 172.21.15.100:0/1965692715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568106a80 0x7fa568106e60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa564009930 tx=0x7fa56402a420 comp rx=0 tx=0).stop 2024-09-12T02:38:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 -- 172.21.15.100:0/1965692715 shutdown_connections 2024-09-12T02:38:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 --2- 172.21.15.100:0/1965692715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568101420 0x7fa56810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 --2- 172.21.15.100:0/1965692715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa568100a80 0x7fa568100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 --2- 172.21.15.100:0/1965692715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568106a80 0x7fa568106e60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 -- 172.21.15.100:0/1965692715 >> 172.21.15.100:0/1965692715 conn(0x7fa5680fc7a0 msgr2=0x7fa5680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.955+0000 7fa56fee3640 1 -- 172.21.15.100:0/1965692715 shutdown_connections 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.956+0000 7fa56fee3640 1 -- 172.21.15.100:0/1965692715 wait complete. 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.956+0000 7fa56fee3640 1 Processor -- start 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.956+0000 7fa56fee3640 1 -- start start 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568100a80 0x7fa568198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568101420 0x7fa568198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa568106a80 0x7fa56819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa568111fa0 con 0x7fa568100a80 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa568111e20 con 0x7fa568101420 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa568112120 con 0x7fa568106a80 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568100a80 0x7fa568198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568100a80 0x7fa568198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39550/0 (socket says 172.21.15.100:39550) 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 -- 172.21.15.100:0/3169638653 learned_addr learned my addr 172.21.15.100:0/3169638653 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56e480640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa568106a80 0x7fa56819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56d47e640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568101420 0x7fa568198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 -- 172.21.15.100:0/3169638653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa568106a80 msgr2=0x7fa56819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa568106a80 0x7fa56819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 -- 172.21.15.100:0/3169638653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568101420 msgr2=0x7fa568198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568101420 0x7fa568198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 -- 172.21.15.100:0/3169638653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56819d4b0 con 0x7fa568100a80 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56e480640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa568106a80 0x7fa56819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56dc7f640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568100a80 0x7fa568198500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa564009a50 tx=0x7fa564004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa55effd640 1 -- 172.21.15.100:0/3169638653 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56403f030 con 0x7fa568100a80 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa55effd640 1 -- 172.21.15.100:0/3169638653 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa564003ce0 con 0x7fa568100a80 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56819d740 con 0x7fa568100a80 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa55effd640 1 -- 172.21.15.100:0/3169638653 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564035070 con 0x7fa568100a80 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.957+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5681a5080 con 0x7fa568100a80 2024-09-12T02:38:43.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.959+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5681021c0 con 0x7fa568100a80 2024-09-12T02:38:43.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.960+0000 7fa55effd640 1 -- 172.21.15.100:0/3169638653 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fa564042030 con 0x7fa568100a80 2024-09-12T02:38:43.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.960+0000 7fa55effd640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa5540a2c10 0x7fa5540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:43.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.960+0000 7fa56d47e640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa5540a2c10 0x7fa5540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:43.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.960+0000 7fa55effd640 1 -- 172.21.15.100:0/3169638653 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa5640ef830 con 0x7fa568100a80 2024-09-12T02:38:43.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.961+0000 7fa56d47e640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa5540a2c10 0x7fa5540a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5680fee20 tx=0x7fa558008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:43.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:43.964+0000 7fa55effd640 1 -- 172.21.15.100:0/3169638653 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5640bc620 con 0x7fa568100a80 2024-09-12T02:38:44.009 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:44.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:43 smithi189 ceph-mon[35196]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:44.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:43 smithi117 ceph-mon[34898]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:44.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.136+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa568062630 con 0x7fa5540a2c10 2024-09-12T02:38:44.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.144+0000 7fa55effd640 1 -- 172.21.15.100:0/3169638653 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259090 (secure 0 0 0) 0x7fa568062630 con 0x7fa5540a2c10 2024-09-12T02:38:44.146 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:44.147 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa5540a2c10 msgr2=0x7fa5540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa5540a2c10 0x7fa5540a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5680fee20 tx=0x7fa558008040 comp rx=0 tx=0).stop 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568100a80 msgr2=0x7fa568198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568100a80 0x7fa568198500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa564009a50 tx=0x7fa564004270 comp rx=0 tx=0).stop 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 shutdown_connections 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa5540a2c10 0x7fa5540a50d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa568106a80 0x7fa56819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568101420 0x7fa568198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.146+0000 7fa56fee3640 1 --2- 172.21.15.100:0/3169638653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa568100a80 0x7fa568198500 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.147+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 >> 172.21.15.100:0/3169638653 conn(0x7fa5680fc7a0 msgr2=0x7fa5680fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.147+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 shutdown_connections 2024-09-12T02:38:44.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:44.147+0000 7fa56fee3640 1 -- 172.21.15.100:0/3169638653 wait complete. 2024-09-12T02:38:44.994 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:44 smithi100 ceph-mon[31390]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:38:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:44 smithi189 ceph-mon[35196]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:38:45.032 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-12T02:38:43.550153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664054,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":771,"num_read_kb":511,"num_write":362,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":790,"ondisk_log_size":790,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356296,"kb_used_data":11208,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585528,"statfs":{"total":1151940427776,"available":1151575580672,"internally_reserved":0,"allocated":11476992,"data_stored":7300710,"data_compressed":176832,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9295,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42,"num_write":12,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002891"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538892+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:38:25.538892+0000","last_peered":"2024-09-12T02:38:25.538892+0000","last_clean":"2024-09-12T02:38:25.538892+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:38:25.538892+0000","last_undegraded":"2024-09-12T02:38:25.538892+0000","last_fullsized":"2024-09-12T02:38:25.538892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537706+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:38:25.537706+0000","last_peered":"2024-09-12T02:38:25.537706+0000","last_clean":"2024-09-12T02:38:25.537706+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:38:25.537706+0000","last_undegraded":"2024-09-12T02:38:25.537706+0000","last_fullsized":"2024-09-12T02:38:25.537706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544892+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:38:25.544892+0000","last_peered":"2024-09-12T02:38:25.544892+0000","last_clean":"2024-09-12T02:38:25.544892+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:38:25.544892+0000","last_undegraded":"2024-09-12T02:38:25.544892+0000","last_fullsized":"2024-09-12T02:38:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526152+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:38:25.526152+0000","last_peered":"2024-09-12T02:38:25.526152+0000","last_clean":"2024-09-12T02:38:25.526152+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:38:25.526152+0000","last_undegraded":"2024-09-12T02:38:25.526152+0000","last_fullsized":"2024-09-12T02:38:25.526152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526205+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:38:25.526205+0000","last_peered":"2024-09-12T02:38:25.526205+0000","last_clean":"2024-09-12T02:38:25.526205+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:38:25.526205+0000","last_undegraded":"2024-09-12T02:38:25.526205+0000","last_fullsized":"2024-09-12T02:38:25.526205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536028+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:38:25.536028+0000","last_peered":"2024-09-12T02:38:25.536028+0000","last_clean":"2024-09-12T02:38:25.536028+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:38:25.536028+0000","last_undegraded":"2024-09-12T02:38:25.536028+0000","last_fullsized":"2024-09-12T02:38:25.536028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540044+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:38:25.540044+0000","last_peered":"2024-09-12T02:38:25.540044+0000","last_clean":"2024-09-12T02:38:25.540044+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:38:25.540044+0000","last_undegraded":"2024-09-12T02:38:25.540044+0000","last_fullsized":"2024-09-12T02:38:25.540044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533451+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:38:25.533451+0000","last_peered":"2024-09-12T02:38:25.533451+0000","last_clean":"2024-09-12T02:38:25.533451+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:38:25.533451+0000","last_undegraded":"2024-09-12T02:38:25.533451+0000","last_fullsized":"2024-09-12T02:38:25.533451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548353+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:38:25.548353+0000","last_peered":"2024-09-12T02:38:25.548353+0000","last_clean":"2024-09-12T02:38:25.548353+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:38:25.548353+0000","last_undegraded":"2024-09-12T02:38:25.548353+0000","last_fullsized":"2024-09-12T02:38:25.548353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540355+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:38:25.540355+0000","last_peered":"2024-09-12T02:38:25.540355+0000","last_clean":"2024-09-12T02:38:25.540355+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:38:25.540355+0000","last_undegraded":"2024-09-12T02:38:25.540355+0000","last_fullsized":"2024-09-12T02:38:25.540355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545641+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:38:25.545641+0000","last_peered":"2024-09-12T02:38:25.545641+0000","last_clean":"2024-09-12T02:38:25.545641+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:38:25.545641+0000","last_undegraded":"2024-09-12T02:38:25.545641+0000","last_fullsized":"2024-09-12T02:38:25.545641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524741+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:38:25.524741+0000","last_peered":"2024-09-12T02:38:25.524741+0000","last_clean":"2024-09-12T02:38:25.524741+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:38:25.524741+0000","last_undegraded":"2024-09-12T02:38:25.524741+0000","last_fullsized":"2024-09-12T02:38:25.524741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535897+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:38:25.535897+0000","last_peered":"2024-09-12T02:38:25.535897+0000","last_clean":"2024-09-12T02:38:25.535897+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:38:25.535897+0000","last_undegraded":"2024-09-12T02:38:25.535897+0000","last_fullsized":"2024-09-12T02:38:25.535897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538014+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:38:25.538014+0000","last_peered":"2024-09-12T02:38:25.538014+0000","last_clean":"2024-09-12T02:38:25.538014+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:38:25.538014+0000","last_undegraded":"2024-09-12T02:38:25.538014+0000","last_fullsized":"2024-09-12T02:38:25.538014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535913+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:38:25.535913+0000","last_peered":"2024-09-12T02:38:25.535913+0000","last_clean":"2024-09-12T02:38:25.535913+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:38:25.535913+0000","last_undegraded":"2024-09-12T02:38:25.535913+0000","last_fullsized":"2024-09-12T02:38:25.535913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549559+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:38:25.549559+0000","last_peered":"2024-09-12T02:38:25.549559+0000","last_clean":"2024-09-12T02:38:25.549559+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:38:25.549559+0000","last_undegraded":"2024-09-12T02:38:25.549559+0000","last_fullsized":"2024-09-12T02:38:25.549559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544656+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:38:25.544656+0000","last_peered":"2024-09-12T02:38:25.544656+0000","last_clean":"2024-09-12T02:38:25.544656+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:38:25.544656+0000","last_undegraded":"2024-09-12T02:38:25.544656+0000","last_fullsized":"2024-09-12T02:38:25.544656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550740+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:38:25.550740+0000","last_peered":"2024-09-12T02:38:25.550740+0000","last_clean":"2024-09-12T02:38:25.550740+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:38:25.550740+0000","last_undegraded":"2024-09-12T02:38:25.550740+0000","last_fullsized":"2024-09-12T02:38:25.550740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537295+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:38:25.537295+0000","last_peered":"2024-09-12T02:38:25.537295+0000","last_clean":"2024-09-12T02:38:25.537295+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:38:25.537295+0000","last_undegraded":"2024-09-12T02:38:25.537295+0000","last_fullsized":"2024-09-12T02:38:25.537295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.531643+0000","last_change":"2024-09-12T02:37:56.677503+0000","last_active":"2024-09-12T02:38:25.531643+0000","last_peered":"2024-09-12T02:38:25.531643+0000","last_clean":"2024-09-12T02:38:25.531643+0000","last_became_active":"2024-09-12T02:37:56.677082+0000","last_became_peered":"2024-09-12T02:37:56.677082+0000","last_unstale":"2024-09-12T02:38:25.531643+0000","last_undegraded":"2024-09-12T02:38:25.531643+0000","last_fullsized":"2024-09-12T02:38:25.531643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:10.331298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542061+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:38:25.542061+0000","last_peered":"2024-09-12T02:38:25.542061+0000","last_clean":"2024-09-12T02:38:25.542061+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:38:25.542061+0000","last_undegraded":"2024-09-12T02:38:25.542061+0000","last_fullsized":"2024-09-12T02:38:25.542061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549255+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:38:25.549255+0000","last_peered":"2024-09-12T02:38:25.549255+0000","last_clean":"2024-09-12T02:38:25.549255+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:38:25.549255+0000","last_undegraded":"2024-09-12T02:38:25.549255+0000","last_fullsized":"2024-09-12T02:38:25.549255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532406+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:38:25.532406+0000","last_peered":"2024-09-12T02:38:25.532406+0000","last_clean":"2024-09-12T02:38:25.532406+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:38:25.532406+0000","last_undegraded":"2024-09-12T02:38:25.532406+0000","last_fullsized":"2024-09-12T02:38:25.532406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537351+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:38:25.537351+0000","last_peered":"2024-09-12T02:38:25.537351+0000","last_clean":"2024-09-12T02:38:25.537351+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:38:25.537351+0000","last_undegraded":"2024-09-12T02:38:25.537351+0000","last_fullsized":"2024-09-12T02:38:25.537351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524406+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:38:25.524406+0000","last_peered":"2024-09-12T02:38:25.524406+0000","last_clean":"2024-09-12T02:38:25.524406+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:38:25.524406+0000","last_undegraded":"2024-09-12T02:38:25.524406+0000","last_fullsized":"2024-09-12T02:38:25.524406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.551180+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:38:25.551180+0000","last_peered":"2024-09-12T02:38:25.551180+0000","last_clean":"2024-09-12T02:38:25.551180+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:38:25.551180+0000","last_undegraded":"2024-09-12T02:38:25.551180+0000","last_fullsized":"2024-09-12T02:38:25.551180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.530680+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:38:25.530680+0000","last_peered":"2024-09-12T02:38:25.530680+0000","last_clean":"2024-09-12T02:38:25.530680+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:38:25.530680+0000","last_undegraded":"2024-09-12T02:38:25.530680+0000","last_fullsized":"2024-09-12T02:38:25.530680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540212+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:38:25.540212+0000","last_peered":"2024-09-12T02:38:25.540212+0000","last_clean":"2024-09-12T02:38:25.540212+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:38:25.540212+0000","last_undegraded":"2024-09-12T02:38:25.540212+0000","last_fullsized":"2024-09-12T02:38:25.540212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537408+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:38:25.537408+0000","last_peered":"2024-09-12T02:38:25.537408+0000","last_clean":"2024-09-12T02:38:25.537408+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:38:25.537408+0000","last_undegraded":"2024-09-12T02:38:25.537408+0000","last_fullsized":"2024-09-12T02:38:25.537408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.534838+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:38:25.534838+0000","last_peered":"2024-09-12T02:38:25.534838+0000","last_clean":"2024-09-12T02:38:25.534838+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:38:25.534838+0000","last_undegraded":"2024-09-12T02:38:25.534838+0000","last_fullsized":"2024-09-12T02:38:25.534838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538471+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:38:25.538471+0000","last_peered":"2024-09-12T02:38:25.538471+0000","last_clean":"2024-09-12T02:38:25.538471+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:38:25.538471+0000","last_undegraded":"2024-09-12T02:38:25.538471+0000","last_fullsized":"2024-09-12T02:38:25.538471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527368+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:38:25.527368+0000","last_peered":"2024-09-12T02:38:25.527368+0000","last_clean":"2024-09-12T02:38:25.527368+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:38:25.527368+0000","last_undegraded":"2024-09-12T02:38:25.527368+0000","last_fullsized":"2024-09-12T02:38:25.527368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529505+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:38:25.529505+0000","last_peered":"2024-09-12T02:38:25.529505+0000","last_clean":"2024-09-12T02:38:25.529505+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:38:25.529505+0000","last_undegraded":"2024-09-12T02:38:25.529505+0000","last_fullsized":"2024-09-12T02:38:25.529505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:37.071787+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:38:37.071787+0000","last_peered":"2024-09-12T02:38:37.071787+0000","last_clean":"2024-09-12T02:38:37.071787+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:38:37.071787+0000","last_undegraded":"2024-09-12T02:38:37.071787+0000","last_fullsized":"2024-09-12T02:38:37.071787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539985+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:38:25.539985+0000","last_peered":"2024-09-12T02:38:25.539985+0000","last_clean":"2024-09-12T02:38:25.539985+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:38:25.539985+0000","last_undegraded":"2024-09-12T02:38:25.539985+0000","last_fullsized":"2024-09-12T02:38:25.539985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.755048+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:37:56.755048+0000","last_peered":"2024-09-12T02:37:56.755048+0000","last_clean":"2024-09-12T02:37:56.755048+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:37:56.755048+0000","last_undegraded":"2024-09-12T02:37:56.755048+0000","last_fullsized":"2024-09-12T02:37:56.755048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.668877+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:37:56.668877+0000","last_peered":"2024-09-12T02:37:56.668877+0000","last_clean":"2024-09-12T02:37:56.668877+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:37:56.668877+0000","last_undegraded":"2024-09-12T02:37:56.668877+0000","last_fullsized":"2024-09-12T02:37:56.668877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527196+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:38:25.527196+0000","last_peered":"2024-09-12T02:38:25.527196+0000","last_clean":"2024-09-12T02:38:25.527196+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:38:25.527196+0000","last_undegraded":"2024-09-12T02:38:25.527196+0000","last_fullsized":"2024-09-12T02:38:25.527196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670102+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:37:56.670102+0000","last_peered":"2024-09-12T02:37:56.670102+0000","last_clean":"2024-09-12T02:37:56.670102+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:37:56.670102+0000","last_undegraded":"2024-09-12T02:37:56.670102+0000","last_fullsized":"2024-09-12T02:37:56.670102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529360+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:38:25.529360+0000","last_peered":"2024-09-12T02:38:25.529360+0000","last_clean":"2024-09-12T02:38:25.529360+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:38:25.529360+0000","last_undegraded":"2024-09-12T02:38:25.529360+0000","last_fullsized":"2024-09-12T02:38:25.529360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:40.075147+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:38:40.075147+0000","last_peered":"2024-09-12T02:38:40.075147+0000","last_clean":"2024-09-12T02:38:40.075147+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:38:40.075147+0000","last_undegraded":"2024-09-12T02:38:40.075147+0000","last_fullsized":"2024-09-12T02:38:40.075147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548745+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:38:25.548745+0000","last_peered":"2024-09-12T02:38:25.548745+0000","last_clean":"2024-09-12T02:38:25.548745+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:38:25.548745+0000","last_undegraded":"2024-09-12T02:38:25.548745+0000","last_fullsized":"2024-09-12T02:38:25.548745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678605+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:37:56.678605+0000","last_peered":"2024-09-12T02:37:56.678605+0000","last_clean":"2024-09-12T02:37:56.678605+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:37:56.678605+0000","last_undegraded":"2024-09-12T02:37:56.678605+0000","last_fullsized":"2024-09-12T02:37:56.678605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538240+0000","last_change":"2024-09-12T02:37:56.677344+0000","last_active":"2024-09-12T02:38:25.538240+0000","last_peered":"2024-09-12T02:38:25.538240+0000","last_clean":"2024-09-12T02:38:25.538240+0000","last_became_active":"2024-09-12T02:37:56.676990+0000","last_became_peered":"2024-09-12T02:37:56.676990+0000","last_unstale":"2024-09-12T02:38:25.538240+0000","last_undegraded":"2024-09-12T02:38:25.538240+0000","last_fullsized":"2024-09-12T02:38:25.538240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,6],"acting":[0,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670363+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:37:56.670363+0000","last_peered":"2024-09-12T02:37:56.670363+0000","last_clean":"2024-09-12T02:37:56.670363+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:37:56.670363+0000","last_undegraded":"2024-09-12T02:37:56.670363+0000","last_fullsized":"2024-09-12T02:37:56.670363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550767+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:38:25.550767+0000","last_peered":"2024-09-12T02:38:25.550767+0000","last_clean":"2024-09-12T02:38:25.550767+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:38:25.550767+0000","last_undegraded":"2024-09-12T02:38:25.550767+0000","last_fullsized":"2024-09-12T02:38:25.550767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:41.076086+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:38:41.076086+0000","last_peered":"2024-09-12T02:38:41.076086+0000","last_clean":"2024-09-12T02:38:41.076086+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:38:41.076086+0000","last_undegraded":"2024-09-12T02:38:41.076086+0000","last_fullsized":"2024-09-12T02:38:41.076086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68607,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":176,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540622+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:38:25.540622+0000","last_peered":"2024-09-12T02:38:25.540622+0000","last_clean":"2024-09-12T02:38:25.540622+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:38:25.540622+0000","last_undegraded":"2024-09-12T02:38:25.540622+0000","last_fullsized":"2024-09-12T02:38:25.540622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678192+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:37:56.678192+0000","last_peered":"2024-09-12T02:37:56.678192+0000","last_clean":"2024-09-12T02:37:56.678192+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:37:56.678192+0000","last_undegraded":"2024-09-12T02:37:56.678192+0000","last_fullsized":"2024-09-12T02:37:56.678192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.522890+0000","last_change":"2024-09-12T02:37:56.679320+0000","last_active":"2024-09-12T02:38:25.522890+0000","last_peered":"2024-09-12T02:38:25.522890+0000","last_clean":"2024-09-12T02:38:25.522890+0000","last_became_active":"2024-09-12T02:37:56.678956+0000","last_became_peered":"2024-09-12T02:37:56.678956+0000","last_unstale":"2024-09-12T02:38:25.522890+0000","last_undegraded":"2024-09-12T02:38:25.522890+0000","last_fullsized":"2024-09-12T02:38:25.522890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:48.238065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669916+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:37:56.669916+0000","last_peered":"2024-09-12T02:37:56.669916+0000","last_clean":"2024-09-12T02:37:56.669916+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:37:56.669916+0000","last_undegraded":"2024-09-12T02:37:56.669916+0000","last_fullsized":"2024-09-12T02:37:56.669916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542029+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:38:25.542029+0000","last_peered":"2024-09-12T02:38:25.542029+0000","last_clean":"2024-09-12T02:38:25.542029+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:38:25.542029+0000","last_undegraded":"2024-09-12T02:38:25.542029+0000","last_fullsized":"2024-09-12T02:38:25.542029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:38.072584+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:38:38.072584+0000","last_peered":"2024-09-12T02:38:38.072584+0000","last_clean":"2024-09-12T02:38:38.072584+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:38:38.072584+0000","last_undegraded":"2024-09-12T02:38:38.072584+0000","last_fullsized":"2024-09-12T02:38:38.072584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.541072+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:38:25.541072+0000","last_peered":"2024-09-12T02:38:25.541072+0000","last_clean":"2024-09-12T02:38:25.541072+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:38:25.541072+0000","last_undegraded":"2024-09-12T02:38:25.541072+0000","last_fullsized":"2024-09-12T02:38:25.541072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.692441+0000","last_change":"2024-09-12T02:37:56.692441+0000","last_active":"2024-09-12T02:37:56.692441+0000","last_peered":"2024-09-12T02:37:56.692441+0000","last_clean":"2024-09-12T02:37:56.692441+0000","last_became_active":"2024-09-12T02:37:56.676982+0000","last_became_peered":"2024-09-12T02:37:56.676982+0000","last_unstale":"2024-09-12T02:37:56.692441+0000","last_undegraded":"2024-09-12T02:37:56.692441+0000","last_fullsized":"2024-09-12T02:37:56.692441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.324488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545588+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:38:25.545588+0000","last_peered":"2024-09-12T02:38:25.545588+0000","last_clean":"2024-09-12T02:38:25.545588+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:38:25.545588+0000","last_undegraded":"2024-09-12T02:38:25.545588+0000","last_fullsized":"2024-09-12T02:38:25.545588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676260+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:37:56.676260+0000","last_peered":"2024-09-12T02:37:56.676260+0000","last_clean":"2024-09-12T02:37:56.676260+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:37:56.676260+0000","last_undegraded":"2024-09-12T02:37:56.676260+0000","last_fullsized":"2024-09-12T02:37:56.676260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524802+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:38:25.524802+0000","last_peered":"2024-09-12T02:38:25.524802+0000","last_clean":"2024-09-12T02:38:25.524802+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:38:25.524802+0000","last_undegraded":"2024-09-12T02:38:25.524802+0000","last_fullsized":"2024-09-12T02:38:25.524802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669147+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.669147+0000","last_peered":"2024-09-12T02:37:56.669147+0000","last_clean":"2024-09-12T02:37:56.669147+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:37:56.669147+0000","last_undegraded":"2024-09-12T02:37:56.669147+0000","last_fullsized":"2024-09-12T02:37:56.669147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542172+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:38:25.542172+0000","last_peered":"2024-09-12T02:38:25.542172+0000","last_clean":"2024-09-12T02:38:25.542172+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:38:25.542172+0000","last_undegraded":"2024-09-12T02:38:25.542172+0000","last_fullsized":"2024-09-12T02:38:25.542172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670750+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:37:56.670750+0000","last_peered":"2024-09-12T02:37:56.670750+0000","last_clean":"2024-09-12T02:37:56.670750+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:37:56.670750+0000","last_undegraded":"2024-09-12T02:37:56.670750+0000","last_fullsized":"2024-09-12T02:37:56.670750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539778+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:38:25.539778+0000","last_peered":"2024-09-12T02:38:25.539778+0000","last_clean":"2024-09-12T02:38:25.539778+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:38:25.539778+0000","last_undegraded":"2024-09-12T02:38:25.539778+0000","last_fullsized":"2024-09-12T02:38:25.539778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677938+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:37:56.677938+0000","last_peered":"2024-09-12T02:37:56.677938+0000","last_clean":"2024-09-12T02:37:56.677938+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:37:56.677938+0000","last_undegraded":"2024-09-12T02:37:56.677938+0000","last_fullsized":"2024-09-12T02:37:56.677938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549470+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:38:25.549470+0000","last_peered":"2024-09-12T02:38:25.549470+0000","last_clean":"2024-09-12T02:38:25.549470+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:38:25.549470+0000","last_undegraded":"2024-09-12T02:38:25.549470+0000","last_fullsized":"2024-09-12T02:38:25.549470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678427+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:37:56.678427+0000","last_peered":"2024-09-12T02:37:56.678427+0000","last_clean":"2024-09-12T02:37:56.678427+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:37:56.678427+0000","last_undegraded":"2024-09-12T02:37:56.678427+0000","last_fullsized":"2024-09-12T02:37:56.678427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793192+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:37:56.793192+0000","last_peered":"2024-09-12T02:37:56.793192+0000","last_clean":"2024-09-12T02:37:56.793192+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:37:56.793192+0000","last_undegraded":"2024-09-12T02:37:56.793192+0000","last_fullsized":"2024-09-12T02:37:56.793192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550428+0000","last_change":"2024-09-12T02:37:56.674162+0000","last_active":"2024-09-12T02:38:25.550428+0000","last_peered":"2024-09-12T02:38:25.550428+0000","last_clean":"2024-09-12T02:38:25.550428+0000","last_became_active":"2024-09-12T02:37:56.673786+0000","last_became_peered":"2024-09-12T02:37:56.673786+0000","last_unstale":"2024-09-12T02:38:25.550428+0000","last_undegraded":"2024-09-12T02:38:25.550428+0000","last_fullsized":"2024-09-12T02:38:25.550428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:46.189919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678298+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.678298+0000","last_peered":"2024-09-12T02:37:56.678298+0000","last_clean":"2024-09-12T02:37:56.678298+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:37:56.678298+0000","last_undegraded":"2024-09-12T02:37:56.678298+0000","last_fullsized":"2024-09-12T02:37:56.678298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.523493+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:38:25.523493+0000","last_peered":"2024-09-12T02:38:25.523493+0000","last_clean":"2024-09-12T02:38:25.523493+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:38:25.523493+0000","last_undegraded":"2024-09-12T02:38:25.523493+0000","last_fullsized":"2024-09-12T02:38:25.523493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:39.073426+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:38:39.073426+0000","last_peered":"2024-09-12T02:38:39.073426+0000","last_clean":"2024-09-12T02:38:39.073426+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:38:39.073426+0000","last_undegraded":"2024-09-12T02:38:39.073426+0000","last_fullsized":"2024-09-12T02:38:39.073426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536855+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:38:25.536855+0000","last_peered":"2024-09-12T02:38:25.536855+0000","last_clean":"2024-09-12T02:38:25.536855+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:38:25.536855+0000","last_undegraded":"2024-09-12T02:38:25.536855+0000","last_fullsized":"2024-09-12T02:38:25.536855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678486+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:37:56.678486+0000","last_peered":"2024-09-12T02:37:56.678486+0000","last_clean":"2024-09-12T02:37:56.678486+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:37:56.678486+0000","last_undegraded":"2024-09-12T02:37:56.678486+0000","last_fullsized":"2024-09-12T02:37:56.678486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535307+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:38:25.535307+0000","last_peered":"2024-09-12T02:38:25.535307+0000","last_clean":"2024-09-12T02:38:25.535307+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:38:25.535307+0000","last_undegraded":"2024-09-12T02:38:25.535307+0000","last_fullsized":"2024-09-12T02:38:25.535307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672207+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:37:56.672207+0000","last_peered":"2024-09-12T02:37:56.672207+0000","last_clean":"2024-09-12T02:37:56.672207+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:37:56.672207+0000","last_undegraded":"2024-09-12T02:37:56.672207+0000","last_fullsized":"2024-09-12T02:37:56.672207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535973+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:38:25.535973+0000","last_peered":"2024-09-12T02:38:25.535973+0000","last_clean":"2024-09-12T02:38:25.535973+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:38:25.535973+0000","last_undegraded":"2024-09-12T02:38:25.535973+0000","last_fullsized":"2024-09-12T02:38:25.535973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.695307+0000","last_change":"2024-09-12T02:37:56.694966+0000","last_active":"2024-09-12T02:37:56.695307+0000","last_peered":"2024-09-12T02:37:56.695307+0000","last_clean":"2024-09-12T02:37:56.695307+0000","last_became_active":"2024-09-12T02:37:56.674729+0000","last_became_peered":"2024-09-12T02:37:56.674729+0000","last_unstale":"2024-09-12T02:37:56.695307+0000","last_undegraded":"2024-09-12T02:37:56.695307+0000","last_fullsized":"2024-09-12T02:37:56.695307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:51.673970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.528703+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:38:25.528703+0000","last_peered":"2024-09-12T02:38:25.528703+0000","last_clean":"2024-09-12T02:38:25.528703+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:38:25.528703+0000","last_undegraded":"2024-09-12T02:38:25.528703+0000","last_fullsized":"2024-09-12T02:38:25.528703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'13","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:31.889524+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:38:31.889524+0000","last_peered":"2024-09-12T02:38:31.889524+0000","last_clean":"2024-09-12T02:38:31.889524+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:38:31.889524+0000","last_undegraded":"2024-09-12T02:38:31.889524+0000","last_fullsized":"2024-09-12T02:38:31.889524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533951+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:38:25.533951+0000","last_peered":"2024-09-12T02:38:25.533951+0000","last_clean":"2024-09-12T02:38:25.533951+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:38:25.533951+0000","last_undegraded":"2024-09-12T02:38:25.533951+0000","last_fullsized":"2024-09-12T02:38:25.533951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793081+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:37:56.793081+0000","last_peered":"2024-09-12T02:37:56.793081+0000","last_clean":"2024-09-12T02:37:56.793081+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:37:56.793081+0000","last_undegraded":"2024-09-12T02:37:56.793081+0000","last_fullsized":"2024-09-12T02:37:56.793081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540129+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:38:25.540129+0000","last_peered":"2024-09-12T02:38:25.540129+0000","last_clean":"2024-09-12T02:38:25.540129+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:38:25.540129+0000","last_undegraded":"2024-09-12T02:38:25.540129+0000","last_fullsized":"2024-09-12T02:38:25.540129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669652+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:37:56.669652+0000","last_peered":"2024-09-12T02:37:56.669652+0000","last_clean":"2024-09-12T02:37:56.669652+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:37:56.669652+0000","last_undegraded":"2024-09-12T02:37:56.669652+0000","last_fullsized":"2024-09-12T02:37:56.669652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.500557+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:38:25.500557+0000","last_peered":"2024-09-12T02:38:25.500557+0000","last_clean":"2024-09-12T02:38:25.500557+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:38:25.500557+0000","last_undegraded":"2024-09-12T02:38:25.500557+0000","last_fullsized":"2024-09-12T02:38:25.500557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792234+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:37:56.792234+0000","last_peered":"2024-09-12T02:37:56.792234+0000","last_clean":"2024-09-12T02:37:56.792234+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:37:56.792234+0000","last_undegraded":"2024-09-12T02:37:56.792234+0000","last_fullsized":"2024-09-12T02:37:56.792234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538185+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:38:25.538185+0000","last_peered":"2024-09-12T02:38:25.538185+0000","last_clean":"2024-09-12T02:38:25.538185+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:38:25.538185+0000","last_undegraded":"2024-09-12T02:38:25.538185+0000","last_fullsized":"2024-09-12T02:38:25.538185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677722+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:37:56.677722+0000","last_peered":"2024-09-12T02:37:56.677722+0000","last_clean":"2024-09-12T02:37:56.677722+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:37:56.677722+0000","last_undegraded":"2024-09-12T02:37:56.677722+0000","last_fullsized":"2024-09-12T02:37:56.677722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532431+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:38:25.532431+0000","last_peered":"2024-09-12T02:38:25.532431+0000","last_clean":"2024-09-12T02:38:25.532431+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:38:25.532431+0000","last_undegraded":"2024-09-12T02:38:25.532431+0000","last_fullsized":"2024-09-12T02:38:25.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.797632+0000","last_change":"2024-09-12T02:37:56.797632+0000","last_active":"2024-09-12T02:37:56.797632+0000","last_peered":"2024-09-12T02:37:56.797632+0000","last_clean":"2024-09-12T02:37:56.797632+0000","last_became_active":"2024-09-12T02:37:56.794171+0000","last_became_peered":"2024-09-12T02:37:56.794171+0000","last_unstale":"2024-09-12T02:37:56.797632+0000","last_undegraded":"2024-09-12T02:37:56.797632+0000","last_fullsized":"2024-09-12T02:37:56.797632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:34.468518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550218+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:38:25.550218+0000","last_peered":"2024-09-12T02:38:25.550218+0000","last_clean":"2024-09-12T02:38:25.550218+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:38:25.550218+0000","last_undegraded":"2024-09-12T02:38:25.550218+0000","last_fullsized":"2024-09-12T02:38:25.550218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549244+0000","last_change":"2024-09-12T02:37:56.680042+0000","last_active":"2024-09-12T02:38:25.549244+0000","last_peered":"2024-09-12T02:38:25.549244+0000","last_clean":"2024-09-12T02:38:25.549244+0000","last_became_active":"2024-09-12T02:37:56.679618+0000","last_became_peered":"2024-09-12T02:37:56.679618+0000","last_unstale":"2024-09-12T02:38:25.549244+0000","last_undegraded":"2024-09-12T02:38:25.549244+0000","last_fullsized":"2024-09-12T02:38:25.549244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:53.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.682015+0000","last_change":"2024-09-12T02:37:56.681606+0000","last_active":"2024-09-12T02:37:56.682015+0000","last_peered":"2024-09-12T02:37:56.682015+0000","last_clean":"2024-09-12T02:37:56.682015+0000","last_became_active":"2024-09-12T02:37:56.674499+0000","last_became_peered":"2024-09-12T02:37:56.674499+0000","last_unstale":"2024-09-12T02:37:56.682015+0000","last_undegraded":"2024-09-12T02:37:56.682015+0000","last_fullsized":"2024-09-12T02:37:56.682015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:02.803838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550254+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:38:25.550254+0000","last_peered":"2024-09-12T02:38:25.550254+0000","last_clean":"2024-09-12T02:38:25.550254+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:38:25.550254+0000","last_undegraded":"2024-09-12T02:38:25.550254+0000","last_fullsized":"2024-09-12T02:38:25.550254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676382+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:37:56.676382+0000","last_peered":"2024-09-12T02:37:56.676382+0000","last_clean":"2024-09-12T02:37:56.676382+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:37:56.676382+0000","last_undegraded":"2024-09-12T02:37:56.676382+0000","last_fullsized":"2024-09-12T02:37:56.676382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549684+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:38:25.549684+0000","last_peered":"2024-09-12T02:38:25.549684+0000","last_clean":"2024-09-12T02:38:25.549684+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:38:25.549684+0000","last_undegraded":"2024-09-12T02:38:25.549684+0000","last_fullsized":"2024-09-12T02:38:25.549684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792826+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:56.792826+0000","last_peered":"2024-09-12T02:37:56.792826+0000","last_clean":"2024-09-12T02:37:56.792826+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:37:56.792826+0000","last_undegraded":"2024-09-12T02:37:56.792826+0000","last_fullsized":"2024-09-12T02:37:56.792826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524640+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:38:25.524640+0000","last_peered":"2024-09-12T02:38:25.524640+0000","last_clean":"2024-09-12T02:38:25.524640+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:38:25.524640+0000","last_undegraded":"2024-09-12T02:38:25.524640+0000","last_fullsized":"2024-09-12T02:38:25.524640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672690+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:37:56.672690+0000","last_peered":"2024-09-12T02:37:56.672690+0000","last_clean":"2024-09-12T02:37:56.672690+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:37:56.672690+0000","last_undegraded":"2024-09-12T02:37:56.672690+0000","last_fullsized":"2024-09-12T02:37:56.672690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73452,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":645,"num_read_kb":402,"num_write":179,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":220356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442983,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1103442,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":443197,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443095,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1035891,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561086,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442586,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1035182,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":443416,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":442897,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":513066,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":511098,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":443857,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:38:45.036 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:38:45.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:38:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:44 smithi117 ceph-mon[34898]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/467865547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce41027a0 msgr2=0x7f2ce41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/467865547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce41027a0 0x7f2ce41067f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009900 tx=0x7f2cd002a410 comp rx=0 tx=0).stop 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/467865547 shutdown_connections 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/467865547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce4106f20 0x7f2ce410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/467865547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce41027a0 0x7f2ce41067f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/467865547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce4101df0 0x7f2ce41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/467865547 >> 172.21.15.100:0/467865547 conn(0x7f2ce40fd8f0 msgr2=0x7f2ce40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/467865547 shutdown_connections 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/467865547 wait complete. 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 Processor -- start 2024-09-12T02:38:45.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.202+0000 7f2ceaa7a640 1 -- start start 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ceaa7a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce4101df0 0x7f2ce41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ceaa7a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce41027a0 0x7f2ce4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ceaa7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce4106f20 0x7f2ce419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ceaa7a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4111f80 con 0x7f2ce4101df0 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ceaa7a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4111e00 con 0x7f2ce4106f20 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ceaa7a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4112100 con 0x7f2ce41027a0 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce4101df0 0x7f2ce41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce4101df0 0x7f2ce41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51306/0 (socket says 172.21.15.100:51306) 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 -- 172.21.15.100:0/3927398072 learned_addr learned my addr 172.21.15.100:0/3927398072 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce41027a0 0x7f2ce4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce9017640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce4106f20 0x7f2ce419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 -- 172.21.15.100:0/3927398072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce41027a0 msgr2=0x7f2ce4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce41027a0 0x7f2ce4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 -- 172.21.15.100:0/3927398072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce4106f20 msgr2=0x7f2ce419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce4106f20 0x7f2ce419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 -- 172.21.15.100:0/3927398072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce419d470 con 0x7f2ce4101df0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce9017640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce4106f20 0x7f2ce419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.203+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce4101df0 0x7f2ce41984c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d770 tx=0x7f2cd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.204+0000 7f2ce1ffb640 1 -- 172.21.15.100:0/3927398072 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8017070 con 0x7f2ce4101df0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.204+0000 7f2ce1ffb640 1 -- 172.21.15.100:0/3927398072 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cd8005500 con 0x7f2ce4101df0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.204+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce419d760 con 0x7f2ce4101df0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.204+0000 7f2ce1ffb640 1 -- 172.21.15.100:0/3927398072 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8004e00 con 0x7f2ce4101df0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.204+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce41a5040 con 0x7f2ce4101df0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2ce1ffb640 1 -- 172.21.15.100:0/3927398072 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f2cd8004fa0 con 0x7f2ce4101df0 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 Processor -- start 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 -- start start 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5633cb5312e0 con 0x5633cb5cbdc0 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5633cb4d8ce0 con 0x5633cb5cb4a0 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2cece53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5633cb52d2a0 con 0x5633cb5d6680 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2ce8816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2ce8816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51316/0 (socket says 172.21.15.100:51316) 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2ce8816640 1 -- 172.21.15.100:0/923387271 learned_addr learned my addr 172.21.15.100:0/923387271 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.207+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce1ffb640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2cd40a2c10 0x7f2cd40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce9017640 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce9017640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2cd40a2c10 0x7f2cd40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce1ffb640 1 -- 172.21.15.100:0/3927398072 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2cd80cec60 con 0x7f2ce4101df0 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce3fff640 1 -- 172.21.15.100:0/923387271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 msgr2=0x5633cb5cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce3fff640 1 -- 172.21.15.100:0/923387271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 msgr2=0x5633cb5d6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce3fff640 1 -- 172.21.15.100:0/923387271 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633cb4bd440 con 0x5633cb5d6680 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce9017640 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce8816640 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce9017640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2cd40a2c10 0x7f2cd40a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0135a0 tx=0x7f2cdc004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.208+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d8a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0005940 tx=0x7f2cd0031630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1e215497c59505 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cceffd640 1 -- 172.21.15.100:0/923387271 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0040070 con 0x5633cb5d6680 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cceffd640 1 -- 172.21.15.100:0/923387271 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cd0005020 con 0x5633cb5d6680 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cceffd640 1 -- 172.21.15.100:0/923387271 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0035040 con 0x5633cb5d6680 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 -- 172.21.15.100:0/923387271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 msgr2=0x5633cb5d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d8a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0005940 tx=0x7f2cd0031630 comp rx=0 tx=0).stop 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 -- 172.21.15.100:0/923387271 shutdown_connections 2024-09-12T02:38:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d8a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 --2- 172.21.15.100:0/923387271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 -- 172.21.15.100:0/923387271 >> 172.21.15.100:0/923387271 conn(0x5633cb5c7a30 msgr2=0x5633cb5c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 -- 172.21.15.100:0/923387271 shutdown_connections 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.209+0000 7f2cece53740 1 -- 172.21.15.100:0/923387271 wait complete. 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 -- start start 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 Processor -- start 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5d5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5633cb5d9250 con 0x5633cb5cbdc0 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5633cb4ec050 con 0x5633cb5cb4a0 2024-09-12T02:38:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5633cb5d93d0 con 0x5633cb5d6680 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2cece53740 10 client.0 _ll_register_callbacks cb 0x5633cb52c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51320/0 (socket says 172.21.15.100:51320) 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.210+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3991515487 learned_addr learned my addr 172.21.15.100:0/3991515487 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5d5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce9017640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3991515487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 msgr2=0x5633cb5d3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 msgr2=0x5633cb5d5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5d5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3991515487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633cb2a23c0 con 0x5633cb5cbdc0 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5d5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d31c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009900 tx=0x7f2cd0005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33468089e6530f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2cc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3991515487 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd004c020 con 0x5633cb5cbdc0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3991515487 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2cd0004750 con 0x5633cb5cbdc0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cd0005020 con 0x5633cb5cbdc0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3991515487 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2cd0057050 con 0x5633cb5cbdc0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2cece53740 10 client.15264 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.211+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5633cb5e4b60 con 0x5633cb5cbdc0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3991515487 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cd0005020 con 0x5633cb5cbdc0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3991515487 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2cd0003b80 con 0x5633cb5cbdc0 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cece53740 10 client.15264 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cece53740 10 client.15264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cece53740 20 client.15264 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cece53740 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb5e5eb0 0x5633cb5e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cece53740 4 client.15264 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633cb53e850 con 0x5633cb5e5eb0 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.212+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb5e5eb0 0x5633cb5e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2cc3fff640 10 client.15264 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb5e5eb0 0x5633cb5e82a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cd3536a18c60beb server_cookie=3a1a84ec5db1791 in_seq=0 out_seq=0 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3991515487 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633cb53e850 con 0x5633cb5e5eb0 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2cc3fff640 10 client.15264 handle_command_reply: tid=0 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2cece53740 1 client.15264 shutdown 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 msgr2=0x5633cb5d31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2cece53740 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d31c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009900 tx=0x7f2cd0005400 comp rx=0 tx=0).stop 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.213+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 shutdown_connections 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb5e5eb0 0x5633cb5e82a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5d3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5d31c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 1 --2- 172.21.15.100:0/3991515487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb5d5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cc3fff640 0 client.15264 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:45.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 >> 172.21.15.100:0/3991515487 conn(0x5633cb5c7a30 msgr2=0x5633cb5cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:45.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 shutdown_connections 2024-09-12T02:38:45.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 1 -- 172.21.15.100:0/3991515487 wait complete. 2024-09-12T02:38:45.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.214+0000 7f2cece53740 20 client.15264 trim_cache size 0 max 16384 2024-09-12T02:38:45.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 Processor -- start 2024-09-12T02:38:45.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 -- start start 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cb4a0 0x5633cb5e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cbdc0 0x5633cb5ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5ede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41afe20 con 0x5633cb5cb4a0 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41ad6f0 con 0x5633cb5cbdc0 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2cece53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41ab540 con 0x5633cb5d6680 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.232+0000 7f2ce8816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cb4a0 0x5633cb5e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cb4a0 0x5633cb5e24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51324/0 (socket says 172.21.15.100:51324) 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 -- 172.21.15.100:0/2865353073 learned_addr learned my addr 172.21.15.100:0/2865353073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce9017640 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cbdc0 0x5633cb5ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 -- 172.21.15.100:0/2865353073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 msgr2=0x5633cb5ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5ede10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 -- 172.21.15.100:0/2865353073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cbdc0 msgr2=0x5633cb5ed8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cbdc0 0x5633cb5ed8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 -- 172.21.15.100:0/2865353073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633cb5c7860 con 0x5633cb5cb4a0 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cbdc0 0x5633cb5ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2ce8816640 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cb4a0 0x5633cb5e24b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009610 tx=0x7f2cd801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c74ea5a2db98382 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2cce7fc640 1 -- 172.21.15.100:0/2865353073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8020040 con 0x5633cb5cb4a0 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2cce7fc640 1 -- 172.21.15.100:0/2865353073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cd809b350 con 0x5633cb5cb4a0 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.233+0000 7f2cce7fc640 1 -- 172.21.15.100:0/2865353073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8009cc0 con 0x5633cb5cb4a0 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 -- 172.21.15.100:0/2865353073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cb4a0 msgr2=0x5633cb5e24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cb4a0 0x5633cb5e24b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009610 tx=0x7f2cd801d040 comp rx=0 tx=0).stop 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 -- 172.21.15.100:0/2865353073 shutdown_connections 2024-09-12T02:38:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cbdc0 0x5633cb5ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 --2- 172.21.15.100:0/2865353073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cb4a0 0x5633cb5e24b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 -- 172.21.15.100:0/2865353073 >> 172.21.15.100:0/2865353073 conn(0x5633cb5c7a30 msgr2=0x5633cb5d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 -- 172.21.15.100:0/2865353073 shutdown_connections 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 -- 172.21.15.100:0/2865353073 wait complete. 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 -- start start 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.234+0000 7f2cece53740 1 Processor -- start 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2cece53740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb64c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2cece53740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5de620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2cece53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5dec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2cece53740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41abbb0 con 0x5633cb5cbdc0 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2cece53740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41ad020 con 0x5633cb5cb4a0 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2cece53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41ac280 con 0x5633cb5d6680 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2cece53740 10 client.0 _ll_register_callbacks cb 0x7f2cd8097670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5de620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51330/0 (socket says 172.21.15.100:51330) 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3420111957 learned_addr learned my addr 172.21.15.100:0/3420111957 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb64c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.235+0000 7f2ce9017640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3420111957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 msgr2=0x5633cb5dec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5dec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 msgr2=0x5633cb64c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb64c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2ce3fff640 1 -- 172.21.15.100:0/3420111957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633cb5d0220 con 0x5633cb5cbdc0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2ce9017640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2ce3fff640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5de620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2cd002a930 tx=0x7f2cd0005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5713fe4666e6f3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3420111957 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd004c040 con 0x5633cb5cbdc0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3420111957 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2cd0004240 con 0x5633cb5cbdc0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cd809b350 con 0x5633cb5cbdc0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3420111957 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2cd0040070 con 0x5633cb5cbdc0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cece53740 10 client.15270 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5633cb654f20 con 0x5633cb5cbdc0 2024-09-12T02:38:45.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.236+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3420111957 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cd809b350 con 0x5633cb5cbdc0 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3420111957 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2cd0065050 con 0x5633cb5cbdc0 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cece53740 10 client.15270 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cece53740 10 client.15270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cece53740 20 client.15270 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cece53740 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb655540 0x5633cb657960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cece53740 4 client.15270 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5633cb5d3a90 con 0x5633cb655540 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb655540 0x5633cb657960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2ce8816640 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb655540 0x5633cb657960 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed43f6045ca7dbc server_cookie=e4543331168c9b82 in_seq=0 out_seq=0 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.237+0000 7f2cc3fff640 10 client.15270 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cc3fff640 1 -- 172.21.15.100:0/3420111957 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5633cb5d3a90 con 0x5633cb655540 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cc3fff640 10 client.15270 handle_command_reply: tid=0 2024-09-12T02:38:45.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 client.15270 shutdown 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 msgr2=0x5633cb5de620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5de620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2cd002a930 tx=0x7f2cd0005890 comp rx=0 tx=0).stop 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 shutdown_connections 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633cb655540 0x5633cb657960 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cc3fff640 0 client.15270 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cb5d6680 0x5633cb5dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633cb5cbdc0 0x5633cb5de620 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 --2- 172.21.15.100:0/3420111957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633cb5cb4a0 0x5633cb64c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 >> 172.21.15.100:0/3420111957 conn(0x5633cb5c7a30 msgr2=0x5633cb5d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 shutdown_connections 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 1 -- 172.21.15.100:0/3420111957 wait complete. 2024-09-12T02:38:45.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.238+0000 7f2cece53740 20 client.15270 trim_cache size 0 max 16384 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout: "61d6dce3-491d-4e2e-b231-70959cc0bb11": { 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "61d6dce3-491d-4e2e-b231-70959cc0bb11", 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:38:45.249 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:38:45.250 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:38:45.250 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:45.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2cd40a2c10 msgr2=0x7f2cd40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2cd40a2c10 0x7f2cd40a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0135a0 tx=0x7f2cdc004ab0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce4101df0 msgr2=0x7f2ce41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce4101df0 0x7f2ce41984c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d770 tx=0x7f2cd800dc30 comp rx=0 tx=0).stop 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 shutdown_connections 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2cd40a2c10 0x7f2cd40a50d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce4106f20 0x7f2ce419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce41027a0 0x7f2ce4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 --2- 172.21.15.100:0/3927398072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ce4101df0 0x7f2ce41984c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 >> 172.21.15.100:0/3927398072 conn(0x7f2ce40fd8f0 msgr2=0x7f2ce40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 shutdown_connections 2024-09-12T02:38:45.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:45.239+0000 7f2ceaa7a640 1 -- 172.21.15.100:0/3927398072 wait complete. 2024-09-12T02:38:46.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:45 smithi189 ceph-mon[35196]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:46.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:45 smithi117 ceph-mon[34898]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:46.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:45 smithi100 ceph-mon[31390]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:46.129 INFO:tasks.cephfs.filesystem:scrub status for tag:61d6dce3-491d-4e2e-b231-70959cc0bb11 - {'path': '/', 'tag': '61d6dce3-491d-4e2e-b231-70959cc0bb11', 'options': 'recursive,force'} 2024-09-12T02:38:46.152 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:46.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 -- 172.21.15.100:0/3447257566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c100a80 msgr2=0x7ff33c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 --2- 172.21.15.100:0/3447257566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c100a80 0x7ff33c100ee0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff324009930 tx=0x7ff32402a420 comp rx=0 tx=0).stop 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 -- 172.21.15.100:0/3447257566 shutdown_connections 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 --2- 172.21.15.100:0/3447257566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff33c101420 0x7ff33c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 --2- 172.21.15.100:0/3447257566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c100a80 0x7ff33c100ee0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 --2- 172.21.15.100:0/3447257566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff33c106a80 0x7ff33c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 -- 172.21.15.100:0/3447257566 >> 172.21.15.100:0/3447257566 conn(0x7ff33c0fc7a0 msgr2=0x7ff33c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 -- 172.21.15.100:0/3447257566 shutdown_connections 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.591+0000 7ff34216f640 1 -- 172.21.15.100:0/3447257566 wait complete. 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 Processor -- start 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 -- start start 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff33c100a80 0x7ff33c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:46.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff33c101420 0x7ff33c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c106a80 0x7ff33c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c111fa0 con 0x7ff33c106a80 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c111e20 con 0x7ff33c100a80 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff34216f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c112120 con 0x7ff33c101420 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c106a80 0x7ff33c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c106a80 0x7ff33c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51338/0 (socket says 172.21.15.100:51338) 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.592+0000 7ff33bfff640 1 -- 172.21.15.100:0/1197133595 learned_addr learned my addr 172.21.15.100:0/1197133595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33b7fe640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff33c100a80 0x7ff33c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33bfff640 1 -- 172.21.15.100:0/1197133595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff33c101420 msgr2=0x7ff33c1989c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33bfff640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff33c101420 0x7ff33c1989c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33bfff640 1 -- 172.21.15.100:0/1197133595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff33c100a80 msgr2=0x7ff33c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33bfff640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff33c100a80 0x7ff33c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33bfff640 1 -- 172.21.15.100:0/1197133595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c19d430 con 0x7ff33c106a80 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33b7fe640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff33c100a80 0x7ff33c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:46.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff33bfff640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c106a80 0x7ff33c19cd50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff33400eaa0 tx=0x7ff33400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff3397fa640 1 -- 172.21.15.100:0/1197133595 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33400cdb0 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c19d720 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff3397fa640 1 -- 172.21.15.100:0/1197133595 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff334005020 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff3397fa640 1 -- 172.21.15.100:0/1197133595 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3340116b0 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.593+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c1a5000 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.594+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c100ee0 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.595+0000 7ff3397fa640 1 -- 172.21.15.100:0/1197133595 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7ff334005560 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.596+0000 7ff3397fa640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff3280a2c10 0x7ff3280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.596+0000 7ff33b7fe640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff3280a2c10 0x7ff3280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.596+0000 7ff3397fa640 1 -- 172.21.15.100:0/1197133595 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff3340cf510 con 0x7ff33c106a80 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.596+0000 7ff33b7fe640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff3280a2c10 0x7ff3280a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0058c0 tx=0x7ff32c005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:46.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.600+0000 7ff3397fa640 1 -- 172.21.15.100:0/1197133595 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff334016030 con 0x7ff33c106a80 2024-09-12T02:38:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.767+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 --> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff33c062630 con 0x7ff3280a2c10 2024-09-12T02:38:46.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.773+0000 7ff3397fa640 1 -- 172.21.15.100:0/1197133595 <== mgr.14150 v2:172.21.15.100:6800/2819887168 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259090 (secure 0 0 0) 0x7ff33c062630 con 0x7ff3280a2c10 2024-09-12T02:38:46.775 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:38:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff3280a2c10 msgr2=0x7ff3280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff3280a2c10 0x7ff3280a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0058c0 tx=0x7ff32c005cb0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c106a80 msgr2=0x7ff33c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c106a80 0x7ff33c19cd50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff33400eaa0 tx=0x7ff33400ef60 comp rx=0 tx=0).stop 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 shutdown_connections 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff3280a2c10 0x7ff3280a50d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff33c106a80 0x7ff33c19cd50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff33c101420 0x7ff33c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 --2- 172.21.15.100:0/1197133595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff33c100a80 0x7ff33c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 >> 172.21.15.100:0/1197133595 conn(0x7ff33c0fc7a0 msgr2=0x7ff33c0fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 shutdown_connections 2024-09-12T02:38:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:46.776+0000 7ff34216f640 1 -- 172.21.15.100:0/1197133595 wait complete. 2024-09-12T02:38:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:46 smithi189 ceph-mon[35196]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-12T02:38:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:46 smithi117 ceph-mon[34898]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-12T02:38:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:46 smithi100 ceph-mon[31390]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-12T02:38:47.591 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-12T02:38:45.550599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664054,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":781,"num_read_kb":511,"num_write":362,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":790,"ondisk_log_size":790,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356296,"kb_used_data":11208,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585528,"statfs":{"total":1151940427776,"available":1151575580672,"internally_reserved":0,"allocated":11476992,"data_stored":7300710,"data_compressed":176832,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9295,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":42,"num_write":12,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002755"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538892+0000","last_change":"2024-09-12T02:36:48.884727+0000","last_active":"2024-09-12T02:38:25.538892+0000","last_peered":"2024-09-12T02:38:25.538892+0000","last_clean":"2024-09-12T02:38:25.538892+0000","last_became_active":"2024-09-12T02:36:48.884436+0000","last_became_peered":"2024-09-12T02:36:48.884436+0000","last_unstale":"2024-09-12T02:38:25.538892+0000","last_undegraded":"2024-09-12T02:38:25.538892+0000","last_fullsized":"2024-09-12T02:38:25.538892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:03.162711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537706+0000","last_change":"2024-09-12T02:36:48.874202+0000","last_active":"2024-09-12T02:38:25.537706+0000","last_peered":"2024-09-12T02:38:25.537706+0000","last_clean":"2024-09-12T02:38:25.537706+0000","last_became_active":"2024-09-12T02:36:48.873902+0000","last_became_peered":"2024-09-12T02:36:48.873902+0000","last_unstale":"2024-09-12T02:38:25.537706+0000","last_undegraded":"2024-09-12T02:38:25.537706+0000","last_fullsized":"2024-09-12T02:38:25.537706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.144741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544892+0000","last_change":"2024-09-12T02:36:48.876382+0000","last_active":"2024-09-12T02:38:25.544892+0000","last_peered":"2024-09-12T02:38:25.544892+0000","last_clean":"2024-09-12T02:38:25.544892+0000","last_became_active":"2024-09-12T02:36:48.876096+0000","last_became_peered":"2024-09-12T02:36:48.876096+0000","last_unstale":"2024-09-12T02:38:25.544892+0000","last_undegraded":"2024-09-12T02:38:25.544892+0000","last_fullsized":"2024-09-12T02:38:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:44.082923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526152+0000","last_change":"2024-09-12T02:36:48.889565+0000","last_active":"2024-09-12T02:38:25.526152+0000","last_peered":"2024-09-12T02:38:25.526152+0000","last_clean":"2024-09-12T02:38:25.526152+0000","last_became_active":"2024-09-12T02:36:48.888322+0000","last_became_peered":"2024-09-12T02:36:48.888322+0000","last_unstale":"2024-09-12T02:38:25.526152+0000","last_undegraded":"2024-09-12T02:38:25.526152+0000","last_fullsized":"2024-09-12T02:38:25.526152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:34.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.526205+0000","last_change":"2024-09-12T02:36:48.879164+0000","last_active":"2024-09-12T02:38:25.526205+0000","last_peered":"2024-09-12T02:38:25.526205+0000","last_clean":"2024-09-12T02:38:25.526205+0000","last_became_active":"2024-09-12T02:36:48.878823+0000","last_became_peered":"2024-09-12T02:36:48.878823+0000","last_unstale":"2024-09-12T02:38:25.526205+0000","last_undegraded":"2024-09-12T02:38:25.526205+0000","last_fullsized":"2024-09-12T02:38:25.526205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:05.668271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536028+0000","last_change":"2024-09-12T02:36:48.878612+0000","last_active":"2024-09-12T02:38:25.536028+0000","last_peered":"2024-09-12T02:38:25.536028+0000","last_clean":"2024-09-12T02:38:25.536028+0000","last_became_active":"2024-09-12T02:36:48.878105+0000","last_became_peered":"2024-09-12T02:36:48.878105+0000","last_unstale":"2024-09-12T02:38:25.536028+0000","last_undegraded":"2024-09-12T02:38:25.536028+0000","last_fullsized":"2024-09-12T02:38:25.536028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:50.125040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540044+0000","last_change":"2024-09-12T02:36:48.882832+0000","last_active":"2024-09-12T02:38:25.540044+0000","last_peered":"2024-09-12T02:38:25.540044+0000","last_clean":"2024-09-12T02:38:25.540044+0000","last_became_active":"2024-09-12T02:36:48.882497+0000","last_became_peered":"2024-09-12T02:36:48.882497+0000","last_unstale":"2024-09-12T02:38:25.540044+0000","last_undegraded":"2024-09-12T02:38:25.540044+0000","last_fullsized":"2024-09-12T02:38:25.540044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:50.829020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533451+0000","last_change":"2024-09-12T02:36:48.879874+0000","last_active":"2024-09-12T02:38:25.533451+0000","last_peered":"2024-09-12T02:38:25.533451+0000","last_clean":"2024-09-12T02:38:25.533451+0000","last_became_active":"2024-09-12T02:36:48.879582+0000","last_became_peered":"2024-09-12T02:36:48.879582+0000","last_unstale":"2024-09-12T02:38:25.533451+0000","last_undegraded":"2024-09-12T02:38:25.533451+0000","last_fullsized":"2024-09-12T02:38:25.533451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:09.312797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548353+0000","last_change":"2024-09-12T02:36:48.886519+0000","last_active":"2024-09-12T02:38:25.548353+0000","last_peered":"2024-09-12T02:38:25.548353+0000","last_clean":"2024-09-12T02:38:25.548353+0000","last_became_active":"2024-09-12T02:36:48.886224+0000","last_became_peered":"2024-09-12T02:36:48.886224+0000","last_unstale":"2024-09-12T02:38:25.548353+0000","last_undegraded":"2024-09-12T02:38:25.548353+0000","last_fullsized":"2024-09-12T02:38:25.548353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:54.231440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540355+0000","last_change":"2024-09-12T02:36:48.887081+0000","last_active":"2024-09-12T02:38:25.540355+0000","last_peered":"2024-09-12T02:38:25.540355+0000","last_clean":"2024-09-12T02:38:25.540355+0000","last_became_active":"2024-09-12T02:36:48.886729+0000","last_became_peered":"2024-09-12T02:36:48.886729+0000","last_unstale":"2024-09-12T02:38:25.540355+0000","last_undegraded":"2024-09-12T02:38:25.540355+0000","last_fullsized":"2024-09-12T02:38:25.540355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:34.311831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545641+0000","last_change":"2024-09-12T02:36:48.884431+0000","last_active":"2024-09-12T02:38:25.545641+0000","last_peered":"2024-09-12T02:38:25.545641+0000","last_clean":"2024-09-12T02:38:25.545641+0000","last_became_active":"2024-09-12T02:36:48.884045+0000","last_became_peered":"2024-09-12T02:36:48.884045+0000","last_unstale":"2024-09-12T02:38:25.545641+0000","last_undegraded":"2024-09-12T02:38:25.545641+0000","last_fullsized":"2024-09-12T02:38:25.545641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.507996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524741+0000","last_change":"2024-09-12T02:36:48.888537+0000","last_active":"2024-09-12T02:38:25.524741+0000","last_peered":"2024-09-12T02:38:25.524741+0000","last_clean":"2024-09-12T02:38:25.524741+0000","last_became_active":"2024-09-12T02:36:48.888071+0000","last_became_peered":"2024-09-12T02:36:48.888071+0000","last_unstale":"2024-09-12T02:38:25.524741+0000","last_undegraded":"2024-09-12T02:38:25.524741+0000","last_fullsized":"2024-09-12T02:38:25.524741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:44.071296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535897+0000","last_change":"2024-09-12T02:36:48.879155+0000","last_active":"2024-09-12T02:38:25.535897+0000","last_peered":"2024-09-12T02:38:25.535897+0000","last_clean":"2024-09-12T02:38:25.535897+0000","last_became_active":"2024-09-12T02:36:48.878873+0000","last_became_peered":"2024-09-12T02:36:48.878873+0000","last_unstale":"2024-09-12T02:38:25.535897+0000","last_undegraded":"2024-09-12T02:38:25.535897+0000","last_fullsized":"2024-09-12T02:38:25.535897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:40.079817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538014+0000","last_change":"2024-09-12T02:36:48.876796+0000","last_active":"2024-09-12T02:38:25.538014+0000","last_peered":"2024-09-12T02:38:25.538014+0000","last_clean":"2024-09-12T02:38:25.538014+0000","last_became_active":"2024-09-12T02:36:48.875586+0000","last_became_peered":"2024-09-12T02:36:48.875586+0000","last_unstale":"2024-09-12T02:38:25.538014+0000","last_undegraded":"2024-09-12T02:38:25.538014+0000","last_fullsized":"2024-09-12T02:38:25.538014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535913+0000","last_change":"2024-09-12T02:36:48.889349+0000","last_active":"2024-09-12T02:38:25.535913+0000","last_peered":"2024-09-12T02:38:25.535913+0000","last_clean":"2024-09-12T02:38:25.535913+0000","last_became_active":"2024-09-12T02:36:48.889073+0000","last_became_peered":"2024-09-12T02:36:48.889073+0000","last_unstale":"2024-09-12T02:38:25.535913+0000","last_undegraded":"2024-09-12T02:38:25.535913+0000","last_fullsized":"2024-09-12T02:38:25.535913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.204186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549559+0000","last_change":"2024-09-12T02:36:48.876525+0000","last_active":"2024-09-12T02:38:25.549559+0000","last_peered":"2024-09-12T02:38:25.549559+0000","last_clean":"2024-09-12T02:38:25.549559+0000","last_became_active":"2024-09-12T02:36:48.876071+0000","last_became_peered":"2024-09-12T02:36:48.876071+0000","last_unstale":"2024-09-12T02:38:25.549559+0000","last_undegraded":"2024-09-12T02:38:25.549559+0000","last_fullsized":"2024-09-12T02:38:25.549559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.719168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.544656+0000","last_change":"2024-09-12T02:36:48.883518+0000","last_active":"2024-09-12T02:38:25.544656+0000","last_peered":"2024-09-12T02:38:25.544656+0000","last_clean":"2024-09-12T02:38:25.544656+0000","last_became_active":"2024-09-12T02:36:48.882081+0000","last_became_peered":"2024-09-12T02:36:48.882081+0000","last_unstale":"2024-09-12T02:38:25.544656+0000","last_undegraded":"2024-09-12T02:38:25.544656+0000","last_fullsized":"2024-09-12T02:38:25.544656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:31.848857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550740+0000","last_change":"2024-09-12T02:36:48.874770+0000","last_active":"2024-09-12T02:38:25.550740+0000","last_peered":"2024-09-12T02:38:25.550740+0000","last_clean":"2024-09-12T02:38:25.550740+0000","last_became_active":"2024-09-12T02:36:48.874357+0000","last_became_peered":"2024-09-12T02:36:48.874357+0000","last_unstale":"2024-09-12T02:38:25.550740+0000","last_undegraded":"2024-09-12T02:38:25.550740+0000","last_fullsized":"2024-09-12T02:38:25.550740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:10.280250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537295+0000","last_change":"2024-09-12T02:36:48.878178+0000","last_active":"2024-09-12T02:38:25.537295+0000","last_peered":"2024-09-12T02:38:25.537295+0000","last_clean":"2024-09-12T02:38:25.537295+0000","last_became_active":"2024-09-12T02:36:48.877838+0000","last_became_peered":"2024-09-12T02:36:48.877838+0000","last_unstale":"2024-09-12T02:38:25.537295+0000","last_undegraded":"2024-09-12T02:38:25.537295+0000","last_fullsized":"2024-09-12T02:38:25.537295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:40.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.531643+0000","last_change":"2024-09-12T02:37:56.677503+0000","last_active":"2024-09-12T02:38:25.531643+0000","last_peered":"2024-09-12T02:38:25.531643+0000","last_clean":"2024-09-12T02:38:25.531643+0000","last_became_active":"2024-09-12T02:37:56.677082+0000","last_became_peered":"2024-09-12T02:37:56.677082+0000","last_unstale":"2024-09-12T02:38:25.531643+0000","last_undegraded":"2024-09-12T02:38:25.531643+0000","last_fullsized":"2024-09-12T02:38:25.531643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:10.331298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542061+0000","last_change":"2024-09-12T02:36:48.877796+0000","last_active":"2024-09-12T02:38:25.542061+0000","last_peered":"2024-09-12T02:38:25.542061+0000","last_clean":"2024-09-12T02:38:25.542061+0000","last_became_active":"2024-09-12T02:36:48.877483+0000","last_became_peered":"2024-09-12T02:36:48.877483+0000","last_unstale":"2024-09-12T02:38:25.542061+0000","last_undegraded":"2024-09-12T02:38:25.542061+0000","last_fullsized":"2024-09-12T02:38:25.542061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:54.529648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549255+0000","last_change":"2024-09-12T02:36:48.877206+0000","last_active":"2024-09-12T02:38:25.549255+0000","last_peered":"2024-09-12T02:38:25.549255+0000","last_clean":"2024-09-12T02:38:25.549255+0000","last_became_active":"2024-09-12T02:36:48.876911+0000","last_became_peered":"2024-09-12T02:36:48.876911+0000","last_unstale":"2024-09-12T02:38:25.549255+0000","last_undegraded":"2024-09-12T02:38:25.549255+0000","last_fullsized":"2024-09-12T02:38:25.549255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:52.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532406+0000","last_change":"2024-09-12T02:36:48.878281+0000","last_active":"2024-09-12T02:38:25.532406+0000","last_peered":"2024-09-12T02:38:25.532406+0000","last_clean":"2024-09-12T02:38:25.532406+0000","last_became_active":"2024-09-12T02:36:48.877901+0000","last_became_peered":"2024-09-12T02:36:48.877901+0000","last_unstale":"2024-09-12T02:38:25.532406+0000","last_undegraded":"2024-09-12T02:38:25.532406+0000","last_fullsized":"2024-09-12T02:38:25.532406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:26.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537351+0000","last_change":"2024-09-12T02:36:48.882312+0000","last_active":"2024-09-12T02:38:25.537351+0000","last_peered":"2024-09-12T02:38:25.537351+0000","last_clean":"2024-09-12T02:38:25.537351+0000","last_became_active":"2024-09-12T02:36:48.881616+0000","last_became_peered":"2024-09-12T02:36:48.881616+0000","last_unstale":"2024-09-12T02:38:25.537351+0000","last_undegraded":"2024-09-12T02:38:25.537351+0000","last_fullsized":"2024-09-12T02:38:25.537351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.721382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524406+0000","last_change":"2024-09-12T02:36:48.889571+0000","last_active":"2024-09-12T02:38:25.524406+0000","last_peered":"2024-09-12T02:38:25.524406+0000","last_clean":"2024-09-12T02:38:25.524406+0000","last_became_active":"2024-09-12T02:36:48.889239+0000","last_became_peered":"2024-09-12T02:36:48.889239+0000","last_unstale":"2024-09-12T02:38:25.524406+0000","last_undegraded":"2024-09-12T02:38:25.524406+0000","last_fullsized":"2024-09-12T02:38:25.524406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:35.572128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.551180+0000","last_change":"2024-09-12T02:36:48.882609+0000","last_active":"2024-09-12T02:38:25.551180+0000","last_peered":"2024-09-12T02:38:25.551180+0000","last_clean":"2024-09-12T02:38:25.551180+0000","last_became_active":"2024-09-12T02:36:48.882076+0000","last_became_peered":"2024-09-12T02:36:48.882076+0000","last_unstale":"2024-09-12T02:38:25.551180+0000","last_undegraded":"2024-09-12T02:38:25.551180+0000","last_fullsized":"2024-09-12T02:38:25.551180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.530680+0000","last_change":"2024-09-12T02:36:48.878727+0000","last_active":"2024-09-12T02:38:25.530680+0000","last_peered":"2024-09-12T02:38:25.530680+0000","last_clean":"2024-09-12T02:38:25.530680+0000","last_became_active":"2024-09-12T02:36:48.878331+0000","last_became_peered":"2024-09-12T02:36:48.878331+0000","last_unstale":"2024-09-12T02:38:25.530680+0000","last_undegraded":"2024-09-12T02:38:25.530680+0000","last_fullsized":"2024-09-12T02:38:25.530680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:14.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540212+0000","last_change":"2024-09-12T02:36:48.890883+0000","last_active":"2024-09-12T02:38:25.540212+0000","last_peered":"2024-09-12T02:38:25.540212+0000","last_clean":"2024-09-12T02:38:25.540212+0000","last_became_active":"2024-09-12T02:36:48.890517+0000","last_became_peered":"2024-09-12T02:36:48.890517+0000","last_unstale":"2024-09-12T02:38:25.540212+0000","last_undegraded":"2024-09-12T02:38:25.540212+0000","last_fullsized":"2024-09-12T02:38:25.540212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:06.008096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.537408+0000","last_change":"2024-09-12T02:36:48.889310+0000","last_active":"2024-09-12T02:38:25.537408+0000","last_peered":"2024-09-12T02:38:25.537408+0000","last_clean":"2024-09-12T02:38:25.537408+0000","last_became_active":"2024-09-12T02:36:48.889023+0000","last_became_peered":"2024-09-12T02:36:48.889023+0000","last_unstale":"2024-09-12T02:38:25.537408+0000","last_undegraded":"2024-09-12T02:38:25.537408+0000","last_fullsized":"2024-09-12T02:38:25.537408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:45.703543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.534838+0000","last_change":"2024-09-12T02:36:48.874259+0000","last_active":"2024-09-12T02:38:25.534838+0000","last_peered":"2024-09-12T02:38:25.534838+0000","last_clean":"2024-09-12T02:38:25.534838+0000","last_became_active":"2024-09-12T02:36:48.873876+0000","last_became_peered":"2024-09-12T02:36:48.873876+0000","last_unstale":"2024-09-12T02:38:25.534838+0000","last_undegraded":"2024-09-12T02:38:25.534838+0000","last_fullsized":"2024-09-12T02:38:25.534838+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.014348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538471+0000","last_change":"2024-09-12T02:36:48.888352+0000","last_active":"2024-09-12T02:38:25.538471+0000","last_peered":"2024-09-12T02:38:25.538471+0000","last_clean":"2024-09-12T02:38:25.538471+0000","last_became_active":"2024-09-12T02:36:48.888001+0000","last_became_peered":"2024-09-12T02:36:48.888001+0000","last_unstale":"2024-09-12T02:38:25.538471+0000","last_undegraded":"2024-09-12T02:38:25.538471+0000","last_fullsized":"2024-09-12T02:38:25.538471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.259356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527368+0000","last_change":"2024-09-12T02:36:48.878697+0000","last_active":"2024-09-12T02:38:25.527368+0000","last_peered":"2024-09-12T02:38:25.527368+0000","last_clean":"2024-09-12T02:38:25.527368+0000","last_became_active":"2024-09-12T02:36:48.877789+0000","last_became_peered":"2024-09-12T02:36:48.877789+0000","last_unstale":"2024-09-12T02:38:25.527368+0000","last_undegraded":"2024-09-12T02:38:25.527368+0000","last_fullsized":"2024-09-12T02:38:25.527368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:36.705348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529505+0000","last_change":"2024-09-12T02:36:48.884089+0000","last_active":"2024-09-12T02:38:25.529505+0000","last_peered":"2024-09-12T02:38:25.529505+0000","last_clean":"2024-09-12T02:38:25.529505+0000","last_became_active":"2024-09-12T02:36:48.883309+0000","last_became_peered":"2024-09-12T02:36:48.883309+0000","last_unstale":"2024-09-12T02:38:25.529505+0000","last_undegraded":"2024-09-12T02:38:25.529505+0000","last_fullsized":"2024-09-12T02:38:25.529505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.439687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":140,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:42.078209+0000","last_change":"2024-09-12T02:36:46.859342+0000","last_active":"2024-09-12T02:38:42.078209+0000","last_peered":"2024-09-12T02:38:42.078209+0000","last_clean":"2024-09-12T02:38:42.078209+0000","last_became_active":"2024-09-12T02:36:46.858697+0000","last_became_peered":"2024-09-12T02:36:46.858697+0000","last_unstale":"2024-09-12T02:38:42.078209+0000","last_undegraded":"2024-09-12T02:38:42.078209+0000","last_fullsized":"2024-09-12T02:38:42.078209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:37.419911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539985+0000","last_change":"2024-09-12T02:36:48.891599+0000","last_active":"2024-09-12T02:38:25.539985+0000","last_peered":"2024-09-12T02:38:25.539985+0000","last_clean":"2024-09-12T02:38:25.539985+0000","last_became_active":"2024-09-12T02:36:48.891285+0000","last_became_peered":"2024-09-12T02:36:48.891285+0000","last_unstale":"2024-09-12T02:38:25.539985+0000","last_undegraded":"2024-09-12T02:38:25.539985+0000","last_fullsized":"2024-09-12T02:38:25.539985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.020734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.755048+0000","last_change":"2024-09-12T02:36:46.857812+0000","last_active":"2024-09-12T02:37:56.755048+0000","last_peered":"2024-09-12T02:37:56.755048+0000","last_clean":"2024-09-12T02:37:56.755048+0000","last_became_active":"2024-09-12T02:36:46.857393+0000","last_became_peered":"2024-09-12T02:36:46.857393+0000","last_unstale":"2024-09-12T02:37:56.755048+0000","last_undegraded":"2024-09-12T02:37:56.755048+0000","last_fullsized":"2024-09-12T02:37:56.755048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:48.521173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.668877+0000","last_change":"2024-09-12T02:36:46.854367+0000","last_active":"2024-09-12T02:37:56.668877+0000","last_peered":"2024-09-12T02:37:56.668877+0000","last_clean":"2024-09-12T02:37:56.668877+0000","last_became_active":"2024-09-12T02:36:46.854042+0000","last_became_peered":"2024-09-12T02:36:46.854042+0000","last_unstale":"2024-09-12T02:37:56.668877+0000","last_undegraded":"2024-09-12T02:37:56.668877+0000","last_fullsized":"2024-09-12T02:37:56.668877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.497112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.527196+0000","last_change":"2024-09-12T02:36:48.872467+0000","last_active":"2024-09-12T02:38:25.527196+0000","last_peered":"2024-09-12T02:38:25.527196+0000","last_clean":"2024-09-12T02:38:25.527196+0000","last_became_active":"2024-09-12T02:36:48.872163+0000","last_became_peered":"2024-09-12T02:36:48.872163+0000","last_unstale":"2024-09-12T02:38:25.527196+0000","last_undegraded":"2024-09-12T02:38:25.527196+0000","last_fullsized":"2024-09-12T02:38:25.527196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:40.357029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670102+0000","last_change":"2024-09-12T02:36:46.859680+0000","last_active":"2024-09-12T02:37:56.670102+0000","last_peered":"2024-09-12T02:37:56.670102+0000","last_clean":"2024-09-12T02:37:56.670102+0000","last_became_active":"2024-09-12T02:36:46.859361+0000","last_became_peered":"2024-09-12T02:36:46.859361+0000","last_unstale":"2024-09-12T02:37:56.670102+0000","last_undegraded":"2024-09-12T02:37:56.670102+0000","last_fullsized":"2024-09-12T02:37:56.670102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:08.699971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.529360+0000","last_change":"2024-09-12T02:36:48.872525+0000","last_active":"2024-09-12T02:38:25.529360+0000","last_peered":"2024-09-12T02:38:25.529360+0000","last_clean":"2024-09-12T02:38:25.529360+0000","last_became_active":"2024-09-12T02:36:48.872185+0000","last_became_peered":"2024-09-12T02:36:48.872185+0000","last_unstale":"2024-09-12T02:38:25.529360+0000","last_undegraded":"2024-09-12T02:38:25.529360+0000","last_fullsized":"2024-09-12T02:38:25.529360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:40.075147+0000","last_change":"2024-09-12T02:36:46.856925+0000","last_active":"2024-09-12T02:38:40.075147+0000","last_peered":"2024-09-12T02:38:40.075147+0000","last_clean":"2024-09-12T02:38:40.075147+0000","last_became_active":"2024-09-12T02:36:46.856543+0000","last_became_peered":"2024-09-12T02:36:46.856543+0000","last_unstale":"2024-09-12T02:38:40.075147+0000","last_undegraded":"2024-09-12T02:38:40.075147+0000","last_fullsized":"2024-09-12T02:38:40.075147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:51.706528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.548745+0000","last_change":"2024-09-12T02:36:48.884941+0000","last_active":"2024-09-12T02:38:25.548745+0000","last_peered":"2024-09-12T02:38:25.548745+0000","last_clean":"2024-09-12T02:38:25.548745+0000","last_became_active":"2024-09-12T02:36:48.884318+0000","last_became_peered":"2024-09-12T02:36:48.884318+0000","last_unstale":"2024-09-12T02:38:25.548745+0000","last_undegraded":"2024-09-12T02:38:25.548745+0000","last_fullsized":"2024-09-12T02:38:25.548745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:21.498987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678605+0000","last_change":"2024-09-12T02:36:46.862151+0000","last_active":"2024-09-12T02:37:56.678605+0000","last_peered":"2024-09-12T02:37:56.678605+0000","last_clean":"2024-09-12T02:37:56.678605+0000","last_became_active":"2024-09-12T02:36:46.861307+0000","last_became_peered":"2024-09-12T02:36:46.861307+0000","last_unstale":"2024-09-12T02:37:56.678605+0000","last_undegraded":"2024-09-12T02:37:56.678605+0000","last_fullsized":"2024-09-12T02:37:56.678605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538240+0000","last_change":"2024-09-12T02:37:56.677344+0000","last_active":"2024-09-12T02:38:25.538240+0000","last_peered":"2024-09-12T02:38:25.538240+0000","last_clean":"2024-09-12T02:38:25.538240+0000","last_became_active":"2024-09-12T02:37:56.676990+0000","last_became_peered":"2024-09-12T02:37:56.676990+0000","last_unstale":"2024-09-12T02:38:25.538240+0000","last_undegraded":"2024-09-12T02:38:25.538240+0000","last_fullsized":"2024-09-12T02:38:25.538240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:05.302672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,6],"acting":[0,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670363+0000","last_change":"2024-09-12T02:36:47.033192+0000","last_active":"2024-09-12T02:37:56.670363+0000","last_peered":"2024-09-12T02:37:56.670363+0000","last_clean":"2024-09-12T02:37:56.670363+0000","last_became_active":"2024-09-12T02:36:47.032820+0000","last_became_peered":"2024-09-12T02:36:47.032820+0000","last_unstale":"2024-09-12T02:37:56.670363+0000","last_undegraded":"2024-09-12T02:37:56.670363+0000","last_fullsized":"2024-09-12T02:37:56.670363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:03.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550767+0000","last_change":"2024-09-12T02:36:48.890836+0000","last_active":"2024-09-12T02:38:25.550767+0000","last_peered":"2024-09-12T02:38:25.550767+0000","last_clean":"2024-09-12T02:38:25.550767+0000","last_became_active":"2024-09-12T02:36:48.890453+0000","last_became_peered":"2024-09-12T02:36:48.890453+0000","last_unstale":"2024-09-12T02:38:25.550767+0000","last_undegraded":"2024-09-12T02:38:25.550767+0000","last_fullsized":"2024-09-12T02:38:25.550767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:39.681626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:41.076086+0000","last_change":"2024-09-12T02:36:46.858202+0000","last_active":"2024-09-12T02:38:41.076086+0000","last_peered":"2024-09-12T02:38:41.076086+0000","last_clean":"2024-09-12T02:38:41.076086+0000","last_became_active":"2024-09-12T02:36:46.857554+0000","last_became_peered":"2024-09-12T02:36:46.857554+0000","last_unstale":"2024-09-12T02:38:41.076086+0000","last_undegraded":"2024-09-12T02:38:41.076086+0000","last_fullsized":"2024-09-12T02:38:41.076086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:31.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68607,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":176,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540622+0000","last_change":"2024-09-12T02:36:48.882501+0000","last_active":"2024-09-12T02:38:25.540622+0000","last_peered":"2024-09-12T02:38:25.540622+0000","last_clean":"2024-09-12T02:38:25.540622+0000","last_became_active":"2024-09-12T02:36:48.881821+0000","last_became_peered":"2024-09-12T02:36:48.881821+0000","last_unstale":"2024-09-12T02:38:25.540622+0000","last_undegraded":"2024-09-12T02:38:25.540622+0000","last_fullsized":"2024-09-12T02:38:25.540622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.248815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678192+0000","last_change":"2024-09-12T02:36:46.858906+0000","last_active":"2024-09-12T02:37:56.678192+0000","last_peered":"2024-09-12T02:37:56.678192+0000","last_clean":"2024-09-12T02:37:56.678192+0000","last_became_active":"2024-09-12T02:36:46.858538+0000","last_became_peered":"2024-09-12T02:36:46.858538+0000","last_unstale":"2024-09-12T02:37:56.678192+0000","last_undegraded":"2024-09-12T02:37:56.678192+0000","last_fullsized":"2024-09-12T02:37:56.678192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:38.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.522890+0000","last_change":"2024-09-12T02:37:56.679320+0000","last_active":"2024-09-12T02:38:25.522890+0000","last_peered":"2024-09-12T02:38:25.522890+0000","last_clean":"2024-09-12T02:38:25.522890+0000","last_became_active":"2024-09-12T02:37:56.678956+0000","last_became_peered":"2024-09-12T02:37:56.678956+0000","last_unstale":"2024-09-12T02:38:25.522890+0000","last_undegraded":"2024-09-12T02:38:25.522890+0000","last_fullsized":"2024-09-12T02:38:25.522890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:48.238065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669916+0000","last_change":"2024-09-12T02:36:46.860618+0000","last_active":"2024-09-12T02:37:56.669916+0000","last_peered":"2024-09-12T02:37:56.669916+0000","last_clean":"2024-09-12T02:37:56.669916+0000","last_became_active":"2024-09-12T02:36:46.860248+0000","last_became_peered":"2024-09-12T02:36:46.860248+0000","last_unstale":"2024-09-12T02:37:56.669916+0000","last_undegraded":"2024-09-12T02:37:56.669916+0000","last_fullsized":"2024-09-12T02:37:56.669916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:36.371412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542029+0000","last_change":"2024-09-12T02:36:48.889694+0000","last_active":"2024-09-12T02:38:25.542029+0000","last_peered":"2024-09-12T02:38:25.542029+0000","last_clean":"2024-09-12T02:38:25.542029+0000","last_became_active":"2024-09-12T02:36:48.889215+0000","last_became_peered":"2024-09-12T02:36:48.889215+0000","last_unstale":"2024-09-12T02:38:25.542029+0000","last_undegraded":"2024-09-12T02:38:25.542029+0000","last_fullsized":"2024-09-12T02:38:25.542029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:17.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:43.079127+0000","last_change":"2024-09-12T02:36:46.861162+0000","last_active":"2024-09-12T02:38:43.079127+0000","last_peered":"2024-09-12T02:38:43.079127+0000","last_clean":"2024-09-12T02:38:43.079127+0000","last_became_active":"2024-09-12T02:36:46.860811+0000","last_became_peered":"2024-09-12T02:36:46.860811+0000","last_unstale":"2024-09-12T02:38:43.079127+0000","last_undegraded":"2024-09-12T02:38:43.079127+0000","last_fullsized":"2024-09-12T02:38:43.079127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.984153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.541072+0000","last_change":"2024-09-12T02:36:48.880598+0000","last_active":"2024-09-12T02:38:25.541072+0000","last_peered":"2024-09-12T02:38:25.541072+0000","last_clean":"2024-09-12T02:38:25.541072+0000","last_became_active":"2024-09-12T02:36:48.880322+0000","last_became_peered":"2024-09-12T02:36:48.880322+0000","last_unstale":"2024-09-12T02:38:25.541072+0000","last_undegraded":"2024-09-12T02:38:25.541072+0000","last_fullsized":"2024-09-12T02:38:25.541072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:24.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.692441+0000","last_change":"2024-09-12T02:37:56.692441+0000","last_active":"2024-09-12T02:37:56.692441+0000","last_peered":"2024-09-12T02:37:56.692441+0000","last_clean":"2024-09-12T02:37:56.692441+0000","last_became_active":"2024-09-12T02:37:56.676982+0000","last_became_peered":"2024-09-12T02:37:56.676982+0000","last_unstale":"2024-09-12T02:37:56.692441+0000","last_undegraded":"2024-09-12T02:37:56.692441+0000","last_fullsized":"2024-09-12T02:37:56.692441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.324488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.545588+0000","last_change":"2024-09-12T02:36:48.891794+0000","last_active":"2024-09-12T02:38:25.545588+0000","last_peered":"2024-09-12T02:38:25.545588+0000","last_clean":"2024-09-12T02:38:25.545588+0000","last_became_active":"2024-09-12T02:36:48.890551+0000","last_became_peered":"2024-09-12T02:36:48.890551+0000","last_unstale":"2024-09-12T02:38:25.545588+0000","last_undegraded":"2024-09-12T02:38:25.545588+0000","last_fullsized":"2024-09-12T02:38:25.545588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676260+0000","last_change":"2024-09-12T02:36:46.858900+0000","last_active":"2024-09-12T02:37:56.676260+0000","last_peered":"2024-09-12T02:37:56.676260+0000","last_clean":"2024-09-12T02:37:56.676260+0000","last_became_active":"2024-09-12T02:36:46.858582+0000","last_became_peered":"2024-09-12T02:36:46.858582+0000","last_unstale":"2024-09-12T02:37:56.676260+0000","last_undegraded":"2024-09-12T02:37:56.676260+0000","last_fullsized":"2024-09-12T02:37:56.676260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.394135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524802+0000","last_change":"2024-09-12T02:36:48.880745+0000","last_active":"2024-09-12T02:38:25.524802+0000","last_peered":"2024-09-12T02:38:25.524802+0000","last_clean":"2024-09-12T02:38:25.524802+0000","last_became_active":"2024-09-12T02:36:48.880371+0000","last_became_peered":"2024-09-12T02:36:48.880371+0000","last_unstale":"2024-09-12T02:38:25.524802+0000","last_undegraded":"2024-09-12T02:38:25.524802+0000","last_fullsized":"2024-09-12T02:38:25.524802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:36.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669147+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.669147+0000","last_peered":"2024-09-12T02:37:56.669147+0000","last_clean":"2024-09-12T02:37:56.669147+0000","last_became_active":"2024-09-12T02:36:46.858486+0000","last_became_peered":"2024-09-12T02:36:46.858486+0000","last_unstale":"2024-09-12T02:37:56.669147+0000","last_undegraded":"2024-09-12T02:37:56.669147+0000","last_fullsized":"2024-09-12T02:37:56.669147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.986920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.542172+0000","last_change":"2024-09-12T02:36:48.883482+0000","last_active":"2024-09-12T02:38:25.542172+0000","last_peered":"2024-09-12T02:38:25.542172+0000","last_clean":"2024-09-12T02:38:25.542172+0000","last_became_active":"2024-09-12T02:36:48.883153+0000","last_became_peered":"2024-09-12T02:36:48.883153+0000","last_unstale":"2024-09-12T02:38:25.542172+0000","last_undegraded":"2024-09-12T02:38:25.542172+0000","last_fullsized":"2024-09-12T02:38:25.542172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.381411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.670750+0000","last_change":"2024-09-12T02:36:46.858870+0000","last_active":"2024-09-12T02:37:56.670750+0000","last_peered":"2024-09-12T02:37:56.670750+0000","last_clean":"2024-09-12T02:37:56.670750+0000","last_became_active":"2024-09-12T02:36:46.858468+0000","last_became_peered":"2024-09-12T02:36:46.858468+0000","last_unstale":"2024-09-12T02:37:56.670750+0000","last_undegraded":"2024-09-12T02:37:56.670750+0000","last_fullsized":"2024-09-12T02:37:56.670750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:52.576202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.539778+0000","last_change":"2024-09-12T02:36:48.882002+0000","last_active":"2024-09-12T02:38:25.539778+0000","last_peered":"2024-09-12T02:38:25.539778+0000","last_clean":"2024-09-12T02:38:25.539778+0000","last_became_active":"2024-09-12T02:36:48.881668+0000","last_became_peered":"2024-09-12T02:36:48.881668+0000","last_unstale":"2024-09-12T02:38:25.539778+0000","last_undegraded":"2024-09-12T02:38:25.539778+0000","last_fullsized":"2024-09-12T02:38:25.539778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677938+0000","last_change":"2024-09-12T02:36:47.033202+0000","last_active":"2024-09-12T02:37:56.677938+0000","last_peered":"2024-09-12T02:37:56.677938+0000","last_clean":"2024-09-12T02:37:56.677938+0000","last_became_active":"2024-09-12T02:36:47.032852+0000","last_became_peered":"2024-09-12T02:36:47.032852+0000","last_unstale":"2024-09-12T02:37:56.677938+0000","last_undegraded":"2024-09-12T02:37:56.677938+0000","last_fullsized":"2024-09-12T02:37:56.677938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549470+0000","last_change":"2024-09-12T02:36:48.879943+0000","last_active":"2024-09-12T02:38:25.549470+0000","last_peered":"2024-09-12T02:38:25.549470+0000","last_clean":"2024-09-12T02:38:25.549470+0000","last_became_active":"2024-09-12T02:36:48.879554+0000","last_became_peered":"2024-09-12T02:36:48.879554+0000","last_unstale":"2024-09-12T02:38:25.549470+0000","last_undegraded":"2024-09-12T02:38:25.549470+0000","last_fullsized":"2024-09-12T02:38:25.549470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:23.720035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678427+0000","last_change":"2024-09-12T02:35:34.557246+0000","last_active":"2024-09-12T02:37:56.678427+0000","last_peered":"2024-09-12T02:37:56.678427+0000","last_clean":"2024-09-12T02:37:56.678427+0000","last_became_active":"2024-09-12T02:35:34.556841+0000","last_became_peered":"2024-09-12T02:35:34.556841+0000","last_unstale":"2024-09-12T02:37:56.678427+0000","last_undegraded":"2024-09-12T02:37:56.678427+0000","last_fullsized":"2024-09-12T02:37:56.678427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:32:09.801896+0000","last_clean_scrub_stamp":"2024-09-12T02:32:09.801896+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:53.556275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793192+0000","last_change":"2024-09-12T02:36:46.860271+0000","last_active":"2024-09-12T02:37:56.793192+0000","last_peered":"2024-09-12T02:37:56.793192+0000","last_clean":"2024-09-12T02:37:56.793192+0000","last_became_active":"2024-09-12T02:36:46.859886+0000","last_became_peered":"2024-09-12T02:36:46.859886+0000","last_unstale":"2024-09-12T02:37:56.793192+0000","last_undegraded":"2024-09-12T02:37:56.793192+0000","last_fullsized":"2024-09-12T02:37:56.793192+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:36.240593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550428+0000","last_change":"2024-09-12T02:37:56.674162+0000","last_active":"2024-09-12T02:38:25.550428+0000","last_peered":"2024-09-12T02:38:25.550428+0000","last_clean":"2024-09-12T02:38:25.550428+0000","last_became_active":"2024-09-12T02:37:56.673786+0000","last_became_peered":"2024-09-12T02:37:56.673786+0000","last_unstale":"2024-09-12T02:38:25.550428+0000","last_undegraded":"2024-09-12T02:38:25.550428+0000","last_fullsized":"2024-09-12T02:38:25.550428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:46.189919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678298+0000","last_change":"2024-09-12T02:36:46.858795+0000","last_active":"2024-09-12T02:37:56.678298+0000","last_peered":"2024-09-12T02:37:56.678298+0000","last_clean":"2024-09-12T02:37:56.678298+0000","last_became_active":"2024-09-12T02:36:46.858436+0000","last_became_peered":"2024-09-12T02:36:46.858436+0000","last_unstale":"2024-09-12T02:37:56.678298+0000","last_undegraded":"2024-09-12T02:37:56.678298+0000","last_fullsized":"2024-09-12T02:37:56.678298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:32.040335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.523493+0000","last_change":"2024-09-12T02:36:48.887139+0000","last_active":"2024-09-12T02:38:25.523493+0000","last_peered":"2024-09-12T02:38:25.523493+0000","last_clean":"2024-09-12T02:38:25.523493+0000","last_became_active":"2024-09-12T02:36:48.886802+0000","last_became_peered":"2024-09-12T02:36:48.886802+0000","last_unstale":"2024-09-12T02:38:25.523493+0000","last_undegraded":"2024-09-12T02:38:25.523493+0000","last_fullsized":"2024-09-12T02:38:25.523493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:43.535186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:39.073426+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:38:39.073426+0000","last_peered":"2024-09-12T02:38:39.073426+0000","last_clean":"2024-09-12T02:38:39.073426+0000","last_became_active":"2024-09-12T02:36:47.031935+0000","last_became_peered":"2024-09-12T02:36:47.031935+0000","last_unstale":"2024-09-12T02:38:39.073426+0000","last_undegraded":"2024-09-12T02:38:39.073426+0000","last_fullsized":"2024-09-12T02:38:39.073426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:09.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.536855+0000","last_change":"2024-09-12T02:36:48.883652+0000","last_active":"2024-09-12T02:38:25.536855+0000","last_peered":"2024-09-12T02:38:25.536855+0000","last_clean":"2024-09-12T02:38:25.536855+0000","last_became_active":"2024-09-12T02:36:48.883331+0000","last_became_peered":"2024-09-12T02:36:48.883331+0000","last_unstale":"2024-09-12T02:38:25.536855+0000","last_undegraded":"2024-09-12T02:38:25.536855+0000","last_fullsized":"2024-09-12T02:38:25.536855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:30.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.678486+0000","last_change":"2024-09-12T02:36:46.856072+0000","last_active":"2024-09-12T02:37:56.678486+0000","last_peered":"2024-09-12T02:37:56.678486+0000","last_clean":"2024-09-12T02:37:56.678486+0000","last_became_active":"2024-09-12T02:36:46.855676+0000","last_became_peered":"2024-09-12T02:36:46.855676+0000","last_unstale":"2024-09-12T02:37:56.678486+0000","last_undegraded":"2024-09-12T02:37:56.678486+0000","last_fullsized":"2024-09-12T02:37:56.678486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.117754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535307+0000","last_change":"2024-09-12T02:36:48.887125+0000","last_active":"2024-09-12T02:38:25.535307+0000","last_peered":"2024-09-12T02:38:25.535307+0000","last_clean":"2024-09-12T02:38:25.535307+0000","last_became_active":"2024-09-12T02:36:48.886806+0000","last_became_peered":"2024-09-12T02:36:48.886806+0000","last_unstale":"2024-09-12T02:38:25.535307+0000","last_undegraded":"2024-09-12T02:38:25.535307+0000","last_fullsized":"2024-09-12T02:38:25.535307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.421701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672207+0000","last_change":"2024-09-12T02:36:47.032204+0000","last_active":"2024-09-12T02:37:56.672207+0000","last_peered":"2024-09-12T02:37:56.672207+0000","last_clean":"2024-09-12T02:37:56.672207+0000","last_became_active":"2024-09-12T02:36:47.031886+0000","last_became_peered":"2024-09-12T02:36:47.031886+0000","last_unstale":"2024-09-12T02:37:56.672207+0000","last_undegraded":"2024-09-12T02:37:56.672207+0000","last_fullsized":"2024-09-12T02:37:56.672207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:20.717012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.535973+0000","last_change":"2024-09-12T02:36:48.873297+0000","last_active":"2024-09-12T02:38:25.535973+0000","last_peered":"2024-09-12T02:38:25.535973+0000","last_clean":"2024-09-12T02:38:25.535973+0000","last_became_active":"2024-09-12T02:36:48.872940+0000","last_became_peered":"2024-09-12T02:36:48.872940+0000","last_unstale":"2024-09-12T02:38:25.535973+0000","last_undegraded":"2024-09-12T02:38:25.535973+0000","last_fullsized":"2024-09-12T02:38:25.535973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:14.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.695307+0000","last_change":"2024-09-12T02:37:56.694966+0000","last_active":"2024-09-12T02:37:56.695307+0000","last_peered":"2024-09-12T02:37:56.695307+0000","last_clean":"2024-09-12T02:37:56.695307+0000","last_became_active":"2024-09-12T02:37:56.674729+0000","last_became_peered":"2024-09-12T02:37:56.674729+0000","last_unstale":"2024-09-12T02:37:56.695307+0000","last_undegraded":"2024-09-12T02:37:56.695307+0000","last_fullsized":"2024-09-12T02:37:56.695307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:51.673970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.528703+0000","last_change":"2024-09-12T02:36:48.876638+0000","last_active":"2024-09-12T02:38:25.528703+0000","last_peered":"2024-09-12T02:38:25.528703+0000","last_clean":"2024-09-12T02:38:25.528703+0000","last_became_active":"2024-09-12T02:36:48.876326+0000","last_became_peered":"2024-09-12T02:36:48.876326+0000","last_unstale":"2024-09-12T02:38:25.528703+0000","last_undegraded":"2024-09-12T02:38:25.528703+0000","last_fullsized":"2024-09-12T02:38:25.528703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:23.496698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'13","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:31.889524+0000","last_change":"2024-09-12T02:36:46.855464+0000","last_active":"2024-09-12T02:38:31.889524+0000","last_peered":"2024-09-12T02:38:31.889524+0000","last_clean":"2024-09-12T02:38:31.889524+0000","last_became_active":"2024-09-12T02:36:46.854898+0000","last_became_peered":"2024-09-12T02:36:46.854898+0000","last_unstale":"2024-09-12T02:38:31.889524+0000","last_undegraded":"2024-09-12T02:38:31.889524+0000","last_fullsized":"2024-09-12T02:38:31.889524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:25.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.533951+0000","last_change":"2024-09-12T02:36:48.878825+0000","last_active":"2024-09-12T02:38:25.533951+0000","last_peered":"2024-09-12T02:38:25.533951+0000","last_clean":"2024-09-12T02:38:25.533951+0000","last_became_active":"2024-09-12T02:36:48.878515+0000","last_became_peered":"2024-09-12T02:36:48.878515+0000","last_unstale":"2024-09-12T02:38:25.533951+0000","last_undegraded":"2024-09-12T02:38:25.533951+0000","last_fullsized":"2024-09-12T02:38:25.533951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:12.898913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.793081+0000","last_change":"2024-09-12T02:36:46.930558+0000","last_active":"2024-09-12T02:37:56.793081+0000","last_peered":"2024-09-12T02:37:56.793081+0000","last_clean":"2024-09-12T02:37:56.793081+0000","last_became_active":"2024-09-12T02:36:46.930187+0000","last_became_peered":"2024-09-12T02:36:46.930187+0000","last_unstale":"2024-09-12T02:37:56.793081+0000","last_undegraded":"2024-09-12T02:37:56.793081+0000","last_fullsized":"2024-09-12T02:37:56.793081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.540129+0000","last_change":"2024-09-12T02:36:48.888758+0000","last_active":"2024-09-12T02:38:25.540129+0000","last_peered":"2024-09-12T02:38:25.540129+0000","last_clean":"2024-09-12T02:38:25.540129+0000","last_became_active":"2024-09-12T02:36:48.888384+0000","last_became_peered":"2024-09-12T02:36:48.888384+0000","last_unstale":"2024-09-12T02:38:25.540129+0000","last_undegraded":"2024-09-12T02:38:25.540129+0000","last_fullsized":"2024-09-12T02:38:25.540129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:20.578101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.669652+0000","last_change":"2024-09-12T02:36:47.033079+0000","last_active":"2024-09-12T02:37:56.669652+0000","last_peered":"2024-09-12T02:37:56.669652+0000","last_clean":"2024-09-12T02:37:56.669652+0000","last_became_active":"2024-09-12T02:36:47.032783+0000","last_became_peered":"2024-09-12T02:36:47.032783+0000","last_unstale":"2024-09-12T02:37:56.669652+0000","last_undegraded":"2024-09-12T02:37:56.669652+0000","last_fullsized":"2024-09-12T02:37:56.669652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:28.128598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.500557+0000","last_change":"2024-09-12T02:36:48.876073+0000","last_active":"2024-09-12T02:38:25.500557+0000","last_peered":"2024-09-12T02:38:25.500557+0000","last_clean":"2024-09-12T02:38:25.500557+0000","last_became_active":"2024-09-12T02:36:48.875693+0000","last_became_peered":"2024-09-12T02:36:48.875693+0000","last_unstale":"2024-09-12T02:38:25.500557+0000","last_undegraded":"2024-09-12T02:38:25.500557+0000","last_fullsized":"2024-09-12T02:38:25.500557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.926782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792234+0000","last_change":"2024-09-12T02:36:46.857422+0000","last_active":"2024-09-12T02:37:56.792234+0000","last_peered":"2024-09-12T02:37:56.792234+0000","last_clean":"2024-09-12T02:37:56.792234+0000","last_became_active":"2024-09-12T02:36:46.857101+0000","last_became_peered":"2024-09-12T02:36:46.857101+0000","last_unstale":"2024-09-12T02:37:56.792234+0000","last_undegraded":"2024-09-12T02:37:56.792234+0000","last_fullsized":"2024-09-12T02:37:56.792234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:36.987975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.538185+0000","last_change":"2024-09-12T02:36:48.875367+0000","last_active":"2024-09-12T02:38:25.538185+0000","last_peered":"2024-09-12T02:38:25.538185+0000","last_clean":"2024-09-12T02:38:25.538185+0000","last_became_active":"2024-09-12T02:36:48.874668+0000","last_became_peered":"2024-09-12T02:36:48.874668+0000","last_unstale":"2024-09-12T02:38:25.538185+0000","last_undegraded":"2024-09-12T02:38:25.538185+0000","last_fullsized":"2024-09-12T02:38:25.538185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:31.781719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.677722+0000","last_change":"2024-09-12T02:36:46.858354+0000","last_active":"2024-09-12T02:37:56.677722+0000","last_peered":"2024-09-12T02:37:56.677722+0000","last_clean":"2024-09-12T02:37:56.677722+0000","last_became_active":"2024-09-12T02:36:46.857540+0000","last_became_peered":"2024-09-12T02:36:46.857540+0000","last_unstale":"2024-09-12T02:37:56.677722+0000","last_undegraded":"2024-09-12T02:37:56.677722+0000","last_fullsized":"2024-09-12T02:37:56.677722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:00.916607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.532431+0000","last_change":"2024-09-12T02:36:48.875540+0000","last_active":"2024-09-12T02:38:25.532431+0000","last_peered":"2024-09-12T02:38:25.532431+0000","last_clean":"2024-09-12T02:38:25.532431+0000","last_became_active":"2024-09-12T02:36:48.875225+0000","last_became_peered":"2024-09-12T02:36:48.875225+0000","last_unstale":"2024-09-12T02:38:25.532431+0000","last_undegraded":"2024-09-12T02:38:25.532431+0000","last_fullsized":"2024-09-12T02:38:25.532431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:07.295734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.797632+0000","last_change":"2024-09-12T02:37:56.797632+0000","last_active":"2024-09-12T02:37:56.797632+0000","last_peered":"2024-09-12T02:37:56.797632+0000","last_clean":"2024-09-12T02:37:56.797632+0000","last_became_active":"2024-09-12T02:37:56.794171+0000","last_became_peered":"2024-09-12T02:37:56.794171+0000","last_unstale":"2024-09-12T02:37:56.797632+0000","last_undegraded":"2024-09-12T02:37:56.797632+0000","last_fullsized":"2024-09-12T02:37:56.797632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:34.468518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550218+0000","last_change":"2024-09-12T02:36:48.879700+0000","last_active":"2024-09-12T02:38:25.550218+0000","last_peered":"2024-09-12T02:38:25.550218+0000","last_clean":"2024-09-12T02:38:25.550218+0000","last_became_active":"2024-09-12T02:36:48.879264+0000","last_became_peered":"2024-09-12T02:36:48.879264+0000","last_unstale":"2024-09-12T02:38:25.550218+0000","last_undegraded":"2024-09-12T02:38:25.550218+0000","last_fullsized":"2024-09-12T02:38:25.550218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:20.237670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549244+0000","last_change":"2024-09-12T02:37:56.680042+0000","last_active":"2024-09-12T02:38:25.549244+0000","last_peered":"2024-09-12T02:38:25.549244+0000","last_clean":"2024-09-12T02:38:25.549244+0000","last_became_active":"2024-09-12T02:37:56.679618+0000","last_became_peered":"2024-09-12T02:37:56.679618+0000","last_unstale":"2024-09-12T02:38:25.549244+0000","last_undegraded":"2024-09-12T02:38:25.549244+0000","last_fullsized":"2024-09-12T02:38:25.549244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:53.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.682015+0000","last_change":"2024-09-12T02:37:56.681606+0000","last_active":"2024-09-12T02:37:56.682015+0000","last_peered":"2024-09-12T02:37:56.682015+0000","last_clean":"2024-09-12T02:37:56.682015+0000","last_became_active":"2024-09-12T02:37:56.674499+0000","last_became_peered":"2024-09-12T02:37:56.674499+0000","last_unstale":"2024-09-12T02:37:56.682015+0000","last_undegraded":"2024-09-12T02:37:56.682015+0000","last_fullsized":"2024-09-12T02:37:56.682015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:02.803838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.550254+0000","last_change":"2024-09-12T02:36:48.881452+0000","last_active":"2024-09-12T02:38:25.550254+0000","last_peered":"2024-09-12T02:38:25.550254+0000","last_clean":"2024-09-12T02:38:25.550254+0000","last_became_active":"2024-09-12T02:36:48.881127+0000","last_became_peered":"2024-09-12T02:36:48.881127+0000","last_unstale":"2024-09-12T02:38:25.550254+0000","last_undegraded":"2024-09-12T02:38:25.550254+0000","last_fullsized":"2024-09-12T02:38:25.550254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:27.000194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.676382+0000","last_change":"2024-09-12T02:36:46.860322+0000","last_active":"2024-09-12T02:37:56.676382+0000","last_peered":"2024-09-12T02:37:56.676382+0000","last_clean":"2024-09-12T02:37:56.676382+0000","last_became_active":"2024-09-12T02:36:46.859692+0000","last_became_peered":"2024-09-12T02:36:46.859692+0000","last_unstale":"2024-09-12T02:37:56.676382+0000","last_undegraded":"2024-09-12T02:37:56.676382+0000","last_fullsized":"2024-09-12T02:37:56.676382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:32.945165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.549684+0000","last_change":"2024-09-12T02:36:48.876427+0000","last_active":"2024-09-12T02:38:25.549684+0000","last_peered":"2024-09-12T02:38:25.549684+0000","last_clean":"2024-09-12T02:38:25.549684+0000","last_became_active":"2024-09-12T02:36:48.876138+0000","last_became_peered":"2024-09-12T02:36:48.876138+0000","last_unstale":"2024-09-12T02:38:25.549684+0000","last_undegraded":"2024-09-12T02:38:25.549684+0000","last_fullsized":"2024-09-12T02:38:25.549684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:49.630268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.792826+0000","last_change":"2024-09-12T02:36:47.032274+0000","last_active":"2024-09-12T02:37:56.792826+0000","last_peered":"2024-09-12T02:37:56.792826+0000","last_clean":"2024-09-12T02:37:56.792826+0000","last_became_active":"2024-09-12T02:36:47.031961+0000","last_became_peered":"2024-09-12T02:36:47.031961+0000","last_unstale":"2024-09-12T02:37:56.792826+0000","last_undegraded":"2024-09-12T02:37:56.792826+0000","last_fullsized":"2024-09-12T02:37:56.792826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:30.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:38:25.524640+0000","last_change":"2024-09-12T02:36:48.881681+0000","last_active":"2024-09-12T02:38:25.524640+0000","last_peered":"2024-09-12T02:38:25.524640+0000","last_clean":"2024-09-12T02:38:25.524640+0000","last_became_active":"2024-09-12T02:36:48.881387+0000","last_became_peered":"2024-09-12T02:36:48.881387+0000","last_unstale":"2024-09-12T02:38:25.524640+0000","last_undegraded":"2024-09-12T02:38:25.524640+0000","last_fullsized":"2024-09-12T02:38:25.524640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:47.850712+0000","last_clean_scrub_stamp":"2024-09-12T02:36:47.850712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:12.759092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T02:37:56.672690+0000","last_change":"2024-09-12T02:36:46.859400+0000","last_active":"2024-09-12T02:37:56.672690+0000","last_peered":"2024-09-12T02:37:56.672690+0000","last_clean":"2024-09-12T02:37:56.672690+0000","last_became_active":"2024-09-12T02:36:46.859103+0000","last_became_peered":"2024-09-12T02:36:46.859103+0000","last_unstale":"2024-09-12T02:37:56.672690+0000","last_undegraded":"2024-09-12T02:37:56.672690+0000","last_fullsized":"2024-09-12T02:37:56.672690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:36:45.838460+0000","last_clean_scrub_stamp":"2024-09-12T02:36:45.838460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:55.924889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73452,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":655,"num_read_kb":402,"num_write":179,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":220356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281192,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442983,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1103442,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":443197,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168628,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":443095,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1035891,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561086,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442586,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1035182,"data_compressed":41559,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":443416,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":442897,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":513066,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":511098,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":443857,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34124,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35764,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:38:47.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:47.848 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 -- 172.21.15.100:0/3128705716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4102ef0 msgr2=0x7ff8c410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 --2- 172.21.15.100:0/3128705716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4102ef0 0x7ff8c410da40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009ca0 tx=0x7ff8bc02a950 comp rx=0 tx=0).stop 2024-09-12T02:38:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 -- 172.21.15.100:0/3128705716 shutdown_connections 2024-09-12T02:38:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 --2- 172.21.15.100:0/3128705716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4102ef0 0x7ff8c410da40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 --2- 172.21.15.100:0/3128705716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8c4102570 0x7ff8c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 --2- 172.21.15.100:0/3128705716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c4100e20 0x7ff8c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 -- 172.21.15.100:0/3128705716 >> 172.21.15.100:0/3128705716 conn(0x7ff8c40fc7d0 msgr2=0x7ff8c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 -- 172.21.15.100:0/3128705716 shutdown_connections 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.315+0000 7ff8ca473640 1 -- 172.21.15.100:0/3128705716 wait complete. 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 Processor -- start 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 -- start start 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4100e20 0x7ff8c4197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8c4102570 0x7ff8c4197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c4102ef0 0x7ff8c419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4110f80 con 0x7ff8c4100e20 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4110e00 con 0x7ff8c4102ef0 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8ca473640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4111100 con 0x7ff8c4102570 2024-09-12T02:38:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4100e20 0x7ff8c4197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4100e20 0x7ff8c4197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51354/0 (socket says 172.21.15.100:51354) 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.316+0000 7ff8c3fff640 1 -- 172.21.15.100:0/2851808278 learned_addr learned my addr 172.21.15.100:0/2851808278 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8bbfff640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8c4102570 0x7ff8c4197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c8a10640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c4102ef0 0x7ff8c419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c3fff640 1 -- 172.21.15.100:0/2851808278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8c4102570 msgr2=0x7ff8c4197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c3fff640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8c4102570 0x7ff8c4197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c3fff640 1 -- 172.21.15.100:0/2851808278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c4102ef0 msgr2=0x7ff8c419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c3fff640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c4102ef0 0x7ff8c419bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c3fff640 1 -- 172.21.15.100:0/2851808278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c419c3b0 con 0x7ff8c4100e20 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c3fff640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4100e20 0x7ff8c4197400 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400d950 tx=0x7ff8b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c1ffb640 1 -- 172.21.15.100:0/2851808278 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4017030 con 0x7ff8c4100e20 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c1ffb640 1 -- 172.21.15.100:0/2851808278 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8b4004020 con 0x7ff8c4100e20 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8c1ffb640 1 -- 172.21.15.100:0/2851808278 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40047a0 con 0x7ff8c4100e20 2024-09-12T02:38:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c419c6a0 con 0x7ff8c4100e20 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.317+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c41a3f80 con 0x7ff8c4100e20 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.318+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c4101200 con 0x7ff8c4100e20 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.319+0000 7ff8c1ffb640 1 -- 172.21.15.100:0/2851808278 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7ff8b40041d0 con 0x7ff8c4100e20 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.320+0000 7ff8c1ffb640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8b00a2c90 0x7ff8b00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.320+0000 7ff8bbfff640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8b00a2c90 0x7ff8b00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.320+0000 7ff8c1ffb640 1 -- 172.21.15.100:0/2851808278 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff8b40cf350 con 0x7ff8c4100e20 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.321+0000 7ff8bbfff640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8b00a2c90 0x7ff8b00a5150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac005d80 tx=0x7ff8ac005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.324+0000 7ff8c1ffb640 1 -- 172.21.15.100:0/2851808278 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8b409c160 con 0x7ff8c4100e20 2024-09-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.531+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8c4198760 con 0x7ff8c4100e20 2024-09-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.532+0000 7ff8c1ffb640 1 -- 172.21.15.100:0/2851808278 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7ff8c4198760 con 0x7ff8c4100e20 2024-09-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":25,"btime":"2024-09-12T02:38:32:651439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:32.370844+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 25 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8b00a2c90 msgr2=0x7ff8b00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8b00a2c90 0x7ff8b00a5150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac005d80 tx=0x7ff8ac005c90 comp rx=0 tx=0).stop 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4100e20 msgr2=0x7ff8c4197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4100e20 0x7ff8c4197400 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400d950 tx=0x7ff8b400de10 comp rx=0 tx=0).stop 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 shutdown_connections 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8b00a2c90 0x7ff8b00a5150 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c4102ef0 0x7ff8c419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8c4102570 0x7ff8c4197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 --2- 172.21.15.100:0/2851808278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c4100e20 0x7ff8c4197400 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 >> 172.21.15.100:0/2851808278 conn(0x7ff8c40fc7d0 msgr2=0x7ff8c4106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 shutdown_connections 2024-09-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:48.534+0000 7ff8ca473640 1 -- 172.21.15.100:0/2851808278 wait complete. 2024-09-12T02:38:48.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:48 smithi100 ceph-mon[31390]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:48.868 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:48 smithi100 ceph-mon[31390]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-12T02:38:48.868 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2851808278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:48 smithi189 ceph-mon[35196]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:48 smithi189 ceph-mon[35196]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-12T02:38:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2851808278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:48 smithi117 ceph-mon[34898]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:48 smithi117 ceph-mon[34898]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-12T02:38:49.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2851808278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:49.255 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:49.501 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:49.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 -- 172.21.15.100:0/3331561486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c100a80 msgr2=0x7f9a0c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:49.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/3331561486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c100a80 0x7f9a0c100ee0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009930 tx=0x7f9a0002a420 comp rx=0 tx=0).stop 2024-09-12T02:38:49.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 -- 172.21.15.100:0/3331561486 shutdown_connections 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/3331561486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a0c101420 0x7f9a0c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/3331561486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c100a80 0x7f9a0c100ee0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/3331561486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c106a80 0x7f9a0c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 -- 172.21.15.100:0/3331561486 >> 172.21.15.100:0/3331561486 conn(0x7f9a0c0fc7a0 msgr2=0x7f9a0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 -- 172.21.15.100:0/3331561486 shutdown_connections 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.969+0000 7f9a11ae6640 1 -- 172.21.15.100:0/3331561486 wait complete. 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 Processor -- start 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 -- start start 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a0c100a80 0x7f9a0c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c101420 0x7f9a0c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c106a80 0x7f9a0c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c110e80 con 0x7f9a0c101420 2024-09-12T02:38:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c110d00 con 0x7f9a0c106a80 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a11ae6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c111000 con 0x7f9a0c100a80 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a0affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c101420 0x7f9a0c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a0affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c101420 0x7f9a0c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51364/0 (socket says 172.21.15.100:51364) 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a0affd640 1 -- 172.21.15.100:0/2140506696 learned_addr learned my addr 172.21.15.100:0/2140506696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.970+0000 7f9a0bfff640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c106a80 0x7f9a0c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0b7fe640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a0c100a80 0x7f9a0c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0affd640 1 -- 172.21.15.100:0/2140506696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a0c100a80 msgr2=0x7f9a0c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0affd640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a0c100a80 0x7f9a0c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0affd640 1 -- 172.21.15.100:0/2140506696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c106a80 msgr2=0x7f9a0c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0affd640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c106a80 0x7f9a0c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0affd640 1 -- 172.21.15.100:0/2140506696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c19d390 con 0x7f9a0c101420 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0b7fe640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a0c100a80 0x7f9a0c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a0affd640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c101420 0x7f9a0c198920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009230 tx=0x7f9a00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a08ff9640 1 -- 172.21.15.100:0/2140506696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0003f030 con 0x7f9a0c101420 2024-09-12T02:38:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a08ff9640 1 -- 172.21.15.100:0/2140506696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a00003ad0 con 0x7f9a0c101420 2024-09-12T02:38:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c19d620 con 0x7f9a0c101420 2024-09-12T02:38:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a08ff9640 1 -- 172.21.15.100:0/2140506696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00035070 con 0x7f9a0c101420 2024-09-12T02:38:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.971+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c1a4f60 con 0x7f9a0c101420 2024-09-12T02:38:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.973+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c1021c0 con 0x7f9a0c101420 2024-09-12T02:38:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.974+0000 7f9a08ff9640 1 -- 172.21.15.100:0/2140506696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f9a00042030 con 0x7f9a0c101420 2024-09-12T02:38:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.974+0000 7f9a08ff9640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99f40a2c10 0x7f99f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.974+0000 7f9a0b7fe640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99f40a2c10 0x7f99f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.974+0000 7f9a08ff9640 1 -- 172.21.15.100:0/2140506696 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9a000ef6d0 con 0x7f9a0c101420 2024-09-12T02:38:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.975+0000 7f9a0b7fe640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99f40a2c10 0x7f99f40a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a300 tx=0x7f99fc00a290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:49.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:49.978+0000 7f9a08ff9640 1 -- 172.21.15.100:0/2140506696 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a000bc4c0 con 0x7f9a0c101420 2024-09-12T02:38:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.177+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a0c10a020 con 0x7f9a0c101420 2024-09-12T02:38:50.180 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:50.181 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":25,"btime":"2024-09-12T02:38:32:651439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:32.370844+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:38:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.178+0000 7f9a08ff9640 1 -- 172.21.15.100:0/2140506696 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f9a000bbdc0 con 0x7f9a0c101420 2024-09-12T02:38:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 25 2024-09-12T02:38:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99f40a2c10 msgr2=0x7f99f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99f40a2c10 0x7f99f40a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a300 tx=0x7f99fc00a290 comp rx=0 tx=0).stop 2024-09-12T02:38:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c101420 msgr2=0x7f9a0c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c101420 0x7f9a0c198920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009230 tx=0x7f9a00004270 comp rx=0 tx=0).stop 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 shutdown_connections 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99f40a2c10 0x7f99f40a50d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c106a80 0x7f9a0c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a0c101420 0x7f9a0c198920 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 --2- 172.21.15.100:0/2140506696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a0c100a80 0x7f9a0c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 >> 172.21.15.100:0/2140506696 conn(0x7f9a0c0fc7a0 msgr2=0x7f9a0c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 shutdown_connections 2024-09-12T02:38:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:50.181+0000 7f9a11ae6640 1 -- 172.21.15.100:0/2140506696 wait complete. 2024-09-12T02:38:50.796 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:50 smithi100 ceph-mon[31390]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:38:50.796 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:50 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2140506696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:50.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:38:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:50 smithi189 ceph-mon[35196]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:38:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:50 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2140506696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:51.065 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:50 smithi117 ceph-mon[34898]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:38:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:50 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2140506696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:51.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 -- 172.21.15.100:0/3102504013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 msgr2=0x7f993010d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 --2- 172.21.15.100:0/3102504013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f993010d8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9928009ca0 tx=0x7f992802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 -- 172.21.15.100:0/3102504013 shutdown_connections 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 --2- 172.21.15.100:0/3102504013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f993010d8f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 --2- 172.21.15.100:0/3102504013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930101220 0x7f9930101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 --2- 172.21.15.100:0/3102504013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9930105a70 0x7f9930105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 -- 172.21.15.100:0/3102504013 >> 172.21.15.100:0/3102504013 conn(0x7f99300fbee0 msgr2=0x7f99300fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 -- 172.21.15.100:0/3102504013 shutdown_connections 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.539+0000 7f9936d48640 1 -- 172.21.15.100:0/3102504013 wait complete. 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 Processor -- start 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 -- start start 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930101220 0x7f9930197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f99301977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:51.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9930105a70 0x7f993019bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9930110f50 con 0x7f9930101ba0 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9930110dd0 con 0x7f9930101220 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9936d48640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99301110d0 con 0x7f9930105a70 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f992ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f99301977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f992ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f99301977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51386/0 (socket says 172.21.15.100:51386) 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f992ffff640 1 -- 172.21.15.100:0/91461360 learned_addr learned my addr 172.21.15.100:0/91461360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.540+0000 7f9934ae4640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930101220 0x7f9930197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f99352e5640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9930105a70 0x7f993019bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992ffff640 1 -- 172.21.15.100:0/91461360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9930105a70 msgr2=0x7f993019bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992ffff640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9930105a70 0x7f993019bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992ffff640 1 -- 172.21.15.100:0/91461360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930101220 msgr2=0x7f9930197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:51.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992ffff640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930101220 0x7f9930197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992ffff640 1 -- 172.21.15.100:0/91461360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993019c240 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992ffff640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f99301977d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f991c00d950 tx=0x7f991c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992dffb640 1 -- 172.21.15.100:0/91461360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c017070 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992dffb640 1 -- 172.21.15.100:0/91461360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f991c00de80 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993019c530 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f992dffb640 1 -- 172.21.15.100:0/91461360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c00f620 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.541+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99301a3e10 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.542+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9930101660 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.543+0000 7f992dffb640 1 -- 172.21.15.100:0/91461360 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f991c009c30 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.544+0000 7f992dffb640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99200a2d60 0x7f99200a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.544+0000 7f992dffb640 1 -- 172.21.15.100:0/91461360 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f991c0cee60 con 0x7f9930101ba0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.544+0000 7f9934ae4640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99200a2d60 0x7f99200a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.544+0000 7f9934ae4640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99200a2d60 0x7f99200a5220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f992400abe0 tx=0x7f992400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:51.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.548+0000 7f992dffb640 1 -- 172.21.15.100:0/91461360 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f991c09bbf0 con 0x7f9930101ba0 2024-09-12T02:38:51.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.717+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99301a3fe0 con 0x7f9930101ba0 2024-09-12T02:38:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.718+0000 7f992dffb640 1 -- 172.21.15.100:0/91461360 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22871 (secure 0 0 0) 0x7f991c09b4f0 con 0x7f9930101ba0 2024-09-12T02:38:51.720 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:51.720 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:37:56.665591+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.720+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99200a2d60 msgr2=0x7f99200a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.720+0000 7f9936d48640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99200a2d60 0x7f99200a5220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f992400abe0 tx=0x7f992400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.720+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 msgr2=0x7f99301977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.720+0000 7f9936d48640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f99301977d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f991c00d950 tx=0x7f991c00dd50 comp rx=0 tx=0).stop 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 shutdown_connections 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99200a2d60 0x7f99200a5220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9930105a70 0x7f993019bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9930101ba0 0x7f99301977d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 --2- 172.21.15.100:0/91461360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930101220 0x7f9930197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 >> 172.21.15.100:0/91461360 conn(0x7f99300fbee0 msgr2=0x7f99300fc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 shutdown_connections 2024-09-12T02:38:51.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:51.721+0000 7f9936d48640 1 -- 172.21.15.100:0/91461360 wait complete. 2024-09-12T02:38:52.427 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T02:38:52.674 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:52.958 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:52 smithi100 ceph-mon[31390]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T02:38:52.958 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:52 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/91461360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:52 smithi189 ceph-mon[35196]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T02:38:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:52 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/91461360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:52 smithi117 ceph-mon[34898]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T02:38:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:52 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/91461360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:38:53.846 INFO:teuthology.orchestra.run.smithi100.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T02:38:53.847 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T02:38:53.847 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T02:38:53.847 DEBUG:tasks.quiescer:Yielding 2024-09-12T02:38:53.847 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:38:53.857 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:38:53.857 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:38:53.857 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-12T02:38:53.858 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:38:53.896 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:38:53.909 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-12T02:38:53.910 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:3300,172.21.15.117:3300,172.21.15.189:3300:/volumes/qa/sv_1/9048c5c6-a64a-4258-a68c-278de7233f01 340G 0 340G 0% /tmp/cephfs 2024-09-12T02:38:53.912 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-12T02:38:53.976 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:53 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:54.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-12T02:38:54.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:53 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:54.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-12T02:38:54.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:53 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:54.868 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:54.993 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:54 smithi100 ceph-mon[31390]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:38:54.993 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:54 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:54.993 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:54 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:54.993 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:54 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:54.993 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:54 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:54.993 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:54 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:38:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:54 smithi189 ceph-mon[35196]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:38:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:54 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:54 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:54 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:54 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:54 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:38:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:54 smithi117 ceph-mon[34898]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:38:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:54 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:54 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:54 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:54 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:54 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:38:56.004 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:55 smithi100 ceph-mon[31390]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-12T02:38:56.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 -- 172.21.15.100:0/3425190026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278101420 msgr2=0x7f427810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:56.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 --2- 172.21.15.100:0/3425190026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278101420 0x7f427810d950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4268009930 tx=0x7f426802a420 comp rx=0 tx=0).stop 2024-09-12T02:38:56.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 -- 172.21.15.100:0/3425190026 shutdown_connections 2024-09-12T02:38:56.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 --2- 172.21.15.100:0/3425190026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278101420 0x7f427810d950 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 --2- 172.21.15.100:0/3425190026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278100a80 0x7f4278100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 --2- 172.21.15.100:0/3425190026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278106a80 0x7f4278106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 -- 172.21.15.100:0/3425190026 >> 172.21.15.100:0/3425190026 conn(0x7f42780fc7a0 msgr2=0x7f42780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 -- 172.21.15.100:0/3425190026 shutdown_connections 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.002+0000 7f427c873640 1 -- 172.21.15.100:0/3425190026 wait complete. 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 Processor -- start 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 -- start start 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278100a80 0x7f4278198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278101420 0x7f42781989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278106a80 0x7f427819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4278110ea0 con 0x7f4278106a80 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4278110d20 con 0x7f4278100a80 2024-09-12T02:38:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.003+0000 7f427c873640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4278111020 con 0x7f4278101420 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278106a80 0x7f427819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278106a80 0x7f427819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52582/0 (socket says 172.21.15.100:52582) 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 -- 172.21.15.100:0/2378725496 learned_addr learned my addr 172.21.15.100:0/2378725496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f427659c640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278100a80 0x7f4278198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4275d9b640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278101420 0x7f42781989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 -- 172.21.15.100:0/2378725496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278101420 msgr2=0x7f42781989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278101420 0x7f42781989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 -- 172.21.15.100:0/2378725496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278100a80 msgr2=0x7f4278198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278100a80 0x7f4278198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 -- 172.21.15.100:0/2378725496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427819d420 con 0x7f4278106a80 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f427659c640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278100a80 0x7f4278198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:56.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f4276d9d640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278106a80 0x7f427819cd40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4268005ab0 tx=0x7f42680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f426f7fe640 1 -- 172.21.15.100:0/2378725496 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426803f030 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427819d6b0 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.004+0000 7f426f7fe640 1 -- 172.21.15.100:0/2378725496 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4268003ce0 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.005+0000 7f426f7fe640 1 -- 172.21.15.100:0/2378725496 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268035070 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.005+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42781a4ff0 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.006+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4278100ee0 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.007+0000 7f426f7fe640 1 -- 172.21.15.100:0/2378725496 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f4268042030 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.007+0000 7f426f7fe640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42640a2c10 0x7f42640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.007+0000 7f427659c640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42640a2c10 0x7f42640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.007+0000 7f426f7fe640 1 -- 172.21.15.100:0/2378725496 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f42680ef730 con 0x7f4278106a80 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.008+0000 7f427659c640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42640a2c10 0x7f42640a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4270005fd0 tx=0x7f4270009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:56.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.011+0000 7f426f7fe640 1 -- 172.21.15.100:0/2378725496 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42680bc520 con 0x7f4278106a80 2024-09-12T02:38:56.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-12T02:38:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.225+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f427810a020 con 0x7f4278106a80 2024-09-12T02:38:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.226+0000 7f426f7fe640 1 -- 172.21.15.100:0/2378725496 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f42680bbe20 con 0x7f4278106a80 2024-09-12T02:38:56.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:56.228 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":25,"btime":"2024-09-12T02:38:32:651439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:32.370844+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:38:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 25 2024-09-12T02:38:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42640a2c10 msgr2=0x7f42640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42640a2c10 0x7f42640a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4270005fd0 tx=0x7f4270009520 comp rx=0 tx=0).stop 2024-09-12T02:38:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278106a80 msgr2=0x7f427819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278106a80 0x7f427819cd40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4268005ab0 tx=0x7f42680042f0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 shutdown_connections 2024-09-12T02:38:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42640a2c10 0x7f42640a50d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4278106a80 0x7f427819cd40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278101420 0x7f42781989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 --2- 172.21.15.100:0/2378725496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278100a80 0x7f4278198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 >> 172.21.15.100:0/2378725496 conn(0x7f42780fc7a0 msgr2=0x7f427806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 shutdown_connections 2024-09-12T02:38:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:56.228+0000 7f427c873640 1 -- 172.21.15.100:0/2378725496 wait complete. 2024-09-12T02:38:56.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:55 smithi189 ceph-mon[35196]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-12T02:38:56.270 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-12T02:38:56.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-12T02:38:56.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:55 smithi117 ceph-mon[34898]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-12T02:38:56.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-12T02:38:56.424 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/: 2024-09-12T02:38:56.424 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:38:56.424 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:38:56.425 INFO:teuthology.orchestra.run.smithi100.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 .. 2024-09-12T02:38:56.425 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 data 2024-09-12T02:38:56.425 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:38:56.425 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data: 2024-09-12T02:38:56.425 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:38:56.425 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:38:56.425 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 .. 2024-09-12T02:38:56.426 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi100.stdout:[Service] 2024-09-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi100.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi100.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-12T02:38:56.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-12T02:38:56.656 INFO:teuthology.orchestra.run.smithi100.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-12T02:38:57.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:36:49.490181+0000', 'modified': '2024-09-12T02:38:32.370844+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24473, 'mds_1': 24466, 'mds_2': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3724625594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3724625594}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3724625594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/4244197989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 4244197989}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 4244197989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6837/2625823245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 2625823245}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 2625823245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.189:6837/2893582984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 2893582984}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 2893582984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/249791432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 249791432}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 249791432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6839/801964439', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 801964439}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 801964439}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24473, 24466, 24448]} 2024-09-12T02:38:57.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:38:57.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:38:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:56 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2378725496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:57.319 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:57.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:56 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2378725496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:57.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:56 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2378725496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:38:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 -- 172.21.15.100:0/576403728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71381036e0 msgr2=0x7f7138107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 --2- 172.21.15.100:0/576403728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71381036e0 0x7f7138107b90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7128009930 tx=0x7f712802a420 comp rx=0 tx=0).stop 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 -- 172.21.15.100:0/576403728 shutdown_connections 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 --2- 172.21.15.100:0/576403728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71381082a0 0x7f713810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 --2- 172.21.15.100:0/576403728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71381036e0 0x7f7138107b90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 --2- 172.21.15.100:0/576403728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7138102d30 0x7f7138103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 -- 172.21.15.100:0/576403728 >> 172.21.15.100:0/576403728 conn(0x7f71380fc7d0 msgr2=0x7f71380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 -- 172.21.15.100:0/576403728 shutdown_connections 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.826+0000 7f71406ee640 1 -- 172.21.15.100:0/576403728 wait complete. 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 Processor -- start 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 -- start start 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7138102d30 0x7f7138198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71381036e0 0x7f7138198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71381082a0 0x7f713819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7138112060 con 0x7f7138102d30 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7138111ee0 con 0x7f71381082a0 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f71406ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71381121e0 con 0x7f71381036e0 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7138102d30 0x7f7138198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7138102d30 0x7f7138198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52594/0 (socket says 172.21.15.100:52594) 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 -- 172.21.15.100:0/1738195595 learned_addr learned my addr 172.21.15.100:0/1738195595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713dc89640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71381036e0 0x7f7138198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713ec8b640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71381082a0 0x7f713819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 -- 172.21.15.100:0/1738195595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71381036e0 msgr2=0x7f7138198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71381036e0 0x7f7138198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 -- 172.21.15.100:0/1738195595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71381082a0 msgr2=0x7f713819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71381082a0 0x7f713819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713e48a640 1 -- 172.21.15.100:0/1738195595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713819d5b0 con 0x7f7138102d30 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.827+0000 7f713ec8b640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71381082a0 0x7f713819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.828+0000 7f713e48a640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7138102d30 0x7f7138198600 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f713400d950 tx=0x7f713400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.828+0000 7f712f7fe640 1 -- 172.21.15.100:0/1738195595 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134017030 con 0x7f7138102d30 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.828+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713819d8a0 con 0x7f7138102d30 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.828+0000 7f712f7fe640 1 -- 172.21.15.100:0/1738195595 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7134004020 con 0x7f7138102d30 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.828+0000 7f712f7fe640 1 -- 172.21.15.100:0/1738195595 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71340047a0 con 0x7f7138102d30 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.828+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71381a5180 con 0x7f7138102d30 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.830+0000 7f712f7fe640 1 -- 172.21.15.100:0/1738195595 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f71340041d0 con 0x7f7138102d30 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.830+0000 7f7142ac7740 1 Processor -- start 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f7142ac7740 1 -- start start 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c82987cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829881f0 0x557c82996a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c82996fc0 0x557c829993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f7142ac7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557c828ee090 con 0x557c829881f0 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f7142ac7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557c82895a70 con 0x557c829878d0 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f7142ac7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c828ea050 con 0x557c82996fc0 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f712f7fe640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f71240a2c10 0x7f71240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f713e48a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829881f0 0x557c82996a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f713e48a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829881f0 0x557c82996a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52610/0 (socket says 172.21.15.100:52610) 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f713e48a640 1 -- 172.21.15.100:0/30007737 learned_addr learned my addr 172.21.15.100:0/30007737 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f713ec8b640 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c82987cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f713dc89640 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c82996fc0 0x557c829993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f713ec8b640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f71240a2c10 0x7f71240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.831+0000 7f712f7fe640 1 -- 172.21.15.100:0/1738195595 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f71340cec00 con 0x7f7138102d30 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713e48a640 1 -- 172.21.15.100:0/30007737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c82996fc0 msgr2=0x557c829993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713e48a640 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c82996fc0 0x557c829993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713e48a640 1 -- 172.21.15.100:0/30007737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 msgr2=0x557c82987cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713e48a640 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c82987cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713e48a640 1 -- 172.21.15.100:0/30007737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c828a2130 con 0x557c829881f0 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713ec8b640 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c82987cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713dc89640 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c82996fc0 0x557c829993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713e48a640 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829881f0 0x557c82996a80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f71340cc5d0 tx=0x7f7134005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b5dba1b5f775e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f713ec8b640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f71240a2c10 0x7f71240a50d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7130005fd0 tx=0x7f7130005c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f712cff9640 1 -- 172.21.15.100:0/30007737 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713409ae30 con 0x557c829881f0 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f712cff9640 1 -- 172.21.15.100:0/30007737 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713409b9f0 con 0x557c829881f0 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.832+0000 7f712cff9640 1 -- 172.21.15.100:0/30007737 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71340bb6b0 con 0x557c829881f0 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 -- 172.21.15.100:0/30007737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829881f0 msgr2=0x557c82996a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829881f0 0x557c82996a80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f71340cc5d0 tx=0x7f7134005130 comp rx=0 tx=0).stop 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 -- 172.21.15.100:0/30007737 shutdown_connections 2024-09-12T02:38:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c82996fc0 0x557c829993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829881f0 0x557c82996a80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 --2- 172.21.15.100:0/30007737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c82987cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 -- 172.21.15.100:0/30007737 >> 172.21.15.100:0/30007737 conn(0x557c82983f60 msgr2=0x557c82984340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 -- 172.21.15.100:0/30007737 shutdown_connections 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 -- 172.21.15.100:0/30007737 wait complete. 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 -- start start 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.833+0000 7f7142ac7740 1 Processor -- start 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829878d0 0x557c82996a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c8298fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c82996fc0 0x557c82990480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557c8298a790 con 0x557c829878d0 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557c828a8f20 con 0x557c82996fc0 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c8298a910 con 0x557c829881f0 2024-09-12T02:38:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 10 client.0 _ll_register_callbacks cb 0x557c82872030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829878d0 0x557c82996a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829878d0 0x557c82996a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52612/0 (socket says 172.21.15.100:52612) 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 -- 172.21.15.100:0/13319147 learned_addr learned my addr 172.21.15.100:0/13319147 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713ec8b640 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c82996fc0 0x557c82990480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713dc89640 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c8298fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 -- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 msgr2=0x557c8298fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c8298fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 -- 172.21.15.100:0/13319147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c82996fc0 msgr2=0x557c82990480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c82996fc0 0x557c82990480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 -- 172.21.15.100:0/13319147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c8265f2b0 con 0x557c829878d0 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f713e48a640 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829878d0 0x557c82996a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f71340cef70 tx=0x7f71340cca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22430c0436882b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7121ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:57.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7121ffb640 1 -- 172.21.15.100:0/13319147 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713409ac50 con 0x557c829878d0 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7121ffb640 1 -- 172.21.15.100:0/13319147 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f71340ccbb0 con 0x557c829878d0 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f713409b9f0 con 0x557c829878d0 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7121ffb640 1 -- 172.21.15.100:0/13319147 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f713409ae30 con 0x557c829878d0 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 10 client.15312 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.834+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c829a10f0 con 0x557c829878d0 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7121ffb640 1 -- 172.21.15.100:0/13319147 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713409b9f0 con 0x557c829878d0 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7121ffb640 1 -- 172.21.15.100:0/13319147 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f713407fce0 con 0x557c829878d0 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7142ac7740 10 client.15312 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7142ac7740 10 client.15312 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7142ac7740 20 client.15312 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7142ac7740 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c829a2440 0x557c829a4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7142ac7740 4 client.15312 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c828fb600 con 0x557c829a2440 2024-09-12T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.835+0000 7f713dc89640 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c829a2440 0x557c829a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7121ffb640 10 client.15312 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f713dc89640 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c829a2440 0x557c829a4610 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0e253335201d7f5 server_cookie=6bb537065d8bf21b in_seq=0 out_seq=0 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7121ffb640 1 -- 172.21.15.100:0/13319147 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c828fb600 con 0x557c829a2440 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7121ffb640 10 client.15312 handle_command_reply: tid=0 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 client.15312 shutdown 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829878d0 msgr2=0x557c82996a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829878d0 0x557c82996a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f71340cef70 tx=0x7f71340cca20 comp rx=0 tx=0).stop 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 shutdown_connections 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c829a2440 0x557c829a4610 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c82996fc0 0x557c82990480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c8298fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7121ffb640 0 client.15312 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:57.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 --2- 172.21.15.100:0/13319147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c829878d0 0x557c82996a10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 >> 172.21.15.100:0/13319147 conn(0x557c82983f60 msgr2=0x557c82989c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.836+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 shutdown_connections 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.837+0000 7f7142ac7740 1 -- 172.21.15.100:0/13319147 wait complete. 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.837+0000 7f7142ac7740 20 client.15312 trim_cache size 0 max 16384 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 Processor -- start 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 -- start start 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829a3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c82994440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c8298b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557c829a2950 con 0x557c82996fc0 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557c829a3020 con 0x557c829878d0 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f7142ac7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c829a36f0 con 0x557c829881f0 2024-09-12T02:38:57.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f713ec8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c8298b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f713ec8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c8298b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52618/0 (socket says 172.21.15.100:52618) 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.854+0000 7f713ec8b640 1 -- 172.21.15.100:0/1048058768 learned_addr learned my addr 172.21.15.100:0/1048058768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713dc89640 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c82994440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713e48a640 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713ec8b640 1 -- 172.21.15.100:0/1048058768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 msgr2=0x557c82994440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713ec8b640 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c82994440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713ec8b640 1 -- 172.21.15.100:0/1048058768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 msgr2=0x557c829a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713ec8b640 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713ec8b640 1 -- 172.21.15.100:0/1048058768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c82988ed0 con 0x557c82996fc0 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713e48a640 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713dc89640 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c82994440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f713ec8b640 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c8298b270 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f713001eea0 tx=0x7f7130014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427f47cb5a88ec7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f7123fff640 1 -- 172.21.15.100:0/1048058768 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130032070 con 0x557c82996fc0 2024-09-12T02:38:57.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f7123fff640 1 -- 172.21.15.100:0/1048058768 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7130015930 con 0x557c82996fc0 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.855+0000 7f7123fff640 1 -- 172.21.15.100:0/1048058768 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713002d780 con 0x557c82996fc0 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- 172.21.15.100:0/1048058768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 msgr2=0x557c8298b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c8298b270 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f713001eea0 tx=0x7f7130014000 comp rx=0 tx=0).stop 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- 172.21.15.100:0/1048058768 shutdown_connections 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c8298b270 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c82994440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 --2- 172.21.15.100:0/1048058768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- 172.21.15.100:0/1048058768 >> 172.21.15.100:0/1048058768 conn(0x557c82983f60 msgr2=0x557c8298ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- 172.21.15.100:0/1048058768 shutdown_connections 2024-09-12T02:38:57.914 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24448, 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 119.937742641, 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 25, 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 84, 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 152.49526616599999 2024-09-12T02:38:57.915 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- 172.21.15.100:0/1048058768 wait complete. 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- start start 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 Processor -- start 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c829ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c82a0b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557c829a4490 con 0x557c82996fc0 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557c829a3dc0 con 0x557c829878d0 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c829a4b60 con 0x557c829881f0 2024-09-12T02:38:57.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f7142ac7740 10 client.0 _ll_register_callbacks cb 0x7f7134097590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.856+0000 7f713ec8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c82a0b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c82a0b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52622/0 (socket says 172.21.15.100:52622) 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 -- 172.21.15.100:0/3022426699 learned_addr learned my addr 172.21.15.100:0/3022426699 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713e48a640 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713dc89640 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c829ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 -- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 msgr2=0x557c829ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c829ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 -- 172.21.15.100:0/3022426699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 msgr2=0x557c829ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 -- 172.21.15.100:0/3022426699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c82a0bde0 con 0x557c82996fc0 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f713ec8b640 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c82a0b8a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7130005f10 tx=0x7f713000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff211795aec051b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7121ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:57.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7121ffb640 1 -- 172.21.15.100:0/3022426699 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130032050 con 0x557c82996fc0 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7121ffb640 1 -- 172.21.15.100:0/3022426699 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7130015730 con 0x557c82996fc0 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7130015930 con 0x557c82996fc0 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7121ffb640 1 -- 172.21.15.100:0/3022426699 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f713002d500 con 0x557c82996fc0 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7142ac7740 10 client.15318 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c82a0cf10 con 0x557c82996fc0 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.857+0000 7f7121ffb640 1 -- 172.21.15.100:0/3022426699 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7130015930 con 0x557c82996fc0 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7121ffb640 1 -- 172.21.15.100:0/3022426699 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7130021040 con 0x557c82996fc0 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7142ac7740 10 client.15318 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7142ac7740 10 client.15318 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7142ac7740 20 client.15318 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7142ac7740 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c82a11700 0x557c82a10410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7142ac7740 4 client.15318 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:57.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "status"}) -- 0x557c828f5b10 con 0x557c82a11700 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f713e48a640 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c82a11700 0x557c82a10410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f7121ffb640 10 client.15318 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.858+0000 7f713e48a640 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c82a11700 0x557c82a10410 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=383c263c08f47e53 server_cookie=56672a6c44892817 in_seq=0 out_seq=0 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7121ffb640 1 -- 172.21.15.100:0/3022426699 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557c828f5b10 con 0x557c82a11700 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7121ffb640 10 client.15318 handle_command_reply: tid=0 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 client.15318 shutdown 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 msgr2=0x557c82a0b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c82a0b8a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7130005f10 tx=0x7f713000a430 comp rx=0 tx=0).stop 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 shutdown_connections 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557c82a11700 0x557c82a10410 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c82996fc0 0x557c82a0b8a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c829881f0 0x557c829ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7121ffb640 0 client.15318 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 --2- 172.21.15.100:0/3022426699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c829878d0 0x557c829ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 >> 172.21.15.100:0/3022426699 conn(0x557c82983f60 msgr2=0x557c82989450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 shutdown_connections 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 1 -- 172.21.15.100:0/3022426699 wait complete. 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f7142ac7740 20 client.15318 trim_cache size 0 max 16384 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f71240a2c10 msgr2=0x7f71240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f71406ee640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f71240a2c10 0x7f71240a50d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7130005fd0 tx=0x7f7130005c80 comp rx=0 tx=0).stop 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7138102d30 msgr2=0x7f7138198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.859+0000 7f71406ee640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7138102d30 0x7f7138198600 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f713400d950 tx=0x7f713400de10 comp rx=0 tx=0).stop 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 shutdown_connections 2024-09-12T02:38:57.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f71240a2c10 0x7f71240a50d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71381082a0 0x7f713819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71381036e0 0x7f7138198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 --2- 172.21.15.100:0/1738195595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7138102d30 0x7f7138198600 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 >> 172.21.15.100:0/1738195595 conn(0x7f71380fc7d0 msgr2=0x7f7138105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 shutdown_connections 2024-09-12T02:38:57.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:57.860+0000 7f71406ee640 1 -- 172.21.15.100:0/1738195595 wait complete. 2024-09-12T02:38:58.360 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.360 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.360 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:58 smithi100 ceph-mon[31390]: pgmap v345: 97 pgs: 97 active+clean; 659 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T02:38:58.360 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.360 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:58.360 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:38:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:58 smithi189 ceph-mon[35196]: pgmap v345: 97 pgs: 97 active+clean; 659 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T02:38:58.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:58.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:38:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:58 smithi117 ceph-mon[34898]: pgmap v345: 97 pgs: 97 active+clean; 659 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T02:38:58.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:58.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:38:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:38:58.644 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:38:58.898 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:59.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 -- 172.21.15.100:0/4260269928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c010c170 msgr2=0x7fa6c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/4260269928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c010c170 0x7fa6c010e610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009900 tx=0x7fa6b802a480 comp rx=0 tx=0).stop 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 -- 172.21.15.100:0/4260269928 shutdown_connections 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/4260269928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c010c170 0x7fa6c010e610 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/4260269928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6c0103660 0x7fa6c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/4260269928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 0x7fa6c0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 -- 172.21.15.100:0/4260269928 >> 172.21.15.100:0/4260269928 conn(0x7fa6c00fc7a0 msgr2=0x7fa6c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 -- 172.21.15.100:0/4260269928 shutdown_connections 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 -- 172.21.15.100:0/4260269928 wait complete. 2024-09-12T02:38:59.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.406+0000 7fa6c4e54640 1 Processor -- start 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6c4e54640 1 -- start start 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6c4e54640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 0x7fa6c01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6c4e54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c0103660 0x7fa6c0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6c4e54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6c010c170 0x7fa6c019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6c4e54640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0111f70 con 0x7fa6c0103660 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6c4e54640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0111df0 con 0x7fa6c0102d40 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6c4e54640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c01120f0 con 0x7fa6c010c170 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6bdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c0103660 0x7fa6c0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 0x7fa6c01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 0x7fa6c01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:37926/0 (socket says 172.21.15.100:37926) 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6bdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c0103660 0x7fa6c0198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52650/0 (socket says 172.21.15.100:52650) 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 -- 172.21.15.100:0/1270757541 learned_addr learned my addr 172.21.15.100:0/1270757541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:59.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6bed9d640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6c010c170 0x7fa6c019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 -- 172.21.15.100:0/1270757541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6c010c170 msgr2=0x7fa6c019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6c010c170 0x7fa6c019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 -- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c0103660 msgr2=0x7fa6c0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c0103660 0x7fa6c0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 -- 172.21.15.100:0/1270757541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c019d3a0 con 0x7fa6c0102d40 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.407+0000 7fa6be59c640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 0x7fa6c01983f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000ebc0 tx=0x7fa6b000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.408+0000 7fa6af7fe640 1 -- 172.21.15.100:0/1270757541 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0010630 con 0x7fa6c0102d40 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.408+0000 7fa6af7fe640 1 -- 172.21.15.100:0/1270757541 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b0010cb0 con 0x7fa6c0102d40 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.408+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c019d690 con 0x7fa6c0102d40 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.408+0000 7fa6af7fe640 1 -- 172.21.15.100:0/1270757541 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0018bd0 con 0x7fa6c0102d40 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.408+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c01a4f70 con 0x7fa6c0102d40 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.411+0000 7fa6c722d740 1 Processor -- start 2024-09-12T02:38:59.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.411+0000 7fa6c722d740 1 -- start start 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.411+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc401870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.411+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc4021f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.411+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc417640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.411+0000 7fa6c722d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5591dc368090 con 0x5591dc401db0 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.411+0000 7fa6c722d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591dc30fa70 con 0x5591dc402f50 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6c722d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5591dc364050 con 0x5591dc415250 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6af7fe640 1 -- 172.21.15.100:0/1270757541 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fa6b00107d0 con 0x7fa6c0102d40 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc401870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bdd9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc417640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc401870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:37932/0 (socket says 172.21.15.100:37932) 2024-09-12T02:38:59.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bed9d640 1 -- 172.21.15.100:0/1646031859 learned_addr learned my addr 172.21.15.100:0/1646031859 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6be59c640 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc4021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bdd9b640 1 -- 172.21.15.100:0/1646031859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 msgr2=0x5591dc401870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc401870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bdd9b640 1 -- 172.21.15.100:0/1646031859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 msgr2=0x5591dc4021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc4021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bdd9b640 1 -- 172.21.15.100:0/1646031859 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591dc31c130 con 0x5591dc415250 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc417640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40045b0 tx=0x7fa6b400bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=215193dce03f38b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.412+0000 7fa6acff9640 1 -- 172.21.15.100:0/1646031859 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4003bd0 con 0x5591dc415250 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6acff9640 1 -- 172.21.15.100:0/1646031859 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b4015070 con 0x5591dc415250 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6acff9640 1 -- 172.21.15.100:0/1646031859 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4004d40 con 0x5591dc415250 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6af7fe640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa6a80a2c90 0x7fa6a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6bed9d640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa6a80a2c90 0x7fa6a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6af7fe640 1 -- 172.21.15.100:0/1270757541 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa6b00cf780 con 0x7fa6c0102d40 2024-09-12T02:38:59.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6c722d740 1 -- 172.21.15.100:0/1646031859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 msgr2=0x5591dc417640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6c722d740 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc417640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40045b0 tx=0x7fa6b400bb10 comp rx=0 tx=0).stop 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6c722d740 1 -- 172.21.15.100:0/1646031859 shutdown_connections 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6c722d740 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc417640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6c722d740 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc4021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6c722d740 1 --2- 172.21.15.100:0/1646031859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc401870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.413+0000 7fa6c722d740 1 -- 172.21.15.100:0/1646031859 >> 172.21.15.100:0/1646031859 conn(0x5591dc3fdf60 msgr2=0x5591dc3fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 -- 172.21.15.100:0/1646031859 shutdown_connections 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 -- 172.21.15.100:0/1646031859 wait complete. 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6bed9d640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa6a80a2c90 0x7fa6a80a5150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80096c0 tx=0x7fa6b8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 -- start start 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 Processor -- start 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc40eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc40f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc4148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5591dc408e20 con 0x5591dc415250 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591dc322f20 con 0x5591dc401db0 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5591dc408fa0 con 0x5591dc402f50 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6c722d740 10 client.0 _ll_register_callbacks cb 0x5591dc2ec030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc4148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.414+0000 7fa6be59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc40eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc4148b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52658/0 (socket says 172.21.15.100:52658) 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6be59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc40eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:37946/0 (socket says 172.21.15.100:37946) 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6bed9d640 1 -- 172.21.15.100:0/3975692234 learned_addr learned my addr 172.21.15.100:0/3975692234 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc40f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6be59c640 1 -- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 msgr2=0x5591dc40f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6be59c640 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc40f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6be59c640 1 -- 172.21.15.100:0/3975692234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 msgr2=0x5591dc4148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6be59c640 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc4148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6be59c640 1 -- 172.21.15.100:0/3975692234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591dc0d92b0 con 0x5591dc401db0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc40f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6be59c640 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc40eba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00cd120 tx=0x7fa6b00982c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f6b49f5fbe82f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/3975692234 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0010e60 con 0x5591dc401db0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b4015070 con 0x5591dc401db0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/3975692234 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa6b00cd370 con 0x5591dc401db0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/3975692234 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6b009bf20 con 0x5591dc401db0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6c722d740 10 client.24860 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.415+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591dc42c240 con 0x5591dc401db0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/3975692234 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b4015070 con 0x5591dc401db0 2024-09-12T02:38:59.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/3975692234 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6b00baab0 con 0x5591dc401db0 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6c722d740 10 client.24860 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6c722d740 10 client.24860 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6c722d740 20 client.24860 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6c722d740 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc42e7e0 0x5591dc42fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6c722d740 4 client.24860 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591dc375600 con 0x5591dc42e7e0 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc42e7e0 0x5591dc42fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6a5ffb640 10 client.24860 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:59.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.416+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc42e7e0 0x5591dc42fc50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a02a744005ddaa4 server_cookie=67c7a3a12874b12 in_seq=0 out_seq=0 2024-09-12T02:38:59.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/3975692234 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591dc375600 con 0x5591dc42e7e0 2024-09-12T02:38:59.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6a5ffb640 10 client.24860 handle_command_reply: tid=0 2024-09-12T02:38:59.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 client.24860 shutdown 2024-09-12T02:38:59.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 msgr2=0x5591dc40eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc40eba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00cd120 tx=0x7fa6b00982c0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 shutdown_connections 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc42e7e0 0x5591dc42fc50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc4148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc40f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6a5ffb640 0 client.24860 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 --2- 172.21.15.100:0/3975692234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc40eba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 >> 172.21.15.100:0/3975692234 conn(0x5591dc3fdf60 msgr2=0x5591dc403cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 shutdown_connections 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 1 -- 172.21.15.100:0/3975692234 wait complete. 2024-09-12T02:38:59.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.417+0000 7fa6c722d740 20 client.24860 trim_cache size 0 max 16384 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 Processor -- start 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 -- start start 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc408350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc414820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc401750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5591dc42df90 con 0x5591dc415250 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591dc42e660 con 0x5591dc401db0 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6c722d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5591dc42ed30 con 0x5591dc402f50 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc401750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6be59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc408350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc401750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52672/0 (socket says 172.21.15.100:52672) 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6bed9d640 1 -- 172.21.15.100:0/2379847600 learned_addr learned my addr 172.21.15.100:0/2379847600 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.436+0000 7fa6bdd9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc414820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6bed9d640 1 -- 172.21.15.100:0/2379847600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 msgr2=0x5591dc414820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6bed9d640 1 --2- 172.21.15.100:0/2379847600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc414820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6bed9d640 1 -- 172.21.15.100:0/2379847600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 msgr2=0x5591dc408350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6bed9d640 1 --2- 172.21.15.100:0/2379847600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc408350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6bed9d640 1 -- 172.21.15.100:0/2379847600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591dc417970 con 0x5591dc415250 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6bed9d640 1 --2- 172.21.15.100:0/2379847600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc401750 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8031b30 tx=0x7fa6b803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c08d41aff4034f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6a7fff640 1 -- 172.21.15.100:0/2379847600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b804f070 con 0x5591dc415250 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6a7fff640 1 -- 172.21.15.100:0/2379847600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b8003e50 con 0x5591dc415250 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.437+0000 7fa6a7fff640 1 -- 172.21.15.100:0/2379847600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8035040 con 0x5591dc415250 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 -- 172.21.15.100:0/2379847600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 msgr2=0x5591dc401750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 --2- 172.21.15.100:0/2379847600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc401750 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8031b30 tx=0x7fa6b803f000 comp rx=0 tx=0).stop 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 -- 172.21.15.100:0/2379847600 shutdown_connections 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 --2- 172.21.15.100:0/2379847600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc415250 0x5591dc401750 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 --2- 172.21.15.100:0/2379847600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc402f50 0x5591dc414820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 --2- 172.21.15.100:0/2379847600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc401db0 0x5591dc408350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 -- 172.21.15.100:0/2379847600 >> 172.21.15.100:0/2379847600 conn(0x5591dc3fdf60 msgr2=0x5591dc407c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 -- 172.21.15.100:0/2379847600 shutdown_connections 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 -- 172.21.15.100:0/2379847600 wait complete. 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 -- start start 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 Processor -- start 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc438170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc4386b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.438+0000 7fa6c722d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc405be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6c722d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5591dc42fad0 con 0x5591dc401db0 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6c722d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591dc42f400 con 0x5591dc402f50 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6c722d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5591dc4301a0 con 0x5591dc415250 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6c722d740 10 client.0 _ll_register_callbacks cb 0x7fa6b0097aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc438170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc438170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52688/0 (socket says 172.21.15.100:52688) 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 -- 172.21.15.100:0/513241560 learned_addr learned my addr 172.21.15.100:0/513241560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc4386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6bed9d640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc405be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 -- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 msgr2=0x5591dc405be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc405be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 -- 172.21.15.100:0/513241560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 msgr2=0x5591dc4386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc4386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 -- 172.21.15.100:0/513241560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591dc406410 con 0x5591dc401db0 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc4386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6be59c640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc438170 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000eb90 tx=0x7fa6b00cd5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1f08cccc7ad860 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/513241560 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b009ba60 con 0x5591dc401db0 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/513241560 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa6b009b580 con 0x5591dc401db0 2024-09-12T02:38:59.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b8003e50 con 0x5591dc401db0 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/513241560 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6b00a0220 con 0x5591dc401db0 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6c722d740 10 client.15336 fetch_fsmap learned FSMap version 25 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.439+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591dc437a30 con 0x5591dc401db0 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/513241560 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b8003e50 con 0x5591dc401db0 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/513241560 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6b00a13b0 con 0x5591dc401db0 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6c722d740 10 client.15336 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6c722d740 10 client.15336 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6c722d740 20 client.15336 populate_metadata read hostname 'smithi100' 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6c722d740 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc49d400 0x5591dc49c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6c722d740 4 client.15336 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "status"}) -- 0x5591dc36fb10 con 0x5591dc49d400 2024-09-12T02:38:59.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc49d400 0x5591dc49c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6a5ffb640 10 client.15336 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.440+0000 7fa6bdd9b640 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc49d400 0x5591dc49c110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba56698014f9cb53 server_cookie=b65b13f5d18d6f5a in_seq=0 out_seq=0 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6a5ffb640 1 -- 172.21.15.100:0/513241560 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5591dc36fb10 con 0x5591dc49d400 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6a5ffb640 10 client.15336 handle_command_reply: tid=0 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 client.15336 shutdown 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 msgr2=0x5591dc438170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc438170 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000eb90 tx=0x7fa6b00cd5a0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 shutdown_connections 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5591dc49d400 0x5591dc49c110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5591dc415250 0x5591dc405be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591dc402f50 0x5591dc4386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 --2- 172.21.15.100:0/513241560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591dc401db0 0x5591dc438170 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6a5ffb640 0 client.15336 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:38:59.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 >> 172.21.15.100:0/513241560 conn(0x5591dc3fdf60 msgr2=0x5591dc4094c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 shutdown_connections 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 1 -- 172.21.15.100:0/513241560 wait complete. 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.441+0000 7fa6c722d740 20 client.15336 trim_cache size 0 max 16384 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24466, 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:38:59.450 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:38:59.451 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 122.53329629, 2024-09-12T02:38:59.451 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 25, 2024-09-12T02:38:59.451 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:38:59.451 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 84, 2024-09-12T02:38:59.451 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 148.68724640400001 2024-09-12T02:38:59.451 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:38:59.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa6a80a2c90 msgr2=0x7fa6a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa6a80a2c90 0x7fa6a80a5150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80096c0 tx=0x7fa6b8005b50 comp rx=0 tx=0).stop 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 msgr2=0x7fa6c01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 0x7fa6c01983f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000ebc0 tx=0x7fa6b000c6a0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 shutdown_connections 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa6a80a2c90 0x7fa6a80a5150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6c010c170 0x7fa6c019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6c0103660 0x7fa6c0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 --2- 172.21.15.100:0/1270757541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6c0102d40 0x7fa6c01983f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 >> 172.21.15.100:0/1270757541 conn(0x7fa6c00fc7a0 msgr2=0x7fa6c00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 shutdown_connections 2024-09-12T02:38:59.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:38:59.442+0000 7fa6c4e54640 1 -- 172.21.15.100:0/1270757541 wait complete. 2024-09-12T02:39:00.138 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:39:00.381 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:00.774 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:00 smithi100 ceph-mon[31390]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-12T02:39:00.774 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:00 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:39:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:00 smithi117 ceph-mon[34898]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-12T02:39:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:00 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:39:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 -- 172.21.15.100:0/3140685191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4102d40 msgr2=0x7fc9e4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/3140685191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4102d40 0x7fc9e4103120 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009ca0 tx=0x7fc9e002a950 comp rx=0 tx=0).stop 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 -- 172.21.15.100:0/3140685191 shutdown_connections 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/3140685191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e410c170 0x7fc9e410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/3140685191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e4103660 0x7fc9e410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/3140685191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4102d40 0x7fc9e4103120 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 -- 172.21.15.100:0/3140685191 >> 172.21.15.100:0/3140685191 conn(0x7fc9e40fc7a0 msgr2=0x7fc9e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 -- 172.21.15.100:0/3140685191 shutdown_connections 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.853+0000 7fc9eb82e640 1 -- 172.21.15.100:0/3140685191 wait complete. 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 Processor -- start 2024-09-12T02:39:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 -- start start 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e4102d40 0x7fc9e41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4103660 0x7fc9e4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e410c170 0x7fc9e4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4111f70 con 0x7fc9e4103660 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4111df0 con 0x7fc9e4102d40 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9eb82e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e41120f0 con 0x7fc9e410c170 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9e8dc9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4103660 0x7fc9e4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9e8dc9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4103660 0x7fc9e4100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52698/0 (socket says 172.21.15.100:52698) 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9e8dc9640 1 -- 172.21.15.100:0/2844652707 learned_addr learned my addr 172.21.15.100:0/2844652707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.854+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e4102d40 0x7fc9e41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e410c170 0x7fc9e4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9e8dc9640 1 -- 172.21.15.100:0/2844652707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e410c170 msgr2=0x7fc9e4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e410c170 0x7fc9e4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9e8dc9640 1 -- 172.21.15.100:0/2844652707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e4102d40 msgr2=0x7fc9e41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e4102d40 0x7fc9e41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9e8dc9640 1 -- 172.21.15.100:0/2844652707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e41a6900 con 0x7fc9e4103660 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4103660 0x7fc9e4100ee0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c970 tx=0x7fc9d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9da7fc640 1 -- 172.21.15.100:0/2844652707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4007bb0 con 0x7fc9e4103660 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e41a6bf0 con 0x7fc9e4103660 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9da7fc640 1 -- 172.21.15.100:0/2844652707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9d4007d50 con 0x7fc9e4103660 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9da7fc640 1 -- 172.21.15.100:0/2844652707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4018820 con 0x7fc9e4103660 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.855+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e41a7180 con 0x7fc9e4103660 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.857+0000 7fc9da7fc640 1 -- 172.21.15.100:0/2844652707 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fc9d40189c0 con 0x7fc9e4103660 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 Processor -- start 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 -- start start 2024-09-12T02:39:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d486db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4872f0 0x557d0d491670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d493fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557d0d3ed090 con 0x557d0d4872f0 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557d0d394a70 con 0x557d0d491bb0 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9edc07740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d0d3e9050 con 0x557d0d4869d0 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4872f0 0x557d0d491670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4872f0 0x557d0d491670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52702/0 (socket says 172.21.15.100:52702) 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 -- 172.21.15.100:0/2684343892 learned_addr learned my addr 172.21.15.100:0/2684343892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d486db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9da7fc640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc9d00a2c10 0x7fc9d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d493fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc9d00a2c10 0x7fc9d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 -- 172.21.15.100:0/2684343892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 msgr2=0x557d0d486db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d486db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 -- 172.21.15.100:0/2684343892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 msgr2=0x557d0d493fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d493fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e95ca640 1 -- 172.21.15.100:0/2684343892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0d3a1130 con 0x557d0d4872f0 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.858+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d493fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.859+0000 7fc9da7fc640 1 -- 172.21.15.100:0/2844652707 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc9d40cf270 con 0x7fc9e4103660 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.859+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4872f0 0x557d0d491670 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009ca0 tx=0x7fc9e00098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ce090daa31cf79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.859+0000 7fc9cf7fe640 1 -- 172.21.15.100:0/2684343892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0048070 con 0x557d0d4872f0 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.859+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc9d00a2c10 0x7fc9d00a50d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc004120 tx=0x7fc9dc004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.859+0000 7fc9cf7fe640 1 -- 172.21.15.100:0/2684343892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9e002f940 con 0x557d0d4872f0 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.859+0000 7fc9cf7fe640 1 -- 172.21.15.100:0/2684343892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0034040 con 0x557d0d4872f0 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 -- 172.21.15.100:0/2684343892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4872f0 msgr2=0x557d0d491670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4872f0 0x557d0d491670 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009ca0 tx=0x7fc9e00098d0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 -- 172.21.15.100:0/2684343892 shutdown_connections 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d493fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4872f0 0x557d0d491670 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 --2- 172.21.15.100:0/2684343892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d486db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 -- 172.21.15.100:0/2684343892 >> 172.21.15.100:0/2684343892 conn(0x557d0d482f60 msgr2=0x557d0d483340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 -- 172.21.15.100:0/2684343892 shutdown_connections 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 -- 172.21.15.100:0/2684343892 wait complete. 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 -- start start 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.860+0000 7fc9edc07740 1 Processor -- start 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d491390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d48e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d48ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557d0d494780 con 0x557d0d4869d0 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557d0d3a7f20 con 0x557d0d491bb0 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d0d494900 con 0x557d0d4872f0 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 10 client.0 _ll_register_callbacks cb 0x557d0d371030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d491390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d491390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52714/0 (socket says 172.21.15.100:52714) 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1033306333 learned_addr learned my addr 172.21.15.100:0/1033306333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d48e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1033306333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 msgr2=0x557d0d48e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d48e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1033306333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 msgr2=0x557d0d48ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d48ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1033306333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0d15e2b0 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d48e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d491390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc9e002a990 tx=0x7fc9e0003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3bd17d5b8127bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1033306333 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0048030 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1033306333 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc9e0040040 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e002f940 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1033306333 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9e0034050 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 10 client.15348 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.861+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557d0d49ffe0 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1033306333 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9e002f940 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1033306333 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc9e004e560 con 0x557d0d4869d0 2024-09-12T02:39:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9edc07740 10 client.15348 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9edc07740 10 client.15348 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9edc07740 20 client.15348 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d4a21b0 0x557d0d4a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9edc07740 4 client.15348 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d0d3fa600 con 0x557d0d4a21b0 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d4a21b0 0x557d0d4a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d4a21b0 0x557d0d4a3620 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2689c3d3a33b889 server_cookie=9644524d65dfd895 in_seq=0 out_seq=0 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.862+0000 7fc9ccff9640 10 client.15348 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1033306333 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d0d3fa600 con 0x557d0d4a21b0 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9ccff9640 10 client.15348 handle_command_reply: tid=0 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 client.15348 shutdown 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 msgr2=0x557d0d491390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d491390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc9e002a990 tx=0x7fc9e0003bd0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 shutdown_connections 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d4a21b0 0x557d0d4a3620 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d48ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d48e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9ccff9640 0 client.15348 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1033306333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d491390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 >> 172.21.15.100:0/1033306333 conn(0x557d0d482f60 msgr2=0x557d0d488c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 shutdown_connections 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.863+0000 7fc9edc07740 1 -- 172.21.15.100:0/1033306333 wait complete. 2024-09-12T02:39:00.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.864+0000 7fc9edc07740 20 client.15348 trim_cache size 0 max 16384 2024-09-12T02:39:00.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.881+0000 7fc9edc07740 1 Processor -- start 2024-09-12T02:39:00.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.881+0000 7fc9edc07740 1 -- start start 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d4a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d4872f0 0x557d0d47dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d491bb0 0x557d0d48b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9edc07740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557d0d4a1960 con 0x557d0d491bb0 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9edc07740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557d0d4a2030 con 0x557d0d4872f0 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9edc07740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d0d4a2700 con 0x557d0d4869d0 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d491bb0 0x557d0d48b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d491bb0 0x557d0d48b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52722/0 (socket says 172.21.15.100:52722) 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 -- 172.21.15.100:0/4239492789 learned_addr learned my addr 172.21.15.100:0/4239492789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d4872f0 0x557d0d47dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d4a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 -- 172.21.15.100:0/4239492789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 msgr2=0x557d0d4a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d4a3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 -- 172.21.15.100:0/4239492789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d4872f0 msgr2=0x557d0d47dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d4872f0 0x557d0d47dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 -- 172.21.15.100:0/4239492789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0d482d90 con 0x557d0d491bb0 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d491bb0 0x557d0d48b940 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc003e90 tx=0x7fc9dc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d994ee359af5ed49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9ceffd640 1 -- 172.21.15.100:0/4239492789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc022680 con 0x557d0d491bb0 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9ceffd640 1 -- 172.21.15.100:0/4239492789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9dc027070 con 0x557d0d491bb0 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.882+0000 7fc9ceffd640 1 -- 172.21.15.100:0/4239492789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc013750 con 0x557d0d491bb0 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 -- 172.21.15.100:0/4239492789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d491bb0 msgr2=0x557d0d48b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d491bb0 0x557d0d48b940 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc003e90 tx=0x7fc9dc005f90 comp rx=0 tx=0).stop 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 -- 172.21.15.100:0/4239492789 shutdown_connections 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d491bb0 0x557d0d48b940 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d4872f0 0x557d0d47dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 --2- 172.21.15.100:0/4239492789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4869d0 0x557d0d4a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 -- 172.21.15.100:0/4239492789 >> 172.21.15.100:0/4239492789 conn(0x557d0d482f60 msgr2=0x557d0d489d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 -- 172.21.15.100:0/4239492789 shutdown_connections 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 -- 172.21.15.100:0/4239492789 wait complete. 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.883+0000 7fc9edc07740 1 -- start start 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 1 Processor -- start 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d4abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d4a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d4a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557d0d4a34a0 con 0x557d0d4869d0 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557d0d4a2dd0 con 0x557d0d491bb0 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d0d4a3b70 con 0x557d0d4872f0 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9edc07740 10 client.0 _ll_register_callbacks cb 0x7fc9e0046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d4abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d4abd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52726/0 (socket says 172.21.15.100:52726) 2024-09-12T02:39:00.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1473560042 learned_addr learned my addr 172.21.15.100:0/1473560042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e9dcb640 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d4a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d4a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1473560042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 msgr2=0x557d0d4a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d4a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 msgr2=0x557d0d4a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d4a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.884+0000 7fc9e95ca640 1 -- 172.21.15.100:0/1473560042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0d4a5b60 con 0x557d0d4869d0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9e95ca640 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d4abd60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009a60 tx=0x7fc9e0003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b3c6ef66c77859 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1473560042 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e005e060 con 0x557d0d4869d0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1473560042 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc9e004e670 con 0x557d0d4869d0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9dc027070 con 0x557d0d4869d0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1473560042 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9e0048070 con 0x557d0d4869d0 2024-09-12T02:39:00.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 10 client.15354 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557d0d4aa5d0 con 0x557d0d4869d0 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1473560042 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9dc027070 con 0x557d0d4869d0 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1473560042 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc9e0059470 con 0x557d0d4869d0 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 10 client.15354 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 10 client.15354 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 20 client.15354 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d511190 0x557d0d50fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 4 client.15354 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.885+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "status"}) -- 0x557d0d3f4b10 con 0x557d0d511190 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d511190 0x557d0d50fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9e8dc9640 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d511190 0x557d0d50fe70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18c6a6a350b230d4 server_cookie=b0aa10f997db5706 in_seq=0 out_seq=0 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9ccff9640 10 client.15354 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:00.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9ccff9640 1 -- 172.21.15.100:0/1473560042 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557d0d3f4b10 con 0x557d0d511190 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9ccff9640 10 client.15354 handle_command_reply: tid=0 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 client.15354 shutdown 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 msgr2=0x557d0d4abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d4abd60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009a60 tx=0x7fc9e0003cb0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 shutdown_connections 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557d0d511190 0x557d0d50fe70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d0d491bb0 0x557d0d4a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d0d4872f0 0x557d0d4a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9ccff9640 0 client.15354 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 --2- 172.21.15.100:0/1473560042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557d0d4869d0 0x557d0d4abd60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 >> 172.21.15.100:0/1473560042 conn(0x557d0d482f60 msgr2=0x557d0d489cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 shutdown_connections 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.886+0000 7fc9edc07740 1 -- 172.21.15.100:0/1473560042 wait complete. 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9edc07740 20 client.15354 trim_cache size 0 max 16384 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a7cd2c8a-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24473, 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:39:00.897 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:39:00.898 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 131.01693555899999, 2024-09-12T02:39:00.898 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 26, 2024-09-12T02:39:00.898 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 84, 2024-09-12T02:39:00.898 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 84, 2024-09-12T02:39:00.898 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 141.38285445099999 2024-09-12T02:39:00.898 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc9d00a2c10 msgr2=0x7fc9d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc9d00a2c10 0x7fc9d00a50d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc004120 tx=0x7fc9dc004730 comp rx=0 tx=0).stop 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4103660 msgr2=0x7fc9e4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4103660 0x7fc9e4100ee0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c970 tx=0x7fc9d400ce30 comp rx=0 tx=0).stop 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 shutdown_connections 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc9d00a2c10 0x7fc9d00a50d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e410c170 0x7fc9e4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e4103660 0x7fc9e4100ee0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 --2- 172.21.15.100:0/2844652707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e4102d40 0x7fc9e41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 >> 172.21.15.100:0/2844652707 conn(0x7fc9e40fc7a0 msgr2=0x7fc9e40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 shutdown_connections 2024-09-12T02:39:00.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:00.887+0000 7fc9eb82e640 1 -- 172.21.15.100:0/2844652707 wait complete. 2024-09-12T02:39:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:00 smithi189 ceph-mon[35196]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-12T02:39:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:00 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:39:01.615 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T02:39:02.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:02 smithi117 ceph-mon[34898]: pgmap v347: 97 pgs: 97 active+clean; 8.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 688 KiB/s wr, 27 op/s 2024-09-12T02:39:02.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:02 smithi100 ceph-mon[31390]: pgmap v347: 97 pgs: 97 active+clean; 8.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 688 KiB/s wr, 27 op/s 2024-09-12T02:39:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:02 smithi189 ceph-mon[35196]: pgmap v347: 97 pgs: 97 active+clean; 8.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 688 KiB/s wr, 27 op/s 2024-09-12T02:39:04.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:04 smithi117 ceph-mon[34898]: pgmap v348: 97 pgs: 97 active+clean; 10 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 853 KiB/s wr, 33 op/s 2024-09-12T02:39:04.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:04 smithi100 ceph-mon[31390]: pgmap v348: 97 pgs: 97 active+clean; 10 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 853 KiB/s wr, 33 op/s 2024-09-12T02:39:05.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:04 smithi189 ceph-mon[35196]: pgmap v348: 97 pgs: 97 active+clean; 10 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 853 KiB/s wr, 33 op/s 2024-09-12T02:39:05.161 INFO:teuthology.orchestra.run.smithi100.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-12T02:39:05.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/: 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 .. 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 data 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data: 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:total 35 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 . 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 .. 2024-09-12T02:39:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 base 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 12 02:38 global 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 log 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_commit_ts 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_dynshmem 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 12 02:38 pg_hba.conf 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 12 02:38 pg_ident.conf 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:39 pg_logical 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 pg_multixact 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_notify 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_replslot 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_serial 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_snapshots 2024-09-12T02:39:05.208 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_stat 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_stat_tmp 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 pg_subtrans 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_tblspc 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_twophase 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 PG_VERSION 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 pg_wal 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 pg_xact 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 12 02:38 postgresql.auto.conf 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 12 02:38 postgresql.conf 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base: 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 . 2024-09-12T02:39:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 1 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 13493 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:39 13494 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:total 7777 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 . 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 .. 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 112 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 113 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 1247 2024-09-12T02:39:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1247_fsm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1247_vm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:38 1249 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1249_fsm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1249_vm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:38 1255 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1255_fsm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1255_vm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:38 1259 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1259_fsm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1259_vm 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:38 13344 2024-09-12T02:39:05.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13344_fsm 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13344_vm 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13346 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13348 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13349_fsm 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349_vm 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13351 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13353 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354 2024-09-12T02:39:05.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13354_fsm 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354_vm 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13356 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13358 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13359_fsm 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359_vm 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13361 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13363 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1417 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1418 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 174 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 175 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2187 2024-09-12T02:39:05.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2224 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2328 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2336 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2337 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2579 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2600 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2600_fsm 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2600_vm 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2601_fsm 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601_vm 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2602 2024-09-12T02:39:05.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2602_fsm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2602_vm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2603 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2603_fsm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2603_vm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2604 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2605 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2605_fsm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2605_vm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2606_fsm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606_vm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2607 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2607_fsm 2024-09-12T02:39:05.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2607_vm 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:38 2608 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2608_fsm 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2608_vm 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:38 2609 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2609_fsm 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2609_vm 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2610 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2610_fsm 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2610_vm 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2611 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612 2024-09-12T02:39:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2612_fsm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612_vm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2613 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2615_fsm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615_vm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2616 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2616_fsm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2616_vm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:38 2617 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2617_fsm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2617_vm 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:38 2618 2024-09-12T02:39:05.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2618_fsm 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2618_vm 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:38 2619 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2619_fsm 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2619_vm 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2620 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2650 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2651 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2652 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2653 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2654 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2655 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2656 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2657 2024-09-12T02:39:05.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:38 2658 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 2659 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2660 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2661 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2662 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2663 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2664 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2665 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2666 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2667 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2668 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2669 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2670 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:38 2673 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:38 2674 2024-09-12T02:39:05.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:38 2675 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2678 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2679 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2680 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2681 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2682 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2683 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2684 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2685 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2686 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2687 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2688 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2689 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:38 2690 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:38 2691 2024-09-12T02:39:05.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2692 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2693 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2696 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2699 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2701 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2702 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2703 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2704 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2753 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2753_fsm 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2753_vm 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2754 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2755 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2756 2024-09-12T02:39:05.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2757 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2830 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2831 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2832 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2833 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2834 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2835 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2836 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2837 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:38 2838 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2838_fsm 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2838_vm 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2839 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840_fsm 2024-09-12T02:39:05.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2840_vm 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2841 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2995 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2996 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3079_fsm 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079_vm 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3080 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3081 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3085 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3118 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3119 2024-09-12T02:39:05.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:38 3164 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3256 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3257 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3258 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3350 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3351 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3379 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3380 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3381 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3394 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3394_fsm 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3394_vm 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3395 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3429 2024-09-12T02:39:05.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3430 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3431 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3433 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3439 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3440 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3455 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:38 3456 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3456_fsm 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3456_vm 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3466 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3467 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3468 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3501 2024-09-12T02:39:05.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3502 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3503 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3534 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3541_fsm 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541_vm 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3542 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3574 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3575 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3576 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3596 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3597 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3598 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3599 2024-09-12T02:39:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3600_fsm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600_vm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3601_fsm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601_vm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3602_fsm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602_vm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603_fsm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3603_vm 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3604 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3605 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3606 2024-09-12T02:39:05.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3607 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3608 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 3609 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3712 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3764_fsm 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764_vm 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3766 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3767 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3997 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4143 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4144 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4145 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4146 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4147 2024-09-12T02:39:05.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4148 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4149 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4150 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4151 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4152 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4153 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4154 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4155 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4156 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4157 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4158 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4159 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4160 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4161 2024-09-12T02:39:05.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4162 2024-09-12T02:39:05.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4163 2024-09-12T02:39:05.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4164 2024-09-12T02:39:05.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4165 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4166 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4167 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4168 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4169 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4170 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4171 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4172 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4173 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4174 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 5002 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 548 2024-09-12T02:39:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 549 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6102 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6104 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6106 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6110 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6111 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6112 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6113 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6117 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 826 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 827 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 828 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:38 pg_filenode.map 2024-09-12T02:39:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 PG_VERSION 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:total 7777 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 . 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 .. 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 112 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 113 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 1247 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1247_fsm 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1247_vm 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:38 1249 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1249_fsm 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1249_vm 2024-09-12T02:39:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:38 1255 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1255_fsm 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1255_vm 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:38 1259 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1259_fsm 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1259_vm 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:38 13344 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13344_fsm 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13344_vm 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13346 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13348 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13349_fsm 2024-09-12T02:39:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349_vm 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13351 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13353 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13354_fsm 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354_vm 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13356 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13358 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13359_fsm 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359_vm 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13361 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13363 2024-09-12T02:39:05.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1417 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1418 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 174 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 175 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2187 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2224 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2328 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2336 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2337 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2579 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2600 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2600_fsm 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2600_vm 2024-09-12T02:39:05.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2601_fsm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601_vm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2602 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2602_fsm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2602_vm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2603 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2603_fsm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2603_vm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2604 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2605 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2605_fsm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2605_vm 2024-09-12T02:39:05.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2606_fsm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606_vm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2607 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2607_fsm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2607_vm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:38 2608 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2608_fsm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2608_vm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:38 2609 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2609_fsm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2609_vm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2610 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2610_fsm 2024-09-12T02:39:05.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2610_vm 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2611 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2612_fsm 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612_vm 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2613 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2615_fsm 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615_vm 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2616 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2616_fsm 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2616_vm 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:38 2617 2024-09-12T02:39:05.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2617_fsm 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2617_vm 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:38 2618 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2618_fsm 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2618_vm 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:38 2619 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2619_fsm 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2619_vm 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2620 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2650 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2651 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2652 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2653 2024-09-12T02:39:05.242 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2654 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2655 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2656 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2657 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:38 2658 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 2659 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2660 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2661 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2662 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2663 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2664 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2665 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2666 2024-09-12T02:39:05.243 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2667 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2668 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2669 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2670 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:38 2673 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:38 2674 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:38 2675 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2678 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2679 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2680 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2681 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2682 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2683 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2684 2024-09-12T02:39:05.244 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2685 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2686 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2687 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2688 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2689 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:38 2690 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:38 2691 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2692 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2693 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2696 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2699 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2701 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2702 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2703 2024-09-12T02:39:05.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2704 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2753 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2753_fsm 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2753_vm 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2754 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2755 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2756 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2757 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2830 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2831 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2832 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2833 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2834 2024-09-12T02:39:05.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2835 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2836 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2837 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:38 2838 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2838_fsm 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2838_vm 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2839 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840_fsm 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2840_vm 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2841 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2995 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2996 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079 2024-09-12T02:39:05.247 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3079_fsm 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079_vm 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3080 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3081 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3085 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3118 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3119 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:38 3164 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3256 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3257 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3258 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3350 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3351 2024-09-12T02:39:05.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3379 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3380 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3381 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3394 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3394_fsm 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3394_vm 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3395 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3429 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3430 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3431 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3433 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3439 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3440 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3455 2024-09-12T02:39:05.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:38 3456 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3456_fsm 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3456_vm 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3466 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3467 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3468 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3501 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3502 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3503 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3534 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3541_fsm 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541_vm 2024-09-12T02:39:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3542 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3574 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3575 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3576 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3596 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3597 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3598 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3599 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3600_fsm 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600_vm 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3601_fsm 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601_vm 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602 2024-09-12T02:39:05.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3602_fsm 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602_vm 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603_fsm 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3603_vm 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3604 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3605 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3606 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3607 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3608 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 3609 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3712 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3764_fsm 2024-09-12T02:39:05.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764_vm 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3766 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3767 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3997 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4143 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4144 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4145 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4146 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4147 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4148 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4149 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4150 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4151 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4152 2024-09-12T02:39:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4153 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4154 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4155 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4156 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4157 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4158 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4159 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4160 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4161 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4162 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4163 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4164 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4165 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4166 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4167 2024-09-12T02:39:05.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4168 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4169 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4170 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4171 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4172 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4173 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4174 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 5002 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 548 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 549 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6102 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6104 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6106 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6110 2024-09-12T02:39:05.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6111 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6112 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6113 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6117 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 826 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 827 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 828 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:38 pg_filenode.map 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 PG_VERSION 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:total 7777 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:39 . 2024-09-12T02:39:05.256 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 .. 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 112 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 113 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:39 1247 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1247_fsm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1247_vm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:39 1249 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1249_fsm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1249_vm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:38 1255 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 1255_fsm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1255_vm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:39 1259 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 1259_fsm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1259_vm 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:38 13344 2024-09-12T02:39:05.257 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13344_fsm 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13344_vm 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13346 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13348 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13349_fsm 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13349_vm 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 13351 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13353 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13354 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13354_fsm 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13354_vm 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13356 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13358 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359 2024-09-12T02:39:05.258 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 13359_fsm 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359_vm 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 13361 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13363 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1417 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 1418 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 174 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 175 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2187 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2224 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2328 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2336 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2337 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2579 2024-09-12T02:39:05.259 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2600 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2600_fsm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2600_vm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2601_fsm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601_vm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2602 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2602_fsm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2602_vm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2603 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2603_fsm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2603_vm 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2604 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2605 2024-09-12T02:39:05.260 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2605_fsm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2605_vm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2606 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2606_fsm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2606_vm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2607 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2607_fsm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2607_vm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:39 2608 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2608_fsm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2608_vm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:38 2609 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2609_fsm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2609_vm 2024-09-12T02:39:05.261 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2610 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2610_fsm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2610_vm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2611 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2612_fsm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612_vm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2613 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2615_fsm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615_vm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2616 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2616_fsm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2616_vm 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:38 2617 2024-09-12T02:39:05.262 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2617_fsm 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2617_vm 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:38 2618 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2618_fsm 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2618_vm 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:38 2619 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2619_fsm 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2619_vm 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2620 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2650 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2651 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2652 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 2653 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 2654 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2655 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2656 2024-09-12T02:39:05.263 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2657 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:38 2658 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:39 2659 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2660 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2661 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2662 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:39 2663 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2664 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2665 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2666 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2667 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2668 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2669 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2670 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:39 2673 2024-09-12T02:39:05.264 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:39 2674 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:38 2675 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2678 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2679 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2680 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2681 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2682 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2683 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2684 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2685 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2686 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2687 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2688 2024-09-12T02:39:05.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2689 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:39 2690 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:39 2691 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2692 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2693 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2696 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2699 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2701 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2702 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2703 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 2704 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2753 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2753_fsm 2024-09-12T02:39:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2753_vm 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2754 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2755 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2756 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2757 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2830 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2831 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2832 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2833 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2834 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2835 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2836 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2837 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:39 2838 2024-09-12T02:39:05.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2838_fsm 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2838_vm 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2839 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2840 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2840_fsm 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2840_vm 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2841 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2995 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2996 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3079 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3079_fsm 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3079_vm 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3080 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3081 2024-09-12T02:39:05.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 3085 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3118 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3119 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:39 3164 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3256 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3257 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3258 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3350 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3351 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3379 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3380 2024-09-12T02:39:05.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3381 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3394 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3394_fsm 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3394_vm 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3395 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3429 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3430 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3431 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3433 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3439 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3440 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 3455 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:38 3456 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3456_fsm 2024-09-12T02:39:05.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3456_vm 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3466 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3467 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3468 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3501 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3502 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3503 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3534 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3541_fsm 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3541_vm 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3542 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3574 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3575 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3576 2024-09-12T02:39:05.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3596 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3597 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3598 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3599 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3600_fsm 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600_vm 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3601_fsm 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3601_vm 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3602_fsm 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3602_vm 2024-09-12T02:39:05.272 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3603 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3603_fsm 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3603_vm 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3604 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3605 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3606 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3607 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3608 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 3609 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3712 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3764 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3764_fsm 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3764_vm 2024-09-12T02:39:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3766 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3767 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3997 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4143 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4144 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4145 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4146 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4147 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4148 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4149 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4150 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4151 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4152 2024-09-12T02:39:05.274 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4153 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4154 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4155 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4156 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4157 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4158 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4159 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4160 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4161 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4162 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4163 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4164 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4165 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4166 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4167 2024-09-12T02:39:05.275 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4168 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4169 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4170 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4171 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4172 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4173 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4174 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 5002 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 548 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 549 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6102 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6104 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 6106 2024-09-12T02:39:05.276 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 6110 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 6111 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 6112 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6113 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6117 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 826 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 827 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 828 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:39 pg_filenode.map 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:39 PG_VERSION 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/global: 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:total 537 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 12 02:38 . 2024-09-12T02:39:05.277 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1213 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1213_fsm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1213_vm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1214 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1214_fsm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1214_vm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 1232 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 1233 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1260 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1260_fsm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1260_vm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1261 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1261_fsm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1261_vm 2024-09-12T02:39:05.278 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 1262 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1262_fsm 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1262_vm 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2396 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2396_fsm 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2396_vm 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2397 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2671 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2672 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2676 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2677 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2694 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2695 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2697 2024-09-12T02:39:05.279 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2698 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2846 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2847 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2964 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2965 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2966 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2967 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3592 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3593 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4060 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4061 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4175 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4176 2024-09-12T02:39:05.280 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4177 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4178 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4181 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4182 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4183 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4184 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4185 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4186 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6000 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6001 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6002 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6100 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6114 2024-09-12T02:39:05.281 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6115 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 pg_control 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:38 pg_filenode.map 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/log: 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 . 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.282 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:total 1 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:39 . 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 mappings 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 12 02:39 replorigin_checkpoint 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 snapshots 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.283 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:39 .. 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:39 .. 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 . 2024-09-12T02:39:05.284 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 members 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 offsets 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:total 8 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 .. 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 0000 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:total 8 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:39:05.285 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 .. 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 0000 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.286 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.287 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:total 8 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 0000 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:total 16384 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 . 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:39 000000010000000000000001 2024-09-12T02:39:05.289 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 archive_status 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 .. 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:total 8 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:39 .. 2024-09-12T02:39:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 0000 2024-09-12T02:39:05.291 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-12T02:39:05.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-12T02:39:05.460 INFO:teuthology.orchestra.run.smithi100.stderr:dropping old tables... 2024-09-12T02:39:05.460 INFO:teuthology.orchestra.run.smithi100.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-12T02:39:05.461 INFO:teuthology.orchestra.run.smithi100.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-12T02:39:05.461 INFO:teuthology.orchestra.run.smithi100.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-12T02:39:05.461 INFO:teuthology.orchestra.run.smithi100.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-12T02:39:05.461 INFO:teuthology.orchestra.run.smithi100.stderr:creating tables... 2024-09-12T02:39:05.470 INFO:teuthology.orchestra.run.smithi100.stderr:generating data (client-side)... 2024-09-12T02:39:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.80 s) 2024-09-12T02:39:05.701 INFO:teuthology.orchestra.run.smithi100.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.21 s, remaining 3.21 s) 2024-09-12T02:39:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.30 s, remaining 2.95 s) 2024-09-12T02:39:05.916 INFO:teuthology.orchestra.run.smithi100.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.43 s, remaining 3.00 s) 2024-09-12T02:39:06.045 INFO:teuthology.orchestra.run.smithi100.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.56 s, remaining 3.02 s) 2024-09-12T02:39:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.64 s, remaining 2.78 s) 2024-09-12T02:39:06.276 INFO:teuthology.orchestra.run.smithi100.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.79 s, remaining 2.82 s) 2024-09-12T02:39:06.450 INFO:teuthology.orchestra.run.smithi100.stderr:800000 of 3200000 tuples (25%) done (elapsed 0.96 s, remaining 2.89 s) 2024-09-12T02:39:06.550 INFO:teuthology.orchestra.run.smithi100.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.06 s, remaining 2.72 s) 2024-09-12T02:39:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.20 s, remaining 2.65 s) 2024-09-12T02:39:06.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:06 smithi117 ceph-mon[34898]: pgmap v349: 97 pgs: 97 active+clean; 31 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 2.5 MiB/s wr, 49 op/s 2024-09-12T02:39:06.853 INFO:teuthology.orchestra.run.smithi100.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.37 s, remaining 2.61 s) 2024-09-12T02:39:06.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:06 smithi100 ceph-mon[31390]: pgmap v349: 97 pgs: 97 active+clean; 31 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 2.5 MiB/s wr, 49 op/s 2024-09-12T02:39:06.943 INFO:teuthology.orchestra.run.smithi100.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.46 s, remaining 2.43 s) 2024-09-12T02:39:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:06 smithi189 ceph-mon[35196]: pgmap v349: 97 pgs: 97 active+clean; 31 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 2.5 MiB/s wr, 49 op/s 2024-09-12T02:39:07.071 INFO:teuthology.orchestra.run.smithi100.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.58 s, remaining 2.32 s) 2024-09-12T02:39:07.231 INFO:teuthology.orchestra.run.smithi100.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.74 s, remaining 2.24 s) 2024-09-12T02:39:07.315 INFO:teuthology.orchestra.run.smithi100.stderr:1500000 of 3200000 tuples (46%) done (elapsed 1.83 s, remaining 2.07 s) 2024-09-12T02:39:07.447 INFO:teuthology.orchestra.run.smithi100.stderr:1600000 of 3200000 tuples (50%) done (elapsed 1.96 s, remaining 1.96 s) 2024-09-12T02:39:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.05 s, remaining 1.81 s) 2024-09-12T02:39:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.20 s, remaining 1.71 s) 2024-09-12T02:39:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.37 s, remaining 1.62 s) 2024-09-12T02:39:08.013 INFO:teuthology.orchestra.run.smithi100.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.53 s, remaining 1.52 s) 2024-09-12T02:39:08.090 INFO:teuthology.orchestra.run.smithi100.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.60 s, remaining 1.36 s) 2024-09-12T02:39:08.228 INFO:teuthology.orchestra.run.smithi100.stderr:2200000 of 3200000 tuples (68%) done (elapsed 2.74 s, remaining 1.25 s) 2024-09-12T02:39:08.308 INFO:teuthology.orchestra.run.smithi100.stderr:2300000 of 3200000 tuples (71%) done (elapsed 2.82 s, remaining 1.10 s) 2024-09-12T02:39:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2400000 of 3200000 tuples (75%) done (elapsed 2.95 s, remaining 0.98 s) 2024-09-12T02:39:08.596 INFO:teuthology.orchestra.run.smithi100.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.11 s, remaining 0.87 s) 2024-09-12T02:39:08.694 INFO:teuthology.orchestra.run.smithi100.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.21 s, remaining 0.74 s) 2024-09-12T02:39:08.813 INFO:teuthology.orchestra.run.smithi100.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.33 s, remaining 0.62 s) 2024-09-12T02:39:08.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:08 smithi117 ceph-mon[34898]: pgmap v350: 97 pgs: 97 active+clean; 62 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 7.2 MiB/s wr, 101 op/s 2024-09-12T02:39:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:08 smithi100 ceph-mon[31390]: pgmap v350: 97 pgs: 97 active+clean; 62 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 7.2 MiB/s wr, 101 op/s 2024-09-12T02:39:08.911 INFO:teuthology.orchestra.run.smithi100.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.42 s, remaining 0.49 s) 2024-09-12T02:39:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:08 smithi189 ceph-mon[35196]: pgmap v350: 97 pgs: 97 active+clean; 62 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 7.2 MiB/s wr, 101 op/s 2024-09-12T02:39:09.035 INFO:teuthology.orchestra.run.smithi100.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.55 s, remaining 0.37 s) 2024-09-12T02:39:09.188 INFO:teuthology.orchestra.run.smithi100.stderr:3000000 of 3200000 tuples (93%) done (elapsed 3.70 s, remaining 0.25 s) 2024-09-12T02:39:09.352 INFO:teuthology.orchestra.run.smithi100.stderr:3100000 of 3200000 tuples (96%) done (elapsed 3.87 s, remaining 0.12 s) 2024-09-12T02:39:09.425 INFO:teuthology.orchestra.run.smithi100.stderr:3200000 of 3200000 tuples (100%) done (elapsed 3.94 s, remaining 0.00 s) 2024-09-12T02:39:09.462 INFO:teuthology.orchestra.run.smithi100.stderr:vacuuming... 2024-09-12T02:39:10.041 INFO:teuthology.orchestra.run.smithi100.stderr:creating primary keys... 2024-09-12T02:39:10.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:10 smithi117 ceph-mon[34898]: pgmap v351: 97 pgs: 97 active+clean; 179 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 27 MiB/s wr, 126 op/s 2024-09-12T02:39:10.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:10 smithi100 ceph-mon[31390]: pgmap v351: 97 pgs: 97 active+clean; 179 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 27 MiB/s wr, 126 op/s 2024-09-12T02:39:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:10 smithi189 ceph-mon[35196]: pgmap v351: 97 pgs: 97 active+clean; 179 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 27 MiB/s wr, 126 op/s 2024-09-12T02:39:11.213 INFO:teuthology.orchestra.run.smithi100.stderr:done in 5.75 s (drop tables 0.00 s, create tables 0.01 s, client-side generate 3.99 s, vacuum 0.58 s, primary keys 1.17 s). 2024-09-12T02:39:11.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-12T02:39:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:starting vacuum...end. 2024-09-12T02:39:12.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:12 smithi117 ceph-mon[34898]: pgmap v352: 97 pgs: 97 active+clean; 317 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 49 MiB/s wr, 140 op/s 2024-09-12T02:39:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:12 smithi100 ceph-mon[31390]: pgmap v352: 97 pgs: 97 active+clean; 317 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 49 MiB/s wr, 140 op/s 2024-09-12T02:39:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:12 smithi189 ceph-mon[35196]: pgmap v352: 97 pgs: 97 active+clean; 317 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 49 MiB/s wr, 140 op/s 2024-09-12T02:39:14.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:14 smithi117 ceph-mon[34898]: pgmap v353: 97 pgs: 97 active+clean; 369 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 57 MiB/s wr, 121 op/s 2024-09-12T02:39:14.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:14 smithi100 ceph-mon[31390]: pgmap v353: 97 pgs: 97 active+clean; 369 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 57 MiB/s wr, 121 op/s 2024-09-12T02:39:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:14 smithi189 ceph-mon[35196]: pgmap v353: 97 pgs: 97 active+clean; 369 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 57 MiB/s wr, 121 op/s 2024-09-12T02:39:16.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:39:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 5.0 s, 3791.4 tps, lat 25.904 ms stddev 25.387 2024-09-12T02:39:16.472 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:16.615 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T02:39:16.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:39:16.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:16 smithi117 ceph-mon[34898]: pgmap v354: 97 pgs: 97 active+clean; 482 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 70 MiB/s wr, 129 op/s 2024-09-12T02:39:16.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:16 smithi100 ceph-mon[31390]: pgmap v354: 97 pgs: 97 active+clean; 482 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 70 MiB/s wr, 129 op/s 2024-09-12T02:39:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:16 smithi189 ceph-mon[35196]: pgmap v354: 97 pgs: 97 active+clean; 482 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 70 MiB/s wr, 129 op/s 2024-09-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.041+0000 7f765d457640 1 -- 172.21.15.100:0/1589123980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7658114ab0 msgr2=0x7f7658116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.041+0000 7f765d457640 1 --2- 172.21.15.100:0/1589123980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7658114ab0 0x7f7658116ea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7648009900 tx=0x7f764802a4b0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.041+0000 7f765d457640 1 -- 172.21.15.100:0/1589123980 shutdown_connections 2024-09-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.041+0000 7f765d457640 1 --2- 172.21.15.100:0/1589123980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7658114ab0 0x7f7658116ea0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.041+0000 7f765d457640 1 --2- 172.21.15.100:0/1589123980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7658109b10 0x7f7658114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.041+0000 7f765d457640 1 --2- 172.21.15.100:0/1589123980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76581091f0 0x7f76581095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.041+0000 7f765d457640 1 -- 172.21.15.100:0/1589123980 >> 172.21.15.100:0/1589123980 conn(0x7f765806e140 msgr2=0x7f765806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.042+0000 7f765d457640 1 -- 172.21.15.100:0/1589123980 shutdown_connections 2024-09-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.042+0000 7f765d457640 1 -- 172.21.15.100:0/1589123980 wait complete. 2024-09-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.043+0000 7f765d457640 1 Processor -- start 2024-09-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.044+0000 7f765d457640 1 -- start start 2024-09-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.044+0000 7f765d457640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76581091f0 0x7f765811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.044+0000 7f765d457640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7658109b10 0x7f765811efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.044+0000 7f765d457640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7658114ab0 0x7f7658119b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.044+0000 7f765d457640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76581185c0 con 0x7f7658114ab0 2024-09-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.044+0000 7f765d457640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7658118440 con 0x7f76581091f0 2024-09-12T02:39:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.044+0000 7f765d457640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7658118740 con 0x7f7658109b10 2024-09-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.045+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76581091f0 0x7f765811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.045+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76581091f0 0x7f765811ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36362/0 (socket says 172.21.15.100:36362) 2024-09-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.045+0000 7f7656ffd640 1 -- 172.21.15.100:0/2898941428 learned_addr learned my addr 172.21.15.100:0/2898941428 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.046+0000 7f76567fc640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7658109b10 0x7f765811efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.046+0000 7f7656ffd640 1 -- 172.21.15.100:0/2898941428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7658109b10 msgr2=0x7f765811efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.046+0000 7f7656ffd640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7658109b10 0x7f765811efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.046+0000 7f7656ffd640 1 -- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7658114ab0 msgr2=0x7f7658119b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.046+0000 7f7656ffd640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7658114ab0 0x7f7658119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.046+0000 7f7656ffd640 1 -- 172.21.15.100:0/2898941428 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765811a440 con 0x7f76581091f0 2024-09-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.048+0000 7f7656ffd640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76581091f0 0x7f765811ea60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f765000ebc0 tx=0x7f765000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.048+0000 7f763ffff640 1 -- 172.21.15.100:0/2898941428 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650010630 con 0x7f76581091f0 2024-09-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.048+0000 7f763ffff640 1 -- 172.21.15.100:0/2898941428 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7650010cb0 con 0x7f76581091f0 2024-09-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.049+0000 7f763ffff640 1 -- 172.21.15.100:0/2898941428 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650018bd0 con 0x7f76581091f0 2024-09-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.049+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765811a730 con 0x7f76581091f0 2024-09-12T02:39:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.049+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7658122940 con 0x7f76581091f0 2024-09-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 Processor -- start 2024-09-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 -- start start 2024-09-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9b1dc0 0x5594ff9bc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9bc680 0x5594ff9bea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5594ff9172e0 con 0x5594ff9b1dc0 2024-09-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5594ff8bece0 con 0x5594ff9bc680 2024-09-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f765f830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5594ff9132a0 con 0x5594ff9b14a0 2024-09-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f763ffff640 1 -- 172.21.15.100:0/2898941428 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f76500107d0 con 0x7f76581091f0 2024-09-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f76567fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9bc680 0x5594ff9bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f76567fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9bc680 0x5594ff9bea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36370/0 (socket says 172.21.15.100:36370) 2024-09-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f76567fc640 1 -- 172.21.15.100:0/3816317554 learned_addr learned my addr 172.21.15.100:0/3816317554 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.053+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9b1dc0 0x5594ff9bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f76577fe640 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f76567fc640 1 -- 172.21.15.100:0/3816317554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 msgr2=0x5594ff9b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f76567fc640 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f76567fc640 1 -- 172.21.15.100:0/3816317554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9b1dc0 msgr2=0x5594ff9bc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f76567fc640 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9b1dc0 0x5594ff9bc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f76567fc640 1 -- 172.21.15.100:0/3816317554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594ff8a3440 con 0x5594ff9bc680 2024-09-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f76567fc640 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9bc680 0x5594ff9bea70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f764c009c20 tx=0x7f764c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fec7334b94ed550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f763d7fa640 1 -- 172.21.15.100:0/3816317554 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c004050 con 0x5594ff9bc680 2024-09-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f763d7fa640 1 -- 172.21.15.100:0/3816317554 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c005500 con 0x5594ff9bc680 2024-09-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f763d7fa640 1 -- 172.21.15.100:0/3816317554 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c004dd0 con 0x5594ff9bc680 2024-09-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.054+0000 7f763ffff640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76400a2d60 0x7f76400a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.055+0000 7f763ffff640 1 -- 172.21.15.100:0/2898941428 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f76500cf850 con 0x7f76581091f0 2024-09-12T02:39:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.055+0000 7f76577fe640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76400a2d60 0x7f76400a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.055+0000 7f765f830740 1 -- 172.21.15.100:0/3816317554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9bc680 msgr2=0x5594ff9bea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.055+0000 7f765f830740 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9bc680 0x5594ff9bea70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f764c009c20 tx=0x7f764c011810 comp rx=0 tx=0).stop 2024-09-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.056+0000 7f76577fe640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76400a2d60 0x7f76400a5220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76581172c0 tx=0x7f76480095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.057+0000 7f765f830740 1 -- 172.21.15.100:0/3816317554 shutdown_connections 2024-09-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.057+0000 7f765f830740 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9bc680 0x5594ff9bea70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.057+0000 7f765f830740 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9b1dc0 0x5594ff9bc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.057+0000 7f765f830740 1 --2- 172.21.15.100:0/3816317554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.057+0000 7f765f830740 1 -- 172.21.15.100:0/3816317554 >> 172.21.15.100:0/3816317554 conn(0x5594ff9ada30 msgr2=0x5594ff9ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.058+0000 7f765f830740 1 -- 172.21.15.100:0/3816317554 shutdown_connections 2024-09-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.058+0000 7f765f830740 1 -- 172.21.15.100:0/3816317554 wait complete. 2024-09-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.058+0000 7f765f830740 1 -- start start 2024-09-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 1 Processor -- start 2024-09-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9b1dc0 0x5594ff9b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5594ff9bf250 con 0x5594ff9bc680 2024-09-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5594ff8d2050 con 0x5594ff9b1dc0 2024-09-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5594ff9bf3d0 con 0x5594ff9b14a0 2024-09-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f765f830740 10 client.0 _ll_register_callbacks cb 0x5594ff912160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f76577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f76577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35714/0 (socket says 172.21.15.100:35714) 2024-09-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.059+0000 7f76577fe640 1 -- 172.21.15.100:0/203213386 learned_addr learned my addr 172.21.15.100:0/203213386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f76567fc640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9b1dc0 0x5594ff9b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f7656ffd640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f76567fc640 1 -- 172.21.15.100:0/203213386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 msgr2=0x5594ff9bbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f76567fc640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9bbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f76567fc640 1 -- 172.21.15.100:0/203213386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 msgr2=0x5594ff9b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f76567fc640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f76567fc640 1 -- 172.21.15.100:0/203213386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594ff6883c0 con 0x5594ff9b1dc0 2024-09-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.060+0000 7f7656ffd640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f76567fc640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9b1dc0 0x5594ff9b91a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5594ff9aedb0 tx=0x7f764c0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5721b5336f791b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f763aff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f763aff5640 1 -- 172.21.15.100:0/203213386 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c028020 con 0x5594ff9b1dc0 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f763aff5640 1 -- 172.21.15.100:0/203213386 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f764c003a90 con 0x5594ff9b1dc0 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764c005500 con 0x5594ff9b1dc0 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f763aff5640 1 -- 172.21.15.100:0/203213386 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f764c01e040 con 0x5594ff9b1dc0 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f765f830740 10 client.24893 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.061+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5594ff9cab70 con 0x5594ff9b1dc0 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f763aff5640 1 -- 172.21.15.100:0/203213386 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c005500 con 0x5594ff9b1dc0 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f763aff5640 1 -- 172.21.15.100:0/203213386 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f764c005190 con 0x5594ff9b1dc0 2024-09-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f765f830740 10 client.24893 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f765f830740 10 client.24893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f765f830740 20 client.24893 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f765f830740 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ff9cbf80 0x5594ff9ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f765f830740 4 client.24893 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594ff924850 con 0x5594ff9cbf80 2024-09-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.062+0000 7f7656ffd640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ff9cbf80 0x5594ff9ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.063+0000 7f763aff5640 10 client.24893 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.063+0000 7f7656ffd640 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ff9cbf80 0x5594ff9ce370 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be831cbea99edcd2 server_cookie=b32e1775e156ef18 in_seq=0 out_seq=0 2024-09-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.064+0000 7f763aff5640 1 -- 172.21.15.100:0/203213386 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594ff924850 con 0x5594ff9cbf80 2024-09-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.064+0000 7f763aff5640 10 client.24893 handle_command_reply: tid=0 2024-09-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.064+0000 7f765f830740 1 client.24893 shutdown 2024-09-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9b1dc0 msgr2=0x5594ff9b91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9b1dc0 0x5594ff9b91a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5594ff9aedb0 tx=0x7f764c0038a0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 shutdown_connections 2024-09-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ff9cbf80 0x5594ff9ce370 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9b1dc0 0x5594ff9b91a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 --2- 172.21.15.100:0/203213386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.065+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 >> 172.21.15.100:0/203213386 conn(0x5594ff9ada30 msgr2=0x5594ff9b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.066+0000 7f763aff5640 0 client.24893 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.066+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 shutdown_connections 2024-09-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.066+0000 7f765f830740 1 -- 172.21.15.100:0/203213386 wait complete. 2024-09-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.066+0000 7f765f830740 20 client.24893 trim_cache size 0 max 16384 2024-09-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 Processor -- start 2024-09-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 -- start start 2024-09-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9bb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76581c7650 con 0x5594ff9bc680 2024-09-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f76581c4f20 con 0x5594ff9c84e0 2024-09-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f765f830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76581c2d70 con 0x5594ff9b14a0 2024-09-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f76567fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f76577fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f76567fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9bb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35722/0 (socket says 172.21.15.100:35722) 2024-09-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f76567fc640 1 -- 172.21.15.100:0/1571153902 learned_addr learned my addr 172.21.15.100:0/1571153902 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.097+0000 7f76577fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36388/0 (socket says 172.21.15.100:36388) 2024-09-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f76577fe640 1 -- 172.21.15.100:0/1571153902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 msgr2=0x5594ff9b4900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f76577fe640 1 --2- 172.21.15.100:0/1571153902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9b4900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f76577fe640 1 -- 172.21.15.100:0/1571153902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 msgr2=0x5594ff9bb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f76577fe640 1 --2- 172.21.15.100:0/1571153902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9bb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f76577fe640 1 -- 172.21.15.100:0/1571153902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594ff9ad860 con 0x5594ff9c84e0 2024-09-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f76577fe640 1 --2- 172.21.15.100:0/1571153902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9d3ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7648009230 tx=0x7f764803e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cdefc2cb380adbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.098+0000 7f763cff9640 1 -- 172.21.15.100:0/1571153902 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648004930 con 0x5594ff9c84e0 2024-09-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.099+0000 7f763cff9640 1 -- 172.21.15.100:0/1571153902 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7648071070 con 0x5594ff9c84e0 2024-09-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.099+0000 7f763cff9640 1 -- 172.21.15.100:0/1571153902 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648003c70 con 0x5594ff9c84e0 2024-09-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 -- 172.21.15.100:0/1571153902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 msgr2=0x5594ff9d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 --2- 172.21.15.100:0/1571153902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9d3ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7648009230 tx=0x7f764803e000 comp rx=0 tx=0).stop 2024-09-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 -- 172.21.15.100:0/1571153902 shutdown_connections 2024-09-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 --2- 172.21.15.100:0/1571153902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9d3ae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 --2- 172.21.15.100:0/1571153902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9bb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 --2- 172.21.15.100:0/1571153902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 -- 172.21.15.100:0/1571153902 >> 172.21.15.100:0/1571153902 conn(0x5594ff9ada30 msgr2=0x5594ff9baa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 -- 172.21.15.100:0/1571153902 shutdown_connections 2024-09-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 -- 172.21.15.100:0/1571153902 wait complete. 2024-09-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 -- start start 2024-09-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.100+0000 7f765f830740 1 Processor -- start 2024-09-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f765f830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f765f830740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f765f830740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f765f830740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76581c33e0 con 0x5594ff9bc680 2024-09-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f765f830740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f76581c4850 con 0x5594ff9c84e0 2024-09-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f765f830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76581c3ab0 con 0x5594ff9b14a0 2024-09-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38526/0 (socket says 172.21.15.100:38526) 2024-09-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 -- 172.21.15.100:0/154356185 learned_addr learned my addr 172.21.15.100:0/154356185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f765f830740 10 client.0 _ll_register_callbacks cb 0x7f76500d53a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f76567fc640 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f76577fe640 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 -- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 msgr2=0x5594ff9c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 -- 172.21.15.100:0/154356185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 msgr2=0x5594ff9c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 -- 172.21.15.100:0/154356185 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594ffa35ab0 con 0x5594ff9b14a0 2024-09-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.101+0000 7f7656ffd640 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9c4ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76500988b0 tx=0x7f76500d1ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e735686229de11a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.102+0000 7f763aff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.102+0000 7f763aff5640 1 -- 172.21.15.100:0/154356185 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650010e60 con 0x5594ff9b14a0 2024-09-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.102+0000 7f763aff5640 1 -- 172.21.15.100:0/154356185 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7650098550 con 0x5594ff9b14a0 2024-09-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.102+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7648071070 con 0x5594ff9b14a0 2024-09-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.102+0000 7f763aff5640 1 -- 172.21.15.100:0/154356185 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f765009b840 con 0x5594ff9b14a0 2024-09-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.102+0000 7f765f830740 10 client.24889 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.102+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5594ffa36c10 con 0x5594ff9b14a0 2024-09-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f763aff5640 1 -- 172.21.15.100:0/154356185 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f765009c5e0 con 0x5594ff9b14a0 2024-09-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f763aff5640 1 -- 172.21.15.100:0/154356185 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f765009b330 con 0x5594ff9b14a0 2024-09-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f765f830740 10 client.24889 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f765f830740 10 client.24889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f765f830740 20 client.24889 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f765f830740 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ffa37360 0x5594ffa39780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f765f830740 4 client.24889 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7648071070 con 0x5594ffa37360 2024-09-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.103+0000 7f76567fc640 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ffa37360 0x5594ffa39780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f76567fc640 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ffa37360 0x5594ffa39780 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40fef63341ee9bf server_cookie=b60036eeb82ef5f7 in_seq=0 out_seq=0 2024-09-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f763aff5640 10 client.24889 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f763aff5640 1 -- 172.21.15.100:0/154356185 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7648071070 con 0x5594ffa37360 2024-09-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f763aff5640 10 client.24889 handle_command_reply: tid=0 2024-09-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 client.24889 shutdown 2024-09-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 msgr2=0x5594ff9c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9c4ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76500988b0 tx=0x7f76500d1ce0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 shutdown_connections 2024-09-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5594ffa37360 0x5594ffa39780 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f763aff5640 0 client.24889 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5594ff9c84e0 0x5594ff9c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594ff9bc680 0x5594ff9c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 --2- 172.21.15.100:0/154356185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594ff9b14a0 0x5594ff9c4ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.104+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 >> 172.21.15.100:0/154356185 conn(0x5594ff9ada30 msgr2=0x5594ff9c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.105+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 shutdown_connections 2024-09-12T02:39:17.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.105+0000 7f765f830740 1 -- 172.21.15.100:0/154356185 wait complete. 2024-09-12T02:39:17.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.105+0000 7f765f830740 20 client.24889 trim_cache size 0 max 16384 2024-09-12T02:39:17.121 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:39:17.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.106+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76400a2d60 msgr2=0x7f76400a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.106+0000 7f765d457640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76400a2d60 0x7f76400a5220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76581172c0 tx=0x7f76480095c0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.106+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76581091f0 msgr2=0x7f765811ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.106+0000 7f765d457640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76581091f0 0x7f765811ea60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f765000ebc0 tx=0x7f765000c6a0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.107+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 shutdown_connections 2024-09-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.107+0000 7f765d457640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76400a2d60 0x7f76400a5220 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.107+0000 7f765d457640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7658114ab0 0x7f7658119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.107+0000 7f765d457640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7658109b10 0x7f765811efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.107+0000 7f765d457640 1 --2- 172.21.15.100:0/2898941428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76581091f0 0x7f765811ea60 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f765000ebc0 tx=0x7f765000c6a0 comp rx=0 tx=0).stop 2024-09-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.107+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 >> 172.21.15.100:0/2898941428 conn(0x7f765806e140 msgr2=0x7f7658070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.107+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 shutdown_connections 2024-09-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.108+0000 7f765d457640 1 -- 172.21.15.100:0/2898941428 wait complete. 2024-09-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:18.280 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:39:18.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:39:18.407 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:18.408 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:38:59:560858+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:59.510722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:39:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 -- 172.21.15.100:0/1841667530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580100a90 msgr2=0x7f1580100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 --2- 172.21.15.100:0/1841667530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580100a90 0x7f1580100ef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1574009890 tx=0x7f157402a360 comp rx=0 tx=0).stop 2024-09-12T02:39:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 -- 172.21.15.100:0/1841667530 shutdown_connections 2024-09-12T02:39:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 --2- 172.21.15.100:0/1841667530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1580101430 0x7f158010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 --2- 172.21.15.100:0/1841667530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580100a90 0x7f1580100ef0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1574009890 tx=0x7f157402a360 comp rx=0 tx=0).stop 2024-09-12T02:39:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 --2- 172.21.15.100:0/1841667530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1580106a90 0x7f1580106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 -- 172.21.15.100:0/1841667530 >> 172.21.15.100:0/1841667530 conn(0x7f15800fc7d0 msgr2=0x7f15800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 -- 172.21.15.100:0/1841667530 shutdown_connections 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.888+0000 7f1585a75640 1 -- 172.21.15.100:0/1841667530 wait complete. 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.889+0000 7f1585a75640 1 Processor -- start 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.890+0000 7f1585a75640 1 -- start start 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.890+0000 7f1585a75640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580101430 0x7f15801a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.890+0000 7f1585a75640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1580106a90 0x7f15801a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.890+0000 7f1585a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f158019eaa0 0x7f158019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.890+0000 7f1585a75640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f158010fd80 con 0x7f158019eaa0 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.890+0000 7f1585a75640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f158010fc00 con 0x7f1580106a90 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.890+0000 7f1585a75640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f158010ff00 con 0x7f1580101430 2024-09-12T02:39:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580101430 0x7f15801a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580101430 0x7f15801a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38544/0 (socket says 172.21.15.100:38544) 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 -- 172.21.15.100:0/3920720602 learned_addr learned my addr 172.21.15.100:0/3920720602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157effd640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1580106a90 0x7f15801a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157ffff640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f158019eaa0 0x7f158019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 -- 172.21.15.100:0/3920720602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1580106a90 msgr2=0x7f15801a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1580106a90 0x7f15801a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 -- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f158019eaa0 msgr2=0x7f158019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f158019eaa0 0x7f158019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157f7fe640 1 -- 172.21.15.100:0/3920720602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158019f5c0 con 0x7f1580101430 2024-09-12T02:39:18.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.891+0000 7f157ffff640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f158019eaa0 0x7f158019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.893+0000 7f157f7fe640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580101430 0x7f15801a48e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15700097d0 tx=0x7f1570009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.893+0000 7f157cff9640 1 -- 172.21.15.100:0/3920720602 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157000eab0 con 0x7f1580101430 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.893+0000 7f157cff9640 1 -- 172.21.15.100:0/3920720602 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1570019070 con 0x7f1580101430 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.893+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158019f8b0 con 0x7f1580101430 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.893+0000 7f157cff9640 1 -- 172.21.15.100:0/3920720602 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570013380 con 0x7f1580101430 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.893+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15801abb40 con 0x7f1580101430 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.894+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1580100ef0 con 0x7f1580101430 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.896+0000 7f157cff9640 1 -- 172.21.15.100:0/3920720602 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f1570014420 con 0x7f1580101430 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.897+0000 7f157cff9640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15680a2d40 0x7f15680a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.897+0000 7f157cff9640 1 -- 172.21.15.100:0/3920720602 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f15700cf1b0 con 0x7f1580101430 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.897+0000 7f157effd640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15680a2d40 0x7f15680a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.898+0000 7f157effd640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15680a2d40 0x7f15680a5200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1574035040 tx=0x7f15740056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:17.899+0000 7f157cff9640 1 -- 172.21.15.100:0/3920720602 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f157009bf40 con 0x7f1580101430 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.242+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15801abe90 con 0x7f1580101430 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.243+0000 7f157cff9640 1 -- 172.21.15.100:0/3920720602 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7f157009b840 con 0x7f1580101430 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.247+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15680a2d40 msgr2=0x7f15680a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.247+0000 7f1585a75640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15680a2d40 0x7f15680a5200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1574035040 tx=0x7f15740056d0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.247+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580101430 msgr2=0x7f15801a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.247+0000 7f1585a75640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580101430 0x7f15801a48e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15700097d0 tx=0x7f1570009c90 comp rx=0 tx=0).stop 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 shutdown_connections 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15680a2d40 0x7f15680a5200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f158019eaa0 0x7f158019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1580106a90 0x7f15801a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 --2- 172.21.15.100:0/3920720602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1580101430 0x7f15801a48e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:18.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 >> 172.21.15.100:0/3920720602 conn(0x7f15800fc7d0 msgr2=0x7f15801045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:18.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 shutdown_connections 2024-09-12T02:39:18.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:18.248+0000 7f1585a75640 1 -- 172.21.15.100:0/3920720602 wait complete. 2024-09-12T02:39:18.742 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:18 smithi100 ceph-mon[31390]: pgmap v355: 97 pgs: 97 active+clean; 715 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 75 MiB/s wr, 266 op/s 2024-09-12T02:39:18.743 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:18 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3920720602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:18.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:18 smithi117 ceph-mon[34898]: pgmap v355: 97 pgs: 97 active+clean; 715 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 75 MiB/s wr, 266 op/s 2024-09-12T02:39:18.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:18 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3920720602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:18 smithi189 ceph-mon[35196]: pgmap v355: 97 pgs: 97 active+clean; 715 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 75 MiB/s wr, 266 op/s 2024-09-12T02:39:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:18 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3920720602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:19.063 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T02:39:19.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T02:39:19.167 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 -- 172.21.15.100:0/169990621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978102ef0 msgr2=0x7ff97810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 --2- 172.21.15.100:0/169990621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978102ef0 0x7ff97810da40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff970009ca0 tx=0x7ff97002a950 comp rx=0 tx=0).stop 2024-09-12T02:39:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 -- 172.21.15.100:0/169990621 shutdown_connections 2024-09-12T02:39:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 --2- 172.21.15.100:0/169990621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978102ef0 0x7ff97810da40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 --2- 172.21.15.100:0/169990621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff978102570 0x7ff9781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 --2- 172.21.15.100:0/169990621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff978100e20 0x7ff978101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 -- 172.21.15.100:0/169990621 >> 172.21.15.100:0/169990621 conn(0x7ff9780fc7d0 msgr2=0x7ff9780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 -- 172.21.15.100:0/169990621 shutdown_connections 2024-09-12T02:39:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.714+0000 7ff97cf04640 1 -- 172.21.15.100:0/169990621 wait complete. 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 Processor -- start 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 -- start start 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978100e20 0x7ff97819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff978102570 0x7ff97819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff978102ef0 0x7ff97819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff978114260 con 0x7ff978100e20 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff9781140e0 con 0x7ff978102ef0 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97cf04640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9781143e0 con 0x7ff978102570 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978100e20 0x7ff97819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978100e20 0x7ff97819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35770/0 (socket says 172.21.15.100:35770) 2024-09-12T02:39:19.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff975d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff978102570 0x7ff97819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff97659c640 1 -- 172.21.15.100:0/2422296266 learned_addr learned my addr 172.21.15.100:0/2422296266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.715+0000 7ff976d9d640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff978102ef0 0x7ff97819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.716+0000 7ff97659c640 1 -- 172.21.15.100:0/2422296266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff978102570 msgr2=0x7ff97819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.716+0000 7ff97659c640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff978102570 0x7ff97819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.716+0000 7ff97659c640 1 -- 172.21.15.100:0/2422296266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff978102ef0 msgr2=0x7ff97819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.716+0000 7ff97659c640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff978102ef0 0x7ff97819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.716+0000 7ff97659c640 1 -- 172.21.15.100:0/2422296266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97819f610 con 0x7ff978100e20 2024-09-12T02:39:19.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.716+0000 7ff97659c640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978100e20 0x7ff97819a660 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff96800e9f0 tx=0x7ff96800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:19.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.717+0000 7ff9677fe640 1 -- 172.21.15.100:0/2422296266 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96800cd80 con 0x7ff978100e20 2024-09-12T02:39:19.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.717+0000 7ff9677fe640 1 -- 172.21.15.100:0/2422296266 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff968005500 con 0x7ff978100e20 2024-09-12T02:39:19.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.717+0000 7ff9677fe640 1 -- 172.21.15.100:0/2422296266 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968010690 con 0x7ff978100e20 2024-09-12T02:39:19.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.718+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97819f900 con 0x7ff978100e20 2024-09-12T02:39:19.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.718+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9781a71e0 con 0x7ff978100e20 2024-09-12T02:39:19.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.720+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9781021b0 con 0x7ff978100e20 2024-09-12T02:39:19.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.723+0000 7ff9677fe640 1 -- 172.21.15.100:0/2422296266 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7ff9680046c0 con 0x7ff978100e20 2024-09-12T02:39:19.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.723+0000 7ff9677fe640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff9600a2da0 0x7ff9600a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.724+0000 7ff9677fe640 1 -- 172.21.15.100:0/2422296266 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff9680cfb90 con 0x7ff978100e20 2024-09-12T02:39:19.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.724+0000 7ff975d9b640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff9600a2da0 0x7ff9600a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:19.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.724+0000 7ff975d9b640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff9600a2da0 0x7ff9600a5260 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9780fec10 tx=0x7ff96c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:19.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:19.728+0000 7ff9677fe640 1 -- 172.21.15.100:0/2422296266 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff968026020 con 0x7ff978100e20 2024-09-12T02:39:19.774 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:20.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.050+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff978101200 con 0x7ff978100e20 2024-09-12T02:39:20.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.052+0000 7ff9677fe640 1 -- 172.21.15.100:0/2422296266 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7ff96809ca00 con 0x7ff978100e20 2024-09-12T02:39:20.053 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:20.053 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:38:59:560858+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:59.510722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:39:20.053 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:39:20.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff9600a2da0 msgr2=0x7ff9600a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff9600a2da0 0x7ff9600a5260 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9780fec10 tx=0x7ff96c005f90 comp rx=0 tx=0).stop 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978100e20 msgr2=0x7ff97819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978100e20 0x7ff97819a660 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff96800e9f0 tx=0x7ff96800edf0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 shutdown_connections 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff9600a2da0 0x7ff9600a5260 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff978102ef0 0x7ff97819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff978102570 0x7ff97819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 --2- 172.21.15.100:0/2422296266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978100e20 0x7ff97819a660 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.054+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 >> 172.21.15.100:0/2422296266 conn(0x7ff9780fc7d0 msgr2=0x7ff978106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.055+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 shutdown_connections 2024-09-12T02:39:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.055+0000 7ff97cf04640 1 -- 172.21.15.100:0/2422296266 wait complete. 2024-09-12T02:39:20.636 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:20 smithi100 ceph-mon[31390]: pgmap v356: 97 pgs: 97 active+clean; 880 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 71 MiB/s wr, 297 op/s 2024-09-12T02:39:20.636 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:20 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2422296266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:20.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:39:20.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:20 smithi117 ceph-mon[34898]: pgmap v356: 97 pgs: 97 active+clean; 880 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 71 MiB/s wr, 297 op/s 2024-09-12T02:39:20.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:20 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2422296266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.997+0000 7ffa55624640 1 -- 172.21.15.100:0/3362431407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 msgr2=0x7ffa5010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.997+0000 7ffa55624640 1 --2- 172.21.15.100:0/3362431407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 0x7ffa5010d960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009ca0 tx=0x7ffa4802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.997+0000 7ffa55624640 1 -- 172.21.15.100:0/3362431407 shutdown_connections 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.998+0000 7ffa55624640 1 --2- 172.21.15.100:0/3362431407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 0x7ffa5010d960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.998+0000 7ffa55624640 1 --2- 172.21.15.100:0/3362431407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa50101e20 0x7ffa501056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.998+0000 7ffa55624640 1 --2- 172.21.15.100:0/3362431407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa50101470 0x7ffa50101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.998+0000 7ffa55624640 1 -- 172.21.15.100:0/3362431407 >> 172.21.15.100:0/3362431407 conn(0x7ffa50077230 msgr2=0x7ffa500fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.998+0000 7ffa55624640 1 -- 172.21.15.100:0/3362431407 shutdown_connections 2024-09-12T02:39:20.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:20.998+0000 7ffa55624640 1 -- 172.21.15.100:0/3362431407 wait complete. 2024-09-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.000+0000 7ffa55624640 1 Processor -- start 2024-09-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.000+0000 7ffa55624640 1 -- start start 2024-09-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.000+0000 7ffa55624640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa50101470 0x7ffa50197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.000+0000 7ffa55624640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa50101e20 0x7ffa501976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.000+0000 7ffa55624640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 0x7ffa5019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.000+0000 7ffa55624640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50110e90 con 0x7ffa50105de0 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.000+0000 7ffa55624640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50110d10 con 0x7ffa50101470 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 0x7ffa5019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 0x7ffa5019ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35782/0 (socket says 172.21.15.100:35782) 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/667554037 learned_addr learned my addr 172.21.15.100:0/667554037 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50111010 con 0x7ffa50101e20 2024-09-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4effd640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa50101470 0x7ffa50197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa47fff640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa50101e20 0x7ffa501976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4effd640 1 -- 172.21.15.100:0/667554037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa50101e20 msgr2=0x7ffa501976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4effd640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa50101e20 0x7ffa501976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4effd640 1 -- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 msgr2=0x7ffa5019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4effd640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 0x7ffa5019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.001+0000 7ffa4effd640 1 -- 172.21.15.100:0/667554037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5019c140 con 0x7ffa50101470 2024-09-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.002+0000 7ffa4effd640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa50101470 0x7ffa50197190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000d6d0 tx=0x7ffa4000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.003+0000 7ffa4cff9640 1 -- 172.21.15.100:0/667554037 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4001b070 con 0x7ffa50101470 2024-09-12T02:39:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.003+0000 7ffa4cff9640 1 -- 172.21.15.100:0/667554037 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa40005500 con 0x7ffa50101470 2024-09-12T02:39:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.003+0000 7ffa4cff9640 1 -- 172.21.15.100:0/667554037 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40009e50 con 0x7ffa50101470 2024-09-12T02:39:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.003+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5019c430 con 0x7ffa50101470 2024-09-12T02:39:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.003+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5019c860 con 0x7ffa50101470 2024-09-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.007+0000 7ffa579fd740 1 Processor -- start 2024-09-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.007+0000 7ffa579fd740 1 -- start start 2024-09-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6372760 0x5631c6372b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6373080 0x5631c637d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c637d940 0x5631c637fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa579fd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5631c62d82a0 con 0x5631c6373080 2024-09-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa579fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5631c627fb10 con 0x5631c6372760 2024-09-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa579fd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631c62d4260 con 0x5631c637d940 2024-09-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c637d940 0x5631c637fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.008+0000 7ffa4cff9640 1 -- 172.21.15.100:0/667554037 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7ffa400141b0 con 0x7ffa50101470 2024-09-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6372760 0x5631c6372b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c637d940 0x5631c637fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38564/0 (socket says 172.21.15.100:38564) 2024-09-12T02:39:21.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa47fff640 1 -- 172.21.15.100:0/876977922 learned_addr learned my addr 172.21.15.100:0/876977922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4effd640 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6373080 0x5631c637d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/876977922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c637d940 msgr2=0x5631c637fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c637d940 0x5631c637fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/876977922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6373080 msgr2=0x5631c637d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6373080 0x5631c637d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/876977922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6049b90 con 0x5631c6372760 2024-09-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.009+0000 7ffa4effd640 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6373080 0x5631c637d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.010+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6372760 0x5631c6372b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009bf0 tx=0x7ffa48001060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37db766ef30bc5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.010+0000 7ffa457fa640 1 -- 172.21.15.100:0/876977922 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48031db0 con 0x5631c6372760 2024-09-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.010+0000 7ffa457fa640 1 -- 172.21.15.100:0/876977922 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa48036030 con 0x5631c6372760 2024-09-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.010+0000 7ffa457fa640 1 -- 172.21.15.100:0/876977922 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48004330 con 0x5631c6372760 2024-09-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.011+0000 7ffa4cff9640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa3c0a2f80 0x7ffa3c0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.011+0000 7ffa4effd640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa3c0a2f80 0x7ffa3c0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.011+0000 7ffa579fd740 1 -- 172.21.15.100:0/876977922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6372760 msgr2=0x5631c6372b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.012+0000 7ffa579fd740 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6372760 0x5631c6372b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009bf0 tx=0x7ffa48001060 comp rx=0 tx=0).stop 2024-09-12T02:39:21.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:20 smithi189 ceph-mon[35196]: pgmap v356: 97 pgs: 97 active+clean; 880 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 71 MiB/s wr, 297 op/s 2024-09-12T02:39:21.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:20 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2422296266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.011+0000 7ffa4cff9640 1 -- 172.21.15.100:0/667554037 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa400ce160 con 0x7ffa50101470 2024-09-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.012+0000 7ffa579fd740 1 -- 172.21.15.100:0/876977922 shutdown_connections 2024-09-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.012+0000 7ffa579fd740 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c637d940 0x5631c637fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.012+0000 7ffa4effd640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa3c0a2f80 0x7ffa3c0a5440 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffa400a2f30 tx=0x7ffa4006eeb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.013+0000 7ffa579fd740 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6373080 0x5631c637d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.013+0000 7ffa579fd740 1 --2- 172.21.15.100:0/876977922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6372760 0x5631c6372b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.013+0000 7ffa579fd740 1 -- 172.21.15.100:0/876977922 >> 172.21.15.100:0/876977922 conn(0x5631c636ecf0 msgr2=0x5631c636f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.014+0000 7ffa579fd740 1 -- 172.21.15.100:0/876977922 shutdown_connections 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.014+0000 7ffa579fd740 1 -- 172.21.15.100:0/876977922 wait complete. 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.014+0000 7ffa579fd740 1 -- start start 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.014+0000 7ffa579fd740 1 Processor -- start 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6372760 0x5631c637a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6373080 0x5631c637ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c637d940 0x5631c637b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa579fd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5631c6380390 con 0x5631c6372760 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa579fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5631c62606e0 con 0x5631c637d940 2024-09-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa579fd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631c6380510 con 0x5631c6373080 2024-09-12T02:39:21.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa579fd740 10 client.0 _ll_register_callbacks cb 0x5631c6284a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:21.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6373080 0x5631c637ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6373080 0x5631c637ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38572/0 (socket says 172.21.15.100:38572) 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 -- 172.21.15.100:0/1045394722 learned_addr learned my addr 172.21.15.100:0/1045394722 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 -- 172.21.15.100:0/1045394722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c637d940 msgr2=0x5631c637b2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c637d940 0x5631c637b2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 -- 172.21.15.100:0/1045394722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6372760 msgr2=0x5631c637a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6372760 0x5631c637a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 -- 172.21.15.100:0/1045394722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c6389900 con 0x5631c6373080 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa47fff640 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6373080 0x5631c637ad70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa38013710 tx=0x7ffa38013bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ca34dfe181f8f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.015+0000 7ffa367fc640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.016+0000 7ffa367fc640 1 -- 172.21.15.100:0/1045394722 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380119c0 con 0x5631c6373080 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.016+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa48036030 con 0x5631c6373080 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.016+0000 7ffa367fc640 1 -- 172.21.15.100:0/1045394722 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa38011b60 con 0x5631c6373080 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.016+0000 7ffa367fc640 1 -- 172.21.15.100:0/1045394722 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffa38011d60 con 0x5631c6373080 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.016+0000 7ffa579fd740 10 client.24910 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.016+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5631c638c340 con 0x5631c6373080 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa367fc640 1 -- 172.21.15.100:0/1045394722 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa48036030 con 0x5631c6373080 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa367fc640 1 -- 172.21.15.100:0/1045394722 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ffa3801a020 con 0x5631c6373080 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa579fd740 10 client.24910 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa579fd740 10 client.24910 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa579fd740 20 client.24910 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa579fd740 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c638fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa579fd740 4 client.24910 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.017+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631c62e59d0 con 0x5631c638d7f0 2024-09-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.018+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c638fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.019+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c638fc50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60df64f2513caf90 server_cookie=9c542b40c2792fb0 in_seq=0 out_seq=0 2024-09-12T02:39:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.019+0000 7ffa367fc640 10 client.24910 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.020+0000 7ffa367fc640 1 -- 172.21.15.100:0/1045394722 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631c62e59d0 con 0x5631c638d7f0 2024-09-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.020+0000 7ffa367fc640 10 client.24910 handle_command_reply: tid=0 2024-09-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.020+0000 7ffa579fd740 1 client.24910 shutdown 2024-09-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.020+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6373080 msgr2=0x5631c637ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.020+0000 7ffa579fd740 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6373080 0x5631c637ad70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa38013710 tx=0x7ffa38013bd0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 shutdown_connections 2024-09-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c638fc50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa367fc640 0 client.24910 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c637d940 0x5631c637b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6373080 0x5631c637ad70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 --2- 172.21.15.100:0/1045394722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c6372760 0x5631c637a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 >> 172.21.15.100:0/1045394722 conn(0x5631c636ecf0 msgr2=0x5631c636de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 shutdown_connections 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.021+0000 7ffa579fd740 1 -- 172.21.15.100:0/1045394722 wait complete. 2024-09-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.022+0000 7ffa579fd740 20 client.24910 trim_cache size 0 max 16384 2024-09-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.055+0000 7ffa579fd740 1 Processor -- start 2024-09-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa579fd740 1 -- start start 2024-09-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c637b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6395560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 0x5631c6395aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa579fd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa501b6420 con 0x5631c637d940 2024-09-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa579fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa501b3cf0 con 0x5631c6373080 2024-09-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa579fd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa501b1b40 con 0x5631c6372760 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa4f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c637b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6395560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa4f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c637b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38576/0 (socket says 172.21.15.100:38576) 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6395560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36464/0 (socket says 172.21.15.100:36464) 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/2109240990 learned_addr learned my addr 172.21.15.100:0/2109240990 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.056+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 0x5631c6395aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/2109240990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 msgr2=0x5631c6395560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6395560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/2109240990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 msgr2=0x5631c6395aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 0x5631c6395aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/2109240990 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6373c70 con 0x5631c6372760 2024-09-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa47fff640 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6395560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c637b100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000f80 tx=0x7ffa48005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e3f329c356350e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.057+0000 7ffa44ff9640 1 -- 172.21.15.100:0/2109240990 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48054040 con 0x5631c6372760 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.058+0000 7ffa44ff9640 1 -- 172.21.15.100:0/2109240990 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa48036040 con 0x5631c6372760 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.058+0000 7ffa44ff9640 1 -- 172.21.15.100:0/2109240990 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4804a040 con 0x5631c6372760 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 -- 172.21.15.100:0/2109240990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 msgr2=0x5631c637b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c637b100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000f80 tx=0x7ffa48005fd0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 -- 172.21.15.100:0/2109240990 shutdown_connections 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 0x5631c6395aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6395560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 --2- 172.21.15.100:0/2109240990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c637b100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 -- 172.21.15.100:0/2109240990 >> 172.21.15.100:0/2109240990 conn(0x5631c636ecf0 msgr2=0x5631c637c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 -- 172.21.15.100:0/2109240990 shutdown_connections 2024-09-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 -- 172.21.15.100:0/2109240990 wait complete. 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 -- start start 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.059+0000 7ffa579fd740 1 Processor -- start 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c6377850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa579fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6377d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa4f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c6377850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa4f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c6377850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38584/0 (socket says 172.21.15.100:38584) 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/370963906 learned_addr learned my addr 172.21.15.100:0/370963906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa47fff640 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6377d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa579fd740 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 0x5631c63782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa501b21b0 con 0x5631c637d940 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa501b3620 con 0x5631c6373080 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.060+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa501b2880 con 0x5631c6372760 2024-09-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 msgr2=0x5631c6377d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6377d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/370963906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 msgr2=0x5631c63782d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 0x5631c63782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa4f7fe640 1 -- 172.21.15.100:0/370963906 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c643b540 con 0x5631c6372760 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa579fd740 10 client.0 _ll_register_callbacks cb 0x7ffa38009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa48036040 con 0x5631c6372760 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.061+0000 7ffa4f7fe640 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c6377850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa480314c0 tx=0x7ffa480314f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=455361e3b53303f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.062+0000 7ffa367fc640 10 client.24916 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.062+0000 7ffa367fc640 1 -- 172.21.15.100:0/370963906 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48054070 con 0x5631c6372760 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.062+0000 7ffa367fc640 1 -- 172.21.15.100:0/370963906 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa48003970 con 0x5631c6372760 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.062+0000 7ffa367fc640 1 -- 172.21.15.100:0/370963906 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffa48003b90 con 0x5631c6372760 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.062+0000 7ffa579fd740 10 client.24916 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.062+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5631c643c570 con 0x5631c6372760 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa367fc640 1 -- 172.21.15.100:0/370963906 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ffa48068020 con 0x5631c6372760 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa579fd740 10 client.24916 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa579fd740 10 client.24916 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa579fd740 20 client.24916 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa579fd740 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c643e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa579fd740 4 client.24916 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x7ffa48036040 con 0x5631c638d7f0 2024-09-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.063+0000 7ffa47fff640 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c643e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.064+0000 7ffa47fff640 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c643e800 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc296d15b6ceea9f server_cookie=2481a6f3e5e985a1 in_seq=0 out_seq=0 2024-09-12T02:39:21.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.064+0000 7ffa367fc640 10 client.24916 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:21.122 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 10.0 s, 3529.3 tps, lat 27.280 ms stddev 27.901 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.819+0000 7f521e605640 1 -- 172.21.15.100:0/3781435457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218106a80 msgr2=0x7f5218106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.819+0000 7f521e605640 1 --2- 172.21.15.100:0/3781435457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218106a80 0x7f5218106e60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5208009930 tx=0x7f520802a420 comp rx=0 tx=0).stop 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.819+0000 7f521e605640 1 -- 172.21.15.100:0/3781435457 shutdown_connections 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.819+0000 7f521e605640 1 --2- 172.21.15.100:0/3781435457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5218101420 0x7f521810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.819+0000 7f521e605640 1 --2- 172.21.15.100:0/3781435457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5218100a80 0x7f5218100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.819+0000 7f521e605640 1 --2- 172.21.15.100:0/3781435457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218106a80 0x7f5218106e60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.819+0000 7f521e605640 1 -- 172.21.15.100:0/3781435457 >> 172.21.15.100:0/3781435457 conn(0x7f52180fc7a0 msgr2=0x7f52180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.820+0000 7f521e605640 1 -- 172.21.15.100:0/3781435457 shutdown_connections 2024-09-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.820+0000 7f521e605640 1 -- 172.21.15.100:0/3781435457 wait complete. 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.820+0000 7f521e605640 1 Processor -- start 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.820+0000 7f521e605640 1 -- start start 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521e605640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5218100a80 0x7f5218198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521e605640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218101420 0x7f5218198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521e605640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5218106a80 0x7f521819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521e605640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5218110e80 con 0x7f5218101420 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521e605640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5218110d00 con 0x7f5218100a80 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521e605640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5218111000 con 0x7f5218106a80 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218101420 0x7f5218198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f5217fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5218100a80 0x7f5218198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218101420 0x7f5218198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35820/0 (socket says 172.21.15.100:35820) 2024-09-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521cba2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5218106a80 0x7f521819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 -- 172.21.15.100:0/1244234314 learned_addr learned my addr 172.21.15.100:0/1244234314 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 -- 172.21.15.100:0/1244234314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5218106a80 msgr2=0x7f521819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5218106a80 0x7f521819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 -- 172.21.15.100:0/1244234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5218100a80 msgr2=0x7f5218198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5218100a80 0x7f5218198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 -- 172.21.15.100:0/1244234314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521819d3c0 con 0x7f5218101420 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f521cba2640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5218106a80 0x7f521819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f5217fff640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5218100a80 0x7f5218198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.821+0000 7f52177fe640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218101420 0x7f5218198950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f520c00e9f0 tx=0x7f520c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.822+0000 7f52157fa640 1 -- 172.21.15.100:0/1244234314 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c00cd80 con 0x7f5218101420 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.822+0000 7f52157fa640 1 -- 172.21.15.100:0/1244234314 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f520c010910 con 0x7f5218101420 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.822+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521819d6b0 con 0x7f5218101420 2024-09-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.822+0000 7f52157fa640 1 -- 172.21.15.100:0/1244234314 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c018990 con 0x7f5218101420 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.822+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52181a4f90 con 0x7f5218101420 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.824+0000 7f52157fa640 1 -- 172.21.15.100:0/1244234314 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f520c010ac0 con 0x7f5218101420 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.824+0000 7f52209de740 1 Processor -- start 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.824+0000 7f52209de740 1 -- start start 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.824+0000 7f52209de740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x56378694e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52209de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694e5d0 0x56378694ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52209de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x56378695fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52209de740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5637868b42f0 con 0x56378694fb40 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52209de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56378685bcf0 con 0x56378694e5d0 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52209de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5637868b02b0 con 0x56378695d780 2024-09-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52157fa640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f52000a2c10 0x7f52000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694e5d0 0x56378694ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694e5d0 0x56378694ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36508/0 (socket says 172.21.15.100:36508) 2024-09-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 -- 172.21.15.100:0/165616931 learned_addr learned my addr 172.21.15.100:0/165616931 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52177fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x56378695fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f521cba2640 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x56378694e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f521cba2640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f52000a2c10 0x7f52000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f52157fa640 1 -- 172.21.15.100:0/1244234314 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f520c0cf4f0 con 0x7f5218101420 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 -- 172.21.15.100:0/165616931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 msgr2=0x56378695fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x56378695fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 -- 172.21.15.100:0/165616931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 msgr2=0x56378694e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x56378694e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 -- 172.21.15.100:0/165616931 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637868403a0 con 0x56378694e5d0 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f5217fff640 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694e5d0 0x56378694ea10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5208000c00 tx=0x7f5208005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38faad383f1ab994 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f521cba2640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f52000a2c10 0x7f52000a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f52100099e0 tx=0x7f5210009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.825+0000 7f51fe7fc640 1 -- 172.21.15.100:0/165616931 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208035040 con 0x56378694e5d0 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f51fe7fc640 1 -- 172.21.15.100:0/165616931 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5208031830 con 0x56378694e5d0 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f51fe7fc640 1 -- 172.21.15.100:0/165616931 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208003e20 con 0x56378694e5d0 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 -- 172.21.15.100:0/165616931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694e5d0 msgr2=0x56378694ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694e5d0 0x56378694ea10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5208000c00 tx=0x7f5208005d50 comp rx=0 tx=0).stop 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 -- 172.21.15.100:0/165616931 shutdown_connections 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x56378695fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694e5d0 0x56378694ea10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 --2- 172.21.15.100:0/165616931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x56378694e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 -- 172.21.15.100:0/165616931 >> 172.21.15.100:0/165616931 conn(0x563786917310 msgr2=0x56378694ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 -- 172.21.15.100:0/165616931 shutdown_connections 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.826+0000 7f52209de740 1 -- 172.21.15.100:0/165616931 wait complete. 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 -- start start 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 Processor -- start 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x56378695d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694fb40 0x56378695a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x56378695a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563786960420 con 0x56378694e5d0 2024-09-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56378686f060 con 0x56378695d780 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5637869605a0 con 0x56378694fb40 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52209de740 10 client.0 _ll_register_callbacks cb 0x5637865c28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f5217fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x56378695d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f5217fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x56378695d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35840/0 (socket says 172.21.15.100:35840) 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f5217fff640 1 -- 172.21.15.100:0/3717682850 learned_addr learned my addr 172.21.15.100:0/3717682850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f521cba2640 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x56378695a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.827+0000 7f52177fe640 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694fb40 0x56378695a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f5217fff640 1 -- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694fb40 msgr2=0x56378695a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f5217fff640 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694fb40 0x56378695a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f5217fff640 1 -- 172.21.15.100:0/3717682850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 msgr2=0x56378695a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f5217fff640 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x56378695a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f5217fff640 1 -- 172.21.15.100:0/3717682850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637866253c0 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f5217fff640 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x56378695d110 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f520802a940 tx=0x7f52080038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d2eedb616d243 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f51f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f51f77fe640 1 -- 172.21.15.100:0/3717682850 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520804e070 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f51f77fe640 1 -- 172.21.15.100:0/3717682850 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5208003df0 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5208031830 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f51f77fe640 1 -- 172.21.15.100:0/3717682850 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f520805a050 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f52209de740 10 client.15402 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56378696be50 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f51f77fe640 1 -- 172.21.15.100:0/3717682850 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5208031830 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.828+0000 7f51f77fe640 1 -- 172.21.15.100:0/3717682850 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f520803c920 con 0x56378694e5d0 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52209de740 10 client.15402 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52209de740 10 client.15402 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52209de740 20 client.15402 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52209de740 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56378696d1a0 0x56378696f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52209de740 4 client.15402 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637868c1860 con 0x56378696d1a0 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52177fe640 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56378696d1a0 0x56378696f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f51f77fe640 10 client.15402 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.829+0000 7f52177fe640 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56378696d1a0 0x56378696f590 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=674c40e1613f963d server_cookie=9b8ab7f8723fc26c in_seq=0 out_seq=0 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f51f77fe640 1 -- 172.21.15.100:0/3717682850 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637868c1860 con 0x56378696d1a0 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f51f77fe640 10 client.15402 handle_command_reply: tid=0 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 client.15402 shutdown 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 msgr2=0x56378695d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x56378695d110 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f520802a940 tx=0x7f52080038a0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 shutdown_connections 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56378696d1a0 0x56378696f590 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x56378695a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694fb40 0x56378695a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 --2- 172.21.15.100:0/3717682850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x56378695d110 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 >> 172.21.15.100:0/3717682850 conn(0x563786917310 msgr2=0x563786950960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f51f77fe640 0 client.15402 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 shutdown_connections 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 1 -- 172.21.15.100:0/3717682850 wait complete. 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.830+0000 7f52209de740 20 client.15402 trim_cache size 0 max 16384 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 Processor -- start 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 -- start start 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x5637869696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694fb40 0x563786959290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x563786974b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52181adc10 con 0x56378694e5d0 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f52181ab4e0 con 0x56378694fb40 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52209de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52181a9330 con 0x56378695d780 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f5217fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x5637869696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f5217fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x5637869696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35846/0 (socket says 172.21.15.100:35846) 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f5217fff640 1 -- 172.21.15.100:0/771203365 learned_addr learned my addr 172.21.15.100:0/771203365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.843+0000 7f52177fe640 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694fb40 0x563786959290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f521cba2640 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x563786974b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f5217fff640 1 -- 172.21.15.100:0/771203365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 msgr2=0x563786974b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f5217fff640 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x563786974b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f5217fff640 1 -- 172.21.15.100:0/771203365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694fb40 msgr2=0x563786959290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f5217fff640 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694fb40 0x563786959290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f5217fff640 1 -- 172.21.15.100:0/771203365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563786958930 con 0x56378694e5d0 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f52177fe640 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694fb40 0x563786959290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f5217fff640 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x5637869696c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f520803ccf0 tx=0x7f5208005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84478d1859e4642a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f51fdffb640 1 -- 172.21.15.100:0/771203365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520804e070 con 0x56378694e5d0 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f51fdffb640 1 -- 172.21.15.100:0/771203365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5208003df0 con 0x56378694e5d0 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f51fdffb640 1 -- 172.21.15.100:0/771203365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208035040 con 0x56378694e5d0 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f52209de740 1 -- 172.21.15.100:0/771203365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 msgr2=0x5637869696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f52209de740 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x5637869696c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f520803ccf0 tx=0x7f5208005780 comp rx=0 tx=0).stop 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.844+0000 7f52209de740 1 -- 172.21.15.100:0/771203365 shutdown_connections 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378695d780 0x563786974b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378694fb40 0x563786959290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 --2- 172.21.15.100:0/771203365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694e5d0 0x5637869696c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 -- 172.21.15.100:0/771203365 >> 172.21.15.100:0/771203365 conn(0x563786917310 msgr2=0x563786958b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 -- 172.21.15.100:0/771203365 shutdown_connections 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 -- 172.21.15.100:0/771203365 wait complete. 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 -- start start 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 Processor -- start 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694e5d0 0x563786965f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x5637869570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x5637869575f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52181a99a0 con 0x56378694fb40 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f52181aae10 con 0x56378695d780 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52181aa070 con 0x56378694e5d0 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.845+0000 7f52209de740 10 client.0 _ll_register_callbacks cb 0x7f5208040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x5637869570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f5217fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694e5d0 0x563786965f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f521cba2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x5637869575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x5637869570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35860/0 (socket says 172.21.15.100:35860) 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f521cba2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x5637869575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36542/0 (socket says 172.21.15.100:36542) 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 -- 172.21.15.100:0/3387672994 learned_addr learned my addr 172.21.15.100:0/3387672994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 -- 172.21.15.100:0/3387672994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694e5d0 msgr2=0x563786965f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694e5d0 0x563786965f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 -- 172.21.15.100:0/3387672994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 msgr2=0x5637869575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x5637869575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 -- 172.21.15.100:0/3387672994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563786957df0 con 0x56378694fb40 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52177fe640 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x5637869570b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f520c09bc20 tx=0x7f520c06bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c7a30f22267442 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f51f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f51f77fe640 1 -- 172.21.15.100:0/3387672994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c098300 con 0x56378694fb40 2024-09-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f51f77fe640 1 -- 172.21.15.100:0/3387672994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f520c0cf0b0 con 0x56378694fb40 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5208003df0 con 0x56378694fb40 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f51f77fe640 1 -- 172.21.15.100:0/3387672994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f520c0984a0 con 0x56378694fb40 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52209de740 10 client.15408 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5637869d7b30 con 0x56378694fb40 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.846+0000 7f51f77fe640 1 -- 172.21.15.100:0/3387672994 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5208003df0 con 0x56378694fb40 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f51f77fe640 1 -- 172.21.15.100:0/3387672994 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f520c09b0e0 con 0x56378694fb40 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f52209de740 10 client.15408 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f52209de740 10 client.15408 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f52209de740 20 client.15408 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f52209de740 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5637869d8230 0x5637869da650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f52209de740 4 client.15408 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637868bbd70 con 0x5637869d8230 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f5217fff640 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5637869d8230 0x5637869da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f5217fff640 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5637869d8230 0x5637869da650 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=117be493f3c8225e server_cookie=f6564637dae2c301 in_seq=0 out_seq=0 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f51f77fe640 10 client.15408 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f51f77fe640 1 -- 172.21.15.100:0/3387672994 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637868bbd70 con 0x5637869d8230 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f51f77fe640 10 client.15408 handle_command_reply: tid=0 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.847+0000 7f52209de740 1 client.15408 shutdown 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 msgr2=0x5637869570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x5637869570b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f520c09bc20 tx=0x7f520c06bc00 comp rx=0 tx=0).stop 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 shutdown_connections 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x5637869d8230 0x5637869da650 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56378695d780 0x5637869575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56378694fb40 0x5637869570b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f51f77fe640 0 client.15408 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 --2- 172.21.15.100:0/3387672994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56378694e5d0 0x563786965f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 >> 172.21.15.100:0/3387672994 conn(0x563786917310 msgr2=0x563786949d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 shutdown_connections 2024-09-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 1 -- 172.21.15.100:0/3387672994 wait complete. 2024-09-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f52209de740 20 client.15408 trim_cache size 0 max 16384 2024-09-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f52000a2c10 msgr2=0x7f52000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f521e605640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f52000a2c10 0x7f52000a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f52100099e0 tx=0x7f5210009500 comp rx=0 tx=0).stop 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218101420 msgr2=0x7f5218198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.848+0000 7f521e605640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218101420 0x7f5218198950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f520c00e9f0 tx=0x7f520c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 shutdown_connections 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f52000a2c10 0x7f52000a50d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5218106a80 0x7f521819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218101420 0x7f5218198950 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 --2- 172.21.15.100:0/1244234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5218100a80 0x7f5218198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 >> 172.21.15.100:0/1244234314 conn(0x7f52180fc7a0 msgr2=0x7f521806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 shutdown_connections 2024-09-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:21.849+0000 7f521e605640 1 -- 172.21.15.100:0/1244234314 wait complete. 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa367fc640 1 -- 172.21.15.100:0/370963906 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7ffa48036040 con 0x5631c638d7f0 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa367fc640 10 client.24916 handle_command_reply: tid=0 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 client.24916 shutdown 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 msgr2=0x5631c6377850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c6377850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa480314c0 tx=0x7ffa480314f0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 shutdown_connections 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631c638d7f0 0x5631c643e800 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c637d940 0x5631c63782d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5631c6373080 0x5631c6377d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 --2- 172.21.15.100:0/370963906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631c6372760 0x5631c6377850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa367fc640 0 client.24916 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 >> 172.21.15.100:0/370963906 conn(0x5631c636ecf0 msgr2=0x5631c636d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 shutdown_connections 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 1 -- 172.21.15.100:0/370963906 wait complete. 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.342+0000 7ffa579fd740 20 client.24916 trim_cache size 0 max 16384 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 26, 2024-09-12T02:39:22.344 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 2, 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "936b729e": { 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 2, 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 144.5, 2024-09-12T02:39:22.345 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:22.346 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:39:22.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa3c0a2f80 msgr2=0x7ffa3c0a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:22.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa3c0a2f80 0x7ffa3c0a5440 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffa400a2f30 tx=0x7ffa4006eeb0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa50101470 msgr2=0x7ffa50197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:22.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa50101470 0x7ffa50197190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000d6d0 tx=0x7ffa4000db90 comp rx=0 tx=0).stop 2024-09-12T02:39:22.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 shutdown_connections 2024-09-12T02:39:22.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa3c0a2f80 0x7ffa3c0a5440 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa50105de0 0x7ffa5019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa50101e20 0x7ffa501976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 --2- 172.21.15.100:0/667554037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa50101470 0x7ffa50197190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:22.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 >> 172.21.15.100:0/667554037 conn(0x7ffa50077230 msgr2=0x7ffa50105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:22.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 shutdown_connections 2024-09-12T02:39:22.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:22.343+0000 7ffa55624640 1 -- 172.21.15.100:0/667554037 wait complete. 2024-09-12T02:39:22.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:39:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:22 smithi100 ceph-mon[31390]: pgmap v357: 97 pgs: 97 active+clean; 908 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 MiB/s wr, 454 op/s 2024-09-12T02:39:22.883 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:22 smithi189 ceph-mon[35196]: pgmap v357: 97 pgs: 97 active+clean; 908 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 MiB/s wr, 454 op/s 2024-09-12T02:39:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:22 smithi117 ceph-mon[34898]: pgmap v357: 97 pgs: 97 active+clean; 908 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 MiB/s wr, 454 op/s 2024-09-12T02:39:23.360 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '936b729e', quiesce took 6.7 seconds. Will release after: 17.8 2024-09-12T02:39:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 -- 172.21.15.100:0/924917705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384100a80 msgr2=0x7f3384100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 --2- 172.21.15.100:0/924917705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384100a80 0x7f3384100ee0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3380009930 tx=0x7f338002a420 comp rx=0 tx=0).stop 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 -- 172.21.15.100:0/924917705 shutdown_connections 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 --2- 172.21.15.100:0/924917705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3384101420 0x7f338410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 --2- 172.21.15.100:0/924917705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384100a80 0x7f3384100ee0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 --2- 172.21.15.100:0/924917705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3384106a80 0x7f3384106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 -- 172.21.15.100:0/924917705 >> 172.21.15.100:0/924917705 conn(0x7f33840fc7a0 msgr2=0x7f33840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 -- 172.21.15.100:0/924917705 shutdown_connections 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 -- 172.21.15.100:0/924917705 wait complete. 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 Processor -- start 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.801+0000 7f338b913640 1 -- start start 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3384100a80 0x7f3384198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384101420 0x7f33841988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3384106a80 0x7f338419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3384111f90 con 0x7f3384101420 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3384111e10 con 0x7f3384106a80 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3384112110 con 0x7f3384100a80 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384101420 0x7f33841988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384101420 0x7f33841988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35880/0 (socket says 172.21.15.100:35880) 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 -- 172.21.15.100:0/2006528145 learned_addr learned my addr 172.21.15.100:0/2006528145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f33896af640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3384100a80 0x7f3384198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3389eb0640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3384106a80 0x7f338419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 -- 172.21.15.100:0/2006528145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3384100a80 msgr2=0x7f3384198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3384100a80 0x7f3384198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 -- 172.21.15.100:0/2006528145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3384106a80 msgr2=0x7f338419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3384106a80 0x7f338419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 -- 172.21.15.100:0/2006528145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338419d330 con 0x7f3384101420 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f3388eae640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384101420 0x7f33841988c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3380009a50 tx=0x7f3380004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:23.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f337a7fc640 1 -- 172.21.15.100:0/2006528145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338003f030 con 0x7f3384101420 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f337a7fc640 1 -- 172.21.15.100:0/2006528145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3380003ce0 con 0x7f3384101420 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338419d5c0 con 0x7f3384101420 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f337a7fc640 1 -- 172.21.15.100:0/2006528145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380035070 con 0x7f3384101420 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.802+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33841a4f00 con 0x7f3384101420 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.805+0000 7f337a7fc640 1 -- 172.21.15.100:0/2006528145 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f3380042030 con 0x7f3384101420 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.805+0000 7f338dcec740 1 Processor -- start 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f338dcec740 1 -- start start 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f338dcec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f338dcec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42dcaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f338dcec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42ddbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f338dcec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560e42d302f0 con 0x560e42dca5d0 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f338dcec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560e42cd7cf0 con 0x560e42dcbb40 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f338dcec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560e42d2c2b0 con 0x560e42dd9780 2024-09-12T02:39:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42dcaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42dcaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35894/0 (socket says 172.21.15.100:35894) 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 -- 172.21.15.100:0/3028907272 learned_addr learned my addr 172.21.15.100:0/3028907272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f3389eb0640 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f3388eae640 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42ddbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f337a7fc640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33700a2c10 0x7f33700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 -- 172.21.15.100:0/3028907272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 msgr2=0x560e42ddbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42ddbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 -- 172.21.15.100:0/3028907272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 msgr2=0x560e42dca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 -- 172.21.15.100:0/3028907272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e42cbc3a0 con 0x560e42dca5d0 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f3389eb0640 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:23.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f3389eb0640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33700a2c10 0x7f33700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f337a7fc640 1 -- 172.21.15.100:0/2006528145 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f33800ef8b0 con 0x7f3384101420 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.806+0000 7f33896af640 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42dcaa10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f337400cbe0 tx=0x7f337400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a390767234624e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f336f7fe640 1 -- 172.21.15.100:0/3028907272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374005220 con 0x560e42dca5d0 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f336f7fe640 1 -- 172.21.15.100:0/3028907272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3374004c80 con 0x560e42dca5d0 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f336f7fe640 1 -- 172.21.15.100:0/3028907272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374010850 con 0x560e42dca5d0 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f338dcec740 1 -- 172.21.15.100:0/3028907272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 msgr2=0x560e42dcaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f3389eb0640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33700a2c10 0x7f33700a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f337c008e80 tx=0x7f337c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f338dcec740 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42dcaa10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f337400cbe0 tx=0x7f337400e720 comp rx=0 tx=0).stop 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f338dcec740 1 -- 172.21.15.100:0/3028907272 shutdown_connections 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f338dcec740 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42ddbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f338dcec740 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42dcaa10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f338dcec740 1 --2- 172.21.15.100:0/3028907272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.807+0000 7f338dcec740 1 -- 172.21.15.100:0/3028907272 >> 172.21.15.100:0/3028907272 conn(0x560e42d93310 msgr2=0x560e42dc6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:23.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 -- 172.21.15.100:0/3028907272 shutdown_connections 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 -- 172.21.15.100:0/3028907272 wait complete. 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 -- start start 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 Processor -- start 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42dd90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42dd63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560e42ddc480 con 0x560e42dcbb40 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560e42ceb060 con 0x560e42dca5d0 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560e42ddc600 con 0x560e42dd9780 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f338dcec740 10 client.0 _ll_register_callbacks cb 0x560e42a3e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f3388eae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42dd63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.808+0000 7f3388eae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42dd63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35904/0 (socket says 172.21.15.100:35904) 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3388eae640 1 -- 172.21.15.100:0/4014080505 learned_addr learned my addr 172.21.15.100:0/4014080505 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3389eb0640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f33896af640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42dd90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3388eae640 1 -- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 msgr2=0x560e42dd6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3388eae640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3388eae640 1 -- 172.21.15.100:0/4014080505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 msgr2=0x560e42dd90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3388eae640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42dd90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3388eae640 1 -- 172.21.15.100:0/4014080505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e42aa13c0 con 0x560e42dcbb40 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f33896af640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42dd90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f3388eae640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42dd63a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3380031550 tx=0x7f3380009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23a3f187322dca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f336cff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f336cff9640 1 -- 172.21.15.100:0/4014080505 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380049050 con 0x560e42dcbb40 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f336cff9640 1 -- 172.21.15.100:0/4014080505 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f338003bd00 con 0x560e42dcbb40 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3374004c80 con 0x560e42dcbb40 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f336cff9640 1 -- 172.21.15.100:0/4014080505 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f33800bd270 con 0x560e42dcbb40 2024-09-12T02:39:23.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f338dcec740 10 client.15420 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560e42de7e90 con 0x560e42dcbb40 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.809+0000 7f336cff9640 1 -- 172.21.15.100:0/4014080505 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3374004c80 con 0x560e42dcbb40 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f336cff9640 1 -- 172.21.15.100:0/4014080505 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f33800b85b0 con 0x560e42dcbb40 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f338dcec740 10 client.15420 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f338dcec740 10 client.15420 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f338dcec740 20 client.15420 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f338dcec740 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42de92a0 0x560e42deb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f338dcec740 4 client.15420 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e42d3d860 con 0x560e42de92a0 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f33896af640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42de92a0 0x560e42deb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f33896af640 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42de92a0 0x560e42deb6d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=638283778d01d55c server_cookie=eaa38aeb83606d64 in_seq=0 out_seq=0 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.810+0000 7f336cff9640 10 client.15420 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f336cff9640 1 -- 172.21.15.100:0/4014080505 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e42d3d860 con 0x560e42de92a0 2024-09-12T02:39:23.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f336cff9640 10 client.15420 handle_command_reply: tid=0 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 client.15420 shutdown 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 msgr2=0x560e42dd63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42dd63a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3380031550 tx=0x7f3380009650 comp rx=0 tx=0).stop 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 shutdown_connections 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42de92a0 0x560e42deb6d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42dd63a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 --2- 172.21.15.100:0/4014080505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42dd90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f336cff9640 0 client.15420 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 >> 172.21.15.100:0/4014080505 conn(0x560e42d93310 msgr2=0x560e42dcc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 shutdown_connections 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.811+0000 7f338dcec740 1 -- 172.21.15.100:0/4014080505 wait complete. 2024-09-12T02:39:23.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.812+0000 7f338dcec740 20 client.15420 trim_cache size 0 max 16384 2024-09-12T02:39:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.824+0000 7f338dcec740 1 Processor -- start 2024-09-12T02:39:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.824+0000 7f338dcec740 1 -- start start 2024-09-12T02:39:23.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f338dcec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42de5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f338dcec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dd5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f338dcec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dc6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f338dcec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33841adb70 con 0x560e42dca5d0 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f338dcec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33841ab440 con 0x560e42dcbb40 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f338dcec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33841a9290 con 0x560e42dd9780 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42de5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42de5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35918/0 (socket says 172.21.15.100:35918) 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 -- 172.21.15.100:0/2593390439 learned_addr learned my addr 172.21.15.100:0/2593390439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 -- 172.21.15.100:0/2593390439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 msgr2=0x560e42dc6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 --2- 172.21.15.100:0/2593390439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dc6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 -- 172.21.15.100:0/2593390439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 msgr2=0x560e42dd5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 --2- 172.21.15.100:0/2593390439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dd5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 -- 172.21.15.100:0/2593390439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e42dd48f0 con 0x560e42dca5d0 2024-09-12T02:39:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f33896af640 1 --2- 172.21.15.100:0/2593390439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42de5720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f337400cbb0 tx=0x7f33740058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4927c4187f0256f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f336effd640 1 -- 172.21.15.100:0/2593390439 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374005200 con 0x560e42dca5d0 2024-09-12T02:39:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f336effd640 1 -- 172.21.15.100:0/2593390439 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33740053a0 con 0x560e42dca5d0 2024-09-12T02:39:23.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.825+0000 7f336effd640 1 -- 172.21.15.100:0/2593390439 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33740268d0 con 0x560e42dca5d0 2024-09-12T02:39:23.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 -- 172.21.15.100:0/2593390439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 msgr2=0x560e42de5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 --2- 172.21.15.100:0/2593390439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42de5720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f337400cbb0 tx=0x7f33740058b0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 -- 172.21.15.100:0/2593390439 shutdown_connections 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 --2- 172.21.15.100:0/2593390439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dc6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 --2- 172.21.15.100:0/2593390439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dcbb40 0x560e42dd5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 --2- 172.21.15.100:0/2593390439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dca5d0 0x560e42de5720 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 -- 172.21.15.100:0/2593390439 >> 172.21.15.100:0/2593390439 conn(0x560e42d93310 msgr2=0x560e42dd1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 -- 172.21.15.100:0/2593390439 shutdown_connections 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 -- 172.21.15.100:0/2593390439 wait complete. 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 -- start start 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.826+0000 7f338dcec740 1 Processor -- start 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f338dcec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42de1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f338dcec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42de1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f338dcec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f338dcec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33841a9900 con 0x560e42dcbb40 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f338dcec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33841aad70 con 0x560e42dca5d0 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f338dcec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33841a9fd0 con 0x560e42dd9780 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f338dcec740 10 client.0 _ll_register_callbacks cb 0x7f3380009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42de1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42de1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35932/0 (socket says 172.21.15.100:35932) 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 -- 172.21.15.100:0/3708496003 learned_addr learned my addr 172.21.15.100:0/3708496003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f33896af640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42de1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3389eb0640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 -- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 msgr2=0x560e42dd2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 -- 172.21.15.100:0/3708496003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 msgr2=0x560e42de1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42de1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 -- 172.21.15.100:0/3708496003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e42dd33e0 con 0x560e42dcbb40 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3389eb0640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f33896af640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42de1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f3388eae640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42de1fb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33800ba1f0 tx=0x7f338003bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ce51877f5eb26c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.827+0000 7f336cff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f336cff9640 1 -- 172.21.15.100:0/3708496003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380049070 con 0x560e42dcbb40 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f336cff9640 1 -- 172.21.15.100:0/3708496003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f33800c4720 con 0x560e42dcbb40 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33740053a0 con 0x560e42dcbb40 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f336cff9640 1 -- 172.21.15.100:0/3708496003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f33800bba80 con 0x560e42dcbb40 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 10 client.15426 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560e42e53a30 con 0x560e42dcbb40 2024-09-12T02:39:23.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f336cff9640 1 -- 172.21.15.100:0/3708496003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33740053a0 con 0x560e42dcbb40 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f336cff9640 1 -- 172.21.15.100:0/3708496003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f33800c1690 con 0x560e42dcbb40 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 10 client.15426 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 10 client.15426 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 20 client.15426 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42e53f40 0x560e42e56360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 4 client.15426 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e42d37d70 con 0x560e42e53f40 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.828+0000 7f33896af640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42e53f40 0x560e42e56360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f336cff9640 10 client.15426 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f33896af640 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42e53f40 0x560e42e56360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cdb28dc1542a61eb server_cookie=298d0d283081f37b in_seq=0 out_seq=0 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f336cff9640 1 -- 172.21.15.100:0/3708496003 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e42d37d70 con 0x560e42e53f40 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f336cff9640 10 client.15426 handle_command_reply: tid=0 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 client.15426 shutdown 2024-09-12T02:39:23.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 msgr2=0x560e42de1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42de1fb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33800ba1f0 tx=0x7f338003bf10 comp rx=0 tx=0).stop 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 shutdown_connections 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x560e42e53f40 0x560e42e56360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e42dd9780 0x560e42dd2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e42dcbb40 0x560e42de1fb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 --2- 172.21.15.100:0/3708496003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e42dca5d0 0x560e42de1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 >> 172.21.15.100:0/3708496003 conn(0x560e42d93310 msgr2=0x560e42dc66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f336cff9640 0 client.15426 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 shutdown_connections 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.829+0000 7f338dcec740 1 -- 172.21.15.100:0/3708496003 wait complete. 2024-09-12T02:39:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338dcec740 20 client.15426 trim_cache size 0 max 16384 2024-09-12T02:39:23.836 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:39:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33700a2c10 msgr2=0x7f33700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33700a2c10 0x7f33700a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f337c008e80 tx=0x7f337c004a40 comp rx=0 tx=0).stop 2024-09-12T02:39:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384101420 msgr2=0x7f33841988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384101420 0x7f33841988c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3380009a50 tx=0x7f3380004270 comp rx=0 tx=0).stop 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 shutdown_connections 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33700a2c10 0x7f33700a50d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3384106a80 0x7f338419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384101420 0x7f33841988c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 --2- 172.21.15.100:0/2006528145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3384100a80 0x7f3384198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 >> 172.21.15.100:0/2006528145 conn(0x7f33840fc7a0 msgr2=0x7f33840fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 shutdown_connections 2024-09-12T02:39:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:23.830+0000 7f338b913640 1 -- 172.21.15.100:0/2006528145 wait complete. 2024-09-12T02:39:24.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:39:24.733 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:24.853 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:24 smithi100 ceph-mon[31390]: pgmap v358: 97 pgs: 97 active+clean; 916 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 32 MiB/s wr, 460 op/s 2024-09-12T02:39:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:24 smithi189 ceph-mon[35196]: pgmap v358: 97 pgs: 97 active+clean; 916 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 32 MiB/s wr, 460 op/s 2024-09-12T02:39:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:24 smithi117 ceph-mon[34898]: pgmap v358: 97 pgs: 97 active+clean; 916 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 32 MiB/s wr, 460 op/s 2024-09-12T02:39:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 -- 172.21.15.100:0/3385515162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4101420 msgr2=0x7f50c410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 --2- 172.21.15.100:0/3385515162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4101420 0x7f50c410d950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009cd0 tx=0x7f50bc02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 -- 172.21.15.100:0/3385515162 shutdown_connections 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 --2- 172.21.15.100:0/3385515162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4101420 0x7f50c410d950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 --2- 172.21.15.100:0/3385515162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4100a80 0x7f50c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 --2- 172.21.15.100:0/3385515162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 -- 172.21.15.100:0/3385515162 >> 172.21.15.100:0/3385515162 conn(0x7f50c40fc7a0 msgr2=0x7f50c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 -- 172.21.15.100:0/3385515162 shutdown_connections 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.202+0000 7f50cbab9640 1 -- 172.21.15.100:0/3385515162 wait complete. 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 Processor -- start 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 -- start start 2024-09-12T02:39:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c40fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c40fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c40fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4110f20 con 0x7f50c4100a80 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4110da0 con 0x7f50c4101420 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50cbab9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41110a0 con 0x7f50c4106a80 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c40fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c40fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34702/0 (socket says 172.21.15.100:34702) 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 -- 172.21.15.100:0/1025317859 learned_addr learned my addr 172.21.15.100:0/1025317859 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50ca056640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c40fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9054640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c40fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 -- 172.21.15.100:0/1025317859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 msgr2=0x7f50c40fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c40fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 -- 172.21.15.100:0/1025317859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 msgr2=0x7f50c40fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c40fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 -- 172.21.15.100:0/1025317859 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c41a69f0 con 0x7f50c4100a80 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.203+0000 7f50c9855640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c40fce50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f50b800b4a0 tx=0x7f50b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.204+0000 7f50b6ffd640 1 -- 172.21.15.100:0/1025317859 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8014070 con 0x7f50c4100a80 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.204+0000 7f50b6ffd640 1 -- 172.21.15.100:0/1025317859 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b8010af0 con 0x7f50c4100a80 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.204+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c41a6ce0 con 0x7f50c4100a80 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.204+0000 7f50b6ffd640 1 -- 172.21.15.100:0/1025317859 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8017d10 con 0x7f50c4100a80 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.204+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c41a7170 con 0x7f50c4100a80 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.206+0000 7f50b6ffd640 1 -- 172.21.15.100:0/1025317859 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f50b8017070 con 0x7f50c4100a80 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.206+0000 7f50cde92740 1 Processor -- start 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.206+0000 7f50cde92740 1 -- start start 2024-09-12T02:39:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50cde92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c40090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50cde92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c40a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50cde92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c4b370 0x55c490c4d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50cde92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c490ba62f0 con 0x55c490c41b40 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50cde92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c490b4dcf0 con 0x55c490c405d0 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50cde92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c490ba22b0 con 0x55c490c4b370 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c40090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c40090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34718/0 (socket says 172.21.15.100:34718) 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 -- 172.21.15.100:0/469316621 learned_addr learned my addr 172.21.15.100:0/469316621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50b6ffd640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2c10 0x7f50b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50c9855640 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c40a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50c9054640 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c4b370 0x55c490c4d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2c10 0x7f50b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50b6ffd640 1 -- 172.21.15.100:0/1025317859 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f50b80ce550 con 0x7f50c4100a80 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 -- 172.21.15.100:0/469316621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c4b370 msgr2=0x55c490c4d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c4b370 0x55c490c4d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 -- 172.21.15.100:0/469316621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 msgr2=0x55c490c40a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c40a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 -- 172.21.15.100:0/469316621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c490b323a0 con 0x55c490c41b40 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.207+0000 7f50ca056640 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c40090 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009430 tx=0x7f50bc031800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3396cc0413fdbd5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50ca056640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2c10 0x7f50b00a50d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005fe0 tx=0x7f50bc051000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50affff640 1 -- 172.21.15.100:0/469316621 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc003d40 con 0x55c490c41b40 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50affff640 1 -- 172.21.15.100:0/469316621 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50bc036040 con 0x55c490c41b40 2024-09-12T02:39:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50affff640 1 -- 172.21.15.100:0/469316621 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc003ee0 con 0x55c490c41b40 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50cde92740 1 -- 172.21.15.100:0/469316621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 msgr2=0x55c490c40090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50cde92740 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c40090 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009430 tx=0x7f50bc031800 comp rx=0 tx=0).stop 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50cde92740 1 -- 172.21.15.100:0/469316621 shutdown_connections 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50cde92740 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c4b370 0x55c490c4d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50cde92740 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c40a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50cde92740 1 --2- 172.21.15.100:0/469316621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c40090 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.208+0000 7f50cde92740 1 -- 172.21.15.100:0/469316621 >> 172.21.15.100:0/469316621 conn(0x55c490c09310 msgr2=0x55c490c3cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 -- 172.21.15.100:0/469316621 shutdown_connections 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 -- 172.21.15.100:0/469316621 wait complete. 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 -- start start 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 Processor -- start 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c4ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c47fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 0x55c490c48570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c490c4e010 con 0x55c490c41b40 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c490b61060 con 0x55c490c4b370 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c490c4e190 con 0x55c490c405d0 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50cde92740 10 client.0 _ll_register_callbacks cb 0x55c4908b48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50c9054640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c47fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50c9054640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c47fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34728/0 (socket says 172.21.15.100:34728) 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.209+0000 7f50c9054640 1 -- 172.21.15.100:0/1716526864 learned_addr learned my addr 172.21.15.100:0/1716526864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50c9855640 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c4ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50c9054640 1 -- 172.21.15.100:0/1716526864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 msgr2=0x55c490c4ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50c9054640 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c4ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50c9054640 1 -- 172.21.15.100:0/1716526864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 msgr2=0x55c490c48570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50c9054640 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 0x55c490c48570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50c9054640 1 -- 172.21.15.100:0/1716526864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4909173c0 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50c9054640 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c47fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50c0010500 tx=0x7f50c00109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbcc4bedd4169f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50ad7fa640 1 -- 172.21.15.100:0/1716526864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c001a020 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50ad7fa640 1 -- 172.21.15.100:0/1716526864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f50c0016750 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50bc036040 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50ad7fa640 1 -- 172.21.15.100:0/1716526864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f50c0025050 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50cde92740 10 client.15438 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c490c59ac0 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.210+0000 7f50ad7fa640 1 -- 172.21.15.100:0/1716526864 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50bc036040 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50ad7fa640 1 -- 172.21.15.100:0/1716526864 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f50c0014b90 con 0x55c490c41b40 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50cde92740 10 client.15438 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50cde92740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50cde92740 20 client.15438 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50cde92740 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490c5b020 0x55c490c5d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50cde92740 4 client.15438 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c490bb3860 con 0x55c490c5b020 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50c9855640 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490c5b020 0x55c490c5d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50ad7fa640 10 client.15438 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.211+0000 7f50c9855640 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490c5b020 0x55c490c5d460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b33837a112ba3c90 server_cookie=b26feb1b59abccac in_seq=0 out_seq=0 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50ad7fa640 1 -- 172.21.15.100:0/1716526864 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c490bb3860 con 0x55c490c5b020 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50ad7fa640 10 client.15438 handle_command_reply: tid=0 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 client.15438 shutdown 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 msgr2=0x55c490c47fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c47fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50c0010500 tx=0x7f50c00109c0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 shutdown_connections 2024-09-12T02:39:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490c5b020 0x55c490c5d460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 0x55c490c48570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c47fd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 --2- 172.21.15.100:0/1716526864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c4ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 >> 172.21.15.100:0/1716526864 conn(0x55c490c09310 msgr2=0x55c490c42930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50ad7fa640 0 client.15438 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 shutdown_connections 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 1 -- 172.21.15.100:0/1716526864 wait complete. 2024-09-12T02:39:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.212+0000 7f50cde92740 20 client.15438 trim_cache size 0 max 16384 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.225+0000 7f50cde92740 1 Processor -- start 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.225+0000 7f50cde92740 1 -- start start 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50cde92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50cde92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50cde92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 0x55c490c43660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50cde92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41add40 con 0x55c490c41b40 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50cde92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41ab610 con 0x55c490c4b370 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50cde92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41a9480 con 0x55c490c405d0 2024-09-12T02:39:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c43120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34738/0 (socket says 172.21.15.100:34738) 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 -- 172.21.15.100:0/3474498273 learned_addr learned my addr 172.21.15.100:0/3474498273 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9855640 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 -- 172.21.15.100:0/3474498273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 msgr2=0x55c490c572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50ca056640 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 0x55c490c43660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 -- 172.21.15.100:0/3474498273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 msgr2=0x55c490c43660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 0x55c490c43660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 -- 172.21.15.100:0/3474498273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c490c46520 con 0x55c490c41b40 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9855640 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50c9054640 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c43120 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f50c00104d0 tx=0x7f50c0006ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b51f1a8b47e0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50af7fe640 1 -- 172.21.15.100:0/3474498273 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c002e070 con 0x55c490c41b40 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50af7fe640 1 -- 172.21.15.100:0/3474498273 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50c000bd20 con 0x55c490c41b40 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.226+0000 7f50af7fe640 1 -- 172.21.15.100:0/3474498273 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c001a040 con 0x55c490c41b40 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 -- 172.21.15.100:0/3474498273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 msgr2=0x55c490c43120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c43120 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f50c00104d0 tx=0x7f50c0006ab0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 -- 172.21.15.100:0/3474498273 shutdown_connections 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c4b370 0x55c490c43660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c41b40 0x55c490c43120 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 --2- 172.21.15.100:0/3474498273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c405d0 0x55c490c572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 -- 172.21.15.100:0/3474498273 >> 172.21.15.100:0/3474498273 conn(0x55c490c09310 msgr2=0x55c490c470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 -- 172.21.15.100:0/3474498273 shutdown_connections 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 -- 172.21.15.100:0/3474498273 wait complete. 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.227+0000 7f50cde92740 1 -- start start 2024-09-12T02:39:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 1 Processor -- start 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c45020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c41b40 0x55c490c45560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c4b370 0x55c490c45aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41a9ad0 con 0x55c490c4b370 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41aaf40 con 0x55c490c405d0 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41aa1a0 con 0x55c490c41b40 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50cde92740 10 client.0 _ll_register_callbacks cb 0x7f50c000b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c4b370 0x55c490c45aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c4b370 0x55c490c45aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34746/0 (socket says 172.21.15.100:34746) 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50c9054640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c41b40 0x55c490c45560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 -- 172.21.15.100:0/29700195 learned_addr learned my addr 172.21.15.100:0/29700195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50c9855640 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c45020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 -- 172.21.15.100:0/29700195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c41b40 msgr2=0x55c490c45560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c41b40 0x55c490c45560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 -- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 msgr2=0x55c490c45020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c45020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.228+0000 7f50ca056640 1 -- 172.21.15.100:0/29700195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c490cc4d70 con 0x55c490c4b370 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50ca056640 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c4b370 0x55c490c45aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006010 tx=0x7f50bc0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e493ad91a485e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50ad7fa640 1 -- 172.21.15.100:0/29700195 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc060020 con 0x55c490c4b370 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50ad7fa640 1 -- 172.21.15.100:0/29700195 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f50bc04aaf0 con 0x55c490c4b370 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50c000bd20 con 0x55c490c4b370 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50ad7fa640 1 -- 172.21.15.100:0/29700195 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f50bc005bd0 con 0x55c490c4b370 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 10 client.15444 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:25.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c490cc6030 con 0x55c490c4b370 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50ad7fa640 1 -- 172.21.15.100:0/29700195 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50c000bd20 con 0x55c490c4b370 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50ad7fa640 1 -- 172.21.15.100:0/29700195 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f50bc030070 con 0x55c490c4b370 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 10 client.15444 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 20 client.15444 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490cc6420 0x55c490cc8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 4 client.15444 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.229+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c490badd70 con 0x55c490cc6420 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50c9855640 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490cc6420 0x55c490cc8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50ad7fa640 10 client.15444 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50c9855640 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490cc6420 0x55c490cc8810 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2469e009b44047e5 server_cookie=dd2ff4fc7a3d79dc in_seq=0 out_seq=0 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50ad7fa640 1 -- 172.21.15.100:0/29700195 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c490badd70 con 0x55c490cc6420 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50ad7fa640 10 client.15444 handle_command_reply: tid=0 2024-09-12T02:39:25.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50cde92740 1 client.15444 shutdown 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c4b370 msgr2=0x55c490c45aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.230+0000 7f50cde92740 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c4b370 0x55c490c45aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006010 tx=0x7f50bc0317b0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 shutdown_connections 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c490cc6420 0x55c490cc8810 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c490c4b370 0x55c490c45aa0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c490c41b40 0x55c490c45560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50ad7fa640 0 client.15444 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 --2- 172.21.15.100:0/29700195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c490c405d0 0x55c490c45020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 >> 172.21.15.100:0/29700195 conn(0x55c490c09310 msgr2=0x55c490c49830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 shutdown_connections 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 1 -- 172.21.15.100:0/29700195 wait complete. 2024-09-12T02:39:25.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cde92740 20 client.15444 trim_cache size 0 max 16384 2024-09-12T02:39:25.244 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:39:25.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2c10 msgr2=0x7f50b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2c10 0x7f50b00a50d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005fe0 tx=0x7f50bc051000 comp rx=0 tx=0).stop 2024-09-12T02:39:25.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 msgr2=0x7f50c40fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:25.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c40fce50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f50b800b4a0 tx=0x7f50b800b960 comp rx=0 tx=0).stop 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 shutdown_connections 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2c10 0x7f50b00a50d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c40fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c40fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 --2- 172.21.15.100:0/1025317859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c40fce50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 >> 172.21.15.100:0/1025317859 conn(0x7f50c40fc7a0 msgr2=0x7f50c406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 shutdown_connections 2024-09-12T02:39:25.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:25.231+0000 7f50cbab9640 1 -- 172.21.15.100:0/1025317859 wait complete. 2024-09-12T02:39:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 15.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:39:26.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:26 smithi100 ceph-mon[31390]: pgmap v359: 97 pgs: 97 active+clean; 930 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 25 MiB/s wr, 624 op/s 2024-09-12T02:39:26.989 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:39:26.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:39:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:26 smithi189 ceph-mon[35196]: pgmap v359: 97 pgs: 97 active+clean; 930 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 25 MiB/s wr, 624 op/s 2024-09-12T02:39:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:26 smithi117 ceph-mon[34898]: pgmap v359: 97 pgs: 97 active+clean; 930 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 25 MiB/s wr, 624 op/s 2024-09-12T02:39:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:27.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.715+0000 7f34a3589640 1 -- 172.21.15.100:0/2742809131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 msgr2=0x7f349c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.715+0000 7f34a3589640 1 --2- 172.21.15.100:0/2742809131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c101200 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f348c009900 tx=0x7f348c02a480 comp rx=0 tx=0).stop 2024-09-12T02:39:27.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.715+0000 7f34a3589640 1 -- 172.21.15.100:0/2742809131 shutdown_connections 2024-09-12T02:39:27.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.715+0000 7f34a3589640 1 --2- 172.21.15.100:0/2742809131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f349c102ef0 0x7f349c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.715+0000 7f34a3589640 1 --2- 172.21.15.100:0/2742809131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349c102570 0x7f349c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.715+0000 7f34a3589640 1 --2- 172.21.15.100:0/2742809131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c101200 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.715+0000 7f34a3589640 1 -- 172.21.15.100:0/2742809131 >> 172.21.15.100:0/2742809131 conn(0x7f349c0fc7d0 msgr2=0x7f349c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 -- 172.21.15.100:0/2742809131 shutdown_connections 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 -- 172.21.15.100:0/2742809131 wait complete. 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 Processor -- start 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 -- start start 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349c102570 0x7f349c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f349c102ef0 0x7f349c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f349c110f50 con 0x7f349c100e20 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f349c110dd0 con 0x7f349c102570 2024-09-12T02:39:27.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a3589640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1110d0 con 0x7f349c102ef0 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.716+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34770/0 (socket says 172.21.15.100:34770) 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 -- 172.21.15.100:0/3896940371 learned_addr learned my addr 172.21.15.100:0/3896940371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a0b24640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349c102570 0x7f349c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1b26640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f349c102ef0 0x7f349c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 -- 172.21.15.100:0/3896940371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f349c102ef0 msgr2=0x7f349c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f349c102ef0 0x7f349c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 -- 172.21.15.100:0/3896940371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349c102570 msgr2=0x7f349c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349c102570 0x7f349c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 -- 172.21.15.100:0/3896940371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c19d470 con 0x7f349c100e20 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1b26640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f349c102ef0 0x7f349c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a1325640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c1984c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f348c006010 tx=0x7f348c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:27.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34927fc640 1 -- 172.21.15.100:0/3896940371 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c03f070 con 0x7f349c100e20 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34927fc640 1 -- 172.21.15.100:0/3896940371 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f348c031c30 con 0x7f349c100e20 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c19d700 con 0x7f349c100e20 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34927fc640 1 -- 172.21.15.100:0/3896940371 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c035030 con 0x7f349c100e20 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.717+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c1a5040 con 0x7f349c100e20 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.719+0000 7f34927fc640 1 -- 172.21.15.100:0/3896940371 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f348c042070 con 0x7f349c100e20 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 Processor -- start 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 -- start start 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34927fc640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34880a2c10 0x7f34880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d99b60 0x557ba9d99f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a1b26640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34880a2c10 0x7f34880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9da4d40 0x557ba9da7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557ba9cff280 con 0x557ba9da4d40 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557ba9ca6b10 con 0x557ba9d9a480 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a5962740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557ba9cfb240 con 0x557ba9d99b60 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34927fc640 1 -- 172.21.15.100:0/3896940371 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f348c0efaa0 con 0x7f349c100e20 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a1b26640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9da4d40 0x557ba9da7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.720+0000 7f34a1b26640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9da4d40 0x557ba9da7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34782/0 (socket says 172.21.15.100:34782) 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a1b26640 1 -- 172.21.15.100:0/626146956 learned_addr learned my addr 172.21.15.100:0/626146956 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a0b24640 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a1325640 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d99b60 0x557ba9d99f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a1b26640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34880a2c10 0x7f34880a50d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3494012760 tx=0x7f3494012b60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a0b24640 1 -- 172.21.15.100:0/626146956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d99b60 msgr2=0x557ba9d99f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a0b24640 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d99b60 0x557ba9d99f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a0b24640 1 -- 172.21.15.100:0/626146956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9da4d40 msgr2=0x557ba9da7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a0b24640 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9da4d40 0x557ba9da7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a0b24640 1 -- 172.21.15.100:0/626146956 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ba9cb31f0 con 0x557ba9d9a480 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a1325640 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d99b60 0x557ba9d99f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34a0b24640 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da4800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f349800bbc0 tx=0x7f34980107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27572f6f7c7a7062 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34877fe640 1 -- 172.21.15.100:0/626146956 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498004030 con 0x557ba9d9a480 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34877fe640 1 -- 172.21.15.100:0/626146956 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34980041d0 con 0x557ba9d9a480 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.721+0000 7f34877fe640 1 -- 172.21.15.100:0/626146956 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34980116a0 con 0x557ba9d9a480 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 -- 172.21.15.100:0/626146956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 msgr2=0x557ba9da4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da4800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f349800bbc0 tx=0x7f34980107a0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 -- 172.21.15.100:0/626146956 shutdown_connections 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9da4d40 0x557ba9da7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da4800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 --2- 172.21.15.100:0/626146956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d99b60 0x557ba9d99f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 -- 172.21.15.100:0/626146956 >> 172.21.15.100:0/626146956 conn(0x557ba9d960f0 msgr2=0x557ba9d964d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 -- 172.21.15.100:0/626146956 shutdown_connections 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 -- 172.21.15.100:0/626146956 wait complete. 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 -- start start 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.722+0000 7f34a5962740 1 Processor -- start 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a5962740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a5962740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9da2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a5962740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a5962740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557ba9da7910 con 0x557ba9d99b60 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a5962740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557ba9cb9f10 con 0x557ba9da4d40 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a5962740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557ba9da7a90 con 0x557ba9d9a480 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a5962740 10 client.0 _ll_register_callbacks cb 0x557ba9c82a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34792/0 (socket says 172.21.15.100:34792) 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 -- 172.21.15.100:0/1876398365 learned_addr learned my addr 172.21.15.100:0/1876398365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1b26640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9da2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 -- 172.21.15.100:0/1876398365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 msgr2=0x557ba9da2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9da2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 -- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 msgr2=0x557ba9da2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a1325640 1 -- 172.21.15.100:0/1876398365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ba9a706a0 con 0x557ba9d99b60 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.723+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9da2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a1325640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da1bd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f348c0b8590 tx=0x7f348c0bbcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1448ca039c6a85f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f3484ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f3484ff9640 1 -- 172.21.15.100:0/1876398365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0d5060 con 0x557ba9d99b60 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f3484ff9640 1 -- 172.21.15.100:0/1876398365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f348c0c0170 con 0x557ba9d99b60 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34980041d0 con 0x557ba9d99b60 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f3484ff9640 1 -- 172.21.15.100:0/1876398365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f348c049040 con 0x557ba9d99b60 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 10 client.15456 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557ba9db34c0 con 0x557ba9d99b60 2024-09-12T02:39:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f3484ff9640 1 -- 172.21.15.100:0/1876398365 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34980041d0 con 0x557ba9d99b60 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f3484ff9640 1 -- 172.21.15.100:0/1876398365 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f348c0b87a0 con 0x557ba9d99b60 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 10 client.15456 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 20 client.15456 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9db4900 0x557ba9db6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 4 client.15456 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.724+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ba9d0c7f0 con 0x557ba9db4900 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.725+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9db4900 0x557ba9db6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.725+0000 7f3484ff9640 10 client.15456 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.725+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9db4900 0x557ba9db6d70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98ad9b96f8cfa6cd server_cookie=91778d4339da7f1f in_seq=0 out_seq=0 2024-09-12T02:39:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f3484ff9640 1 -- 172.21.15.100:0/1876398365 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ba9d0c7f0 con 0x557ba9db4900 2024-09-12T02:39:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f3484ff9640 10 client.15456 handle_command_reply: tid=0 2024-09-12T02:39:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 client.15456 shutdown 2024-09-12T02:39:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 msgr2=0x557ba9da1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da1bd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f348c0b8590 tx=0x7f348c0bbcf0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 shutdown_connections 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9db4900 0x557ba9db6d70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9da2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f3484ff9640 0 client.15456 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 --2- 172.21.15.100:0/1876398365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da1bd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 >> 172.21.15.100:0/1876398365 conn(0x557ba9d960f0 msgr2=0x557ba9d95270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 shutdown_connections 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 1 -- 172.21.15.100:0/1876398365 wait complete. 2024-09-12T02:39:27.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.726+0000 7f34a5962740 20 client.15456 trim_cache size 0 max 16384 2024-09-12T02:39:27.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 Processor -- start 2024-09-12T02:39:27.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 -- start start 2024-09-12T02:39:27.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9dbc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9dbcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1afe00 con 0x557ba9d99b60 2024-09-12T02:39:27.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1ad6d0 con 0x557ba9da4d40 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a5962740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1ab520 con 0x557ba9d9a480 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9dbc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9dbc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34794/0 (socket says 172.21.15.100:34794) 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 -- 172.21.15.100:0/3904079591 learned_addr learned my addr 172.21.15.100:0/3904079591 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1b26640 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a0b24640 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9dbcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 -- 172.21.15.100:0/3904079591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 msgr2=0x557ba9dbcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9dbcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 -- 172.21.15.100:0/3904079591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 msgr2=0x557ba9da3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1325640 1 -- 172.21.15.100:0/3904079591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ba9d9c9d0 con 0x557ba9d99b60 2024-09-12T02:39:27.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.744+0000 7f34a1b26640 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:27.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a1325640 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9dbc680 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f348c005ab0 tx=0x7f348c0bc5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabc780fcbefae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:27.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f3486ffd640 1 -- 172.21.15.100:0/3904079591 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0cb070 con 0x557ba9d99b60 2024-09-12T02:39:27.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f3486ffd640 1 -- 172.21.15.100:0/3904079591 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f348c0c04e0 con 0x557ba9d99b60 2024-09-12T02:39:27.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f3486ffd640 1 -- 172.21.15.100:0/3904079591 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0c0170 con 0x557ba9d99b60 2024-09-12T02:39:27.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a5962740 1 -- 172.21.15.100:0/3904079591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 msgr2=0x557ba9dbc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a5962740 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9dbc680 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f348c005ab0 tx=0x7f348c0bc5a0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a5962740 1 -- 172.21.15.100:0/3904079591 shutdown_connections 2024-09-12T02:39:27.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a5962740 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9da4d40 0x557ba9da3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a5962740 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9d9a480 0x557ba9dbcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a5962740 1 --2- 172.21.15.100:0/3904079591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9dbc680 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.745+0000 7f34a5962740 1 -- 172.21.15.100:0/3904079591 >> 172.21.15.100:0/3904079591 conn(0x557ba9d960f0 msgr2=0x557ba9da0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 -- 172.21.15.100:0/3904079591 shutdown_connections 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 -- 172.21.15.100:0/3904079591 wait complete. 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 -- start start 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 Processor -- start 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9da4d40 0x557ba9e1e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1abb90 con 0x557ba9d99b60 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1ad000 con 0x557ba9d9a480 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1ac260 con 0x557ba9da4d40 2024-09-12T02:39:27.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a5962740 10 client.0 _ll_register_callbacks cb 0x7f348c005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a1325640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34806/0 (socket says 172.21.15.100:34806) 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.746+0000 7f34a1325640 1 -- 172.21.15.100:0/1299079117 learned_addr learned my addr 172.21.15.100:0/1299079117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1b26640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9da4d40 0x557ba9e1e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1325640 1 -- 172.21.15.100:0/1299079117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9da4d40 msgr2=0x557ba9e1e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1325640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9da4d40 0x557ba9e1e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1325640 1 -- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 msgr2=0x557ba9da9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1325640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1325640 1 -- 172.21.15.100:0/1299079117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ba9e1eb90 con 0x557ba9d99b60 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1b26640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9da4d40 0x557ba9e1e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a1325640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da90d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f348c0bc0c0 tx=0x7f348c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77774a1793673414 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:27.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f3484ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f3484ff9640 1 -- 172.21.15.100:0/1299079117 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0bc830 con 0x557ba9d99b60 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f3484ff9640 1 -- 172.21.15.100:0/1299079117 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f348c0c4910 con 0x557ba9d99b60 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f348c0c04e0 con 0x557ba9d99b60 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f3484ff9640 1 -- 172.21.15.100:0/1299079117 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f348c0d0390 con 0x557ba9d99b60 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a5962740 10 client.15462 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557ba9e1eb90 con 0x557ba9d99b60 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.747+0000 7f3484ff9640 1 -- 172.21.15.100:0/1299079117 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f348c0c04e0 con 0x557ba9d99b60 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f3484ff9640 1 -- 172.21.15.100:0/1299079117 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f348c0bb580 con 0x557ba9d99b60 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a5962740 10 client.15462 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a5962740 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a5962740 20 client.15462 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a5962740 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9e1fff0 0x557ba9e223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:27.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a5962740 4 client.15462 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557ba9d06d00 con 0x557ba9e1fff0 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9e1fff0 0x557ba9e223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f34a0b24640 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9e1fff0 0x557ba9e223e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae837f06bc05cb93 server_cookie=bc92060dbb51b8aa in_seq=0 out_seq=0 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.748+0000 7f3484ff9640 10 client.15462 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.749+0000 7f3484ff9640 1 -- 172.21.15.100:0/1299079117 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557ba9d06d00 con 0x557ba9e1fff0 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.749+0000 7f3484ff9640 10 client.15462 handle_command_reply: tid=0 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.749+0000 7f34a5962740 1 client.15462 shutdown 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 msgr2=0x557ba9da90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da90d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f348c0bc0c0 tx=0x7f348c005b50 comp rx=0 tx=0).stop 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 shutdown_connections 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ba9e1fff0 0x557ba9e223e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ba9da4d40 0x557ba9e1e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ba9d9a480 0x557ba9da9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 --2- 172.21.15.100:0/1299079117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ba9d99b60 0x557ba9da90d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 >> 172.21.15.100:0/1299079117 conn(0x557ba9d960f0 msgr2=0x557ba9d9b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f3484ff9640 0 client.15462 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 shutdown_connections 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 1 -- 172.21.15.100:0/1299079117 wait complete. 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a5962740 20 client.15462 trim_cache size 0 max 16384 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "e22feb51-9e68-4868-9b85-ee88442ef60b", 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:39:27.756 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34880a2c10 msgr2=0x7f34880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a3589640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34880a2c10 0x7f34880a50d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3494012760 tx=0x7f3494012b60 comp rx=0 tx=0).stop 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 msgr2=0x7f349c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.750+0000 7f34a3589640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c1984c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f348c006010 tx=0x7f348c003c10 comp rx=0 tx=0).stop 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 shutdown_connections 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34880a2c10 0x7f34880a50d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f349c102ef0 0x7f349c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349c102570 0x7f349c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 --2- 172.21.15.100:0/3896940371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c100e20 0x7f349c1984c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 >> 172.21.15.100:0/3896940371 conn(0x7f349c0fc7d0 msgr2=0x7f349c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 shutdown_connections 2024-09-12T02:39:27.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:27.751+0000 7f34a3589640 1 -- 172.21.15.100:0/3896940371 wait complete. 2024-09-12T02:39:28.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:39:28.709 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:28.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:28 smithi100 ceph-mon[31390]: pgmap v360: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 12 MiB/s wr, 616 op/s 2024-09-12T02:39:28.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:28 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:39:28.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:28 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:28.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:28 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:39:28.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:28 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:39:28.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:28 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:28.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:28 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:28 smithi189 ceph-mon[35196]: pgmap v360: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 12 MiB/s wr, 616 op/s 2024-09-12T02:39:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:28 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:39:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:28 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:28 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:39:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:28 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:39:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:28 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:29.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:28 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:29.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:28 smithi117 ceph-mon[34898]: pgmap v360: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 12 MiB/s wr, 616 op/s 2024-09-12T02:39:29.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:28 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:39:29.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:28 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:29.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:28 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:39:29.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:28 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:39:29.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:28 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:29.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:28 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:39:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 -- 172.21.15.100:0/2029705368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 msgr2=0x7f07401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 --2- 172.21.15.100:0/2029705368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f07401067e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f073c009900 tx=0x7f073c02a410 comp rx=0 tx=0).stop 2024-09-12T02:39:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 -- 172.21.15.100:0/2029705368 shutdown_connections 2024-09-12T02:39:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 --2- 172.21.15.100:0/2029705368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740106f10 0x7f074010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 --2- 172.21.15.100:0/2029705368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f07401067e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 --2- 172.21.15.100:0/2029705368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0740101de0 0x7f07401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 -- 172.21.15.100:0/2029705368 >> 172.21.15.100:0/2029705368 conn(0x7f07400fd8c0 msgr2=0x7f07400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 -- 172.21.15.100:0/2029705368 shutdown_connections 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.191+0000 7f0748336640 1 -- 172.21.15.100:0/2029705368 wait complete. 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 Processor -- start 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 -- start start 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740101de0 0x7f07400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f0740074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0740106f10 0x7f0740074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0740111f70 con 0x7f0740102790 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0740111df0 con 0x7f0740106f10 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f0748336640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07401120f0 con 0x7f0740101de0 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f0740074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f0740074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34822/0 (socket says 172.21.15.100:34822) 2024-09-12T02:39:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 -- 172.21.15.100:0/4167491894 learned_addr learned my addr 172.21.15.100:0/4167491894 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07460d2640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740101de0 0x7f07400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07468d3640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0740106f10 0x7f0740074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 -- 172.21.15.100:0/4167491894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740101de0 msgr2=0x7f07400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740101de0 0x7f07400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 -- 172.21.15.100:0/4167491894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0740106f10 msgr2=0x7f0740074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0740106f10 0x7f0740074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07458d1640 1 -- 172.21.15.100:0/4167491894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07401a6930 con 0x7f0740102790 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07460d2640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740101de0 0x7f07400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.192+0000 7f07468d3640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0740106f10 0x7f0740074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.193+0000 7f07458d1640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f0740074a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f073c005ab0 tx=0x7f073c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.193+0000 7f07337fe640 1 -- 172.21.15.100:0/4167491894 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c03f030 con 0x7f0740102790 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.193+0000 7f07337fe640 1 -- 172.21.15.100:0/4167491894 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f073c003ce0 con 0x7f0740102790 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.193+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07401a6bc0 con 0x7f0740102790 2024-09-12T02:39:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.193+0000 7f07337fe640 1 -- 172.21.15.100:0/4167491894 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c035070 con 0x7f0740102790 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.193+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07401a70f0 con 0x7f0740102790 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.195+0000 7f07337fe640 1 -- 172.21.15.100:0/4167491894 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f073c042030 con 0x7f0740102790 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.195+0000 7f074a70f740 1 Processor -- start 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f074a70f740 1 -- start start 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f074a70f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eae8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f074a70f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eae8dc0 0x55d38eaf3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f074a70f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eaf3680 0x55d38eaf5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f074a70f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d38ea4e2e0 con 0x55d38eaf3680 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f074a70f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d38e9f5ce0 con 0x55d38eae84a0 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f074a70f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d38ea4a2a0 con 0x55d38eae8dc0 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eaf3680 0x55d38eaf5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eaf3680 0x55d38eaf5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34834/0 (socket says 172.21.15.100:34834) 2024-09-12T02:39:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 -- 172.21.15.100:0/803766597 learned_addr learned my addr 172.21.15.100:0/803766597 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07468d3640 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eae8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07460d2640 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eae8dc0 0x55d38eaf3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07337fe640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f072c0a2c90 0x7f072c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07468d3640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f072c0a2c90 0x7f072c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 -- 172.21.15.100:0/803766597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eae8dc0 msgr2=0x55d38eaf3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eae8dc0 0x55d38eaf3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 -- 172.21.15.100:0/803766597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 msgr2=0x55d38eae8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eae8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07337fe640 1 -- 172.21.15.100:0/4167491894 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f073c0ef730 con 0x7f0740102790 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.196+0000 7f07458d1640 1 -- 172.21.15.100:0/803766597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d38e9da440 con 0x55d38eaf3680 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.197+0000 7f07458d1640 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eaf3680 0x55d38eaf5a70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f073c0ed010 tx=0x7f073c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf53ab8b1f22068 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.197+0000 7f07468d3640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f072c0a2c90 0x7f072c0a5150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f07380127f0 tx=0x7f0738004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.197+0000 7f0730dea640 1 -- 172.21.15.100:0/803766597 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c049070 con 0x55d38eaf3680 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.197+0000 7f0730dea640 1 -- 172.21.15.100:0/803766597 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f073c0bc520 con 0x55d38eaf3680 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.197+0000 7f0730dea640 1 -- 172.21.15.100:0/803766597 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c0c4a90 con 0x55d38eaf3680 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.197+0000 7f074a70f740 1 -- 172.21.15.100:0/803766597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eaf3680 msgr2=0x55d38eaf5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.197+0000 7f074a70f740 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eaf3680 0x55d38eaf5a70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f073c0ed010 tx=0x7f073c02a410 comp rx=0 tx=0).stop 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- 172.21.15.100:0/803766597 shutdown_connections 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eaf3680 0x55d38eaf5a70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eae8dc0 0x55d38eaf3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 --2- 172.21.15.100:0/803766597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eae8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- 172.21.15.100:0/803766597 >> 172.21.15.100:0/803766597 conn(0x55d38eae4a30 msgr2=0x55d38eae4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- 172.21.15.100:0/803766597 shutdown_connections 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- 172.21.15.100:0/803766597 wait complete. 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- start start 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 Processor -- start 2024-09-12T02:39:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eaf2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae8dc0 0x55d38eaf0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d38eaf6010 con 0x55d38eae8dc0 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d38ea09050 con 0x55d38eae84a0 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d38eaf6190 con 0x55d38eaf3680 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f074a70f740 10 client.0 _ll_register_callbacks cb 0x55d38ea49160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f07458d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae8dc0 0x55d38eaf0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f07458d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae8dc0 0x55d38eaf0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34842/0 (socket says 172.21.15.100:34842) 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.198+0000 7f07458d1640 1 -- 172.21.15.100:0/1969920936 learned_addr learned my addr 172.21.15.100:0/1969920936 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07468d3640 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07458d1640 1 -- 172.21.15.100:0/1969920936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 msgr2=0x55d38eaf0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07460d2640 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eaf2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07458d1640 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07458d1640 1 -- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 msgr2=0x55d38eaf2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07458d1640 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eaf2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07458d1640 1 -- 172.21.15.100:0/1969920936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d38e7bf3c0 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f07458d1640 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae8dc0 0x55d38eaf0220 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f073c000c00 tx=0x7f073c0f5360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac42862dd61e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f0729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f0729ffb640 1 -- 172.21.15.100:0/1969920936 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c049070 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f0729ffb640 1 -- 172.21.15.100:0/1969920936 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f073c0b8490 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073c0bc520 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f0729ffb640 1 -- 172.21.15.100:0/1969920936 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f073c0bb960 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f074a70f740 10 client.15474 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d38eaf6010 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f0729ffb640 1 -- 172.21.15.100:0/1969920936 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f073c0bc520 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.199+0000 7f0729ffb640 1 -- 172.21.15.100:0/1969920936 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f073c0b7b70 con 0x55d38eae8dc0 2024-09-12T02:39:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f074a70f740 10 client.15474 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f074a70f740 10 client.15474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f074a70f740 20 client.15474 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f074a70f740 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb02c70 0x55d38eb050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f074a70f740 4 client.15474 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d38ea5b850 con 0x55d38eb02c70 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f07460d2640 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb02c70 0x55d38eb050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f0729ffb640 10 client.15474 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.200+0000 7f07460d2640 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb02c70 0x55d38eb050b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713db99351d0e23 server_cookie=d935593296140f63 in_seq=0 out_seq=0 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f0729ffb640 1 -- 172.21.15.100:0/1969920936 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d38ea5b850 con 0x55d38eb02c70 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f0729ffb640 10 client.15474 handle_command_reply: tid=0 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 client.15474 shutdown 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae8dc0 msgr2=0x55d38eaf0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae8dc0 0x55d38eaf0220 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f073c000c00 tx=0x7f073c0f5360 comp rx=0 tx=0).stop 2024-09-12T02:39:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 shutdown_connections 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb02c70 0x55d38eb050b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae8dc0 0x55d38eaf0220 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 --2- 172.21.15.100:0/1969920936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae84a0 0x55d38eaf2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f0729ffb640 0 client.15474 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 >> 172.21.15.100:0/1969920936 conn(0x55d38eae4a30 msgr2=0x55d38eaea760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 shutdown_connections 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 1 -- 172.21.15.100:0/1969920936 wait complete. 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.201+0000 7f074a70f740 20 client.15474 trim_cache size 0 max 16384 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 Processor -- start 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 -- start start 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eaff270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaef200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eb0a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07401b2080 con 0x55d38eae84a0 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07401af950 con 0x55d38eae8dc0 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f074a70f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07401ad7a0 con 0x55d38eaf3680 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f07460d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eaff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f07460d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eaff270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34858/0 (socket says 172.21.15.100:34858) 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.218+0000 7f07460d2640 1 -- 172.21.15.100:0/2171942406 learned_addr learned my addr 172.21.15.100:0/2171942406 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07458d1640 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07468d3640 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eb0a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07460d2640 1 -- 172.21.15.100:0/2171942406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 msgr2=0x55d38eb0a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07460d2640 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eb0a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07460d2640 1 -- 172.21.15.100:0/2171942406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 msgr2=0x55d38eaef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07460d2640 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07460d2640 1 -- 172.21.15.100:0/2171942406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d38eae4860 con 0x55d38eae84a0 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f07460d2640 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eaff270 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x55d38eb058f0 tx=0x7f073400c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a9fff7b922570f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f072bfff640 1 -- 172.21.15.100:0/2171942406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073401e070 con 0x55d38eae84a0 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f072bfff640 1 -- 172.21.15.100:0/2171942406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0734004c10 con 0x55d38eae84a0 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.219+0000 7f072bfff640 1 -- 172.21.15.100:0/2171942406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073401a520 con 0x55d38eae84a0 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 -- 172.21.15.100:0/2171942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 msgr2=0x55d38eaff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eaff270 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x55d38eb058f0 tx=0x7f073400c4f0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 -- 172.21.15.100:0/2171942406 shutdown_connections 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eb0a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 --2- 172.21.15.100:0/2171942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eaff270 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 -- 172.21.15.100:0/2171942406 >> 172.21.15.100:0/2171942406 conn(0x55d38eae4a30 msgr2=0x55d38eaeeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 -- 172.21.15.100:0/2171942406 shutdown_connections 2024-09-12T02:39:29.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 -- 172.21.15.100:0/2171942406 wait complete. 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 -- start start 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.220+0000 7f074a70f740 1 Processor -- start 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eafbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaf6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07401ade10 con 0x55d38eae84a0 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07401af280 con 0x55d38eae8dc0 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07401ae4e0 con 0x55d38eaf3680 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 10 client.0 _ll_register_callbacks cb 0x7f073800a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eafbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eafbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34872/0 (socket says 172.21.15.100:34872) 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 -- 172.21.15.100:0/853464891 learned_addr learned my addr 172.21.15.100:0/853464891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07458d1640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaf6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07468d3640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 -- 172.21.15.100:0/853464891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 msgr2=0x55d38eaf7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 -- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 msgr2=0x55d38eaf6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaf6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 -- 172.21.15.100:0/853464891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d38eb6c950 con 0x55d38eae84a0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07458d1640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaf6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f07460d2640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eafbc80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0734011fd0 tx=0x7f0734011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3b815f5068fd6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f0729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f0729ffb640 1 -- 172.21.15.100:0/853464891 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073401e040 con 0x55d38eae84a0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f0729ffb640 1 -- 172.21.15.100:0/853464891 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f0734004a10 con 0x55d38eae84a0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.221+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0734004c10 con 0x55d38eae84a0 2024-09-12T02:39:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f0729ffb640 1 -- 172.21.15.100:0/853464891 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0734004dc0 con 0x55d38eae84a0 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 10 client.15480 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d38eb6dab0 con 0x55d38eae84a0 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f0729ffb640 1 -- 172.21.15.100:0/853464891 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0734004c10 con 0x55d38eae84a0 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f0729ffb640 1 -- 172.21.15.100:0/853464891 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f07340357f0 con 0x55d38eae84a0 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stdout: "e22feb51-9e68-4868-9b85-ee88442ef60b": { 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:39:29.243 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "e22feb51-9e68-4868-9b85-ee88442ef60b", 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 10 client.15480 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 20 client.15480 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb6e140 0x55d38eb70560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 4 client.15480 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:39:29.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d38ea55d60 con 0x55d38eb6e140 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.222+0000 7f07458d1640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb6e140 0x55d38eb70560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f07458d1640 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb6e140 0x55d38eb70560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77d0077b15f7ddb2 server_cookie=f5362fe11c2dc7b3 in_seq=0 out_seq=0 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f0729ffb640 10 client.15480 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f0729ffb640 1 -- 172.21.15.100:0/853464891 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d38ea55d60 con 0x55d38eb6e140 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f0729ffb640 10 client.15480 handle_command_reply: tid=0 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 client.15480 shutdown 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 msgr2=0x55d38eafbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eafbc80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0734011fd0 tx=0x7f0734011670 comp rx=0 tx=0).stop 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 shutdown_connections 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d38eb6e140 0x55d38eb70560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d38eaf3680 0x55d38eaf7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d38eae8dc0 0x55d38eaf6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f0729ffb640 0 client.15480 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:29.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 --2- 172.21.15.100:0/853464891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d38eae84a0 0x55d38eafbc80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 >> 172.21.15.100:0/853464891 conn(0x55d38eae4a30 msgr2=0x55d38eaef310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 shutdown_connections 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 1 -- 172.21.15.100:0/853464891 wait complete. 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.223+0000 7f074a70f740 20 client.15480 trim_cache size 0 max 16384 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f072c0a2c90 msgr2=0x7f072c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f072c0a2c90 0x7f072c0a5150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f07380127f0 tx=0x7f0738004ab0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 msgr2=0x7f0740074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f0740074a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f073c005ab0 tx=0x7f073c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 shutdown_connections 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f072c0a2c90 0x7f072c0a5150 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0740106f10 0x7f0740074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0740102790 0x7f0740074a30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 --2- 172.21.15.100:0/4167491894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740101de0 0x7f07400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:29.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 >> 172.21.15.100:0/4167491894 conn(0x7f07400fd8c0 msgr2=0x7f07400fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:29.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 shutdown_connections 2024-09-12T02:39:29.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:29.224+0000 7f0748336640 1 -- 172.21.15.100:0/4167491894 wait complete. 2024-09-12T02:39:29.927 INFO:tasks.cephfs.filesystem:scrub status for tag:e22feb51-9e68-4868-9b85-ee88442ef60b - {'path': '/', 'tag': 'e22feb51-9e68-4868-9b85-ee88442ef60b', 'options': 'recursive,force'} 2024-09-12T02:39:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:30 smithi100 ceph-mon[31390]: pgmap v361: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.3 MiB/s wr, 465 op/s 2024-09-12T02:39:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:30 smithi189 ceph-mon[35196]: pgmap v361: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.3 MiB/s wr, 465 op/s 2024-09-12T02:39:31.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:30 smithi117 ceph-mon[34898]: pgmap v361: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.3 MiB/s wr, 465 op/s 2024-09-12T02:39:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 20.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:39:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:32 smithi100 ceph-mon[31390]: pgmap v362: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 4.7 MiB/s wr, 384 op/s 2024-09-12T02:39:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:32 smithi189 ceph-mon[35196]: pgmap v362: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 4.7 MiB/s wr, 384 op/s 2024-09-12T02:39:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:32 smithi117 ceph-mon[34898]: pgmap v362: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 4.7 MiB/s wr, 384 op/s 2024-09-12T02:39:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:34 smithi100 ceph-mon[31390]: pgmap v363: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.3 MiB/s wr, 200 op/s 2024-09-12T02:39:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:34 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:39:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:34 smithi189 ceph-mon[35196]: pgmap v363: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.3 MiB/s wr, 200 op/s 2024-09-12T02:39:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:34 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:39:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:34 smithi117 ceph-mon[34898]: pgmap v363: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.3 MiB/s wr, 200 op/s 2024-09-12T02:39:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:34 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:39:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:35 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:39:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:35 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:39:36.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:35 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:39:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 25.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:39:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:36 smithi100 ceph-mon[31390]: pgmap v364: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 1.8 MiB/s wr, 180 op/s 2024-09-12T02:39:36.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:36 smithi189 ceph-mon[35196]: pgmap v364: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 1.8 MiB/s wr, 180 op/s 2024-09-12T02:39:36.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:36 smithi117 ceph-mon[34898]: pgmap v364: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 1.8 MiB/s wr, 180 op/s 2024-09-12T02:39:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:38 smithi100 ceph-mon[31390]: pgmap v365: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-09-12T02:39:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:38 smithi189 ceph-mon[35196]: pgmap v365: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-09-12T02:39:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:38 smithi117 ceph-mon[34898]: pgmap v365: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-09-12T02:39:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:40 smithi189 ceph-mon[35196]: pgmap v366: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-12T02:39:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:40 smithi117 ceph-mon[34898]: pgmap v366: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-12T02:39:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:40 smithi100 ceph-mon[31390]: pgmap v366: 97 pgs: 97 active+clean; 930 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-12T02:39:41.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:39:41.302 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 30.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:39:41.404 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:41.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 -- 172.21.15.100:0/519144495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398101420 msgr2=0x7f239810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 --2- 172.21.15.100:0/519144495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398101420 0x7f239810d950 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2390009cd0 tx=0x7f239002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 -- 172.21.15.100:0/519144495 shutdown_connections 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 --2- 172.21.15.100:0/519144495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398101420 0x7f239810d950 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 --2- 172.21.15.100:0/519144495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2398100a80 0x7f2398100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 --2- 172.21.15.100:0/519144495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2398106a80 0x7f2398106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 -- 172.21.15.100:0/519144495 >> 172.21.15.100:0/519144495 conn(0x7f23980fc7a0 msgr2=0x7f23980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 -- 172.21.15.100:0/519144495 shutdown_connections 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.884+0000 7f239d89d640 1 -- 172.21.15.100:0/519144495 wait complete. 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 Processor -- start 2024-09-12T02:39:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 -- start start 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2398100a80 0x7f2398197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2398101420 0x7f2398197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398106a80 0x7f239819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2398110e80 con 0x7f2398106a80 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2398110d00 con 0x7f2398100a80 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f239d89d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111000 con 0x7f2398101420 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f23977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398106a80 0x7f239819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f23977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398106a80 0x7f239819bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37114/0 (socket says 172.21.15.100:37114) 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f23977fe640 1 -- 172.21.15.100:0/1882529022 learned_addr learned my addr 172.21.15.100:0/1882529022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f2396ffd640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2398100a80 0x7f2398197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.885+0000 7f23967fc640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2398101420 0x7f2398197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f23977fe640 1 -- 172.21.15.100:0/1882529022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2398101420 msgr2=0x7f2398197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f23977fe640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2398101420 0x7f2398197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f23977fe640 1 -- 172.21.15.100:0/1882529022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2398100a80 msgr2=0x7f2398197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f23977fe640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2398100a80 0x7f2398197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f23977fe640 1 -- 172.21.15.100:0/1882529022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239819c2d0 con 0x7f2398106a80 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f23977fe640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398106a80 0x7f239819bbf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2390005cc0 tx=0x7f2390003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f239c89b640 1 -- 172.21.15.100:0/1882529022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390004040 con 0x7f2398106a80 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f239c89b640 1 -- 172.21.15.100:0/1882529022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23900046c0 con 0x7f2398106a80 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f239c89b640 1 -- 172.21.15.100:0/1882529022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390046480 con 0x7f2398106a80 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239819c560 con 0x7f2398106a80 2024-09-12T02:39:41.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.886+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23981a3ea0 con 0x7f2398106a80 2024-09-12T02:39:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.887+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2398100ee0 con 0x7f2398106a80 2024-09-12T02:39:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.888+0000 7f239c89b640 1 -- 172.21.15.100:0/1882529022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7f23900305a0 con 0x7f2398106a80 2024-09-12T02:39:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.889+0000 7f239c89b640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23800a2c10 0x7f23800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.889+0000 7f2396ffd640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23800a2c10 0x7f23800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.889+0000 7f239c89b640 1 -- 172.21.15.100:0/1882529022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f239002e030 con 0x7f2398106a80 2024-09-12T02:39:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.889+0000 7f2396ffd640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23800a2c10 0x7f23800a50d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2388005fd0 tx=0x7f238800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:41.893+0000 7f239c89b640 1 -- 172.21.15.100:0/1882529022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f239004b060 con 0x7f2398106a80 2024-09-12T02:39:42.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.094+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2398109050 con 0x7f2398106a80 2024-09-12T02:39:42.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.095+0000 7f239c89b640 1 -- 172.21.15.100:0/1882529022 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7f23900bd740 con 0x7f2398106a80 2024-09-12T02:39:42.095 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:39:42.095 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:38:59:560858+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:59.510722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:39:42.096 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:39:42.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23800a2c10 msgr2=0x7f23800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:42.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23800a2c10 0x7f23800a50d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2388005fd0 tx=0x7f238800b390 comp rx=0 tx=0).stop 2024-09-12T02:39:42.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398106a80 msgr2=0x7f239819bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398106a80 0x7f239819bbf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2390005cc0 tx=0x7f2390003970 comp rx=0 tx=0).stop 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 shutdown_connections 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23800a2c10 0x7f23800a50d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2398106a80 0x7f239819bbf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2398101420 0x7f2398197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 --2- 172.21.15.100:0/1882529022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2398100a80 0x7f2398197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 >> 172.21.15.100:0/1882529022 conn(0x7f23980fc7a0 msgr2=0x7f23980fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 shutdown_connections 2024-09-12T02:39:42.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:42.097+0000 7f239d89d640 1 -- 172.21.15.100:0/1882529022 wait complete. 2024-09-12T02:39:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:42 smithi100 ceph-mon[31390]: pgmap v367: 97 pgs: 97 active+clean; 946 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 MiB/s wr, 74 op/s 2024-09-12T02:39:42.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:42 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1882529022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:42 smithi189 ceph-mon[35196]: pgmap v367: 97 pgs: 97 active+clean; 946 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 MiB/s wr, 74 op/s 2024-09-12T02:39:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:42 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1882529022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:43.034 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 936b729e --release --await' 2024-09-12T02:39:43.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 936b729e --release --await 2024-09-12T02:39:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:42 smithi117 ceph-mon[34898]: pgmap v367: 97 pgs: 97 active+clean; 946 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 MiB/s wr, 74 op/s 2024-09-12T02:39:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:42 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1882529022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:39:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:43.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.742+0000 7fdf31e40640 1 -- 172.21.15.100:0/2227928017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 msgr2=0x7fdf2c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.742+0000 7fdf31e40640 1 --2- 172.21.15.100:0/2227928017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c107ba0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009930 tx=0x7fdf2002a420 comp rx=0 tx=0).stop 2024-09-12T02:39:43.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.742+0000 7fdf31e40640 1 -- 172.21.15.100:0/2227928017 shutdown_connections 2024-09-12T02:39:43.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.742+0000 7fdf31e40640 1 --2- 172.21.15.100:0/2227928017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2c1082e0 0x7fdf2c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.742+0000 7fdf31e40640 1 --2- 172.21.15.100:0/2227928017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c107ba0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.742+0000 7fdf31e40640 1 --2- 172.21.15.100:0/2227928017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf2c102db0 0x7fdf2c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.742+0000 7fdf31e40640 1 -- 172.21.15.100:0/2227928017 >> 172.21.15.100:0/2227928017 conn(0x7fdf2c0fc7d0 msgr2=0x7fdf2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.743+0000 7fdf31e40640 1 -- 172.21.15.100:0/2227928017 shutdown_connections 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.743+0000 7fdf31e40640 1 -- 172.21.15.100:0/2227928017 wait complete. 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.743+0000 7fdf31e40640 1 Processor -- start 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.743+0000 7fdf31e40640 1 -- start start 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2c102db0 0x7fdf2c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf2c1082e0 0x7fdf2c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c112050 con 0x7fdf2c103760 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c111ed0 con 0x7fdf2c102db0 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1121d0 con 0x7fdf2c1082e0 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37126/0 (socket says 172.21.15.100:37126) 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 -- 172.21.15.100:0/145564804 learned_addr learned my addr 172.21.15.100:0/145564804 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf2c1082e0 0x7fdf2c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2c102db0 0x7fdf2c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 -- 172.21.15.100:0/145564804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf2c1082e0 msgr2=0x7fdf2c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf2c1082e0 0x7fdf2c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 -- 172.21.15.100:0/145564804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2c102db0 msgr2=0x7fdf2c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2c102db0 0x7fdf2c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 -- 172.21.15.100:0/145564804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c19d480 con 0x7fdf2c103760 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2c102db0 0x7fdf2c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf2affd640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c198a10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009230 tx=0x7fdf20003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf28ff9640 1 -- 172.21.15.100:0/145564804 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2003f070 con 0x7fdf2c103760 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf28ff9640 1 -- 172.21.15.100:0/145564804 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf20031e30 con 0x7fdf2c103760 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c19d710 con 0x7fdf2c103760 2024-09-12T02:39:43.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf28ff9640 1 -- 172.21.15.100:0/145564804 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20035030 con 0x7fdf2c103760 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.744+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c1a5050 con 0x7fdf2c103760 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.746+0000 7fdf28ff9640 1 -- 172.21.15.100:0/145564804 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) ==== 137885+0+0 (secure 0 0 0) 0x7fdf20042070 con 0x7fdf2c103760 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 Processor -- start 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 -- start start 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc060 0x55a1a6fcc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6f31620 con 0x55a1a6fcc060 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6ed8e50 con 0x55a1a6fd7240 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf34219740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6f2d5e0 con 0x55a1a6fcc980 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc060 0x55a1a6fcc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc060 0x55a1a6fcc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37138/0 (socket says 172.21.15.100:37138) 2024-09-12T02:39:43.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2309171061 learned_addr learned my addr 172.21.15.100:0/2309171061 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.747+0000 7fdf28ff9640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdf140a2c10 0x7fdf140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdf140a2c10 0x7fdf140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2309171061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 msgr2=0x55a1a6fd6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2309171061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fd7240 msgr2=0x55a1a6fd9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf28ff9640 1 -- 172.21.15.100:0/145564804 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdf200efb90 con 0x7fdf2c103760 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2affd640 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2309171061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a6ec9d40 con 0x55a1a6fcc060 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2affd640 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:43.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc060 0x55a1a6fcc440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdf240139d0 tx=0x7fdf24013e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11f7c440fb41ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf11ffb640 1 -- 172.21.15.100:0/2309171061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24013050 con 0x55a1a6fcc060 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf11ffb640 1 -- 172.21.15.100:0/2309171061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf24022070 con 0x55a1a6fcc060 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.748+0000 7fdf11ffb640 1 -- 172.21.15.100:0/2309171061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24012690 con 0x55a1a6fcc060 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 -- 172.21.15.100:0/2309171061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc060 msgr2=0x55a1a6fcc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdf140a2c10 0x7fdf140a50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdf24021000 tx=0x7fdf2401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc060 0x55a1a6fcc440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdf240139d0 tx=0x7fdf24013e90 comp rx=0 tx=0).stop 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 -- 172.21.15.100:0/2309171061 shutdown_connections 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 --2- 172.21.15.100:0/2309171061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc060 0x55a1a6fcc440 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 -- 172.21.15.100:0/2309171061 >> 172.21.15.100:0/2309171061 conn(0x55a1a6fc85f0 msgr2=0x55a1a6fc89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 -- 172.21.15.100:0/2309171061 shutdown_connections 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 -- 172.21.15.100:0/2309171061 wait complete. 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.749+0000 7fdf34219740 1 -- start start 2024-09-12T02:39:43.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 1 Processor -- start 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fd4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6fd9e10 con 0x55a1a6fd7240 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6eb9f10 con 0x55a1a6fcc060 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6fd9f90 con 0x55a1a6fcc980 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf34219740 10 client.0 _ll_register_callbacks cb 0x55a1a6edddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37146/0 (socket says 172.21.15.100:37146) 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2611924003 learned_addr learned my addr 172.21.15.100:0/2611924003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fd4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2affd640 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2611924003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 msgr2=0x55a1a6fd4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 msgr2=0x55a1a6fd4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fd4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 -- 172.21.15.100:0/2611924003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a6c40580 con 0x55a1a6fd7240 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd4bd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf2401ddd0 tx=0x7fdf24013290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ef59201dcc6f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.750+0000 7fdf0affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf0affd640 1 -- 172.21.15.100:0/2611924003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24013500 con 0x55a1a6fd7240 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf0affd640 1 -- 172.21.15.100:0/2611924003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdf2401d810 con 0x55a1a6fd7240 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf24022070 con 0x55a1a6fd7240 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf0affd640 1 -- 172.21.15.100:0/2611924003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf2401da10 con 0x55a1a6fd7240 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 10 client.15498 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a1a6d0a960 con 0x55a1a6fd7240 2024-09-12T02:39:43.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf0affd640 1 -- 172.21.15.100:0/2611924003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf24022070 con 0x55a1a6fd7240 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf0affd640 1 -- 172.21.15.100:0/2611924003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdf2403b050 con 0x55a1a6fd7240 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 10 client.15498 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 10 client.15498 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 20 client.15498 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a6feb0b0 0x55a1a6fed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 4 client.15498 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.751+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1a6f3eb90 con 0x55a1a6feb0b0 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.752+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a6feb0b0 0x55a1a6fed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.752+0000 7fdf0affd640 10 client.15498 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.752+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a6feb0b0 0x55a1a6fed4a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da6888daa063e3e server_cookie=ea2b7ae270772f4f in_seq=0 out_seq=0 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf0affd640 1 -- 172.21.15.100:0/2611924003 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1a6f3eb90 con 0x55a1a6feb0b0 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf0affd640 10 client.15498 handle_command_reply: tid=0 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 client.15498 shutdown 2024-09-12T02:39:43.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 msgr2=0x55a1a6fd4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd4bd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf2401ddd0 tx=0x7fdf24013290 comp rx=0 tx=0).stop 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 shutdown_connections 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a6feb0b0 0x55a1a6fed4a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fd4bd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc980 0x55a1a6fd4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 --2- 172.21.15.100:0/2611924003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fd4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 >> 172.21.15.100:0/2611924003 conn(0x55a1a6fc85f0 msgr2=0x55a1a6fce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf0affd640 0 client.15498 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 shutdown_connections 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 1 -- 172.21.15.100:0/2611924003 wait complete. 2024-09-12T02:39:43.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.753+0000 7fdf34219740 20 client.15498 trim_cache size 0 max 16384 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.769+0000 7fdf34219740 1 Processor -- start 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf34219740 1 -- start start 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf34219740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf34219740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc980 0x55a1a6fc7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf34219740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fd7240 0x55a1a6ff2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf34219740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1adbb0 con 0x55a1a6fcc980 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf34219740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1ab480 con 0x55a1a6fcc060 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf34219740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1a92f0 con 0x55a1a6fd7240 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc980 0x55a1a6fc7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc980 0x55a1a6fc7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37148/0 (socket says 172.21.15.100:37148) 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 -- 172.21.15.100:0/696955702 learned_addr learned my addr 172.21.15.100:0/696955702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:43.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fd7240 0x55a1a6ff2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 -- 172.21.15.100:0/696955702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fd7240 msgr2=0x55a1a6ff2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fd7240 0x55a1a6ff2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 -- 172.21.15.100:0/696955702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 msgr2=0x55a1a6fceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 -- 172.21.15.100:0/696955702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a6fc9280 con 0x55a1a6fcc980 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf2affd640 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc980 0x55a1a6fc7640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf200bbf20 tx=0x7fdf2002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eccb0a2a590e68d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.770+0000 7fdf117fa640 1 -- 172.21.15.100:0/696955702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20049040 con 0x55a1a6fcc980 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf117fa640 1 -- 172.21.15.100:0/696955702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf200bc220 con 0x55a1a6fcc980 2024-09-12T02:39:43.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf117fa640 1 -- 172.21.15.100:0/696955702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf200dae60 con 0x55a1a6fcc980 2024-09-12T02:39:43.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 -- 172.21.15.100:0/696955702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc980 msgr2=0x55a1a6fc7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc980 0x55a1a6fc7640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf200bbf20 tx=0x7fdf2002a420 comp rx=0 tx=0).stop 2024-09-12T02:39:43.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 -- 172.21.15.100:0/696955702 shutdown_connections 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fd7240 0x55a1a6ff2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fcc980 0x55a1a6fc7640 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 --2- 172.21.15.100:0/696955702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc060 0x55a1a6fceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 -- 172.21.15.100:0/696955702 >> 172.21.15.100:0/696955702 conn(0x55a1a6fc85f0 msgr2=0x55a1a6fc6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 -- 172.21.15.100:0/696955702 shutdown_connections 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.771+0000 7fdf34219740 1 -- 172.21.15.100:0/696955702 wait complete. 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 -- start start 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 Processor -- start 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc060 0x55a1a6fdf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc980 0x55a1a6fdf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fdc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1a9940 con 0x55a1a6fd7240 2024-09-12T02:39:43.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1aadb0 con 0x55a1a6fcc980 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fdc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1aa010 con 0x55a1a6fcc060 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fdc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37156/0 (socket says 172.21.15.100:37156) 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf2bfff640 1 -- 172.21.15.100:0/20981439 learned_addr learned my addr 172.21.15.100:0/20981439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf34219740 10 client.0 _ll_register_callbacks cb 0x7fdf24005f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc060 0x55a1a6fdf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.772+0000 7fdf2affd640 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc980 0x55a1a6fdf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf2bfff640 1 -- 172.21.15.100:0/20981439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc060 msgr2=0x55a1a6fdf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc060 0x55a1a6fdf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf2bfff640 1 -- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc980 msgr2=0x55a1a6fdf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc980 0x55a1a6fdf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf2bfff640 1 -- 172.21.15.100:0/20981439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a6fdc8f0 con 0x55a1a6fd7240 2024-09-12T02:39:43.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf2bfff640 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fdc1b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf24013ed0 tx=0x7fdf24005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429095633a3e227e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf0affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf0affd640 1 -- 172.21.15.100:0/20981439 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24007d40 con 0x55a1a6fd7240 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf0affd640 1 -- 172.21.15.100:0/20981439 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdf2402e040 con 0x55a1a6fd7240 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf200bc220 con 0x55a1a6fd7240 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf0affd640 1 -- 172.21.15.100:0/20981439 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf2401d810 con 0x55a1a6fd7240 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf34219740 10 client.15504 fetch_fsmap learned FSMap version 26 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a1a70566a0 con 0x55a1a6fd7240 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.773+0000 7fdf0affd640 1 -- 172.21.15.100:0/20981439 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf24022030 con 0x55a1a6fd7240 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf0affd640 1 -- 172.21.15.100:0/20981439 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdf24044030 con 0x55a1a6fd7240 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf34219740 10 client.15504 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf34219740 10 client.15504 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:39:43.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf34219740 20 client.15504 populate_metadata read hostname 'smithi100' 2024-09-12T02:39:43.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf34219740 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a7056ea0 0x55a1a70592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:43.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf34219740 4 client.15504 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "936b729e", "release": true, "await": true}] 2024-09-12T02:39:43.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "936b729e", "release": true, "await": true}) -- 0x7fdf200bc220 con 0x55a1a7056ea0 2024-09-12T02:39:43.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a7056ea0 0x55a1a70592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:43.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf0affd640 10 client.15504 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:43.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.774+0000 7fdf2b7fe640 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a7056ea0 0x55a1a70592c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d02f0c54447e69 server_cookie=c237b13223c92629 in_seq=0 out_seq=0 2024-09-12T02:39:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.823+0000 7fdf0affd640 1 -- 172.21.15.100:0/20981439 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fdf200bc220 con 0x55a1a7056ea0 2024-09-12T02:39:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.823+0000 7fdf0affd640 10 client.15504 handle_command_reply: tid=0 2024-09-12T02:39:43.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 client.15504 shutdown 2024-09-12T02:39:43.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 msgr2=0x55a1a6fdc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fdc1b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf24013ed0 tx=0x7fdf24005240 comp rx=0 tx=0).stop 2024-09-12T02:39:43.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 shutdown_connections 2024-09-12T02:39:43.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a7056ea0 0x55a1a70592c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a6fd7240 0x55a1a6fdc1b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a6fcc980 0x55a1a6fdf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf0affd640 0 client.15504 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 --2- 172.21.15.100:0/20981439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a6fcc060 0x55a1a6fdf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 >> 172.21.15.100:0/20981439 conn(0x55a1a6fc85f0 msgr2=0x55a1a6fc7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 shutdown_connections 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.826+0000 7fdf34219740 1 -- 172.21.15.100:0/20981439 wait complete. 2024-09-12T02:39:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.827+0000 7fdf34219740 20 client.15504 trim_cache size 0 max 16384 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 26, 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 4, 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "936b729e": { 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 4, 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:39:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 144.5, 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:39:43.830 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:39:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.827+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdf140a2c10 msgr2=0x7fdf140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.827+0000 7fdf31e40640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdf140a2c10 0x7fdf140a50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdf24021000 tx=0x7fdf2401f000 comp rx=0 tx=0).stop 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.827+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 msgr2=0x7fdf2c198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.827+0000 7fdf31e40640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c198a10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009230 tx=0x7fdf20003c10 comp rx=0 tx=0).stop 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 shutdown_connections 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdf140a2c10 0x7fdf140a50d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf2c1082e0 0x7fdf2c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf2c103760 0x7fdf2c198a10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 --2- 172.21.15.100:0/145564804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2c102db0 0x7fdf2c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 >> 172.21.15.100:0/145564804 conn(0x7fdf2c0fc7d0 msgr2=0x7fdf2c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 shutdown_connections 2024-09-12T02:39:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:39:43.828+0000 7fdf31e40640 1 -- 172.21.15.100:0/145564804 wait complete. 2024-09-12T02:39:44.647 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '936b729e', total seconds elapsed: 28.0 2024-09-12T02:39:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:44 smithi100 ceph-mon[31390]: pgmap v368: 97 pgs: 97 active+clean; 970 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.0 MiB/s wr, 94 op/s 2024-09-12T02:39:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:44 smithi189 ceph-mon[35196]: pgmap v368: 97 pgs: 97 active+clean; 970 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.0 MiB/s wr, 94 op/s 2024-09-12T02:39:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:44 smithi117 ceph-mon[34898]: pgmap v368: 97 pgs: 97 active+clean; 970 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.0 MiB/s wr, 94 op/s 2024-09-12T02:39:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 35.0 s, 1929.1 tps, lat 261.417 ms stddev 2304.281 2024-09-12T02:39:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:46 smithi189 ceph-mon[35196]: pgmap v369: 97 pgs: 97 active+clean; 989 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 13 MiB/s wr, 225 op/s 2024-09-12T02:39:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:46 smithi117 ceph-mon[34898]: pgmap v369: 97 pgs: 97 active+clean; 989 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 13 MiB/s wr, 225 op/s 2024-09-12T02:39:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:46 smithi100 ceph-mon[31390]: pgmap v369: 97 pgs: 97 active+clean; 989 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 13 MiB/s wr, 225 op/s 2024-09-12T02:39:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:48 smithi189 ceph-mon[35196]: pgmap v370: 97 pgs: 97 active+clean; 957 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 16 MiB/s wr, 313 op/s 2024-09-12T02:39:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:48 smithi117 ceph-mon[34898]: pgmap v370: 97 pgs: 97 active+clean; 957 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 16 MiB/s wr, 313 op/s 2024-09-12T02:39:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:48 smithi100 ceph-mon[31390]: pgmap v370: 97 pgs: 97 active+clean; 957 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 16 MiB/s wr, 313 op/s 2024-09-12T02:39:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:50 smithi189 ceph-mon[35196]: pgmap v371: 97 pgs: 97 active+clean; 939 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 18 MiB/s wr, 458 op/s 2024-09-12T02:39:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:50 smithi117 ceph-mon[34898]: pgmap v371: 97 pgs: 97 active+clean; 939 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 18 MiB/s wr, 458 op/s 2024-09-12T02:39:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:50 smithi100 ceph-mon[31390]: pgmap v371: 97 pgs: 97 active+clean; 939 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 18 MiB/s wr, 458 op/s 2024-09-12T02:39:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 40.0 s, 3746.6 tps, lat 26.678 ms stddev 27.537 2024-09-12T02:39:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:52 smithi189 ceph-mon[35196]: pgmap v372: 97 pgs: 97 active+clean; 945 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 19 MiB/s wr, 585 op/s 2024-09-12T02:39:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:52 smithi117 ceph-mon[34898]: pgmap v372: 97 pgs: 97 active+clean; 945 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 19 MiB/s wr, 585 op/s 2024-09-12T02:39:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:52 smithi100 ceph-mon[31390]: pgmap v372: 97 pgs: 97 active+clean; 945 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 19 MiB/s wr, 585 op/s 2024-09-12T02:39:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:54 smithi189 ceph-mon[35196]: pgmap v373: 97 pgs: 97 active+clean; 946 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 17 MiB/s wr, 607 op/s 2024-09-12T02:39:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:54 smithi117 ceph-mon[34898]: pgmap v373: 97 pgs: 97 active+clean; 946 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 17 MiB/s wr, 607 op/s 2024-09-12T02:39:55.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:54 smithi100 ceph-mon[31390]: pgmap v373: 97 pgs: 97 active+clean; 946 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 17 MiB/s wr, 607 op/s 2024-09-12T02:39:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 45.0 s, 3904.8 tps, lat 25.494 ms stddev 24.911 2024-09-12T02:39:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:56 smithi189 ceph-mon[35196]: pgmap v374: 97 pgs: 97 active+clean; 958 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 17 MiB/s wr, 774 op/s 2024-09-12T02:39:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:56 smithi189 ceph-mon[35196]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-12T02:39:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:56 smithi117 ceph-mon[34898]: pgmap v374: 97 pgs: 97 active+clean; 958 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 17 MiB/s wr, 774 op/s 2024-09-12T02:39:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:56 smithi117 ceph-mon[34898]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-12T02:39:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:56 smithi100 ceph-mon[31390]: pgmap v374: 97 pgs: 97 active+clean; 958 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 17 MiB/s wr, 774 op/s 2024-09-12T02:39:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:56 smithi100 ceph-mon[31390]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-12T02:39:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:58 smithi189 ceph-mon[35196]: pgmap v375: 97 pgs: 97 active+clean; 961 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 744 op/s 2024-09-12T02:39:59.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:59.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:39:59.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:58 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:39:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:58 smithi117 ceph-mon[34898]: pgmap v375: 97 pgs: 97 active+clean; 961 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 744 op/s 2024-09-12T02:39:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:39:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:58 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:39:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:58 smithi100 ceph-mon[31390]: pgmap v375: 97 pgs: 97 active+clean; 961 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 744 op/s 2024-09-12T02:39:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:39:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:58 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:39:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:59.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:39:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:39:59.929 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:40:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:39:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:40:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:39:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 -- 172.21.15.100:0/2344607823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc10c2f0 msgr2=0x7f99dc10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 --2- 172.21.15.100:0/2344607823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc10c2f0 0x7f99dc10e790 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009ca0 tx=0x7f99d402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 -- 172.21.15.100:0/2344607823 shutdown_connections 2024-09-12T02:40:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 --2- 172.21.15.100:0/2344607823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc10c2f0 0x7f99dc10e790 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 --2- 172.21.15.100:0/2344607823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99dc1037a0 0x7f99dc10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 --2- 172.21.15.100:0/2344607823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc102df0 0x7f99dc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 -- 172.21.15.100:0/2344607823 >> 172.21.15.100:0/2344607823 conn(0x7f99dc0fc7d0 msgr2=0x7f99dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 -- 172.21.15.100:0/2344607823 shutdown_connections 2024-09-12T02:40:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.823+0000 7f99e4007640 1 -- 172.21.15.100:0/2344607823 wait complete. 2024-09-12T02:40:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.825+0000 7f99e4007640 1 Processor -- start 2024-09-12T02:40:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.825+0000 7f99e4007640 1 -- start start 2024-09-12T02:40:00.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.825+0000 7f99e4007640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc102df0 0x7f99dc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e4007640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc1037a0 0x7f99dc198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e4007640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99dc10c2f0 0x7f99dc19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e4007640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc112160 con 0x7f99dc1037a0 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e4007640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc111fe0 con 0x7f99dc102df0 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e4007640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc1122e0 con 0x7f99dc10c2f0 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc1037a0 0x7f99dc198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc1037a0 0x7f99dc198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52520/0 (socket says 172.21.15.100:52520) 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 -- 172.21.15.100:0/396920709 learned_addr learned my addr 172.21.15.100:0/396920709 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e25a4640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99dc10c2f0 0x7f99dc19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e1da3640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc102df0 0x7f99dc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 -- 172.21.15.100:0/396920709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99dc10c2f0 msgr2=0x7f99dc19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99dc10c2f0 0x7f99dc19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 -- 172.21.15.100:0/396920709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc102df0 msgr2=0x7f99dc198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc102df0 0x7f99dc198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e15a2640 1 -- 172.21.15.100:0/396920709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc19d5d0 con 0x7f99dc1037a0 2024-09-12T02:40:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.826+0000 7f99e1da3640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc102df0 0x7f99dc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.827+0000 7f99e15a2640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc1037a0 0x7f99dc198b60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00e9c0 tx=0x7f99cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.827+0000 7f99d2ffd640 1 -- 172.21.15.100:0/396920709 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00ccc0 con 0x7f99dc1037a0 2024-09-12T02:40:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.827+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc19d8c0 con 0x7f99dc1037a0 2024-09-12T02:40:00.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.827+0000 7f99d2ffd640 1 -- 172.21.15.100:0/396920709 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99cc005500 con 0x7f99dc1037a0 2024-09-12T02:40:00.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.827+0000 7f99d2ffd640 1 -- 172.21.15.100:0/396920709 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc010690 con 0x7f99dc1037a0 2024-09-12T02:40:00.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.827+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc1a51a0 con 0x7f99dc1037a0 2024-09-12T02:40:00.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.830+0000 7f99d2ffd640 1 -- 172.21.15.100:0/396920709 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f99cc004e80 con 0x7f99dc1037a0 2024-09-12T02:40:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.831+0000 7f99e63e0740 1 Processor -- start 2024-09-12T02:40:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.831+0000 7f99e63e0740 1 -- start start 2024-09-12T02:40:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.831+0000 7f99d2ffd640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99c80a2b80 0x7f99c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bf4a0 0x56538d4bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e63e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56538d4252e0 con 0x56538d4bfdc0 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e63e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56538d3ccce0 con 0x56538d4ca680 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e63e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56538d4212a0 con 0x56538d4bf4a0 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99d2ffd640 1 -- 172.21.15.100:0/396920709 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f99cc0cf460 con 0x7f99dc1037a0 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e25a4640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99c80a2b80 0x7f99c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e15a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e15a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52522/0 (socket says 172.21.15.100:52522) 2024-09-12T02:40:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e15a2640 1 -- 172.21.15.100:0/3137846378 learned_addr learned my addr 172.21.15.100:0/3137846378 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e25a4640 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.832+0000 7f99e1da3640 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bf4a0 0x56538d4bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.833+0000 7f99e15a2640 1 -- 172.21.15.100:0/3137846378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bf4a0 msgr2=0x56538d4bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.833+0000 7f99e15a2640 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bf4a0 0x56538d4bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.833+0000 7f99e15a2640 1 -- 172.21.15.100:0/3137846378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 msgr2=0x56538d4cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.833+0000 7f99e15a2640 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.833+0000 7f99e15a2640 1 -- 172.21.15.100:0/3137846378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56538d3b1440 con 0x56538d4bfdc0 2024-09-12T02:40:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.833+0000 7f99e25a4640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99c80a2b80 0x7f99c80a5040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f99d4006010 tx=0x7f99d4031c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.833+0000 7f99e15a2640 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4ca140 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f99cc098110 tx=0x7f99cc09b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60e1eee99ec687f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.834+0000 7f99c7fff640 1 -- 172.21.15.100:0/3137846378 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0a0060 con 0x56538d4bfdc0 2024-09-12T02:40:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.834+0000 7f99c7fff640 1 -- 172.21.15.100:0/3137846378 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99cc0a4920 con 0x56538d4bfdc0 2024-09-12T02:40:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.834+0000 7f99c7fff640 1 -- 172.21.15.100:0/3137846378 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0cf0e0 con 0x56538d4bfdc0 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.834+0000 7f99e63e0740 1 -- 172.21.15.100:0/3137846378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 msgr2=0x56538d4ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.834+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4ca140 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f99cc098110 tx=0x7f99cc09b6d0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 -- 172.21.15.100:0/3137846378 shutdown_connections 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4ca140 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3137846378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bf4a0 0x56538d4bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 -- 172.21.15.100:0/3137846378 >> 172.21.15.100:0/3137846378 conn(0x56538d4bba30 msgr2=0x56538d4bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 -- 172.21.15.100:0/3137846378 shutdown_connections 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 -- 172.21.15.100:0/3137846378 wait complete. 2024-09-12T02:40:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 -- start start 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.835+0000 7f99e63e0740 1 Processor -- start 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bf4a0 0x56538d4ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e63e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56538d4de300 con 0x56538d4bf4a0 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e63e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56538d3e0050 con 0x56538d4ca680 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e63e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56538d4de480 con 0x56538d4bfdc0 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e63e0740 10 client.0 _ll_register_callbacks cb 0x56538d420160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e1da3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bf4a0 0x56538d4ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e1da3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bf4a0 0x56538d4ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52530/0 (socket says 172.21.15.100:52530) 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e1da3640 1 -- 172.21.15.100:0/2390424596 learned_addr learned my addr 172.21.15.100:0/2390424596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e25a4640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e15a2640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e25a4640 1 -- 172.21.15.100:0/2390424596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 msgr2=0x56538d4c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e25a4640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e25a4640 1 -- 172.21.15.100:0/2390424596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bf4a0 msgr2=0x56538d4ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e25a4640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bf4a0 0x56538d4ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e25a4640 1 -- 172.21.15.100:0/2390424596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56538d1963c0 con 0x56538d4ca680 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e1da3640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bf4a0 0x56538d4ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e15a2640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.836+0000 7f99e25a4640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4c78e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99d4005e30 tx=0x7f99d402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3f40665e3d2d143 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.837+0000 7f99c57fa640 1 -- 172.21.15.100:0/2390424596 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d404f070 con 0x56538d4ca680 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.837+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99cc0a4920 con 0x56538d4ca680 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.837+0000 7f99c57fa640 1 -- 172.21.15.100:0/2390424596 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f99d4004240 con 0x56538d4ca680 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.837+0000 7f99c57fa640 1 -- 172.21.15.100:0/2390424596 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f99d405b050 con 0x56538d4ca680 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.837+0000 7f99e63e0740 10 client.25013 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.837+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56538d4e9d20 con 0x56538d4ca680 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99c57fa640 1 -- 172.21.15.100:0/2390424596 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99cc0a4920 con 0x56538d4ca680 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99c57fa640 1 -- 172.21.15.100:0/2390424596 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f99d40305c0 con 0x56538d4ca680 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e63e0740 10 client.25013 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e63e0740 10 client.25013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e63e0740 20 client.25013 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e63e0740 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d4eb130 0x56538d4ed520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e63e0740 4 client.25013 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56538d432850 con 0x56538d4eb130 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e1da3640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d4eb130 0x56538d4ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99c57fa640 10 client.25013 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.838+0000 7f99e1da3640 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d4eb130 0x56538d4ed520 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8527b8bbd105acd3 server_cookie=45e8b9be4c53393a in_seq=0 out_seq=0 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99c57fa640 1 -- 172.21.15.100:0/2390424596 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56538d432850 con 0x56538d4eb130 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99c57fa640 10 client.25013 handle_command_reply: tid=0 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 client.25013 shutdown 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 msgr2=0x56538d4c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4c78e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99d4005e30 tx=0x7f99d402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 shutdown_connections 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d4eb130 0x56538d4ed520 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4c78e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99c57fa640 0 client.25013 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 --2- 172.21.15.100:0/2390424596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bf4a0 0x56538d4ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 >> 172.21.15.100:0/2390424596 conn(0x56538d4bba30 msgr2=0x56538d4c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 shutdown_connections 2024-09-12T02:40:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.839+0000 7f99e63e0740 1 -- 172.21.15.100:0/2390424596 wait complete. 2024-09-12T02:40:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.840+0000 7f99e63e0740 20 client.25013 trim_cache size 0 max 16384 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 Processor -- start 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 -- start start 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4bf4a0 0x56538d4c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4ca680 0x56538d4f3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc1a77c0 con 0x56538d4ca680 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc074180 con 0x56538d4bf4a0 2024-09-12T02:40:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e63e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc199980 con 0x56538d4bfdc0 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e25a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4ca680 0x56538d4f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e15a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e25a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4ca680 0x56538d4f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52540/0 (socket says 172.21.15.100:52540) 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e15a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35672/0 (socket says 172.21.15.100:35672) 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e25a4640 1 -- 172.21.15.100:0/998660696 learned_addr learned my addr 172.21.15.100:0/998660696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e1da3640 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4bf4a0 0x56538d4c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e1da3640 1 -- 172.21.15.100:0/998660696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 msgr2=0x56538d4f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e1da3640 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e1da3640 1 -- 172.21.15.100:0/998660696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4ca680 msgr2=0x56538d4f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e1da3640 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4ca680 0x56538d4f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.866+0000 7f99e1da3640 1 -- 172.21.15.100:0/998660696 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56538d4edba0 con 0x56538d4bf4a0 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.867+0000 7f99e1da3640 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4bf4a0 0x56538d4c9620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56538d4c88a0 tx=0x7f99d8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=affccd113c05bb9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.867+0000 7f99c77fe640 1 -- 172.21.15.100:0/998660696 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8023030 con 0x56538d4bf4a0 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.867+0000 7f99c77fe640 1 -- 172.21.15.100:0/998660696 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99d8013c70 con 0x56538d4bf4a0 2024-09-12T02:40:00.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.867+0000 7f99c77fe640 1 -- 172.21.15.100:0/998660696 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d801f8b0 con 0x56538d4bf4a0 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 -- 172.21.15.100:0/998660696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4bf4a0 msgr2=0x56538d4c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4bf4a0 0x56538d4c9620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56538d4c88a0 tx=0x7f99d8009f90 comp rx=0 tx=0).stop 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 -- 172.21.15.100:0/998660696 shutdown_connections 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4ca680 0x56538d4f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4bfdc0 0x56538d4f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 --2- 172.21.15.100:0/998660696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4bf4a0 0x56538d4c9620 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56538d4c88a0 tx=0x7f99d8009f90 comp rx=0 tx=0).stop 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 -- 172.21.15.100:0/998660696 >> 172.21.15.100:0/998660696 conn(0x56538d4bba30 msgr2=0x56538d4bab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.868+0000 7f99e63e0740 1 -- 172.21.15.100:0/998660696 shutdown_connections 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.869+0000 7f99e63e0740 1 -- 172.21.15.100:0/998660696 wait complete. 2024-09-12T02:40:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.869+0000 7f99e63e0740 1 -- start start 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.869+0000 7f99e63e0740 1 Processor -- start 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4e1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4e1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e63e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4e1d90 0x56538d554e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e63e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc072640 con 0x56538d4bfdc0 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e63e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc073ab0 con 0x56538d4ca680 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e63e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc072d10 con 0x56538d4e1d90 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e63e0740 10 client.0 _ll_register_callbacks cb 0x7f99cc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52542/0 (socket says 172.21.15.100:52542) 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 -- 172.21.15.100:0/3121121571 learned_addr learned my addr 172.21.15.100:0/3121121571 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e15a2640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e25a4640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4e1d90 0x56538d554e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 -- 172.21.15.100:0/3121121571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4e1d90 msgr2=0x56538d554e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4e1d90 0x56538d554e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 -- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 msgr2=0x56538d4e1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4e1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 -- 172.21.15.100:0/3121121571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56538d4bc6c0 con 0x56538d4bfdc0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e15a2640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4e1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99e1da3640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4e1310 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99d8012500 tx=0x7f99d8009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ad3ebe8d30b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.870+0000 7f99c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99c57fa640 1 -- 172.21.15.100:0/3121121571 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8023070 con 0x56538d4bfdc0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99c57fa640 1 -- 172.21.15.100:0/3121121571 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f99d8005440 con 0x56538d4bfdc0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99d8013c70 con 0x56538d4bfdc0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99c57fa640 1 -- 172.21.15.100:0/3121121571 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f99d801f630 con 0x56538d4bfdc0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 10 client.15522 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56538d556270 con 0x56538d4bfdc0 2024-09-12T02:40:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99c57fa640 1 -- 172.21.15.100:0/3121121571 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99d8024040 con 0x56538d4bfdc0 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99c57fa640 1 -- 172.21.15.100:0/3121121571 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f99d800f040 con 0x56538d4bfdc0 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 10 client.15522 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 20 client.15522 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d556860 0x56538d558c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 4 client.15522 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f99d8013c70 con 0x56538d556860 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.871+0000 7f99e15a2640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d556860 0x56538d558c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e15a2640 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d556860 0x56538d558c80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dceb78d85aeb2b2e server_cookie=9c25502c3ad25e13 in_seq=0 out_seq=0 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99c57fa640 10 client.15522 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99c57fa640 1 -- 172.21.15.100:0/3121121571 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f99d8013c70 con 0x56538d556860 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99c57fa640 10 client.15522 handle_command_reply: tid=0 2024-09-12T02:40:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 client.15522 shutdown 2024-09-12T02:40:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 msgr2=0x56538d4e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4e1310 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99d8012500 tx=0x7f99d8009e00 comp rx=0 tx=0).stop 2024-09-12T02:40:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 shutdown_connections 2024-09-12T02:40:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56538d556860 0x56538d558c80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56538d4e1d90 0x56538d554e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56538d4ca680 0x56538d4e1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 --2- 172.21.15.100:0/3121121571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56538d4bfdc0 0x56538d4e1310 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 >> 172.21.15.100:0/3121121571 conn(0x56538d4bba30 msgr2=0x56538d4c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99c57fa640 0 client.15522 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 shutdown_connections 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.872+0000 7f99e63e0740 1 -- 172.21.15.100:0/3121121571 wait complete. 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.873+0000 7f99e63e0740 20 client.15522 trim_cache size 0 max 16384 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:40:00.877 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:40:00.878 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.874+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99c80a2b80 msgr2=0x7f99c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.874+0000 7f99e4007640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99c80a2b80 0x7f99c80a5040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f99d4006010 tx=0x7f99d4031c90 comp rx=0 tx=0).stop 2024-09-12T02:40:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.874+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc1037a0 msgr2=0x7f99dc198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.874+0000 7f99e4007640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc1037a0 0x7f99dc198b60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00e9c0 tx=0x7f99cc00ee80 comp rx=0 tx=0).stop 2024-09-12T02:40:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.874+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 shutdown_connections 2024-09-12T02:40:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.875+0000 7f99e4007640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99c80a2b80 0x7f99c80a5040 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.875+0000 7f99e4007640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99dc10c2f0 0x7f99dc19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.875+0000 7f99e4007640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99dc1037a0 0x7f99dc198b60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.875+0000 7f99e4007640 1 --2- 172.21.15.100:0/396920709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc102df0 0x7f99dc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.875+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 >> 172.21.15.100:0/396920709 conn(0x7f99dc0fc7d0 msgr2=0x7f99dc0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.876+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 shutdown_connections 2024-09-12T02:40:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:00.877+0000 7f99e4007640 1 -- 172.21.15.100:0/396920709 wait complete. 2024-09-12T02:40:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:00 smithi189 ceph-mon[35196]: pgmap v376: 97 pgs: 97 active+clean; 962 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.4 MiB/s wr, 796 op/s 2024-09-12T02:40:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:00 smithi189 ceph-mon[35196]: overall HEALTH_OK 2024-09-12T02:40:01.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:00 smithi117 ceph-mon[34898]: pgmap v376: 97 pgs: 97 active+clean; 962 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.4 MiB/s wr, 796 op/s 2024-09-12T02:40:01.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:00 smithi117 ceph-mon[34898]: overall HEALTH_OK 2024-09-12T02:40:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:00 smithi100 ceph-mon[31390]: pgmap v376: 97 pgs: 97 active+clean; 962 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.4 MiB/s wr, 796 op/s 2024-09-12T02:40:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:00 smithi100 ceph-mon[31390]: overall HEALTH_OK 2024-09-12T02:40:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 50.0 s, 3604.2 tps, lat 27.828 ms stddev 26.742 2024-09-12T02:40:01.758 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:40:01.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:40:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:02.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.654+0000 7f79af9bf640 1 -- 172.21.15.100:0/849777667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 msgr2=0x7f79a81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:02.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.654+0000 7f79af9bf640 1 --2- 172.21.15.100:0/849777667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 0x7f79a81029b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009860 tx=0x7f79a402a3d0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 -- 172.21.15.100:0/849777667 shutdown_connections 2024-09-12T02:40:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 --2- 172.21.15.100:0/849777667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8102ef0 0x7f79a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 --2- 172.21.15.100:0/849777667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 0x7f79a81029b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 --2- 172.21.15.100:0/849777667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79a8100e20 0x7f79a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 -- 172.21.15.100:0/849777667 >> 172.21.15.100:0/849777667 conn(0x7f79a80fc7d0 msgr2=0x7f79a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 -- 172.21.15.100:0/849777667 shutdown_connections 2024-09-12T02:40:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 -- 172.21.15.100:0/849777667 wait complete. 2024-09-12T02:40:02.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 Processor -- start 2024-09-12T02:40:02.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.657+0000 7f79af9bf640 1 -- start start 2024-09-12T02:40:02.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79af9bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8100e20 0x7f79a81a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79af9bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 0x7f79a81a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79af9bf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79a8102ef0 0x7f79a819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79af9bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79a810ff00 con 0x7f79a8102570 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79af9bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79a810fd80 con 0x7f79a8100e20 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79af9bf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f79a8110080 con 0x7f79a8102ef0 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79acf5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 0x7f79a81a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8100e20 0x7f79a81a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8100e20 0x7f79a81a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:39558/0 (socket says 172.21.15.100:39558) 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 -- 172.21.15.100:0/573900276 learned_addr learned my addr 172.21.15.100:0/573900276 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79adf5c640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79a8102ef0 0x7f79a819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79acf5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 0x7f79a81a09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52558/0 (socket says 172.21.15.100:52558) 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 -- 172.21.15.100:0/573900276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79a8102ef0 msgr2=0x7f79a819aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79a8102ef0 0x7f79a819aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 -- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 msgr2=0x7f79a81a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 0x7f79a81a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.658+0000 7f79ad75b640 1 -- 172.21.15.100:0/573900276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a819b620 con 0x7f79a8100e20 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.659+0000 7f79ad75b640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8100e20 0x7f79a81a04b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79a000ba50 tx=0x7f79a000be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.659+0000 7f799e7fc640 1 -- 172.21.15.100:0/573900276 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a0019070 con 0x7f79a8100e20 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.659+0000 7f799e7fc640 1 -- 172.21.15.100:0/573900276 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79a0014440 con 0x7f79a8100e20 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.659+0000 7f799e7fc640 1 -- 172.21.15.100:0/573900276 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a00075d0 con 0x7f79a8100e20 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.659+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a819b910 con 0x7f79a8100e20 2024-09-12T02:40:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.659+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a81a72b0 con 0x7f79a8100e20 2024-09-12T02:40:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.660+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a8101200 con 0x7f79a8100e20 2024-09-12T02:40:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.662+0000 7f799e7fc640 1 -- 172.21.15.100:0/573900276 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f79a001c070 con 0x7f79a8100e20 2024-09-12T02:40:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.662+0000 7f799e7fc640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79900a2b80 0x7f79900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.662+0000 7f79acf5a640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79900a2b80 0x7f79900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.662+0000 7f799e7fc640 1 -- 172.21.15.100:0/573900276 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f79a00ce5f0 con 0x7f79a8100e20 2024-09-12T02:40:02.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.663+0000 7f79acf5a640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79900a2b80 0x7f79900a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f79a810de60 tx=0x7f79a4005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:02.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.667+0000 7f799e7fc640 1 -- 172.21.15.100:0/573900276 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79a009aef0 con 0x7f79a8100e20 2024-09-12T02:40:02.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:02 smithi100 ceph-mon[31390]: pgmap v377: 97 pgs: 97 active+clean; 963 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.4 MiB/s wr, 798 op/s 2024-09-12T02:40:02.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.973+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79a81a74e0 con 0x7f79a8100e20 2024-09-12T02:40:02.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.974+0000 7f799e7fc640 1 -- 172.21.15.100:0/573900276 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7f79a009f1f0 con 0x7f79a8100e20 2024-09-12T02:40:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:40:02.976 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:38:59:560858+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:59.510722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:40:02.976 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79900a2b80 msgr2=0x7f79900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79900a2b80 0x7f79900a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f79a810de60 tx=0x7f79a4005a90 comp rx=0 tx=0).stop 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8100e20 msgr2=0x7f79a81a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8100e20 0x7f79a81a04b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79a000ba50 tx=0x7f79a000be50 comp rx=0 tx=0).stop 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 shutdown_connections 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f79900a2b80 0x7f79900a5040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79a8102ef0 0x7f79a819aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a8102570 0x7f79a81a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 --2- 172.21.15.100:0/573900276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a8100e20 0x7f79a81a04b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.977+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 >> 172.21.15.100:0/573900276 conn(0x7f79a80fc7d0 msgr2=0x7f79a8103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.978+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 shutdown_connections 2024-09-12T02:40:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:02.978+0000 7f79af9bf640 1 -- 172.21.15.100:0/573900276 wait complete. 2024-09-12T02:40:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:02 smithi189 ceph-mon[35196]: pgmap v377: 97 pgs: 97 active+clean; 963 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.4 MiB/s wr, 798 op/s 2024-09-12T02:40:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:02 smithi117 ceph-mon[34898]: pgmap v377: 97 pgs: 97 active+clean; 963 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.4 MiB/s wr, 798 op/s 2024-09-12T02:40:03.936 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:03 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/573900276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:03.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:40:04.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:03 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/573900276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:03 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/573900276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:04.790 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:04 smithi100 ceph-mon[31390]: pgmap v378: 97 pgs: 97 active+clean; 968 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 8.5 MiB/s wr, 705 op/s 2024-09-12T02:40:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.924+0000 7f90d3d98640 1 -- 172.21.15.100:0/3695859681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc1091f0 msgr2=0x7f90cc1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.924+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3695859681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc1091f0 0x7f90cc1095d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009ca0 tx=0x7f90c402a8f0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.925+0000 7f90d3d98640 1 -- 172.21.15.100:0/3695859681 shutdown_connections 2024-09-12T02:40:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.925+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3695859681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90cc114ab0 0x7f90cc116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.925+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3695859681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc109ba0 0x7f90cc114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.925+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3695859681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc1091f0 0x7f90cc1095d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.925+0000 7f90d3d98640 1 -- 172.21.15.100:0/3695859681 >> 172.21.15.100:0/3695859681 conn(0x7f90cc06e2d0 msgr2=0x7f90cc06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.925+0000 7f90d3d98640 1 -- 172.21.15.100:0/3695859681 shutdown_connections 2024-09-12T02:40:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.925+0000 7f90d3d98640 1 -- 172.21.15.100:0/3695859681 wait complete. 2024-09-12T02:40:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.926+0000 7f90d3d98640 1 Processor -- start 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d3d98640 1 -- start start 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d3d98640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc1091f0 0x7f90cc113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d3d98640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90cc109ba0 0x7f90cc1143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d3d98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc114ab0 0x7f90cc10aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d3d98640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc11a7b0 con 0x7f90cc109ba0 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d3d98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc11a630 con 0x7f90cc114ab0 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d3d98640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc11a930 con 0x7f90cc1091f0 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc1091f0 0x7f90cc113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc1091f0 0x7f90cc113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:55292/0 (socket says 172.21.15.100:55292) 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 -- 172.21.15.100:0/3684132529 learned_addr learned my addr 172.21.15.100:0/3684132529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d2335640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc114ab0 0x7f90cc10aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1333640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90cc109ba0 0x7f90cc1143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 -- 172.21.15.100:0/3684132529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc114ab0 msgr2=0x7f90cc10aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc114ab0 0x7f90cc10aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 -- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90cc109ba0 msgr2=0x7f90cc1143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90cc109ba0 0x7f90cc1143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.927+0000 7f90d1b34640 1 -- 172.21.15.100:0/3684132529 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc10b760 con 0x7f90cc1091f0 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.928+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc1091f0 0x7f90cc113ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000f80 tx=0x7f90c4003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.928+0000 7f90caffd640 1 -- 172.21.15.100:0/3684132529 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c4031680 con 0x7f90cc1091f0 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.928+0000 7f90caffd640 1 -- 172.21.15.100:0/3684132529 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90c402d070 con 0x7f90cc1091f0 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.928+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc10b9f0 con 0x7f90cc1091f0 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.928+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc10fac0 con 0x7f90cc1091f0 2024-09-12T02:40:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.928+0000 7f90caffd640 1 -- 172.21.15.100:0/3684132529 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c402f9a0 con 0x7f90cc1091f0 2024-09-12T02:40:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.931+0000 7f90caffd640 1 -- 172.21.15.100:0/3684132529 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f90c402fb40 con 0x7f90cc1091f0 2024-09-12T02:40:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.931+0000 7f90d6171740 1 Processor -- start 2024-09-12T02:40:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.931+0000 7f90d6171740 1 -- start start 2024-09-12T02:40:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90d6171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c860b40 0x56424c85f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90d6171740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c85fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90d6171740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c86c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90d6171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56424c7c52f0 con 0x56424c860b40 2024-09-12T02:40:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90d6171740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56424c76ccf0 con 0x56424c85f5d0 2024-09-12T02:40:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90d6171740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56424c7c12b0 con 0x56424c86a370 2024-09-12T02:40:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90caffd640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f90b40a2bc0 0x7f90b40a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.932+0000 7f90caffd640 1 -- 172.21.15.100:0/3684132529 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f90c40f06e0 con 0x7f90cc1091f0 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c85fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d2335640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f90b40a2bc0 0x7f90b40a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c85fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36092/0 (socket says 172.21.15.100:36092) 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 -- 172.21.15.100:0/3875839316 learned_addr learned my addr 172.21.15.100:0/3875839316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1333640 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c86c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d2335640 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c860b40 0x56424c85f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 -- 172.21.15.100:0/3875839316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 msgr2=0x56424c86c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c86c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 -- 172.21.15.100:0/3875839316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c860b40 msgr2=0x56424c85f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c860b40 0x56424c85f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 -- 172.21.15.100:0/3875839316 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424c7513a0 con 0x56424c85f5d0 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1333640 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c86c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d2335640 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c860b40 0x56424c85f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c85fa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90c40f0980 tx=0x7f90c4004850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d707a34310da788 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.933+0000 7f90d2335640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f90b40a2bc0 0x7f90b40a5080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00a520 tx=0x7f90bc00a730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.934+0000 7f90b3fff640 1 -- 172.21.15.100:0/3875839316 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c40bced0 con 0x56424c85f5d0 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.934+0000 7f90b3fff640 1 -- 172.21.15.100:0/3875839316 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90c4036030 con 0x56424c85f5d0 2024-09-12T02:40:04.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.934+0000 7f90b3fff640 1 -- 172.21.15.100:0/3875839316 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c40b9540 con 0x56424c85f5d0 2024-09-12T02:40:04.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.934+0000 7f90d6171740 1 -- 172.21.15.100:0/3875839316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 msgr2=0x56424c85fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.934+0000 7f90d6171740 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c85fa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90c40f0980 tx=0x7f90c4004850 comp rx=0 tx=0).stop 2024-09-12T02:40:04.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.935+0000 7f90d6171740 1 -- 172.21.15.100:0/3875839316 shutdown_connections 2024-09-12T02:40:04.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.935+0000 7f90d6171740 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c86c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.935+0000 7f90d6171740 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c85fa10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.935+0000 7f90d6171740 1 --2- 172.21.15.100:0/3875839316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c860b40 0x56424c85f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.935+0000 7f90d6171740 1 -- 172.21.15.100:0/3875839316 >> 172.21.15.100:0/3875839316 conn(0x56424c828310 msgr2=0x56424c85bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.935+0000 7f90d6171740 1 -- 172.21.15.100:0/3875839316 shutdown_connections 2024-09-12T02:40:04.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.936+0000 7f90d6171740 1 -- 172.21.15.100:0/3875839316 wait complete. 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.937+0000 7f90d6171740 1 -- start start 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.937+0000 7f90d6171740 1 Processor -- start 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.937+0000 7f90d6171740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c869df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.937+0000 7f90d6171740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c860b40 0x56424c8670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.937+0000 7f90d6171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8677e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d6171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56424c86ce30 con 0x56424c86a370 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d6171740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56424c780060 con 0x56424c85f5d0 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d6171740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56424c86cfb0 con 0x56424c860b40 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d6171740 10 client.0 _ll_register_callbacks cb 0x56424c4d38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c860b40 0x56424c8670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d2335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c860b40 0x56424c8670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:55322/0 (socket says 172.21.15.100:55322) 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 -- 172.21.15.100:0/3931395441 learned_addr learned my addr 172.21.15.100:0/3931395441 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d2335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8677e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54686/0 (socket says 172.21.15.100:54686) 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c869df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 -- 172.21.15.100:0/3931395441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 msgr2=0x56424c869df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c869df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 -- 172.21.15.100:0/3931395441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 msgr2=0x56424c8677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 -- 172.21.15.100:0/3931395441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56424c5363c0 con 0x56424c860b40 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d1333640 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c860b40 0x56424c8670a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90c00124f0 tx=0x7f90c00128f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4565c100212e17c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90b17fa640 1 -- 172.21.15.100:0/3931395441 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c001f060 con 0x56424c860b40 2024-09-12T02:40:04.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.938+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90c4036030 con 0x56424c860b40 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90b17fa640 1 -- 172.21.15.100:0/3931395441 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f90c0010700 con 0x56424c860b40 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90b17fa640 1 -- 172.21.15.100:0/3931395441 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f90c0010900 con 0x56424c860b40 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 10 client.25030 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56424c878870 con 0x56424c860b40 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90b17fa640 1 -- 172.21.15.100:0/3931395441 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90c4036030 con 0x56424c860b40 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90b17fa640 1 -- 172.21.15.100:0/3931395441 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f90c00193b0 con 0x56424c860b40 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 10 client.25030 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 10 client.25030 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 20 client.25030 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c879d30 0x56424c87c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 4 client.25030 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56424c7d2860 con 0x56424c879d30 2024-09-12T02:40:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.939+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c879d30 0x56424c87c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.940+0000 7f90b17fa640 10 client.25030 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.940+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c879d30 0x56424c87c160 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=732f5aa1071253ef server_cookie=866b8ccae424a775 in_seq=0 out_seq=0 2024-09-12T02:40:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.940+0000 7f90b17fa640 1 -- 172.21.15.100:0/3931395441 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56424c7d2860 con 0x56424c879d30 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.940+0000 7f90b17fa640 10 client.25030 handle_command_reply: tid=0 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.940+0000 7f90d6171740 1 client.25030 shutdown 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c860b40 msgr2=0x56424c8670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c860b40 0x56424c8670a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90c00124f0 tx=0x7f90c00128f0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 shutdown_connections 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c879d30 0x56424c87c160 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90b17fa640 0 client.25030 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c860b40 0x56424c8670a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 --2- 172.21.15.100:0/3931395441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c869df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.941+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 >> 172.21.15.100:0/3931395441 conn(0x56424c828310 msgr2=0x56424c8619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.942+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 shutdown_connections 2024-09-12T02:40:04.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.942+0000 7f90d6171740 1 -- 172.21.15.100:0/3931395441 wait complete. 2024-09-12T02:40:04.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.942+0000 7f90d6171740 20 client.25030 trim_cache size 0 max 16384 2024-09-12T02:40:04.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 Processor -- start 2024-09-12T02:40:04.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 -- start start 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c875fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c881a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c879d30 0x56424c881fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc1c74c0 con 0x56424c879d30 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc1c4d90 con 0x56424c85f5d0 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.957+0000 7f90d6171740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc1c2be0 con 0x56424c86a370 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c879d30 0x56424c881fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c879d30 0x56424c881fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54700/0 (socket says 172.21.15.100:54700) 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 -- 172.21.15.100:0/3352718477 learned_addr learned my addr 172.21.15.100:0/3352718477 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d1333640 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c881a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c875fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 -- 172.21.15.100:0/3352718477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 msgr2=0x56424c881a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c881a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 -- 172.21.15.100:0/3352718477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 msgr2=0x56424c875fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c875fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 -- 172.21.15.100:0/3352718477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424c860750 con 0x56424c879d30 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d1333640 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c881a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.958+0000 7f90d2335640 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c879d30 0x56424c881fb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f90bc004300 tx=0x7f90bc00a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84dfb804e4090f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.959+0000 7f90b37fe640 1 -- 172.21.15.100:0/3352718477 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc003af0 con 0x56424c879d30 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.959+0000 7f90b37fe640 1 -- 172.21.15.100:0/3352718477 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90bc003c90 con 0x56424c879d30 2024-09-12T02:40:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.959+0000 7f90b37fe640 1 -- 172.21.15.100:0/3352718477 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc01f670 con 0x56424c879d30 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 -- 172.21.15.100:0/3352718477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c879d30 msgr2=0x56424c881fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c879d30 0x56424c881fb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f90bc004300 tx=0x7f90bc00a250 comp rx=0 tx=0).stop 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 -- 172.21.15.100:0/3352718477 shutdown_connections 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c879d30 0x56424c881fb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c86a370 0x56424c881a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 --2- 172.21.15.100:0/3352718477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c875fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 -- 172.21.15.100:0/3352718477 >> 172.21.15.100:0/3352718477 conn(0x56424c828310 msgr2=0x56424c856a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.960+0000 7f90d6171740 1 -- 172.21.15.100:0/3352718477 shutdown_connections 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.961+0000 7f90d6171740 1 -- 172.21.15.100:0/3352718477 wait complete. 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.961+0000 7f90d6171740 1 -- start start 2024-09-12T02:40:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.961+0000 7f90d6171740 1 Processor -- start 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d6171740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c8723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d6171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8728f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d6171740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c879d30 0x56424c863990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d6171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc1c3250 con 0x56424c86a370 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d6171740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc1c46c0 con 0x56424c85f5d0 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c8723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d6171740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc1c3920 con 0x56424c879d30 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c8723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36112/0 (socket says 172.21.15.100:36112) 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 -- 172.21.15.100:0/3192820447 learned_addr learned my addr 172.21.15.100:0/3192820447 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1333640 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d6171740 10 client.0 _ll_register_callbacks cb 0x7f90c0009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d2335640 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c879d30 0x56424c863990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 -- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c879d30 msgr2=0x56424c863990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c879d30 0x56424c863990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 -- 172.21.15.100:0/3192820447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 msgr2=0x56424c8728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8728f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.962+0000 7f90d1b34640 1 -- 172.21.15.100:0/3192820447 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56424c8641c0 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90d1b34640 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c8723b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005e30 tx=0x7f90c402a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9261888db91484be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90b17fa640 1 -- 172.21.15.100:0/3192820447 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c40d8070 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90b17fa640 1 -- 172.21.15.100:0/3192820447 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f90c40ee1f0 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90bc003c90 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90b17fa640 1 -- 172.21.15.100:0/3192820447 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f90c40b9540 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90d6171740 10 client.25043 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56424c8e45a0 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.963+0000 7f90b17fa640 1 -- 172.21.15.100:0/3192820447 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90bc003c90 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90b17fa640 1 -- 172.21.15.100:0/3192820447 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f90c4004cd0 con 0x56424c85f5d0 2024-09-12T02:40:04.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90d6171740 10 client.25043 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90d6171740 10 client.25043 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:40:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90d6171740 20 client.25043 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90d6171740 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c8e4b30 0x56424c8e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90d6171740 4 client.25043 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:40:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56424c7ccd70 con 0x56424c8e4b30 2024-09-12T02:40:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.964+0000 7f90d1333640 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c8e4b30 0x56424c8e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.965+0000 7f90b17fa640 10 client.25043 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.965+0000 7f90d1333640 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c8e4b30 0x56424c8e6f20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e81b17f8751cd78d server_cookie=40984f7e9cb5feec in_seq=0 out_seq=0 2024-09-12T02:40:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.965+0000 7f90b17fa640 1 -- 172.21.15.100:0/3192820447 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56424c7ccd70 con 0x56424c8e4b30 2024-09-12T02:40:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.965+0000 7f90b17fa640 10 client.25043 handle_command_reply: tid=0 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.965+0000 7f90d6171740 1 client.25043 shutdown 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.966+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 msgr2=0x56424c8723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.966+0000 7f90d6171740 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c8723b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005e30 tx=0x7f90c402a8f0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 shutdown_connections 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x56424c8e4b30 0x56424c8e6f20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424c879d30 0x56424c863990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56424c86a370 0x56424c8728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 --2- 172.21.15.100:0/3192820447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56424c85f5d0 0x56424c8723b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 >> 172.21.15.100:0/3192820447 conn(0x56424c828310 msgr2=0x56424c865970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90b17fa640 0 client.25043 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 shutdown_connections 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 1 -- 172.21.15.100:0/3192820447 wait complete. 2024-09-12T02:40:04.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.967+0000 7f90d6171740 20 client.25043 trim_cache size 0 max 16384 2024-09-12T02:40:04.972 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:40:04.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f90b40a2bc0 msgr2=0x7f90b40a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f90b40a2bc0 0x7f90b40a5080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00a520 tx=0x7f90bc00a730 comp rx=0 tx=0).stop 2024-09-12T02:40:04.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc1091f0 msgr2=0x7f90cc113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc1091f0 0x7f90cc113ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000f80 tx=0x7f90c4003f10 comp rx=0 tx=0).stop 2024-09-12T02:40:04.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 shutdown_connections 2024-09-12T02:40:04.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f90b40a2bc0 0x7f90b40a5080 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc114ab0 0x7f90cc10aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90cc109ba0 0x7f90cc1143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 --2- 172.21.15.100:0/3684132529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc1091f0 0x7f90cc113ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 >> 172.21.15.100:0/3684132529 conn(0x7f90cc06e2d0 msgr2=0x7f90cc071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 shutdown_connections 2024-09-12T02:40:04.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:04.968+0000 7f90d3d98640 1 -- 172.21.15.100:0/3684132529 wait complete. 2024-09-12T02:40:05.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:04 smithi189 ceph-mon[35196]: pgmap v378: 97 pgs: 97 active+clean; 968 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 8.5 MiB/s wr, 705 op/s 2024-09-12T02:40:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:04 smithi117 ceph-mon[34898]: pgmap v378: 97 pgs: 97 active+clean; 968 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 8.5 MiB/s wr, 705 op/s 2024-09-12T02:40:05.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:40:06.125 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 55.0 s, 3706.4 tps, lat 26.961 ms stddev 27.480 2024-09-12T02:40:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.669+0000 7f413ad6a640 1 -- 172.21.15.100:0/104553569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 msgr2=0x7f41341089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.669+0000 7f413ad6a640 1 --2- 172.21.15.100:0/104553569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f41341089f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4120009860 tx=0x7f412002a340 comp rx=0 tx=0).stop 2024-09-12T02:40:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.670+0000 7f413ad6a640 1 -- 172.21.15.100:0/104553569 shutdown_connections 2024-09-12T02:40:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.670+0000 7f413ad6a640 1 --2- 172.21.15.100:0/104553569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4134109120 0x7f4134110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.670+0000 7f413ad6a640 1 --2- 172.21.15.100:0/104553569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f41341089f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.670+0000 7f413ad6a640 1 --2- 172.21.15.100:0/104553569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4134103ff0 0x7f41341043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.670+0000 7f413ad6a640 1 -- 172.21.15.100:0/104553569 >> 172.21.15.100:0/104553569 conn(0x7f41340ffab0 msgr2=0x7f4134101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.670+0000 7f413ad6a640 1 -- 172.21.15.100:0/104553569 shutdown_connections 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.670+0000 7f413ad6a640 1 -- 172.21.15.100:0/104553569 wait complete. 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 Processor -- start 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 -- start start 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4134103ff0 0x7f413419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f413419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4134109120 0x7f413419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4134114170 con 0x7f41341049a0 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4134113ff0 con 0x7f4134109120 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.671+0000 7f413ad6a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41341142f0 con 0x7f4134103ff0 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f413419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4138b06640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4134103ff0 0x7f413419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f413419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54724/0 (socket says 172.21.15.100:54724) 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 -- 172.21.15.100:0/1888125812 learned_addr learned my addr 172.21.15.100:0/1888125812 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4139307640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4134109120 0x7f413419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 -- 172.21.15.100:0/1888125812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4134103ff0 msgr2=0x7f413419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4134103ff0 0x7f413419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 -- 172.21.15.100:0/1888125812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4134109120 msgr2=0x7f413419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4134109120 0x7f413419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 -- 172.21.15.100:0/1888125812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413419f5c0 con 0x7f41341049a0 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4133fff640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f413419ab50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f412002a8b0 tx=0x7f4120033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4131ffb640 1 -- 172.21.15.100:0/1888125812 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120037040 con 0x7f41341049a0 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413419f850 con 0x7f41341049a0 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4131ffb640 1 -- 172.21.15.100:0/1888125812 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4120030550 con 0x7f41341049a0 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f4131ffb640 1 -- 172.21.15.100:0/1888125812 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120003970 con 0x7f41341049a0 2024-09-12T02:40:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.672+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41341a7190 con 0x7f41341049a0 2024-09-12T02:40:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.676+0000 7f413d143740 1 Processor -- start 2024-09-12T02:40:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.676+0000 7f4131ffb640 1 -- 172.21.15.100:0/1888125812 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4120042020 con 0x7f41341049a0 2024-09-12T02:40:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.676+0000 7f413d143740 1 -- start start 2024-09-12T02:40:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.676+0000 7f413d143740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.676+0000 7f413d143740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2df1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.676+0000 7f413d143740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2dfbb80 0x558ae2dfdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.676+0000 7f413d143740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ae2d4e2f0 con 0x558ae2df2350 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f413d143740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558ae2cf5cf0 con 0x558ae2dfbb80 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f413d143740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ae2d4a2b0 con 0x558ae2df0de0 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2dfbb80 0x558ae2dfdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4138b06640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2df1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2dfbb80 0x558ae2dfdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36124/0 (socket says 172.21.15.100:36124) 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 -- 172.21.15.100:0/2995385809 learned_addr learned my addr 172.21.15.100:0/2995385809 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4138b06640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2df1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:55362/0 (socket says 172.21.15.100:55362) 2024-09-12T02:40:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 -- 172.21.15.100:0/2995385809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 msgr2=0x558ae2df1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2df1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 -- 172.21.15.100:0/2995385809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 msgr2=0x558ae2df08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.677+0000 7f4133fff640 1 -- 172.21.15.100:0/2995385809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ae2cda3a0 con 0x558ae2dfbb80 2024-09-12T02:40:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.678+0000 7f4133fff640 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2dfbb80 0x558ae2dfdf70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41200f45b0 tx=0x7f41200f46a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d71c4b49a8c8fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.678+0000 7f411effd640 1 -- 172.21.15.100:0/2995385809 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200f00d0 con 0x558ae2dfbb80 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.678+0000 7f411effd640 1 -- 172.21.15.100:0/2995385809 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41200fb030 con 0x558ae2dfbb80 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.678+0000 7f411effd640 1 -- 172.21.15.100:0/2995385809 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120100a50 con 0x558ae2dfbb80 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.678+0000 7f4138b06640 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2df1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.679+0000 7f4131ffb640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41240a2c40 0x7f41240a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.679+0000 7f4131ffb640 1 -- 172.21.15.100:0/1888125812 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f41200ee6b0 con 0x7f41341049a0 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.679+0000 7f4139307640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41240a2c40 0x7f41240a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.679+0000 7f413d143740 1 -- 172.21.15.100:0/2995385809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2dfbb80 msgr2=0x558ae2dfdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.679+0000 7f413d143740 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2dfbb80 0x558ae2dfdf70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41200f45b0 tx=0x7f41200f46a0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 -- 172.21.15.100:0/2995385809 shutdown_connections 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2dfbb80 0x558ae2dfdf70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2df1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 --2- 172.21.15.100:0/2995385809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 -- 172.21.15.100:0/2995385809 >> 172.21.15.100:0/2995385809 conn(0x558ae2db1310 msgr2=0x558ae2ded470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 -- 172.21.15.100:0/2995385809 shutdown_connections 2024-09-12T02:40:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 -- 172.21.15.100:0/2995385809 wait complete. 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 -- start start 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f413d143740 1 Processor -- start 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.680+0000 7f4139307640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41240a2c40 0x7f41240a5100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f412c009a60 tx=0x7f412c010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f413d143740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2dfb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f413d143740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df2350 0x558ae2df87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f413d143740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f413d143740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ae2e0f650 con 0x558ae2dfbb80 2024-09-12T02:40:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f413d143740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558ae2d09060 con 0x558ae2df0de0 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f413d143740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ae2e0f7d0 con 0x558ae2df2350 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f4139307640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f4139307640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54742/0 (socket says 172.21.15.100:54742) 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f4139307640 1 -- 172.21.15.100:0/532451710 learned_addr learned my addr 172.21.15.100:0/532451710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.681+0000 7f413d143740 10 client.0 _ll_register_callbacks cb 0x558ae2a5c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4133fff640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df2350 0x558ae2df87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4138b06640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2dfb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4139307640 1 -- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df2350 msgr2=0x558ae2df87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4139307640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df2350 0x558ae2df87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4139307640 1 -- 172.21.15.100:0/532451710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 msgr2=0x558ae2dfb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4139307640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2dfb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4139307640 1 -- 172.21.15.100:0/532451710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ae2abf3c0 con 0x558ae2dfbb80 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4133fff640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df2350 0x558ae2df87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4139307640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df8d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f412c0042e0 tx=0x7f412c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab2bbe84dd690f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.682+0000 7f4113fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.683+0000 7f4113fff640 1 -- 172.21.15.100:0/532451710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c029060 con 0x558ae2dfbb80 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.683+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41200fb030 con 0x558ae2dfbb80 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.683+0000 7f4113fff640 1 -- 172.21.15.100:0/532451710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f412c01ab30 con 0x558ae2dfbb80 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.683+0000 7f4113fff640 1 -- 172.21.15.100:0/532451710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f412c01ad30 con 0x558ae2dfbb80 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.683+0000 7f413d143740 10 client.15552 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.683+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558ae2e1b090 con 0x558ae2dfbb80 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f4113fff640 1 -- 172.21.15.100:0/532451710 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f412c024950 con 0x558ae2dfbb80 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f4113fff640 1 -- 172.21.15.100:0/532451710 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f412c00b040 con 0x558ae2dfbb80 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f413d143740 10 client.15552 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f413d143740 10 client.15552 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f413d143740 20 client.15552 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f413d143740 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e1c4a0 0x558ae2e1e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f413d143740 4 client.15552 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f41200fb030 con 0x558ae2e1c4a0 2024-09-12T02:40:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.684+0000 7f4138b06640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e1c4a0 0x558ae2e1e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.685+0000 7f4113fff640 10 client.15552 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.685+0000 7f4138b06640 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e1c4a0 0x558ae2e1e8b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d53008a534556db server_cookie=e51c1d5d9d2b12ac in_seq=0 out_seq=0 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.685+0000 7f4113fff640 1 -- 172.21.15.100:0/532451710 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f41200fb030 con 0x558ae2e1c4a0 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.685+0000 7f4113fff640 10 client.15552 handle_command_reply: tid=0 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.685+0000 7f413d143740 1 client.15552 shutdown 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 msgr2=0x558ae2df8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df8d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f412c0042e0 tx=0x7f412c004ab0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 shutdown_connections 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e1c4a0 0x558ae2e1e8b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df8d00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df2350 0x558ae2df87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 --2- 172.21.15.100:0/532451710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2dfb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 >> 172.21.15.100:0/532451710 conn(0x558ae2db1310 msgr2=0x558ae2df3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f4113fff640 0 client.15552 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 shutdown_connections 2024-09-12T02:40:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.686+0000 7f413d143740 1 -- 172.21.15.100:0/532451710 wait complete. 2024-09-12T02:40:06.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.687+0000 7f413d143740 20 client.15552 trim_cache size 0 max 16384 2024-09-12T02:40:06.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.706+0000 7f413d143740 1 Processor -- start 2024-09-12T02:40:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.706+0000 7f413d143740 1 -- start start 2024-09-12T02:40:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f413d143740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2e188b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f413d143740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df2350 0x558ae2df3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f413d143740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f413d143740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4134072550 con 0x558ae2dfbb80 2024-09-12T02:40:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f413d143740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f413406fe20 con 0x558ae2df2350 2024-09-12T02:40:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f413d143740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f413406dc90 con 0x558ae2df0de0 2024-09-12T02:40:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4133fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df2350 0x558ae2df3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4138b06640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2e188b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4133fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df2350 0x558ae2df3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36136/0 (socket says 172.21.15.100:36136) 2024-09-12T02:40:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4133fff640 1 -- 172.21.15.100:0/2287021139 learned_addr learned my addr 172.21.15.100:0/2287021139 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4139307640 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4138b06640 1 -- 172.21.15.100:0/2287021139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df2350 msgr2=0x558ae2df3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4138b06640 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df2350 0x558ae2df3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4138b06640 1 -- 172.21.15.100:0/2287021139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 msgr2=0x558ae2df3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4138b06640 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.707+0000 7f4138b06640 1 -- 172.21.15.100:0/2287021139 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ae2df43b0 con 0x558ae2df0de0 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.708+0000 7f4138b06640 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2e188b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x558ae2e0f8f0 tx=0x7f41280138f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80ef7d1ad24108f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.708+0000 7f411e7fc640 1 -- 172.21.15.100:0/2287021139 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128005220 con 0x558ae2df0de0 2024-09-12T02:40:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.708+0000 7f411e7fc640 1 -- 172.21.15.100:0/2287021139 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4128004c80 con 0x558ae2df0de0 2024-09-12T02:40:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.708+0000 7f411e7fc640 1 -- 172.21.15.100:0/2287021139 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412801c940 con 0x558ae2df0de0 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 -- 172.21.15.100:0/2287021139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 msgr2=0x558ae2e188b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2e188b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x558ae2e0f8f0 tx=0x7f41280138f0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 -- 172.21.15.100:0/2287021139 shutdown_connections 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2dfbb80 0x558ae2df3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df2350 0x558ae2df3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 --2- 172.21.15.100:0/2287021139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2df0de0 0x558ae2e188b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 -- 172.21.15.100:0/2287021139 >> 172.21.15.100:0/2287021139 conn(0x558ae2db1310 msgr2=0x558ae2de3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 -- 172.21.15.100:0/2287021139 shutdown_connections 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 -- 172.21.15.100:0/2287021139 wait complete. 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.710+0000 7f413d143740 1 -- start start 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 1 Processor -- start 2024-09-12T02:40:06.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2e151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2dfbb80 0x558ae2df5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f413406e2e0 con 0x558ae2df2350 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f413406f750 con 0x558ae2df0de0 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f413406e9b0 con 0x558ae2dfbb80 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f413d143740 10 client.0 _ll_register_callbacks cb 0x7f412c003d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4139307640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2dfbb80 0x558ae2df5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4133fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4139307640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2dfbb80 0x558ae2df5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:55378/0 (socket says 172.21.15.100:55378) 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4133fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54758/0 (socket says 172.21.15.100:54758) 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4139307640 1 -- 172.21.15.100:0/717540664 learned_addr learned my addr 172.21.15.100:0/717540664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4138b06640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2e151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4133fff640 1 -- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2dfbb80 msgr2=0x558ae2df5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.711+0000 7f4133fff640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2dfbb80 0x558ae2df5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4133fff640 1 -- 172.21.15.100:0/717540664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 msgr2=0x558ae2e151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4133fff640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2e151d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4133fff640 1 -- 172.21.15.100:0/717540664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ae2df6290 con 0x558ae2df2350 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4138b06640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2e151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4139307640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2dfbb80 0x558ae2df5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4133fff640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df5520 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f41200f4ba0 tx=0x7f41200db0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bb0fff5743cc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4113fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4113fff640 1 -- 172.21.15.100:0/717540664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200b7140 con 0x558ae2df2350 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4128004c80 con 0x558ae2df2350 2024-09-12T02:40:06.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4113fff640 1 -- 172.21.15.100:0/717540664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f41200b7510 con 0x558ae2df2350 2024-09-12T02:40:06.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4113fff640 1 -- 172.21.15.100:0/717540664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f41200ba800 con 0x558ae2df2350 2024-09-12T02:40:06.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f413d143740 10 client.15558 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:06.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558ae2e87200 con 0x558ae2df2350 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.712+0000 7f4113fff640 1 -- 172.21.15.100:0/717540664 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4128004c80 con 0x558ae2df2350 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.713+0000 7f4113fff640 1 -- 172.21.15.100:0/717540664 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f412003a070 con 0x558ae2df2350 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.714+0000 7f413d143740 10 client.15558 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.714+0000 7f413d143740 10 client.15558 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.714+0000 7f413d143740 20 client.15558 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.714+0000 7f413d143740 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e87710 0x558ae2e89b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.714+0000 7f413d143740 4 client.15558 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.714+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ae2d5b860 con 0x558ae2e87710 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.714+0000 7f4138b06640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e87710 0x558ae2e89b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f4138b06640 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e87710 0x558ae2e89b30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be9496641febb73b server_cookie=e77646836e496c12 in_seq=0 out_seq=0 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f4113fff640 10 client.15558 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f4113fff640 1 -- 172.21.15.100:0/717540664 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ae2d5b860 con 0x558ae2e87710 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f4113fff640 10 client.15558 handle_command_reply: tid=0 2024-09-12T02:40:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 client.15558 shutdown 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 msgr2=0x558ae2df5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df5520 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f41200f4ba0 tx=0x7f41200db0b0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 shutdown_connections 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558ae2e87710 0x558ae2e89b30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ae2dfbb80 0x558ae2df5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f4113fff640 0 client.15558 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ae2df2350 0x558ae2df5520 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 --2- 172.21.15.100:0/717540664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ae2df0de0 0x558ae2e151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 >> 172.21.15.100:0/717540664 conn(0x558ae2db1310 msgr2=0x558ae2dfa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 shutdown_connections 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 1 -- 172.21.15.100:0/717540664 wait complete. 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.715+0000 7f413d143740 20 client.15558 trim_cache size 0 max 16384 2024-09-12T02:40:06.720 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:40:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41240a2c40 msgr2=0x7f41240a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41240a2c40 0x7f41240a5100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f412c009a60 tx=0x7f412c010040 comp rx=0 tx=0).stop 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 msgr2=0x7f413419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f413419ab50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f412002a8b0 tx=0x7f4120033d10 comp rx=0 tx=0).stop 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 shutdown_connections 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f41240a2c40 0x7f41240a5100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4134109120 0x7f413419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41341049a0 0x7f413419ab50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 --2- 172.21.15.100:0/1888125812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4134103ff0 0x7f413419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 >> 172.21.15.100:0/1888125812 conn(0x7f41340ffab0 msgr2=0x7f4134100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 shutdown_connections 2024-09-12T02:40:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:06.716+0000 7f413ad6a640 1 -- 172.21.15.100:0/1888125812 wait complete. 2024-09-12T02:40:06.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:06 smithi100 ceph-mon[31390]: pgmap v379: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 807 op/s 2024-09-12T02:40:06.962 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:06 smithi189 ceph-mon[35196]: pgmap v379: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 807 op/s 2024-09-12T02:40:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:06 smithi117 ceph-mon[34898]: pgmap v379: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 807 op/s 2024-09-12T02:40:07.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:40:07.767 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:08.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.432+0000 7fa093a58640 1 -- 172.21.15.100:0/392173915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c1027c0 msgr2=0x7fa08c106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.432+0000 7fa093a58640 1 --2- 172.21.15.100:0/392173915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c1027c0 0x7fa08c106810 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009900 tx=0x7fa07c02a410 comp rx=0 tx=0).stop 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.433+0000 7fa093a58640 1 -- 172.21.15.100:0/392173915 shutdown_connections 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.433+0000 7fa093a58640 1 --2- 172.21.15.100:0/392173915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa08c106f40 0x7fa08c10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.433+0000 7fa093a58640 1 --2- 172.21.15.100:0/392173915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c1027c0 0x7fa08c106810 secure :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009900 tx=0x7fa07c02a410 comp rx=0 tx=0).stop 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.433+0000 7fa093a58640 1 --2- 172.21.15.100:0/392173915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa08c101e10 0x7fa08c1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.433+0000 7fa093a58640 1 -- 172.21.15.100:0/392173915 >> 172.21.15.100:0/392173915 conn(0x7fa08c0fd8d0 msgr2=0x7fa08c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.434+0000 7fa093a58640 1 -- 172.21.15.100:0/392173915 shutdown_connections 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.434+0000 7fa093a58640 1 -- 172.21.15.100:0/392173915 wait complete. 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.434+0000 7fa093a58640 1 Processor -- start 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa093a58640 1 -- start start 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa093a58640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa08c101e10 0x7fa08c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa093a58640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c106f40 0x7fa08c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa093a58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa08c074f70 0x7fa08c1a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa093a58640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c112000 con 0x7fa08c106f40 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa093a58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c111e80 con 0x7fa08c074f70 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa093a58640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c112180 con 0x7fa08c101e10 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c106f40 0x7fa08c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c106f40 0x7fa08c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54780/0 (socket says 172.21.15.100:54780) 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 -- 172.21.15.100:0/3531445073 learned_addr learned my addr 172.21.15.100:0/3531445073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa0917f4640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa08c101e10 0x7fa08c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa091ff5640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa08c074f70 0x7fa08c1a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 -- 172.21.15.100:0/3531445073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa08c101e10 msgr2=0x7fa08c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa08c101e10 0x7fa08c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 -- 172.21.15.100:0/3531445073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa08c074f70 msgr2=0x7fa08c1a68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa08c074f70 0x7fa08c1a68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa090ff3640 1 -- 172.21.15.100:0/3531445073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c1a6fc0 con 0x7fa08c106f40 2024-09-12T02:40:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.435+0000 7fa091ff5640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa08c074f70 0x7fa08c1a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.436+0000 7fa090ff3640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c106f40 0x7fa08c074a30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa07c005940 tx=0x7fa07c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.436+0000 7fa0827fc640 1 -- 172.21.15.100:0/3531445073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c03f030 con 0x7fa08c106f40 2024-09-12T02:40:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.436+0000 7fa0827fc640 1 -- 172.21.15.100:0/3531445073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa07c003ce0 con 0x7fa08c106f40 2024-09-12T02:40:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.436+0000 7fa0827fc640 1 -- 172.21.15.100:0/3531445073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c035070 con 0x7fa08c106f40 2024-09-12T02:40:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.436+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c1a7250 con 0x7fa08c106f40 2024-09-12T02:40:08.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.436+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c1a76e0 con 0x7fa08c106f40 2024-09-12T02:40:08.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.439+0000 7fa095e31740 1 Processor -- start 2024-09-12T02:40:08.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa095e31740 1 -- start start 2024-09-12T02:40:08.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa0827fc640 1 -- 172.21.15.100:0/3531445073 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fa07c042030 con 0x7fa08c106f40 2024-09-12T02:40:08.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa095e31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dc9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa095e31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dc9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa095e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa095e31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1a9d2f2f0 con 0x55a1a9dd4370 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa095e31740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a1a9cd6cf0 con 0x55a1a9dc95d0 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa095e31740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a1a9d2b2b0 con 0x55a1a9dcab40 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa090ff3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa091ff5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dc9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa0917f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dc9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa090ff3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54786/0 (socket says 172.21.15.100:54786) 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa090ff3640 1 -- 172.21.15.100:0/575924445 learned_addr learned my addr 172.21.15.100:0/575924445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa091ff5640 1 -- 172.21.15.100:0/575924445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dc95d0 msgr2=0x55a1a9dc9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa091ff5640 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dc9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa091ff5640 1 -- 172.21.15.100:0/575924445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dd4370 msgr2=0x55a1a9dd6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa091ff5640 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa091ff5640 1 -- 172.21.15.100:0/575924445 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a9cbb3a0 con 0x55a1a9dcab40 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.440+0000 7fa090ff3640 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.441+0000 7fa091ff5640 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dc9090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa084010690 tx=0x7fa084010b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d920267838ad4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.441+0000 7fa0827fc640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0780a2c00 0x7fa0780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.441+0000 7fa0917f4640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0780a2c00 0x7fa0780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.441+0000 7fa0777fe640 1 -- 172.21.15.100:0/575924445 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084004b20 con 0x55a1a9dcab40 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.441+0000 7fa0827fc640 1 -- 172.21.15.100:0/3531445073 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa07c0ef340 con 0x7fa08c106f40 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.441+0000 7fa0777fe640 1 -- 172.21.15.100:0/575924445 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa08400edb0 con 0x55a1a9dcab40 2024-09-12T02:40:08.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.441+0000 7fa0777fe640 1 -- 172.21.15.100:0/575924445 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084005790 con 0x55a1a9dcab40 2024-09-12T02:40:08.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 -- 172.21.15.100:0/575924445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 msgr2=0x55a1a9dc9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dc9090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa084010690 tx=0x7fa084010b50 comp rx=0 tx=0).stop 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa0917f4640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0780a2c00 0x7fa0780a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55a1a9dc6ac0 tx=0x7fa0880090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 -- 172.21.15.100:0/575924445 shutdown_connections 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dc9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 --2- 172.21.15.100:0/575924445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dc9090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 -- 172.21.15.100:0/575924445 >> 172.21.15.100:0/575924445 conn(0x55a1a9d92310 msgr2=0x55a1a9dc5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 -- 172.21.15.100:0/575924445 shutdown_connections 2024-09-12T02:40:08.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 -- 172.21.15.100:0/575924445 wait complete. 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 -- start start 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.442+0000 7fa095e31740 1 Processor -- start 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa095e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa095e31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa095e31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa095e31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1a9dd7070 con 0x55a1a9dc95d0 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa095e31740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a1a9cea060 con 0x55a1a9dd4370 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa095e31740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a1a9dd71f0 con 0x55a1a9dcab40 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa091ff5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa090ff3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa091ff5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36178/0 (socket says 172.21.15.100:36178) 2024-09-12T02:40:08.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa091ff5640 1 -- 172.21.15.100:0/2294834044 learned_addr learned my addr 172.21.15.100:0/2294834044 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa095e31740 10 client.0 _ll_register_callbacks cb 0x55a1a9a3d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.444+0000 7fa0917f4640 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa091ff5640 1 -- 172.21.15.100:0/2294834044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 msgr2=0x55a1a9dd0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa091ff5640 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa091ff5640 1 -- 172.21.15.100:0/2294834044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 msgr2=0x55a1a9dd3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa091ff5640 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa091ff5640 1 -- 172.21.15.100:0/2294834044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a9aa03c0 con 0x55a1a9dd4370 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa091ff5640 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd14a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa0840098b0 tx=0x7fa0840103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d6e1e0adb74073 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa074ff9640 1 -- 172.21.15.100:0/2294834044 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08402b060 con 0x55a1a9dd4370 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.445+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa08400edb0 con 0x55a1a9dd4370 2024-09-12T02:40:08.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.446+0000 7fa074ff9640 1 -- 172.21.15.100:0/2294834044 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa084004a40 con 0x55a1a9dd4370 2024-09-12T02:40:08.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.446+0000 7fa074ff9640 1 -- 172.21.15.100:0/2294834044 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa084004c40 con 0x55a1a9dd4370 2024-09-12T02:40:08.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.446+0000 7fa095e31740 10 client.25067 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:08.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.446+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a1a9de2aa0 con 0x55a1a9dd4370 2024-09-12T02:40:08.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.446+0000 7fa074ff9640 1 -- 172.21.15.100:0/2294834044 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa084004de0 con 0x55a1a9dd4370 2024-09-12T02:40:08.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa074ff9640 1 -- 172.21.15.100:0/2294834044 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa08400f040 con 0x55a1a9dd4370 2024-09-12T02:40:08.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa095e31740 10 client.25067 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:08.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa095e31740 10 client.25067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa095e31740 20 client.25067 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa095e31740 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9de4230 0x55a1a9de6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa095e31740 4 client.25067 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa08400edb0 con 0x55a1a9de4230 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.447+0000 7fa0917f4640 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9de4230 0x55a1a9de6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.448+0000 7fa0917f4640 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9de4230 0x55a1a9de6670 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fff0c91432a8638 server_cookie=75cd450517a94386 in_seq=0 out_seq=0 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.448+0000 7fa074ff9640 10 client.25067 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.449+0000 7fa074ff9640 1 -- 172.21.15.100:0/2294834044 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa08400edb0 con 0x55a1a9de4230 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.449+0000 7fa074ff9640 10 client.25067 handle_command_reply: tid=0 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.449+0000 7fa095e31740 1 client.25067 shutdown 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 msgr2=0x55a1a9dd14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd14a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa0840098b0 tx=0x7fa0840103d0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 shutdown_connections 2024-09-12T02:40:08.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9de4230 0x55a1a9de6670 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd14a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 --2- 172.21.15.100:0/2294834044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 >> 172.21.15.100:0/2294834044 conn(0x55a1a9d92310 msgr2=0x55a1a9dcb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa074ff9640 0 client.25067 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 shutdown_connections 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 1 -- 172.21.15.100:0/2294834044 wait complete. 2024-09-12T02:40:08.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.450+0000 7fa095e31740 20 client.25067 trim_cache size 0 max 16384 2024-09-12T02:40:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 Processor -- start 2024-09-12T02:40:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 -- start start 2024-09-12T02:40:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9de0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dcf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dcfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c1b26c0 con 0x55a1a9dc95d0 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c1aff90 con 0x55a1a9dd4370 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa095e31740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c1adde0 con 0x55a1a9dcab40 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9de0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9de0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54804/0 (socket says 172.21.15.100:54804) 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 -- 172.21.15.100:0/1384478073 learned_addr learned my addr 172.21.15.100:0/1384478073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa090ff3640 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dcf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa091ff5640 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dcfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 -- 172.21.15.100:0/1384478073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 msgr2=0x55a1a9dcf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dcf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 -- 172.21.15.100:0/1384478073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 msgr2=0x55a1a9dcfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dcfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 -- 172.21.15.100:0/1384478073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a9dd4020 con 0x55a1a9dc95d0 2024-09-12T02:40:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa090ff3640 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dcf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.468+0000 7fa0917f4640 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9de0370 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa088011c70 tx=0x7fa088019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7f1290cf3e0b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.469+0000 7fa076ffd640 1 -- 172.21.15.100:0/1384478073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088024a70 con 0x55a1a9dc95d0 2024-09-12T02:40:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.469+0000 7fa076ffd640 1 -- 172.21.15.100:0/1384478073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa088030070 con 0x55a1a9dc95d0 2024-09-12T02:40:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.469+0000 7fa076ffd640 1 -- 172.21.15.100:0/1384478073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0880223e0 con 0x55a1a9dc95d0 2024-09-12T02:40:08.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.469+0000 7fa095e31740 1 -- 172.21.15.100:0/1384478073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 msgr2=0x55a1a9de0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.469+0000 7fa095e31740 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9de0370 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa088011c70 tx=0x7fa088019000 comp rx=0 tx=0).stop 2024-09-12T02:40:08.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 -- 172.21.15.100:0/1384478073 shutdown_connections 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dd4370 0x55a1a9dcfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dcab40 0x55a1a9dcf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 --2- 172.21.15.100:0/1384478073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9de0370 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 -- 172.21.15.100:0/1384478073 >> 172.21.15.100:0/1384478073 conn(0x55a1a9d92310 msgr2=0x55a1a9dd07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 -- 172.21.15.100:0/1384478073 shutdown_connections 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 -- 172.21.15.100:0/1384478073 wait complete. 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 -- start start 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.470+0000 7fa095e31740 1 Processor -- start 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa095e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa095e31740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa095e31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa090ff3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa090ff3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36194/0 (socket says 172.21.15.100:36194) 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa095e31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c1ae450 con 0x55a1a9dc95d0 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa090ff3640 1 -- 172.21.15.100:0/1809575439 learned_addr learned my addr 172.21.15.100:0/1809575439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c1af8c0 con 0x55a1a9dcab40 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c1aeb20 con 0x55a1a9dd4370 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa095e31740 10 client.0 _ll_register_callbacks cb 0x7fa084016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa0917f4640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa091ff5640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa0917f4640 1 -- 172.21.15.100:0/1809575439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dd4370 msgr2=0x55a1a9dd7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa0917f4640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa0917f4640 1 -- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dcab40 msgr2=0x55a1a9dd7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa0917f4640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.471+0000 7fa0917f4640 1 -- 172.21.15.100:0/1809575439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a9e55a90 con 0x55a1a9dc95d0 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa090ff3640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa0917f4640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd74e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa088007010 tx=0x7fa088014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be8e672ff4036fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:08.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa074ff9640 1 -- 172.21.15.100:0/1809575439 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088024a70 con 0x55a1a9dc95d0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa088030070 con 0x55a1a9dc95d0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa074ff9640 1 -- 172.21.15.100:0/1809575439 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa088024c10 con 0x55a1a9dc95d0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa074ff9640 1 -- 172.21.15.100:0/1809575439 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa088034430 con 0x55a1a9dc95d0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa095e31740 10 client.15576 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a1a9e56d30 con 0x55a1a9dc95d0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.472+0000 7fa074ff9640 1 -- 172.21.15.100:0/1809575439 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa08801b040 con 0x55a1a9dc95d0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa074ff9640 1 -- 172.21.15.100:0/1809575439 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa088020040 con 0x55a1a9dc95d0 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa095e31740 10 client.15576 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa095e31740 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa095e31740 20 client.15576 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa095e31740 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9e573a0 0x55a1a9e597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:08.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa095e31740 4 client.15576 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa088030070 con 0x55a1a9e573a0 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa090ff3640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9e573a0 0x55a1a9e597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa090ff3640 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9e573a0 0x55a1a9e597c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77cc72983fc17d4 server_cookie=86c00ba9b97d7142 in_seq=0 out_seq=0 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa074ff9640 10 client.15576 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.473+0000 7fa074ff9640 1 -- 172.21.15.100:0/1809575439 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa088030070 con 0x55a1a9e573a0 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa074ff9640 10 client.15576 handle_command_reply: tid=0 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 client.15576 shutdown 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 msgr2=0x55a1a9dd74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd74e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa088007010 tx=0x7fa088014f30 comp rx=0 tx=0).stop 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 shutdown_connections 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a1a9e573a0 0x55a1a9e597c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1a9dd4370 0x55a1a9dd7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1a9dcab40 0x55a1a9dd7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 --2- 172.21.15.100:0/1809575439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1a9dc95d0 0x55a1a9dd74e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 >> 172.21.15.100:0/1809575439 conn(0x55a1a9d92310 msgr2=0x55a1a9dd2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:08.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa074ff9640 0 client.15576 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:08.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 shutdown_connections 2024-09-12T02:40:08.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 1 -- 172.21.15.100:0/1809575439 wait complete. 2024-09-12T02:40:08.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa095e31740 20 client.15576 trim_cache size 0 max 16384 2024-09-12T02:40:08.482 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0780a2c00 msgr2=0x7fa0780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa093a58640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0780a2c00 0x7fa0780a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55a1a9dc6ac0 tx=0x7fa0880090e0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c106f40 msgr2=0x7fa08c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.474+0000 7fa093a58640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c106f40 0x7fa08c074a30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa07c005940 tx=0x7fa07c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 shutdown_connections 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa0780a2c00 0x7fa0780a50c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa08c074f70 0x7fa08c1a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa08c106f40 0x7fa08c074a30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 --2- 172.21.15.100:0/3531445073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa08c101e10 0x7fa08c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 >> 172.21.15.100:0/3531445073 conn(0x7fa08c0fd8d0 msgr2=0x7fa08c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:08.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 shutdown_connections 2024-09-12T02:40:08.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:08.475+0000 7fa093a58640 1 -- 172.21.15.100:0/3531445073 wait complete. 2024-09-12T02:40:08.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:08 smithi100 ceph-mon[31390]: pgmap v380: 97 pgs: 97 active+clean; 981 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.0 MiB/s wr, 779 op/s 2024-09-12T02:40:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:08 smithi189 ceph-mon[35196]: pgmap v380: 97 pgs: 97 active+clean; 981 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.0 MiB/s wr, 779 op/s 2024-09-12T02:40:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:08 smithi117 ceph-mon[34898]: pgmap v380: 97 pgs: 97 active+clean; 981 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.0 MiB/s wr, 779 op/s 2024-09-12T02:40:10.236 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:40:10.236 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:40:10.583 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:11.004 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:10 smithi100 ceph-mon[31390]: pgmap v381: 97 pgs: 97 active+clean; 983 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.7 MiB/s wr, 821 op/s 2024-09-12T02:40:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:10 smithi189 ceph-mon[35196]: pgmap v381: 97 pgs: 97 active+clean; 983 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.7 MiB/s wr, 821 op/s 2024-09-12T02:40:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:10 smithi117 ceph-mon[34898]: pgmap v381: 97 pgs: 97 active+clean; 983 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.7 MiB/s wr, 821 op/s 2024-09-12T02:40:11.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 -- 172.21.15.100:0/681416506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 msgr2=0x7f69a8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 --2- 172.21.15.100:0/681416506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 0x7f69a8106f60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009900 tx=0x7f69a402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 -- 172.21.15.100:0/681416506 shutdown_connections 2024-09-12T02:40:11.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 --2- 172.21.15.100:0/681416506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100aa0 0x7f69a810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 --2- 172.21.15.100:0/681416506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69a8100100 0x7f69a8100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 --2- 172.21.15.100:0/681416506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 0x7f69a8106f60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 -- 172.21.15.100:0/681416506 >> 172.21.15.100:0/681416506 conn(0x7f69a8077230 msgr2=0x7f69a80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 -- 172.21.15.100:0/681416506 shutdown_connections 2024-09-12T02:40:11.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.126+0000 7f69b0407640 1 -- 172.21.15.100:0/681416506 wait complete. 2024-09-12T02:40:11.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 Processor -- start 2024-09-12T02:40:11.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 -- start start 2024-09-12T02:40:11.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100100 0x7f69a8111670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69a8100aa0 0x7f69a8111bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 0x7f69a8116e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69a810fe70 con 0x7f69a8106b80 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69a810fcf0 con 0x7f69a8100100 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69b0407640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f69a810fff0 con 0x7f69a8100aa0 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69ae1a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100100 0x7f69a8111670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69ae9a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 0x7f69a8116e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69ae1a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100100 0x7f69a8111670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36212/0 (socket says 172.21.15.100:36212) 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69ae1a3640 1 -- 172.21.15.100:0/2167005509 learned_addr learned my addr 172.21.15.100:0/2167005509 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.127+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69a8100aa0 0x7f69a8111bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69ae9a4640 1 -- 172.21.15.100:0/2167005509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69a8100aa0 msgr2=0x7f69a8111bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69ae9a4640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69a8100aa0 0x7f69a8111bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69ae9a4640 1 -- 172.21.15.100:0/2167005509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100100 msgr2=0x7f69a8111670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69ae9a4640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100100 0x7f69a8111670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69ae9a4640 1 -- 172.21.15.100:0/2167005509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a8117720 con 0x7f69a8106b80 2024-09-12T02:40:11.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100100 0x7f69a8111670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:11.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69ae9a4640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 0x7f69a8116e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f69a000caa0 tx=0x7f69a000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f699f7fe640 1 -- 172.21.15.100:0/2167005509 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a000ad30 con 0x7f69a8106b80 2024-09-12T02:40:11.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a8117a10 con 0x7f69a8106b80 2024-09-12T02:40:11.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f699f7fe640 1 -- 172.21.15.100:0/2167005509 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a0003e50 con 0x7f69a8106b80 2024-09-12T02:40:11.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f699f7fe640 1 -- 172.21.15.100:0/2167005509 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a000f6b0 con 0x7f69a8106b80 2024-09-12T02:40:11.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.128+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a81b3df0 con 0x7f69a8106b80 2024-09-12T02:40:11.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.132+0000 7f699f7fe640 1 -- 172.21.15.100:0/2167005509 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f69a0003970 con 0x7f69a8106b80 2024-09-12T02:40:11.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.132+0000 7f69b27e0740 1 Processor -- start 2024-09-12T02:40:11.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69b27e0740 1 -- start start 2024-09-12T02:40:11.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1bb60 0x55f812b1bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b26800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b29130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69b27e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f812a81280 con 0x55f812b26d40 2024-09-12T02:40:11.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69b27e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f812a28b10 con 0x55f812b1c480 2024-09-12T02:40:11.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69b27e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f812a7d240 con 0x55f812b1bb60 2024-09-12T02:40:11.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69ae1a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b26800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69ae1a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b26800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36222/0 (socket says 172.21.15.100:36222) 2024-09-12T02:40:11.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f69ae1a3640 1 -- 172.21.15.100:0/2721707694 learned_addr learned my addr 172.21.15.100:0/2721707694 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.133+0000 7f699f7fe640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69940a2cd0 0x7f69940a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b29130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ae1a3640 1 -- 172.21.15.100:0/2721707694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1bb60 msgr2=0x55f812b1bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1bb60 0x55f812b1bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ae1a3640 1 -- 172.21.15.100:0/2721707694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 msgr2=0x55f812b29130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b29130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ae1a3640 1 -- 172.21.15.100:0/2721707694 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f812a351f0 con 0x55f812b1c480 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b29130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:11.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f699f7fe640 1 -- 172.21.15.100:0/2167005509 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f69a00cef30 con 0x7f69a8106b80 2024-09-12T02:40:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b26800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69a4006010 tx=0x7f69a4004530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c891bddb8e4b922c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f699cdea640 1 -- 172.21.15.100:0/2721707694 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4040070 con 0x55f812b1c480 2024-09-12T02:40:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f699cdea640 1 -- 172.21.15.100:0/2721707694 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a40047a0 con 0x55f812b1c480 2024-09-12T02:40:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f699cdea640 1 -- 172.21.15.100:0/2721707694 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4035040 con 0x55f812b1c480 2024-09-12T02:40:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.134+0000 7f69ae9a4640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69940a2cd0 0x7f69940a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.135+0000 7f69ae9a4640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69940a2cd0 0x7f69940a5190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69a009b420 tx=0x7f69a0004920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.135+0000 7f69b27e0740 1 -- 172.21.15.100:0/2721707694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 msgr2=0x55f812b26800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.135+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b26800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69a4006010 tx=0x7f69a4004530 comp rx=0 tx=0).stop 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.136+0000 7f69b27e0740 1 -- 172.21.15.100:0/2721707694 shutdown_connections 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.136+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b29130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.136+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b26800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.136+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2721707694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1bb60 0x55f812b1bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.136+0000 7f69b27e0740 1 -- 172.21.15.100:0/2721707694 >> 172.21.15.100:0/2721707694 conn(0x55f812b180f0 msgr2=0x55f812b184d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.137+0000 7f69b27e0740 1 -- 172.21.15.100:0/2721707694 shutdown_connections 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.137+0000 7f69b27e0740 1 -- 172.21.15.100:0/2721707694 wait complete. 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.137+0000 7f69b27e0740 1 -- start start 2024-09-12T02:40:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.137+0000 7f69b27e0740 1 Processor -- start 2024-09-12T02:40:11.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.138+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b23cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.138+0000 7f69ad9a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b23cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.138+0000 7f69ad9a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b23cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54856/0 (socket says 172.21.15.100:54856) 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.138+0000 7f69ad9a2640 1 -- 172.21.15.100:0/3771697795 learned_addr learned my addr 172.21.15.100:0/3771697795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.138+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b241f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b26d40 0x55f812b24730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f812b299b0 con 0x55f812b1bb60 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f812a3bf10 con 0x55f812b26d40 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f812b29b30 con 0x55f812b1c480 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69b27e0740 10 client.0 _ll_register_callbacks cb 0x55f812a04a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b26d40 0x55f812b24730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b241f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ad9a2640 1 -- 172.21.15.100:0/3771697795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 msgr2=0x55f812b241f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b241f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ad9a2640 1 -- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b26d40 msgr2=0x55f812b24730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b26d40 0x55f812b24730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ad9a2640 1 -- 172.21.15.100:0/3771697795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8127f26a0 con 0x55f812b1bb60 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b23cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f699800ade0 tx=0x7f699800a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720755d03709fb55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f6991ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f6991ffb640 1 -- 172.21.15.100:0/3771697795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998019030 con 0x55f812b1bb60 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f6991ffb640 1 -- 172.21.15.100:0/3771697795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f699801e410 con 0x55f812b1bb60 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.139+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a40047a0 con 0x55f812b1bb60 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f6991ffb640 1 -- 172.21.15.100:0/3771697795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f699801e610 con 0x55f812b1bb60 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 10 client.15585 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f812b355f0 con 0x55f812b1bb60 2024-09-12T02:40:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f6991ffb640 1 -- 172.21.15.100:0/3771697795 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a40047a0 con 0x55f812b1bb60 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f6991ffb640 1 -- 172.21.15.100:0/3771697795 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f69980287a0 con 0x55f812b1bb60 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 10 client.15585 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 20 client.15585 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812b36dd0 0x55f812b391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 4 client.15585 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f812a8e7f0 con 0x55f812b36dd0 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.140+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812b36dd0 0x55f812b391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.141+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812b36dd0 0x55f812b391e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f22566e4227a346c server_cookie=1f1e86ed9ddf2c5f in_seq=0 out_seq=0 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.141+0000 7f6991ffb640 10 client.15585 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.141+0000 7f6991ffb640 1 -- 172.21.15.100:0/3771697795 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f812a8e7f0 con 0x55f812b36dd0 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.141+0000 7f6991ffb640 10 client.15585 handle_command_reply: tid=0 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.141+0000 7f69b27e0740 1 client.15585 shutdown 2024-09-12T02:40:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 msgr2=0x55f812b23cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b23cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f699800ade0 tx=0x7f699800a990 comp rx=0 tx=0).stop 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 shutdown_connections 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812b36dd0 0x55f812b391e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b26d40 0x55f812b24730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b241f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 --2- 172.21.15.100:0/3771697795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b23cb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 >> 172.21.15.100:0/3771697795 conn(0x55f812b180f0 msgr2=0x55f812b1ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f6991ffb640 0 client.15585 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 shutdown_connections 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 1 -- 172.21.15.100:0/3771697795 wait complete. 2024-09-12T02:40:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.142+0000 7f69b27e0740 20 client.15585 trim_cache size 0 max 16384 2024-09-12T02:40:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 Processor -- start 2024-09-12T02:40:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 -- start start 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b25b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b3eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b26d40 0x55f812b3f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81beba0 con 0x55f812b1bb60 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81bc470 con 0x55f812b1c480 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.169+0000 7f69b27e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81ba2c0 con 0x55f812b26d40 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b25b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b25b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54864/0 (socket says 172.21.15.100:54864) 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 -- 172.21.15.100:0/2863846103 learned_addr learned my addr 172.21.15.100:0/2863846103 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b3eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b26d40 0x55f812b3f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 -- 172.21.15.100:0/2863846103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b26d40 msgr2=0x55f812b3f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b26d40 0x55f812b3f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 -- 172.21.15.100:0/2863846103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 msgr2=0x55f812b3eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b3eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.170+0000 7f69ad9a2640 1 -- 172.21.15.100:0/2863846103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f812b22c60 con 0x55f812b1bb60 2024-09-12T02:40:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.171+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b25b10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f699800b010 tx=0x7f699800ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0105041be04673 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.171+0000 7f6993fff640 1 -- 172.21.15.100:0/2863846103 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998019070 con 0x55f812b1bb60 2024-09-12T02:40:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.172+0000 7f6993fff640 1 -- 172.21.15.100:0/2863846103 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f699801e410 con 0x55f812b1bb60 2024-09-12T02:40:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.172+0000 7f6993fff640 1 -- 172.21.15.100:0/2863846103 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998028720 con 0x55f812b1bb60 2024-09-12T02:40:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.172+0000 7f69b27e0740 1 -- 172.21.15.100:0/2863846103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 msgr2=0x55f812b25b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.172+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b25b10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f699800b010 tx=0x7f699800ef50 comp rx=0 tx=0).stop 2024-09-12T02:40:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.172+0000 7f69b27e0740 1 -- 172.21.15.100:0/2863846103 shutdown_connections 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b26d40 0x55f812b3f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1c480 0x55f812b3eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 --2- 172.21.15.100:0/2863846103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b1bb60 0x55f812b25b10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 -- 172.21.15.100:0/2863846103 >> 172.21.15.100:0/2863846103 conn(0x55f812b180f0 msgr2=0x55f812b25400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 -- 172.21.15.100:0/2863846103 shutdown_connections 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 -- 172.21.15.100:0/2863846103 wait complete. 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 -- start start 2024-09-12T02:40:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.173+0000 7f69b27e0740 1 Processor -- start 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1bb60 0x55f812b2f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b2f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69b27e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b2a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69b27e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81ba930 con 0x55f812b26d40 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69b27e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81bbda0 con 0x55f812b1bb60 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1bb60 0x55f812b2f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69b27e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81bb000 con 0x55f812b1c480 2024-09-12T02:40:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1bb60 0x55f812b2f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36254/0 (socket says 172.21.15.100:36254) 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 -- 172.21.15.100:0/310613827 learned_addr learned my addr 172.21.15.100:0/310613827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b2a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b2f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 -- 172.21.15.100:0/310613827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 msgr2=0x55f812b2f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b2f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 -- 172.21.15.100:0/310613827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 msgr2=0x55f812b2a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b2a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ad9a2640 1 -- 172.21.15.100:0/310613827 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f812b2ac50 con 0x55f812b1bb60 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.174+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b2f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f69ad9a2640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1bb60 0x55f812b2f040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6998005bd0 tx=0x7f69980283e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1890538e747a6d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f6991ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f69b27e0740 10 client.0 _ll_register_callbacks cb 0x7f699800a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f6991ffb640 1 -- 172.21.15.100:0/310613827 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998019070 con 0x55f812b1bb60 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f6991ffb640 1 -- 172.21.15.100:0/310613827 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f69980286d0 con 0x55f812b1bb60 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f699801e410 con 0x55f812b1bb60 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f6991ffb640 1 -- 172.21.15.100:0/310613827 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f69980107d0 con 0x55f812b1bb60 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f69b27e0740 10 client.25088 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.175+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55f812ba1220 con 0x55f812b1bb60 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f6991ffb640 1 -- 172.21.15.100:0/310613827 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f699801e7b0 con 0x55f812b1bb60 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f69b27e0740 10 client.25088 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f69b27e0740 10 client.25088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f69b27e0740 20 client.25088 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f69b27e0740 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812ba1890 0x55f812ba3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f69b27e0740 4 client.25088 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:40:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f812a88d00 con 0x55f812ba1890 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.176+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812ba1890 0x55f812ba3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.177+0000 7f6991ffb640 10 client.25088 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.177+0000 7f69ae1a3640 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812ba1890 0x55f812ba3d50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef59638aedcaaed4 server_cookie=df89ab011050a8b8 in_seq=0 out_seq=0 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.178+0000 7f6991ffb640 1 -- 172.21.15.100:0/310613827 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f812a88d00 con 0x55f812ba1890 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.178+0000 7f6991ffb640 10 client.25088 handle_command_reply: tid=0 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.178+0000 7f69b27e0740 1 client.25088 shutdown 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1bb60 msgr2=0x55f812b2f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1bb60 0x55f812b2f040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6998005bd0 tx=0x7f69980283e0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 shutdown_connections 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f812ba1890 0x55f812ba3d50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f812b26d40 0x55f812b2a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f812b1c480 0x55f812b2f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 --2- 172.21.15.100:0/310613827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f812b1bb60 0x55f812b2f040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 >> 172.21.15.100:0/310613827 conn(0x55f812b180f0 msgr2=0x55f812b17270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f6991ffb640 0 client.25088 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 shutdown_connections 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 1 -- 172.21.15.100:0/310613827 wait complete. 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.179+0000 7f69b27e0740 20 client.25088 trim_cache size 0 max 16384 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "3061a3f0-6e77-421d-8388-3d4f5152cd17", 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:40:11.182 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.180+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69940a2cd0 msgr2=0x7f69940a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.180+0000 7f69b0407640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69940a2cd0 0x7f69940a5190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69a009b420 tx=0x7f69a0004920 comp rx=0 tx=0).stop 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.180+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 msgr2=0x7f69a8116e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.180+0000 7f69b0407640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 0x7f69a8116e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f69a000caa0 tx=0x7f69a000cea0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 shutdown_connections 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69940a2cd0 0x7f69940a5190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69a8106b80 0x7f69a8116e90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69a8100aa0 0x7f69a8111bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 --2- 172.21.15.100:0/2167005509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69a8100100 0x7f69a8111670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 >> 172.21.15.100:0/2167005509 conn(0x7f69a8077230 msgr2=0x7f69a8104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 shutdown_connections 2024-09-12T02:40:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:11.181+0000 7f69b0407640 1 -- 172.21.15.100:0/2167005509 wait complete. 2024-09-12T02:40:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 60.0 s, 3490.6 tps, lat 28.520 ms stddev 30.392 2024-09-12T02:40:11.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:40:11.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:11 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:40:11.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:11 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:11.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:11 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:40:11.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:11 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:40:11.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:11 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:11.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:11 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:11.973 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:11 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:40:11.973 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:11 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:11.973 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:11 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:40:11.973 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:11 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:40:11.974 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:11 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:11.974 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:11 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:11 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:40:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:11 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:11 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:40:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:11 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:40:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:11 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:11 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:12.233 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:12.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.738+0000 7f19629e3640 1 -- 172.21.15.100:0/2465982671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10c590 msgr2=0x7f195c10c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.738+0000 7f19629e3640 1 --2- 172.21.15.100:0/2465982671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10c590 0x7f195c10c9f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1950009900 tx=0x7f195002a410 comp rx=0 tx=0).stop 2024-09-12T02:40:12.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.739+0000 7f19629e3640 1 -- 172.21.15.100:0/2465982671 shutdown_connections 2024-09-12T02:40:12.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.739+0000 7f19629e3640 1 --2- 172.21.15.100:0/2465982671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c10cf30 0x7f195c119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.739+0000 7f19629e3640 1 --2- 172.21.15.100:0/2465982671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10c590 0x7f195c10c9f0 secure :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1950009900 tx=0x7f195002a410 comp rx=0 tx=0).stop 2024-09-12T02:40:12.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.739+0000 7f19629e3640 1 --2- 172.21.15.100:0/2465982671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 0x7f195c112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.739+0000 7f19629e3640 1 -- 172.21.15.100:0/2465982671 >> 172.21.15.100:0/2465982671 conn(0x7f195c06cdc0 msgr2=0x7f195c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.740+0000 7f19629e3640 1 -- 172.21.15.100:0/2465982671 shutdown_connections 2024-09-12T02:40:12.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.741+0000 7f19629e3640 1 -- 172.21.15.100:0/2465982671 wait complete. 2024-09-12T02:40:12.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.741+0000 7f19629e3640 1 Processor -- start 2024-09-12T02:40:12.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.741+0000 7f19629e3640 1 -- start start 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f19629e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10cf30 0x7f195c1179e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f19629e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 0x7f195c123cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f19629e3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c117f20 0x7f195c1183a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f19629e3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f195c06e850 con 0x7f195c10cf30 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f19629e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f195c06e6d0 con 0x7f195c112640 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f19629e3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f195c06e9d0 con 0x7f195c117f20 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 0x7f195c123cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10cf30 0x7f195c1179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 0x7f195c123cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36284/0 (socket says 172.21.15.100:36284) 2024-09-12T02:40:12.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195b7fe640 1 -- 172.21.15.100:0/3528528597 learned_addr learned my addr 172.21.15.100:0/3528528597 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:12.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195b7fe640 1 -- 172.21.15.100:0/3528528597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c117f20 msgr2=0x7f195c1183a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:40:12.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195b7fe640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c117f20 0x7f195c1183a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195b7fe640 1 -- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10cf30 msgr2=0x7f195c1179e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.742+0000 7f195b7fe640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10cf30 0x7f195c1179e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.743+0000 7f195b7fe640 1 -- 172.21.15.100:0/3528528597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c1bc290 con 0x7f195c112640 2024-09-12T02:40:12.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.743+0000 7f195bfff640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10cf30 0x7f195c1179e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:12.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.743+0000 7f195b7fe640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 0x7f195c123cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f195002aa00 tx=0x7f1950003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.745+0000 7f19597fa640 1 -- 172.21.15.100:0/3528528597 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195003f020 con 0x7f195c112640 2024-09-12T02:40:12.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.745+0000 7f19597fa640 1 -- 172.21.15.100:0/3528528597 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1950031c30 con 0x7f195c112640 2024-09-12T02:40:12.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.745+0000 7f19597fa640 1 -- 172.21.15.100:0/3528528597 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950035070 con 0x7f195c112640 2024-09-12T02:40:12.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.745+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195c1bc520 con 0x7f195c112640 2024-09-12T02:40:12.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.745+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195c1bc9b0 con 0x7f195c112640 2024-09-12T02:40:12.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 Processor -- start 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 -- start start 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f19597fa640 1 -- 172.21.15.100:0/3528528597 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1950042020 con 0x7f195c112640 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca29c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca29cdc0 0x563eca2a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca2a7680 0x563eca2a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563eca2022e0 con 0x563eca2a7680 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563eca1a9ce0 con 0x563eca29c4a0 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f1964dbc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563eca1fe2a0 con 0x563eca29cdc0 2024-09-12T02:40:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.750+0000 7f195bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca29cdc0 0x563eca2a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.751+0000 7f1960f80640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca29c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.751+0000 7f195b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca2a7680 0x563eca2a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.751+0000 7f195b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca2a7680 0x563eca2a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54900/0 (socket says 172.21.15.100:54900) 2024-09-12T02:40:12.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.751+0000 7f195b7fe640 1 -- 172.21.15.100:0/4214585885 learned_addr learned my addr 172.21.15.100:0/4214585885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:12.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.751+0000 7f19597fa640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19440a2c00 0x7f19440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f1960f80640 1 -- 172.21.15.100:0/4214585885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca29cdc0 msgr2=0x563eca2a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f19597fa640 1 -- 172.21.15.100:0/3528528597 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f19500ef850 con 0x7f195c112640 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f1960f80640 1 --2- 172.21.15.100:0/4214585885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca29cdc0 0x563eca2a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f1960f80640 1 -- 172.21.15.100:0/4214585885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca2a7680 msgr2=0x563eca2a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f1960f80640 1 --2- 172.21.15.100:0/4214585885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca2a7680 0x563eca2a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f1960f80640 1 -- 172.21.15.100:0/4214585885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eca18e440 con 0x563eca29c4a0 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f1960f80640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19440a2c00 0x7f19440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f1960f80640 1 --2- 172.21.15.100:0/4214585885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca29c880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f194c00bad0 tx=0x7f194c00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc36cc67129c348 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.752+0000 7f19427fc640 1 -- 172.21.15.100:0/4214585885 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c004240 con 0x563eca29c4a0 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.753+0000 7f19427fc640 1 -- 172.21.15.100:0/4214585885 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f194c004460 con 0x563eca29c4a0 2024-09-12T02:40:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.753+0000 7f19427fc640 1 -- 172.21.15.100:0/4214585885 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c012bf0 con 0x563eca29c4a0 2024-09-12T02:40:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 -- 172.21.15.100:0/4214585885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 msgr2=0x563eca29c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1960f80640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19440a2c00 0x7f19440a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f194c01c000 tx=0x7f194c01d7e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 --2- 172.21.15.100:0/4214585885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca29c880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f194c00bad0 tx=0x7f194c00bf90 comp rx=0 tx=0).stop 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 -- 172.21.15.100:0/4214585885 shutdown_connections 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 --2- 172.21.15.100:0/4214585885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca2a7680 0x563eca2a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 --2- 172.21.15.100:0/4214585885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca29cdc0 0x563eca2a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 --2- 172.21.15.100:0/4214585885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca29c880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 -- 172.21.15.100:0/4214585885 >> 172.21.15.100:0/4214585885 conn(0x563eca298a30 msgr2=0x563eca298e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.754+0000 7f1964dbc740 1 -- 172.21.15.100:0/4214585885 shutdown_connections 2024-09-12T02:40:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.755+0000 7f1964dbc740 1 -- 172.21.15.100:0/4214585885 wait complete. 2024-09-12T02:40:12.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.756+0000 7f1964dbc740 1 -- start start 2024-09-12T02:40:12.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.757+0000 7f1964dbc740 1 Processor -- start 2024-09-12T02:40:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.758+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29c4a0 0x563eca2a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.758+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29cdc0 0x563eca2a4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.758+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca2a7680 0x563eca2a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.758+0000 7f1964dbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563eca2aa250 con 0x563eca29c4a0 2024-09-12T02:40:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.758+0000 7f1964dbc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563eca1bd050 con 0x563eca29cdc0 2024-09-12T02:40:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.758+0000 7f1964dbc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563eca2aa3d0 con 0x563eca2a7680 2024-09-12T02:40:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1964dbc740 10 client.0 _ll_register_callbacks cb 0x563eca1fd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:12.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca2a7680 0x563eca2a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca2a7680 0x563eca2a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:55536/0 (socket says 172.21.15.100:55536) 2024-09-12T02:40:12.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 -- 172.21.15.100:0/1269525555 learned_addr learned my addr 172.21.15.100:0/1269525555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:12.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f195bfff640 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29c4a0 0x563eca2a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f195b7fe640 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29cdc0 0x563eca2a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 -- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29cdc0 msgr2=0x563eca2a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29cdc0 0x563eca2a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 -- 172.21.15.100:0/1269525555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29c4a0 msgr2=0x563eca2a6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29c4a0 0x563eca2a6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.759+0000 7f1960f80640 1 -- 172.21.15.100:0/1269525555 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ec9f733c0 con 0x563eca2a7680 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f1960f80640 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca2a7680 0x563eca2a47e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f194c0042a0 tx=0x7f194c021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe46f6cb510d106 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f193b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f193b7fe640 1 -- 172.21.15.100:0/1269525555 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c012e50 con 0x563eca2a7680 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f194c004460 con 0x563eca2a7680 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f193b7fe640 1 -- 172.21.15.100:0/1269525555 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f194c012a80 con 0x563eca2a7680 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f193b7fe640 1 -- 172.21.15.100:0/1269525555 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f194c01de60 con 0x563eca2a7680 2024-09-12T02:40:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f1964dbc740 10 client.25090 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563eca2b5c70 con 0x563eca2a7680 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f193b7fe640 1 -- 172.21.15.100:0/1269525555 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f194c004460 con 0x563eca2a7680 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.760+0000 7f193b7fe640 1 -- 172.21.15.100:0/1269525555 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f194c024070 con 0x563eca2a7680 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.761+0000 7f1964dbc740 10 client.25090 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.761+0000 7f1964dbc740 10 client.25090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.761+0000 7f1964dbc740 20 client.25090 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.761+0000 7f1964dbc740 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2b74a0 0x563eca2b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.761+0000 7f195bfff640 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2b74a0 0x563eca2b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.761+0000 7f1964dbc740 4 client.25090 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.762+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eca20f850 con 0x563eca2b74a0 2024-09-12T02:40:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.762+0000 7f195bfff640 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2b74a0 0x563eca2b98d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d485ec85f6d5554 server_cookie=9527db7282d36b23 in_seq=0 out_seq=0 2024-09-12T02:40:12.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.762+0000 7f193b7fe640 10 client.25090 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.763+0000 7f193b7fe640 1 -- 172.21.15.100:0/1269525555 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563eca20f850 con 0x563eca2b74a0 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.763+0000 7f193b7fe640 10 client.25090 handle_command_reply: tid=0 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.763+0000 7f1964dbc740 1 client.25090 shutdown 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca2a7680 msgr2=0x563eca2a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca2a7680 0x563eca2a47e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f194c0042a0 tx=0x7f194c021000 comp rx=0 tx=0).stop 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 shutdown_connections 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2b74a0 0x563eca2b98d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca2a7680 0x563eca2a47e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29cdc0 0x563eca2a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 --2- 172.21.15.100:0/1269525555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29c4a0 0x563eca2a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 >> 172.21.15.100:0/1269525555 conn(0x563eca298a30 msgr2=0x563eca29e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f193b7fe640 0 client.25090 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:12.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.764+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 shutdown_connections 2024-09-12T02:40:12.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.765+0000 7f1964dbc740 1 -- 172.21.15.100:0/1269525555 wait complete. 2024-09-12T02:40:12.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.765+0000 7f1964dbc740 20 client.25090 trim_cache size 0 max 16384 2024-09-12T02:40:12.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.799+0000 7f1964dbc740 1 Processor -- start 2024-09-12T02:40:12.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.799+0000 7f1964dbc740 1 -- start start 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.799+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.799+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.799+0000 7f195bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:55548/0 (socket says 172.21.15.100:55548) 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195bfff640 1 -- 172.21.15.100:0/3145097513 learned_addr learned my addr 172.21.15.100:0/3145097513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195b7fe640 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f1964dbc740 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1c7a50 con 0x563eca29cdc0 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1c5320 con 0x563eca29c4a0 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1c3170 con 0x563eca298a30 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f1960f80640 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195b7fe640 1 -- 172.21.15.100:0/3145097513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 msgr2=0x563eca2b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195b7fe640 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195b7fe640 1 -- 172.21.15.100:0/3145097513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 msgr2=0x563eca2bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195b7fe640 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f195b7fe640 1 -- 172.21.15.100:0/3145097513 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eca2aa360 con 0x563eca29c4a0 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.800+0000 7f1960f80640 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.801+0000 7f195b7fe640 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2bf190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1950006010 tx=0x7f195003b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c1cf56ff1fbfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.801+0000 7f1941ffb640 1 -- 172.21.15.100:0/3145097513 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19500bba00 con 0x563eca29c4a0 2024-09-12T02:40:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.801+0000 7f1941ffb640 1 -- 172.21.15.100:0/3145097513 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19500bc7a0 con 0x563eca29c4a0 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.801+0000 7f1941ffb640 1 -- 172.21.15.100:0/3145097513 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19500dc070 con 0x563eca29c4a0 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 msgr2=0x563eca2bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2bf190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1950006010 tx=0x7f195003b790 comp rx=0 tx=0).stop 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 shutdown_connections 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2bf190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 --2- 172.21.15.100:0/3145097513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 >> 172.21.15.100:0/3145097513 conn(0x563eca29fc70 msgr2=0x563eca2a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 shutdown_connections 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 -- 172.21.15.100:0/3145097513 wait complete. 2024-09-12T02:40:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 -- start start 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.802+0000 7f1964dbc740 1 Processor -- start 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1964dbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1964dbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1c37e0 con 0x563eca29cdc0 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1964dbc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1c4c50 con 0x563eca29c4a0 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1964dbc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1c3eb0 con 0x563eca298a30 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1964dbc740 10 client.0 _ll_register_callbacks cb 0x7f194c00b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36306/0 (socket says 172.21.15.100:36306) 2024-09-12T02:40:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 -- 172.21.15.100:0/2911827730 learned_addr learned my addr 172.21.15.100:0/2911827730 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f1960f80640 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195bfff640 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 -- 172.21.15.100:0/2911827730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 msgr2=0x563eca2afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 -- 172.21.15.100:0/2911827730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 msgr2=0x563eca2ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 -- 172.21.15.100:0/2911827730 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eca2abd10 con 0x563eca29c4a0 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f195b7fe640 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2aafa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19500ed390 tx=0x7f19500f5150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da2a6a7344bf5029 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.803+0000 7f193b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.804+0000 7f193b7fe640 1 -- 172.21.15.100:0/2911827730 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19500d5060 con 0x563eca29c4a0 2024-09-12T02:40:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.804+0000 7f193b7fe640 1 -- 172.21.15.100:0/2911827730 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f195003b460 con 0x563eca29c4a0 2024-09-12T02:40:12.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.804+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19500bc7a0 con 0x563eca29c4a0 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.805+0000 7f193b7fe640 1 -- 172.21.15.100:0/2911827730 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f19500bba00 con 0x563eca29c4a0 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.805+0000 7f1964dbc740 10 client.25106 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.805+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563eca322070 con 0x563eca29c4a0 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.806+0000 7f193b7fe640 1 -- 172.21.15.100:0/2911827730 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19500bc0a0 con 0x563eca29c4a0 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.806+0000 7f193b7fe640 1 -- 172.21.15.100:0/2911827730 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f19500d7030 con 0x563eca29c4a0 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f1964dbc740 10 client.25106 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f1964dbc740 10 client.25106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f1964dbc740 20 client.25106 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f1964dbc740 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2a7680 0x563eca324750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f1964dbc740 4 client.25106 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f19500bc7a0 con 0x563eca2a7680 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f195bfff640 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2a7680 0x563eca324750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f193b7fe640 10 client.25106 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.807+0000 7f195bfff640 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2a7680 0x563eca324750 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70ed7769a8c13d13 server_cookie=884a3c00e22c32a2 in_seq=0 out_seq=0 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f193b7fe640 1 -- 172.21.15.100:0/2911827730 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f19500bc7a0 con 0x563eca2a7680 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f193b7fe640 10 client.25106 handle_command_reply: tid=0 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 client.25106 shutdown 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 msgr2=0x563eca2aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2aafa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19500ed390 tx=0x7f19500f5150 comp rx=0 tx=0).stop 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 shutdown_connections 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563eca2a7680 0x563eca324750 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563eca29cdc0 0x563eca2ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563eca29c4a0 0x563eca2aafa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f193b7fe640 0 client.25106 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 --2- 172.21.15.100:0/2911827730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563eca298a30 0x563eca2afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 >> 172.21.15.100:0/2911827730 conn(0x563eca29fc70 msgr2=0x563eca2a6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 shutdown_connections 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 1 -- 172.21.15.100:0/2911827730 wait complete. 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.808+0000 7f1964dbc740 20 client.25106 trim_cache size 0 max 16384 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:40:12.814 INFO:teuthology.orchestra.run.smithi100.stdout: "3061a3f0-6e77-421d-8388-3d4f5152cd17": { 2024-09-12T02:40:12.815 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:40:12.815 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "3061a3f0-6e77-421d-8388-3d4f5152cd17", 2024-09-12T02:40:12.815 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:40:12.815 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:12.815 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:12.815 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19440a2c00 msgr2=0x7f19440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19440a2c00 0x7f19440a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f194c01c000 tx=0x7f194c01d7e0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 msgr2=0x7f195c123cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 0x7f195c123cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f195002aa00 tx=0x7f1950003c10 comp rx=0 tx=0).stop 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 shutdown_connections 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19440a2c00 0x7f19440a50c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c117f20 0x7f195c1183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c112640 0x7f195c123cb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 --2- 172.21.15.100:0/3528528597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c10cf30 0x7f195c1179e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 >> 172.21.15.100:0/3528528597 conn(0x7f195c06cdc0 msgr2=0x7f195c070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 shutdown_connections 2024-09-12T02:40:12.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:12.809+0000 7f19629e3640 1 -- 172.21.15.100:0/3528528597 wait complete. 2024-09-12T02:40:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:12 smithi189 ceph-mon[35196]: pgmap v382: 97 pgs: 97 active+clean; 991 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 829 op/s 2024-09-12T02:40:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:12 smithi117 ceph-mon[34898]: pgmap v382: 97 pgs: 97 active+clean; 991 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 829 op/s 2024-09-12T02:40:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:12 smithi100 ceph-mon[31390]: pgmap v382: 97 pgs: 97 active+clean; 991 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 829 op/s 2024-09-12T02:40:13.690 INFO:tasks.cephfs.filesystem:scrub status for tag:3061a3f0-6e77-421d-8388-3d4f5152cd17 - {'path': '/', 'tag': '3061a3f0-6e77-421d-8388-3d4f5152cd17', 'options': 'recursive,force'} 2024-09-12T02:40:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:14 smithi189 ceph-mon[35196]: pgmap v383: 97 pgs: 97 active+clean; 996 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.7 MiB/s wr, 716 op/s 2024-09-12T02:40:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:14 smithi117 ceph-mon[34898]: pgmap v383: 97 pgs: 97 active+clean; 996 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.7 MiB/s wr, 716 op/s 2024-09-12T02:40:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:14 smithi100 ceph-mon[31390]: pgmap v383: 97 pgs: 97 active+clean; 996 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.7 MiB/s wr, 716 op/s 2024-09-12T02:40:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 65.0 s, 3860.8 tps, lat 25.909 ms stddev 27.470 2024-09-12T02:40:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:16 smithi189 ceph-mon[35196]: pgmap v384: 97 pgs: 97 active+clean; 1000 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-09-12T02:40:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:16 smithi117 ceph-mon[34898]: pgmap v384: 97 pgs: 97 active+clean; 1000 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-09-12T02:40:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:16 smithi100 ceph-mon[31390]: pgmap v384: 97 pgs: 97 active+clean; 1000 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-09-12T02:40:18.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:18 smithi100 ceph-mon[31390]: pgmap v385: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-12T02:40:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:18 smithi189 ceph-mon[35196]: pgmap v385: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-12T02:40:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:18 smithi117 ceph-mon[34898]: pgmap v385: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.7 MiB/s wr, 798 op/s 2024-09-12T02:40:20.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:19 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:40:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:19 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:40:20.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:19 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:40:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:20 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:40:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:20 smithi189 ceph-mon[35196]: pgmap v386: 97 pgs: 97 active+clean; 1003 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.9 MiB/s wr, 780 op/s 2024-09-12T02:40:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:20 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:40:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:20 smithi117 ceph-mon[34898]: pgmap v386: 97 pgs: 97 active+clean; 1003 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.9 MiB/s wr, 780 op/s 2024-09-12T02:40:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:20 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:40:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:20 smithi100 ceph-mon[31390]: pgmap v386: 97 pgs: 97 active+clean; 1003 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.9 MiB/s wr, 780 op/s 2024-09-12T02:40:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 70.0 s, 3455.2 tps, lat 28.926 ms stddev 30.757 2024-09-12T02:40:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:22 smithi189 ceph-mon[35196]: pgmap v387: 97 pgs: 97 active+clean; 1011 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 742 op/s 2024-09-12T02:40:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:22 smithi117 ceph-mon[34898]: pgmap v387: 97 pgs: 97 active+clean; 1011 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 742 op/s 2024-09-12T02:40:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:22 smithi100 ceph-mon[31390]: pgmap v387: 97 pgs: 97 active+clean; 1011 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 742 op/s 2024-09-12T02:40:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:24 smithi189 ceph-mon[35196]: pgmap v388: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 703 op/s 2024-09-12T02:40:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:24 smithi117 ceph-mon[34898]: pgmap v388: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 703 op/s 2024-09-12T02:40:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:24 smithi100 ceph-mon[31390]: pgmap v388: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 703 op/s 2024-09-12T02:40:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 75.0 s, 3703.5 tps, lat 27.119 ms stddev 27.273 2024-09-12T02:40:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:26 smithi189 ceph-mon[35196]: pgmap v389: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 751 op/s 2024-09-12T02:40:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:26 smithi117 ceph-mon[34898]: pgmap v389: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 751 op/s 2024-09-12T02:40:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:26 smithi100 ceph-mon[31390]: pgmap v389: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 751 op/s 2024-09-12T02:40:28.991 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:28 smithi100 ceph-mon[31390]: pgmap v390: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 821 op/s 2024-09-12T02:40:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:28 smithi189 ceph-mon[35196]: pgmap v390: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 821 op/s 2024-09-12T02:40:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:28 smithi117 ceph-mon[34898]: pgmap v390: 97 pgs: 97 active+clean; 1020 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 821 op/s 2024-09-12T02:40:30.148 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T02:40:30.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:40:30.508 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:30.887 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:30 smithi100 ceph-mon[31390]: pgmap v391: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 747 op/s 2024-09-12T02:40:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:30 smithi189 ceph-mon[35196]: pgmap v391: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 747 op/s 2024-09-12T02:40:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:30 smithi117 ceph-mon[34898]: pgmap v391: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 747 op/s 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.167+0000 7ff65b6e3640 1 -- 172.21.15.100:0/17464625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654101410 msgr2=0x7ff65410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.167+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/17464625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654101410 0x7ff65410d940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009be0 tx=0x7ff64c02a6c0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.168+0000 7ff65b6e3640 1 -- 172.21.15.100:0/17464625 shutdown_connections 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.168+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/17464625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654101410 0x7ff65410d940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.168+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/17464625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff654100a70 0x7ff654100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.168+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/17464625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff654106a70 0x7ff654106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.168+0000 7ff65b6e3640 1 -- 172.21.15.100:0/17464625 >> 172.21.15.100:0/17464625 conn(0x7ff6540fc790 msgr2=0x7ff6540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.168+0000 7ff65b6e3640 1 -- 172.21.15.100:0/17464625 shutdown_connections 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.168+0000 7ff65b6e3640 1 -- 172.21.15.100:0/17464625 wait complete. 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.169+0000 7ff65b6e3640 1 Processor -- start 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.169+0000 7ff65b6e3640 1 -- start start 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.169+0000 7ff65b6e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654100a70 0x7ff654073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff65b6e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff654101410 0x7ff65406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff65b6e3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff654106a70 0x7ff65406c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff65b6e3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff654110e20 con 0x7ff654101410 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff65b6e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff654110ca0 con 0x7ff654100a70 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff65b6e3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff654110fa0 con 0x7ff654106a70 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff658c7e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff654101410 0x7ff65406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff658c7e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff654101410 0x7ff65406bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54286/0 (socket says 172.21.15.100:54286) 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff658c7e640 1 -- 172.21.15.100:0/2898787943 learned_addr learned my addr 172.21.15.100:0/2898787943 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.170+0000 7ff65947f640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654100a70 0x7ff654073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.171+0000 7ff65947f640 1 -- 172.21.15.100:0/2898787943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff654106a70 msgr2=0x7ff65406c220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.171+0000 7ff65947f640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff654106a70 0x7ff65406c220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.171+0000 7ff65947f640 1 -- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff654101410 msgr2=0x7ff65406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.171+0000 7ff65947f640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff654101410 0x7ff65406bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.171+0000 7ff65947f640 1 -- 172.21.15.100:0/2898787943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65406ca40 con 0x7ff654100a70 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.171+0000 7ff65947f640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654100a70 0x7ff654073d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff65000e790 tx=0x7ff65000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.172+0000 7ff64a7fc640 1 -- 172.21.15.100:0/2898787943 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65000eea0 con 0x7ff654100a70 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.172+0000 7ff64a7fc640 1 -- 172.21.15.100:0/2898787943 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff65000ccc0 con 0x7ff654100a70 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.172+0000 7ff64a7fc640 1 -- 172.21.15.100:0/2898787943 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650018780 con 0x7ff654100a70 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.172+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6541ad200 con 0x7ff654100a70 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.172+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6541ad680 con 0x7ff654100a70 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.174+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6541021b0 con 0x7ff654100a70 2024-09-12T02:40:31.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.175+0000 7ff64a7fc640 1 -- 172.21.15.100:0/2898787943 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff650010430 con 0x7ff654100a70 2024-09-12T02:40:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.176+0000 7ff64a7fc640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6400a2d50 0x7ff6400a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.176+0000 7ff64a7fc640 1 -- 172.21.15.100:0/2898787943 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff6500cf1e0 con 0x7ff654100a70 2024-09-12T02:40:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.178+0000 7ff658c7e640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6400a2d50 0x7ff6400a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.180+0000 7ff658c7e640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6400a2d50 0x7ff6400a5210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff65406d4a0 tx=0x7ff644005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.180+0000 7ff64a7fc640 1 -- 172.21.15.100:0/2898787943 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff65009c0d0 con 0x7ff654100a70 2024-09-12T02:40:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 80.0 s, 3710.6 tps, lat 26.868 ms stddev 26.141 2024-09-12T02:40:31.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.496+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff654100ed0 con 0x7ff654100a70 2024-09-12T02:40:31.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.496+0000 7ff64a7fc640 1 -- 172.21.15.100:0/2898787943 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7ff65009b9d0 con 0x7ff654100a70 2024-09-12T02:40:31.497 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:40:31.497 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:40:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:38:59:560858+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:59.510722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.499+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6400a2d50 msgr2=0x7ff6400a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.499+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6400a2d50 0x7ff6400a5210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff65406d4a0 tx=0x7ff644005f90 comp rx=0 tx=0).stop 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654100a70 msgr2=0x7ff654073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654100a70 0x7ff654073d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff65000e790 tx=0x7ff65000ec50 comp rx=0 tx=0).stop 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 shutdown_connections 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6400a2d50 0x7ff6400a5210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff654106a70 0x7ff65406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff654101410 0x7ff65406bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 --2- 172.21.15.100:0/2898787943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff654100a70 0x7ff654073d10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 >> 172.21.15.100:0/2898787943 conn(0x7ff6540fc790 msgr2=0x7ff65406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 shutdown_connections 2024-09-12T02:40:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:31.500+0000 7ff65b6e3640 1 -- 172.21.15.100:0/2898787943 wait complete. 2024-09-12T02:40:31.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:31 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2898787943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:32.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:31 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2898787943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:32.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:31 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2898787943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:32.814 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T02:40:32.815 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T02:40:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:32 smithi189 ceph-mon[35196]: pgmap v392: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-12T02:40:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:32 smithi117 ceph-mon[34898]: pgmap v392: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-12T02:40:33.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:32 smithi100 ceph-mon[31390]: pgmap v392: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-12T02:40:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:33.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 -- 172.21.15.100:0/3351238246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c9c106f00 msgr2=0x7f7c9c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:33.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/3351238246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c9c106f00 0x7f7c9c10ea80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009ca0 tx=0x7f7c9402a8d0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 -- 172.21.15.100:0/3351238246 shutdown_connections 2024-09-12T02:40:33.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/3351238246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c9c106f00 0x7f7c9c10ea80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/3351238246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c9c102780 0x7f7c9c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/3351238246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c101dd0 0x7f7c9c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 -- 172.21.15.100:0/3351238246 >> 172.21.15.100:0/3351238246 conn(0x7f7c9c0fd870 msgr2=0x7f7c9c0ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 -- 172.21.15.100:0/3351238246 shutdown_connections 2024-09-12T02:40:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.800+0000 7f7ca47ac640 1 -- 172.21.15.100:0/3351238246 wait complete. 2024-09-12T02:40:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.801+0000 7f7ca47ac640 1 Processor -- start 2024-09-12T02:40:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.801+0000 7f7ca47ac640 1 -- start start 2024-09-12T02:40:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca47ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c9c101dd0 0x7f7c9c1a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca47ac640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c102780 0x7f7c9c1a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca47ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c9c106f00 0x7f7c9c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca47ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c118670 con 0x7f7c9c106f00 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca47ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1184f0 con 0x7f7c9c101dd0 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca47ac640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1187f0 con 0x7f7c9c102780 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c102780 0x7f7c9c1a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c102780 0x7f7c9c1a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51780/0 (socket says 172.21.15.100:51780) 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 -- 172.21.15.100:0/664623599 learned_addr learned my addr 172.21.15.100:0/664623599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 -- 172.21.15.100:0/664623599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c9c101dd0 msgr2=0x7f7c9c1a47c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c9c101dd0 0x7f7c9c1a47c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 -- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c9c106f00 msgr2=0x7f7c9c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c9c106f00 0x7f7c9c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.802+0000 7f7ca1d47640 1 -- 172.21.15.100:0/664623599 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c19f0b0 con 0x7f7c9c102780 2024-09-12T02:40:33.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.804+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c102780 0x7f7c9c1a4d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800b450 tx=0x7f7c9800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:33.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.804+0000 7f7c937fe640 1 -- 172.21.15.100:0/664623599 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98015020 con 0x7f7c9c102780 2024-09-12T02:40:33.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.804+0000 7f7c937fe640 1 -- 172.21.15.100:0/664623599 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c98011d70 con 0x7f7c9c102780 2024-09-12T02:40:33.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.804+0000 7f7c937fe640 1 -- 172.21.15.100:0/664623599 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98015020 con 0x7f7c9c102780 2024-09-12T02:40:33.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.804+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c19f3a0 con 0x7f7c9c102780 2024-09-12T02:40:33.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.805+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c06bc10 con 0x7f7c9c102780 2024-09-12T02:40:33.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.808+0000 7f7ca6b85740 1 Processor -- start 2024-09-12T02:40:33.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.808+0000 7f7ca6b85740 1 -- start start 2024-09-12T02:40:33.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053787760 0x565053787b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x565053792400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053792940 0x565053794d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5650536ed2a0 con 0x565053787760 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x565053694b10 con 0x565053792940 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5650536e9260 con 0x565053788080 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053787760 0x565053787b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053787760 0x565053787b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54304/0 (socket says 172.21.15.100:54304) 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 -- 172.21.15.100:0/1182115824 learned_addr learned my addr 172.21.15.100:0/1182115824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2548640 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x565053792400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 -- 172.21.15.100:0/1182115824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 msgr2=0x565053792400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x565053792400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 -- 172.21.15.100:0/1182115824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053792940 msgr2=0x565053794d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:40:33.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053792940 0x565053794d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.809+0000 7f7ca2d49640 1 -- 172.21.15.100:0/1182115824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505345eb90 con 0x565053787760 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7c937fe640 1 -- 172.21.15.100:0/664623599 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7c98018020 con 0x7f7c9c102780 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7ca2d49640 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053787760 0x565053787b40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7c9402aec0 tx=0x7f7c94009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9c7beaaca7e3a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7c90ff9640 1 -- 172.21.15.100:0/1182115824 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94031d80 con 0x565053787760 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7c90ff9640 1 -- 172.21.15.100:0/1182115824 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c9403f070 con 0x565053787760 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7c90ff9640 1 -- 172.21.15.100:0/1182115824 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c940042a0 con 0x565053787760 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7c937fe640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c880a2f70 0x7f7c880a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7ca2548640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c880a2f70 0x7f7c880a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.810+0000 7f7c937fe640 1 -- 172.21.15.100:0/664623599 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7c98011690 con 0x7f7c9c102780 2024-09-12T02:40:33.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1182115824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053787760 msgr2=0x565053787b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053787760 0x565053787b40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7c9402aec0 tx=0x7f7c94009800 comp rx=0 tx=0).stop 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1182115824 shutdown_connections 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053792940 0x565053794d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x565053792400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1182115824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053787760 0x565053787b40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1182115824 >> 172.21.15.100:0/1182115824 conn(0x565053783cf0 msgr2=0x5650537840d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca2548640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c880a2f70 0x7f7c880a5430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x565053784b50 tx=0x7f7c8c0090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1182115824 shutdown_connections 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1182115824 wait complete. 2024-09-12T02:40:33.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.811+0000 7f7ca6b85740 1 -- start start 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 1 Processor -- start 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053787760 0x56505378f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x56505378fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x5650537902a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x565053795560 con 0x565053792940 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5650536756e0 con 0x565053787760 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5650537956e0 con 0x565053788080 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca6b85740 10 client.0 _ll_register_callbacks cb 0x565053699a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca2548640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053787760 0x56505378f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca2548640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053787760 0x56505378f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:50110/0 (socket says 172.21.15.100:50110) 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca2548640 1 -- 172.21.15.100:0/1190042126 learned_addr learned my addr 172.21.15.100:0/1190042126 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x56505378fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.812+0000 7f7ca2548640 1 -- 172.21.15.100:0/1190042126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 msgr2=0x56505378fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.813+0000 7f7ca2548640 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x56505378fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.813+0000 7f7ca2548640 1 -- 172.21.15.100:0/1190042126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 msgr2=0x5650537902a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.813+0000 7f7ca2548640 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x5650537902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.813+0000 7f7ca2548640 1 -- 172.21.15.100:0/1190042126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505379ea50 con 0x565053787760 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.813+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x56505378fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.813+0000 7f7ca2548640 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053787760 0x56505378f820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c015700 tx=0x7f7c8c0047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc0734c54a19c3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7c85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7c85ffb640 1 -- 172.21.15.100:0/1190042126 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c025060 con 0x565053787760 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c9403f070 con 0x565053787760 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7c85ffb640 1 -- 172.21.15.100:0/1190042126 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7c8c012600 con 0x565053787760 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7c85ffb640 1 -- 172.21.15.100:0/1190042126 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c8c012800 con 0x565053787760 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7ca6b85740 10 client.25118 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:33.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5650537a1490 con 0x565053787760 2024-09-12T02:40:33.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.814+0000 7f7c85ffb640 1 -- 172.21.15.100:0/1190042126 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c9403f070 con 0x565053787760 2024-09-12T02:40:33.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7c85ffb640 1 -- 172.21.15.100:0/1190042126 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f7c8c020cc0 con 0x565053787760 2024-09-12T02:40:33.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca6b85740 10 client.25118 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca6b85740 10 client.25118 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca6b85740 20 client.25118 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5650537a2d40 0x5650537a5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca6b85740 4 client.25118 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650536fa9d0 con 0x5650537a2d40 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5650537a2d40 0x5650537a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7c85ffb640 10 client.25118 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.815+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5650537a2d40 0x5650537a5200 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48f6aba6d1252311 server_cookie=a572a4fbfd935bbe in_seq=0 out_seq=0 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7c85ffb640 1 -- 172.21.15.100:0/1190042126 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650536fa9d0 con 0x5650537a2d40 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7c85ffb640 10 client.25118 handle_command_reply: tid=0 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 client.25118 shutdown 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053787760 msgr2=0x56505378f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:33.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053787760 0x56505378f820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c015700 tx=0x7f7c8c0047d0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 shutdown_connections 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5650537a2d40 0x5650537a5200 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x5650537902a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053788080 0x56505378fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/1190042126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053787760 0x56505378f820 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 >> 172.21.15.100:0/1190042126 conn(0x565053783cf0 msgr2=0x5650537899d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7c85ffb640 0 client.25118 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 shutdown_connections 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 1 -- 172.21.15.100:0/1190042126 wait complete. 2024-09-12T02:40:33.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.816+0000 7f7ca6b85740 20 client.25118 trim_cache size 0 max 16384 2024-09-12T02:40:33.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 Processor -- start 2024-09-12T02:40:33.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 -- start start 2024-09-12T02:40:33.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505378a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x5650537aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x5650537ab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1beda0 con 0x565053792940 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1bc6a0 con 0x565053788080 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.839+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c072230 con 0x565053787760 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca1d47640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x5650537aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca1d47640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x5650537aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:50122/0 (socket says 172.21.15.100:50122) 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca1d47640 1 -- 172.21.15.100:0/3287113892 learned_addr learned my addr 172.21.15.100:0/3287113892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca2d49640 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x5650537ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca2548640 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505378a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca2548640 1 -- 172.21.15.100:0/3287113892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 msgr2=0x5650537aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:33.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca2548640 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x5650537aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca2548640 1 -- 172.21.15.100:0/3287113892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 msgr2=0x5650537ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:33.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca2548640 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x5650537ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.840+0000 7f7ca2548640 1 -- 172.21.15.100:0/3287113892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565053784e60 con 0x565053787760 2024-09-12T02:40:33.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.841+0000 7f7ca2548640 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505378a1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c014480 tx=0x7f7c8c012730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8be0ae99e84da18a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:33.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.842+0000 7f7c87fff640 1 -- 172.21.15.100:0/3287113892 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c038070 con 0x565053787760 2024-09-12T02:40:33.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.842+0000 7f7c87fff640 1 -- 172.21.15.100:0/3287113892 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c8c0146f0 con 0x565053787760 2024-09-12T02:40:33.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.842+0000 7f7c87fff640 1 -- 172.21.15.100:0/3287113892 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02f030 con 0x565053787760 2024-09-12T02:40:33.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.842+0000 7f7ca6b85740 1 -- 172.21.15.100:0/3287113892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 msgr2=0x56505378a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.842+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505378a1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c014480 tx=0x7f7c8c012730 comp rx=0 tx=0).stop 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 -- 172.21.15.100:0/3287113892 shutdown_connections 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x5650537ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x5650537aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/3287113892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505378a1c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 -- 172.21.15.100:0/3287113892 >> 172.21.15.100:0/3287113892 conn(0x565053783cf0 msgr2=0x5650537918a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 -- 172.21.15.100:0/3287113892 shutdown_connections 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 -- 172.21.15.100:0/3287113892 wait complete. 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 -- start start 2024-09-12T02:40:33.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.843+0000 7f7ca6b85740 1 Processor -- start 2024-09-12T02:40:33.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505379a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x56505379ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca6b85740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x565053797900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0728a0 con 0x565053792940 2024-09-12T02:40:33.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c073d10 con 0x565053788080 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca6b85740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c072f70 con 0x565053787760 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x565053797900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x565053797900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54324/0 (socket says 172.21.15.100:54324) 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca1d47640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x56505379ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 -- 172.21.15.100:0/359042944 learned_addr learned my addr 172.21.15.100:0/359042944 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2548640 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505379a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca6b85740 10 client.0 _ll_register_callbacks cb 0x7f7c8c00ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 -- 172.21.15.100:0/359042944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 msgr2=0x56505379a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505379a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 -- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 msgr2=0x56505379ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x56505379ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.844+0000 7f7ca2d49640 1 -- 172.21.15.100:0/359042944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505377f260 con 0x565053792940 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.845+0000 7f7ca1d47640 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x56505379ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:33.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7ca2d49640 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x565053797900 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7c94043000 tx=0x7f7c94003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d9746ba571ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7c85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7c85ffb640 1 -- 172.21.15.100:0/359042944 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9404d020 con 0x565053792940 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7c85ffb640 1 -- 172.21.15.100:0/359042944 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7c94031660 con 0x565053792940 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c8c0146f0 con 0x565053792940 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7c85ffb640 1 -- 172.21.15.100:0/359042944 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c94031860 con 0x565053792940 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7ca6b85740 10 client.15624 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x565053787590 con 0x565053792940 2024-09-12T02:40:33.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7c85ffb640 1 -- 172.21.15.100:0/359042944 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c9403f040 con 0x565053792940 2024-09-12T02:40:33.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.846+0000 7f7c85ffb640 1 -- 172.21.15.100:0/359042944 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f7c9402f7a0 con 0x565053792940 2024-09-12T02:40:33.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca6b85740 10 client.15624 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:33.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca6b85740 10 client.15624 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:40:33.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca6b85740 20 client.15624 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:33.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56505380e230 0x565053810620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:33.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca6b85740 4 client.15624 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T02:40:33.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x7f7c8c0146f0 con 0x56505380e230 2024-09-12T02:40:33.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca2548640 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56505380e230 0x565053810620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:33.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7c85ffb640 10 client.15624 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:33.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:33.847+0000 7f7ca2548640 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56505380e230 0x565053810620 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e989fa1f1d7e8e server_cookie=b109c6d3ad94766c in_seq=0 out_seq=0 2024-09-12T02:40:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7c85ffb640 1 -- 172.21.15.100:0/359042944 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f7c8c0146f0 con 0x56505380e230 2024-09-12T02:40:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7c85ffb640 10 client.15624 handle_command_reply: tid=0 2024-09-12T02:40:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 client.15624 shutdown 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 msgr2=0x565053797900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x565053797900 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7c94043000 tx=0x7f7c94003ba0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 shutdown_connections 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56505380e230 0x565053810620 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565053792940 0x565053797900 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x565053788080 0x56505379ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 --2- 172.21.15.100:0/359042944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565053787760 0x56505379a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 >> 172.21.15.100:0/359042944 conn(0x565053783cf0 msgr2=0x565053782650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.119+0000 7f7c85ffb640 0 client.15624 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 shutdown_connections 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca6b85740 1 -- 172.21.15.100:0/359042944 wait complete. 2024-09-12T02:40:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca6b85740 20 client.15624 trim_cache size 0 max 16384 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 26, 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 6, 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "779547b4": { 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 6, 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:40:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 133.4, 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:34.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:34.124 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:34.124 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:34.124 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:34.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c880a2f70 msgr2=0x7f7c880a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:34.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c880a2f70 0x7f7c880a5430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x565053784b50 tx=0x7f7c8c0090e0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c102780 msgr2=0x7f7c9c1a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c102780 0x7f7c9c1a4d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800b450 tx=0x7f7c9800b910 comp rx=0 tx=0).stop 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 shutdown_connections 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7c880a2f70 0x7f7c880a5430 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c9c106f00 0x7f7c9c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c9c102780 0x7f7c9c1a4d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 --2- 172.21.15.100:0/664623599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c9c101dd0 0x7f7c9c1a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 >> 172.21.15.100:0/664623599 conn(0x7f7c9c0fd870 msgr2=0x7f7c9c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 shutdown_connections 2024-09-12T02:40:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:34.120+0000 7f7ca47ac640 1 -- 172.21.15.100:0/664623599 wait complete. 2024-09-12T02:40:34.867 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:34 smithi100 ceph-mon[31390]: pgmap v393: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-09-12T02:40:34.896 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '779547b4', quiesce took 4.7 seconds. Will release after: 8.7 2024-09-12T02:40:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:34 smithi189 ceph-mon[35196]: pgmap v393: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-09-12T02:40:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:34 smithi117 ceph-mon[34898]: pgmap v393: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-09-12T02:40:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 85.0 s, 1587.4 tps, lat 32.582 ms stddev 34.423 2024-09-12T02:40:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:36 smithi189 ceph-mon[35196]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-09-12T02:40:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:36 smithi117 ceph-mon[34898]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-09-12T02:40:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:36 smithi100 ceph-mon[31390]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-09-12T02:40:38.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:37 smithi117 ceph-mon[34898]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 9.3 MiB/s wr, 761 op/s 2024-09-12T02:40:38.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:37 smithi100 ceph-mon[31390]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 9.3 MiB/s wr, 761 op/s 2024-09-12T02:40:38.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:37 smithi189 ceph-mon[35196]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 9.3 MiB/s wr, 761 op/s 2024-09-12T02:40:41.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:40 smithi189 ceph-mon[35196]: pgmap v396: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.2 MiB/s wr, 640 op/s 2024-09-12T02:40:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:40 smithi117 ceph-mon[34898]: pgmap v396: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.2 MiB/s wr, 640 op/s 2024-09-12T02:40:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:40 smithi100 ceph-mon[31390]: pgmap v396: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.2 MiB/s wr, 640 op/s 2024-09-12T02:40:41.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 90.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:40:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:42 smithi100 ceph-mon[31390]: pgmap v397: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 546 op/s 2024-09-12T02:40:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:42 smithi189 ceph-mon[35196]: pgmap v397: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 546 op/s 2024-09-12T02:40:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:42 smithi117 ceph-mon[34898]: pgmap v397: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 546 op/s 2024-09-12T02:40:43.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:40:43.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:40:43.861 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 -- 172.21.15.100:0/3028323883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628105f40 msgr2=0x7fe6281063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/3028323883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628105f40 0x7fe6281063d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe620009ca0 tx=0x7fe62002a940 comp rx=0 tx=0).stop 2024-09-12T02:40:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 -- 172.21.15.100:0/3028323883 shutdown_connections 2024-09-12T02:40:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/3028323883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628105f40 0x7fe6281063d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/3028323883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe628101450 0x7fe628105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/3028323883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe628100b30 0x7fe628100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 -- 172.21.15.100:0/3028323883 >> 172.21.15.100:0/3028323883 conn(0x7fe6280fc7a0 msgr2=0x7fe6280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 -- 172.21.15.100:0/3028323883 shutdown_connections 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.355+0000 7fe62f6d2640 1 -- 172.21.15.100:0/3028323883 wait complete. 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 Processor -- start 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 -- start start 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628100b30 0x7fe6281a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe628101450 0x7fe6281a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe628105f40 0x7fe62819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6281185d0 con 0x7fe628100b30 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe628118450 con 0x7fe628105f40 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62f6d2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe628118750 con 0x7fe628101450 2024-09-12T02:40:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62d46e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628100b30 0x7fe6281a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62d46e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628100b30 0x7fe6281a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38564/0 (socket says 172.21.15.100:38564) 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.356+0000 7fe62d46e640 1 -- 172.21.15.100:0/650060090 learned_addr learned my addr 172.21.15.100:0/650060090 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62cc6d640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe628101450 0x7fe6281a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62dc6f640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe628105f40 0x7fe62819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62d46e640 1 -- 172.21.15.100:0/650060090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe628101450 msgr2=0x7fe6281a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62d46e640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe628101450 0x7fe6281a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62d46e640 1 -- 172.21.15.100:0/650060090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe628105f40 msgr2=0x7fe62819e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62d46e640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe628105f40 0x7fe62819e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62d46e640 1 -- 172.21.15.100:0/650060090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62819f050 con 0x7fe628100b30 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62dc6f640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe628105f40 0x7fe62819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62d46e640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628100b30 0x7fe6281a4760 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe62400b4a0 tx=0x7fe62400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe61e7fc640 1 -- 172.21.15.100:0/650060090 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624014070 con 0x7fe628100b30 2024-09-12T02:40:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe61e7fc640 1 -- 172.21.15.100:0/650060090 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe624010af0 con 0x7fe628100b30 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62819f340 con 0x7fe628100b30 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe61e7fc640 1 -- 172.21.15.100:0/650060090 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624017d10 con 0x7fe628100b30 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.357+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6281ab630 con 0x7fe628100b30 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.358+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe628105920 con 0x7fe628100b30 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.359+0000 7fe61e7fc640 1 -- 172.21.15.100:0/650060090 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe624017070 con 0x7fe628100b30 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.360+0000 7fe61e7fc640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6140a2b80 0x7fe6140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.360+0000 7fe62cc6d640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6140a2b80 0x7fe6140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.360+0000 7fe61e7fc640 1 -- 172.21.15.100:0/650060090 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe6240ce530 con 0x7fe628100b30 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.360+0000 7fe62cc6d640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6140a2b80 0x7fe6140a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe628106610 tx=0x7fe61800a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.364+0000 7fe61e7fc640 1 -- 172.21.15.100:0/650060090 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe62409b420 con 0x7fe628100b30 2024-09-12T02:40:44.404 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.579+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6281ab950 con 0x7fe628100b30 2024-09-12T02:40:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.580+0000 7fe61e7fc640 1 -- 172.21.15.100:0/650060090 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7fe62409ad20 con 0x7fe628100b30 2024-09-12T02:40:44.582 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:40:44.582 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:38:59:560858+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:59.510722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:40:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:40:44.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6140a2b80 msgr2=0x7fe6140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6140a2b80 0x7fe6140a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe628106610 tx=0x7fe61800a560 comp rx=0 tx=0).stop 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628100b30 msgr2=0x7fe6281a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628100b30 0x7fe6281a4760 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe62400b4a0 tx=0x7fe62400b960 comp rx=0 tx=0).stop 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 shutdown_connections 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6140a2b80 0x7fe6140a5040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe628105f40 0x7fe62819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe628101450 0x7fe6281a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 --2- 172.21.15.100:0/650060090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe628100b30 0x7fe6281a4760 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 >> 172.21.15.100:0/650060090 conn(0x7fe6280fc7a0 msgr2=0x7fe6281038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 shutdown_connections 2024-09-12T02:40:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:44.582+0000 7fe62f6d2640 1 -- 172.21.15.100:0/650060090 wait complete. 2024-09-12T02:40:44.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:44 smithi100 ceph-mon[31390]: pgmap v398: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 351 op/s 2024-09-12T02:40:44.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:44 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/650060090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:44 smithi189 ceph-mon[35196]: pgmap v398: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 351 op/s 2024-09-12T02:40:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:44 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/650060090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:44 smithi117 ceph-mon[34898]: pgmap v398: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 351 op/s 2024-09-12T02:40:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:44 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/650060090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:45.323 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 779547b4 --release --await' 2024-09-12T02:40:45.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 779547b4 --release --await 2024-09-12T02:40:45.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.520+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2002309167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 msgr2=0x7f7d1810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.520+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2002309167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1810da40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009ca0 tx=0x7f7d1002a950 comp rx=0 tx=0).stop 2024-09-12T02:40:45.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2002309167 shutdown_connections 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2002309167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1810da40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2002309167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18102570 0x7f7d181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2002309167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18100e20 0x7f7d18101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2002309167 >> 172.21.15.100:0/2002309167 conn(0x7f7d180fc7d0 msgr2=0x7f7d180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2002309167 shutdown_connections 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2002309167 wait complete. 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 Processor -- start 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 -- start start 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18100e20 0x7f7d18198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.521+0000 7f7d1cac4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18102570 0x7f7d18198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1cac4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1cac4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18110fa0 con 0x7f7d18102ef0 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1cac4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18110e20 con 0x7f7d18102570 2024-09-12T02:40:45.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1cac4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18111120 con 0x7f7d18100e20 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38586/0 (socket says 172.21.15.100:38586) 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 -- 172.21.15.100:0/2753325977 learned_addr learned my addr 172.21.15.100:0/2753325977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18102570 0x7f7d18198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1659c640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18100e20 0x7f7d18198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 -- 172.21.15.100:0/2753325977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18100e20 msgr2=0x7f7d18198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18100e20 0x7f7d18198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 -- 172.21.15.100:0/2753325977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18102570 msgr2=0x7f7d18198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18102570 0x7f7d18198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 -- 172.21.15.100:0/2753325977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1819d530 con 0x7f7d18102ef0 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1659c640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18100e20 0x7f7d18198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d16d9d640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1819ce50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7d10006010 tx=0x7f7d1002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d077fe640 1 -- 172.21.15.100:0/2753325977 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10034040 con 0x7f7d18102ef0 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1819d7c0 con 0x7f7d18102ef0 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d077fe640 1 -- 172.21.15.100:0/2753325977 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d10003e00 con 0x7f7d18102ef0 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d077fe640 1 -- 172.21.15.100:0/2753325977 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10045480 con 0x7f7d18102ef0 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.522+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d181a5100 con 0x7f7d18102ef0 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d077fe640 1 -- 172.21.15.100:0/2753325977 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7d10037020 con 0x7f7d18102ef0 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 Processor -- start 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 -- start start 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e0bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0c1d0 0x5605b5e16550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e16a90 0x5605b5e18e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5605b5d6d2e0 con 0x5605b5e16a90 2024-09-12T02:40:45.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5605b5d14ce0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.525+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5605b5d692a0 con 0x5605b5e0b8b0 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e16a90 0x5605b5e18e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d077fe640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d000a2b80 0x7f7d000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e16a90 0x5605b5e18e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38594/0 (socket says 172.21.15.100:38594) 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2621388604 learned_addr learned my addr 172.21.15.100:0/2621388604 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d1659c640 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0c1d0 0x5605b5e16550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e0bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d16d9d640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d000a2b80 0x7f7d000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d077fe640 1 -- 172.21.15.100:0/2753325977 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7d100f0270 con 0x7f7d18102ef0 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2621388604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 msgr2=0x5605b5e0bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e0bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2621388604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0c1d0 msgr2=0x5605b5e16550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0c1d0 0x5605b5e16550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2621388604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b5cf9440 con 0x5605b5e16a90 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d16d9d640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d000a2b80 0x7f7d000a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d1002f760 tx=0x7f7d10087b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e16a90 0x5605b5e18e80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c016530 tx=0x7f7d0c00a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d13885a86741cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d04ff9640 1 -- 172.21.15.100:0/2621388604 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c018430 con 0x5605b5e16a90 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d04ff9640 1 -- 172.21.15.100:0/2621388604 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0c018ab0 con 0x5605b5e16a90 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.526+0000 7f7d04ff9640 1 -- 172.21.15.100:0/2621388604 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c017a40 con 0x5605b5e16a90 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2621388604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e16a90 msgr2=0x5605b5e18e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e16a90 0x5605b5e18e80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c016530 tx=0x7f7d0c00a2b0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2621388604 shutdown_connections 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e16a90 0x5605b5e18e80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0c1d0 0x5605b5e16550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2621388604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e0bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2621388604 >> 172.21.15.100:0/2621388604 conn(0x5605b5e07e40 msgr2=0x5605b5e08220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2621388604 shutdown_connections 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.527+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2621388604 wait complete. 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.528+0000 7f7d1ee9d740 1 -- start start 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.528+0000 7f7d1ee9d740 1 Processor -- start 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e16440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e136f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e13c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5605b5e19600 con 0x5605b5e0c1d0 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5605b5d28050 con 0x5605b5e0b8b0 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5605b5e19780 con 0x5605b5e16a90 2024-09-12T02:40:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1ee9d740 10 client.0 _ll_register_callbacks cb 0x5605b5d68160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38602/0 (socket says 172.21.15.100:38602) 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 -- 172.21.15.100:0/1160112388 learned_addr learned my addr 172.21.15.100:0/1160112388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e13c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e16440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 -- 172.21.15.100:0/1160112388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 msgr2=0x5605b5e13c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e13c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 -- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 msgr2=0x5605b5e16440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e16440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 -- 172.21.15.100:0/1160112388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b5ade3c0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e16440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7d1659c640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e136f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7d08010820 tx=0x7f7d08010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0056dee2900a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.529+0000 7f7cfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7cfdffb640 1 -- 172.21.15.100:0/1160112388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0801d060 con 0x5605b5e0c1d0 2024-09-12T02:40:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7cfdffb640 1 -- 172.21.15.100:0/1160112388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7d0800eda0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d0c018ab0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7cfdffb640 1 -- 172.21.15.100:0/1160112388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7d08018430 con 0x5605b5e0c1d0 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 10 client.15642 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5605b5e250c0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7cfdffb640 1 -- 172.21.15.100:0/1160112388 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0c018ab0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7cfdffb640 1 -- 172.21.15.100:0/1160112388 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f7d080225f0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 10 client.15642 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 20 client.15642 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e265d0 0x5605b5e28a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 4 client.15642 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.530+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605b5d7a850 con 0x5605b5e265d0 2024-09-12T02:40:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.531+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e265d0 0x5605b5e28a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.531+0000 7f7cfdffb640 10 client.15642 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.531+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e265d0 0x5605b5e28a50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d60b601db18f88c server_cookie=dcb436d3042944de in_seq=0 out_seq=0 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7cfdffb640 1 -- 172.21.15.100:0/1160112388 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605b5d7a850 con 0x5605b5e265d0 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7cfdffb640 10 client.15642 handle_command_reply: tid=0 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 client.15642 shutdown 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 msgr2=0x5605b5e136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e136f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7d08010820 tx=0x7f7d08010ce0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 shutdown_connections 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e265d0 0x5605b5e28a50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e13c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e136f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7cfdffb640 0 client.15642 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/1160112388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e16440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 >> 172.21.15.100:0/1160112388 conn(0x5605b5e07e40 msgr2=0x5605b5e02b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 shutdown_connections 2024-09-12T02:40:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/1160112388 wait complete. 2024-09-12T02:40:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.532+0000 7f7d1ee9d740 20 client.15642 trim_cache size 0 max 16384 2024-09-12T02:40:45.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 Processor -- start 2024-09-12T02:40:45.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 -- start start 2024-09-12T02:40:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e12890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e16a90 0x5605b5e22860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181adb90 con 0x5605b5e0c1d0 2024-09-12T02:40:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181ab460 con 0x5605b5e16a90 2024-09-12T02:40:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181a92b0 con 0x5605b5e0b8b0 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e12fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:36806/0 (socket says 172.21.15.100:36806) 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2906537042 learned_addr learned my addr 172.21.15.100:0/2906537042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d1659c640 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e12890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e16a90 0x5605b5e22860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2906537042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e16a90 msgr2=0x5605b5e22860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e16a90 0x5605b5e22860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2906537042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 msgr2=0x5605b5e12890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e12890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.551+0000 7f7d15d9b640 1 -- 172.21.15.100:0/2906537042 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b5e22da0 con 0x5605b5e0b8b0 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.552+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e12fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c01a040 tx=0x7f7d0c0047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a762b507e5409bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.552+0000 7f7cfffff640 1 -- 172.21.15.100:0/2906537042 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c031070 con 0x5605b5e0b8b0 2024-09-12T02:40:45.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.552+0000 7f7cfffff640 1 -- 172.21.15.100:0/2906537042 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0c016e80 con 0x5605b5e0b8b0 2024-09-12T02:40:45.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.552+0000 7f7cfffff640 1 -- 172.21.15.100:0/2906537042 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c025430 con 0x5605b5e0b8b0 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2906537042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 msgr2=0x5605b5e12fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e12fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c01a040 tx=0x7f7d0c0047d0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2906537042 shutdown_connections 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e16a90 0x5605b5e22860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e12890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/2906537042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e0b8b0 0x5605b5e12fb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2906537042 >> 172.21.15.100:0/2906537042 conn(0x5605b5e07e40 msgr2=0x5605b5e08220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2906537042 shutdown_connections 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/2906537042 wait complete. 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 -- start start 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.553+0000 7f7d1ee9d740 1 Processor -- start 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e10bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1ee9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e11130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181a9920 con 0x5605b5e0c1d0 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181aad90 con 0x5605b5e0b8b0 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1ee9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181a9ff0 con 0x5605b5e16a90 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1ee9d740 10 client.0 _ll_register_callbacks cb 0x7f7d0800b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e10bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e10bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38620/0 (socket says 172.21.15.100:38620) 2024-09-12T02:40:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 -- 172.21.15.100:0/4240862922 learned_addr learned my addr 172.21.15.100:0/4240862922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e11130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 -- 172.21.15.100:0/4240862922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 msgr2=0x5605b5e11130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e11130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 -- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 msgr2=0x5605b5e106b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e106b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 -- 172.21.15.100:0/4240862922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b5e90330 con 0x5605b5e0c1d0 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e11130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7d1659c640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e10bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7d08022c00 tx=0x7f7d0800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4285f501c763ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.554+0000 7f7cfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7cfdffb640 1 -- 172.21.15.100:0/4240862922 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08030060 con 0x5605b5e0c1d0 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7cfdffb640 1 -- 172.21.15.100:0/4240862922 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7d080223a0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605b5d74d60 con 0x5605b5e0c1d0 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7cfdffb640 1 -- 172.21.15.100:0/4240862922 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7d08005df0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7d1ee9d740 10 client.15648 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5605b5e91520 con 0x5605b5e0c1d0 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7cfdffb640 1 -- 172.21.15.100:0/4240862922 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5605b5d74d60 con 0x5605b5e0c1d0 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7cfdffb640 1 -- 172.21.15.100:0/4240862922 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f7d080047c0 con 0x5605b5e0c1d0 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7d1ee9d740 10 client.15648 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7d1ee9d740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7d1ee9d740 20 client.15648 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.555+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e91c70 0x5605b5e94090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.556+0000 7f7d1ee9d740 4 client.15648 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:40:45.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.556+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5605b5cf1210 con 0x5605b5e91c70 2024-09-12T02:40:45.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.556+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e91c70 0x5605b5e94090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.556+0000 7f7d15d9b640 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e91c70 0x5605b5e94090 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a772efb8b7e76dc8 server_cookie=44c779e7750c0091 in_seq=0 out_seq=0 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.556+0000 7f7cfdffb640 10 client.15648 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.556+0000 7f7cfdffb640 1 -- 172.21.15.100:0/4240862922 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5605b5cf1210 con 0x5605b5e91c70 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.556+0000 7f7cfdffb640 10 client.15648 handle_command_reply: tid=0 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 client.15648 shutdown 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 msgr2=0x5605b5e10bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e10bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7d08022c00 tx=0x7f7d0800edd0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 shutdown_connections 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5605b5e91c70 0x5605b5e94090 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b5e16a90 0x5605b5e11130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b5e0c1d0 0x5605b5e10bf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 --2- 172.21.15.100:0/4240862922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5605b5e0b8b0 0x5605b5e106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 >> 172.21.15.100:0/4240862922 conn(0x5605b5e07e40 msgr2=0x5605b5e15770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7cfdffb640 0 client.15648 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 shutdown_connections 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 1 -- 172.21.15.100:0/4240862922 wait complete. 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.557+0000 7f7d1ee9d740 20 client.15648 trim_cache size 0 max 16384 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:40:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:40:45.564 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d000a2b80 msgr2=0x7f7d000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d000a2b80 0x7f7d000a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d1002f760 tx=0x7f7d10087b30 comp rx=0 tx=0).stop 2024-09-12T02:40:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 msgr2=0x7f7d1819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1819ce50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7d10006010 tx=0x7f7d1002f6f0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 shutdown_connections 2024-09-12T02:40:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d000a2b80 0x7f7d000a5040 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d18102ef0 0x7f7d1819ce50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18102570 0x7f7d18198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 --2- 172.21.15.100:0/2753325977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18100e20 0x7f7d18198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 >> 172.21.15.100:0/2753325977 conn(0x7f7d180fc7d0 msgr2=0x7f7d1806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 shutdown_connections 2024-09-12T02:40:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:45.558+0000 7f7d1cac4640 1 -- 172.21.15.100:0/2753325977 wait complete. 2024-09-12T02:40:46.212 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:40:46.212 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:40:46.273 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 95.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 -- 172.21.15.100:0/3076285984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224102790 msgr2=0x7f62241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 --2- 172.21.15.100:0/3076285984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224102790 0x7f62241067e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6218009900 tx=0x7f621802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 -- 172.21.15.100:0/3076285984 shutdown_connections 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 --2- 172.21.15.100:0/3076285984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224106f10 0x7f622410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 --2- 172.21.15.100:0/3076285984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224102790 0x7f62241067e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 --2- 172.21.15.100:0/3076285984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6224101de0 0x7f62241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 -- 172.21.15.100:0/3076285984 >> 172.21.15.100:0/3076285984 conn(0x7f62240fd8c0 msgr2=0x7f62240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 -- 172.21.15.100:0/3076285984 shutdown_connections 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.727+0000 7f6229d22640 1 -- 172.21.15.100:0/3076285984 wait complete. 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 Processor -- start 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 -- start start 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224101de0 0x7f6224198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6224102790 0x7f62241988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224106f10 0x7f622419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6224111f30 con 0x7f6224106f10 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6224111db0 con 0x7f6224101de0 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6229d22640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f62241120b0 con 0x7f6224102790 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6223fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224106f10 0x7f622419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6223fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224106f10 0x7f622419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38638/0 (socket says 172.21.15.100:38638) 2024-09-12T02:40:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.728+0000 7f6223fff640 1 -- 172.21.15.100:0/2323499020 learned_addr learned my addr 172.21.15.100:0/2323499020 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f62237fe640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224101de0 0x7f6224198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6224102790 0x7f62241988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6223fff640 1 -- 172.21.15.100:0/2323499020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6224102790 msgr2=0x7f62241988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6223fff640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6224102790 0x7f62241988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6223fff640 1 -- 172.21.15.100:0/2323499020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224101de0 msgr2=0x7f6224198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6223fff640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224101de0 0x7f6224198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6223fff640 1 -- 172.21.15.100:0/2323499020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622419d340 con 0x7f6224106f10 2024-09-12T02:40:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6223fff640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224106f10 0x7f622419cc60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f621c00cad0 tx=0x7f621c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6220ff9640 1 -- 172.21.15.100:0/2323499020 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c00ad60 con 0x7f6224106f10 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6220ff9640 1 -- 172.21.15.100:0/2323499020 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f621c005020 con 0x7f6224106f10 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622419d630 con 0x7f6224106f10 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6220ff9640 1 -- 172.21.15.100:0/2323499020 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c00f6b0 con 0x7f6224106f10 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.729+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62241a4f10 con 0x7f6224106f10 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.731+0000 7f6220ff9640 1 -- 172.21.15.100:0/2323499020 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f621c005560 con 0x7f6224106f10 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 Processor -- start 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 -- start start 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde89f20 0x5606cde8a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cde99110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde9ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5606cddef620 con 0x5606cde99650 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5606cdd96e50 con 0x5606cde89f20 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f622c0fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5606cddeb5e0 con 0x5606cde8a840 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f6220ff9640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f620c0a2b80 0x7f620c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f6222ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde9ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f6222ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde9ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38648/0 (socket says 172.21.15.100:38648) 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f6222ffd640 1 -- 172.21.15.100:0/2960621763 learned_addr learned my addr 172.21.15.100:0/2960621763 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f6223fff640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f620c0a2b80 0x7f620c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde89f20 0x5606cde8a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f6220ff9640 1 -- 172.21.15.100:0/2323499020 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f621c0cf000 con 0x7f6224106f10 2024-09-12T02:40:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.732+0000 7f62237fe640 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cde99110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6222ffd640 1 -- 172.21.15.100:0/2960621763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 msgr2=0x5606cde99110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cde99110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6222ffd640 1 -- 172.21.15.100:0/2960621763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde89f20 msgr2=0x5606cde8a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde89f20 0x5606cde8a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6222ffd640 1 -- 172.21.15.100:0/2960621763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606cdd87d40 con 0x5606cde99650 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6223fff640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f620c0a2b80 0x7f620c0a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f621c09b880 tx=0x7f621c0664c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde9ba40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6218031550 tx=0x7f62180058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ceda9233a592d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6209ffb640 1 -- 172.21.15.100:0/2960621763 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218035040 con 0x5606cde99650 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6209ffb640 1 -- 172.21.15.100:0/2960621763 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62180319e0 con 0x5606cde99650 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.733+0000 7f6209ffb640 1 -- 172.21.15.100:0/2960621763 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180049a0 con 0x5606cde99650 2024-09-12T02:40:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 -- 172.21.15.100:0/2960621763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 msgr2=0x5606cde9ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde9ba40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6218031550 tx=0x7f62180058d0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 -- 172.21.15.100:0/2960621763 shutdown_connections 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde9ba40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cde99110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2960621763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde89f20 0x5606cde8a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 -- 172.21.15.100:0/2960621763 >> 172.21.15.100:0/2960621763 conn(0x5606cde865f0 msgr2=0x5606cde869d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 -- 172.21.15.100:0/2960621763 shutdown_connections 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 -- 172.21.15.100:0/2960621763 wait complete. 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 -- start start 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.734+0000 7f622c0fb740 1 Processor -- start 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cde965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde8a840 0x5606cde96b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde97060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5606cde9c1c0 con 0x5606cde99650 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5606cdd77f10 con 0x5606cde8a840 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5606cde9c340 con 0x5606cde89f20 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 10 client.0 _ll_register_callbacks cb 0x5606cdd9bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde97060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde97060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38656/0 (socket says 172.21.15.100:38656) 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 -- 172.21.15.100:0/229396386 learned_addr learned my addr 172.21.15.100:0/229396386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f62237fe640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde8a840 0x5606cde96b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cde965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 -- 172.21.15.100:0/229396386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 msgr2=0x5606cde965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cde965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 -- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde8a840 msgr2=0x5606cde96b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde8a840 0x5606cde96b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 -- 172.21.15.100:0/229396386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606cdafe580 con 0x5606cde99650 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f62237fe640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde8a840 0x5606cde96b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6222ffd640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde97060 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6218001eb0 tx=0x7f621802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1312d11ea4736388 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6202ffd640 1 -- 172.21.15.100:0/229396386 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621804e070 con 0x5606cde99650 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6202ffd640 1 -- 172.21.15.100:0/229396386 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6218004bb0 con 0x5606cde99650 2024-09-12T02:40:46.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62180319e0 con 0x5606cde99650 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.735+0000 7f6202ffd640 1 -- 172.21.15.100:0/229396386 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6218035040 con 0x5606cde99650 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 10 client.15660 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5606cdbc8960 con 0x5606cde99650 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f6202ffd640 1 -- 172.21.15.100:0/229396386 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62180319e0 con 0x5606cde99650 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f6202ffd640 1 -- 172.21.15.100:0/229396386 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f621803a040 con 0x5606cde99650 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 10 client.15660 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 10 client.15660 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 20 client.15660 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdeab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 4 client.15660 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606cddfcb90 con 0x5606cdea90d0 2024-09-12T02:40:46.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.736+0000 7f62237fe640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdeab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.737+0000 7f62237fe640 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdeab4c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f947bcbac45410e4 server_cookie=85c802ca8540c2ce in_seq=0 out_seq=0 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.737+0000 7f6202ffd640 10 client.15660 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.737+0000 7f6202ffd640 1 -- 172.21.15.100:0/229396386 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606cddfcb90 con 0x5606cdea90d0 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.737+0000 7f6202ffd640 10 client.15660 handle_command_reply: tid=0 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.737+0000 7f622c0fb740 1 client.15660 shutdown 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.737+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 msgr2=0x5606cde97060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.737+0000 7f622c0fb740 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde97060 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6218001eb0 tx=0x7f621802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 shutdown_connections 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdeab4c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde99650 0x5606cde97060 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f6202ffd640 0 client.15660 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde8a840 0x5606cde96b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 --2- 172.21.15.100:0/229396386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cde965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 >> 172.21.15.100:0/229396386 conn(0x5606cde865f0 msgr2=0x5606cde85750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 shutdown_connections 2024-09-12T02:40:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 1 -- 172.21.15.100:0/229396386 wait complete. 2024-09-12T02:40:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.738+0000 7f622c0fb740 20 client.15660 trim_cache size 0 max 16384 2024-09-12T02:40:46.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 Processor -- start 2024-09-12T02:40:46.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 -- start start 2024-09-12T02:40:46.757 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:46 smithi100 ceph-mon[31390]: pgmap v399: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 288 op/s 2024-09-12T02:40:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde89f20 0x5606cde955c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cdeae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdeaea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62241adbe0 con 0x5606cde89f20 2024-09-12T02:40:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62241ab4b0 con 0x5606cde99650 2024-09-12T02:40:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.755+0000 7f622c0fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f62241a9300 con 0x5606cde8a840 2024-09-12T02:40:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde89f20 0x5606cde955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde89f20 0x5606cde955c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38670/0 (socket says 172.21.15.100:38670) 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 -- 172.21.15.100:0/2954678944 learned_addr learned my addr 172.21.15.100:0/2954678944 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f62237fe640 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cdeae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 -- 172.21.15.100:0/2954678944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 msgr2=0x5606cdeae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cdeae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 -- 172.21.15.100:0/2954678944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 msgr2=0x5606cdeaea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdeaea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 -- 172.21.15.100:0/2954678944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606cde84bb0 con 0x5606cde89f20 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f6222ffd640 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde89f20 0x5606cde955c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f62180057c0 tx=0x7f621804a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db359675c993521 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f62097fa640 1 -- 172.21.15.100:0/2954678944 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621804e040 con 0x5606cde89f20 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f62097fa640 1 -- 172.21.15.100:0/2954678944 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62180049b0 con 0x5606cde89f20 2024-09-12T02:40:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.756+0000 7f62097fa640 1 -- 172.21.15.100:0/2954678944 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621803d6e0 con 0x5606cde89f20 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.757+0000 7f622c0fb740 1 -- 172.21.15.100:0/2954678944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde89f20 msgr2=0x5606cde955c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.757+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde89f20 0x5606cde955c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f62180057c0 tx=0x7f621804a8b0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.757+0000 7f622c0fb740 1 -- 172.21.15.100:0/2954678944 shutdown_connections 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.757+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdeaea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.757+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde8a840 0x5606cdeae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.757+0000 7f622c0fb740 1 --2- 172.21.15.100:0/2954678944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde89f20 0x5606cde955c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.757+0000 7f622c0fb740 1 -- 172.21.15.100:0/2954678944 >> 172.21.15.100:0/2954678944 conn(0x5606cde865f0 msgr2=0x5606cde94eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.758+0000 7f622c0fb740 1 -- 172.21.15.100:0/2954678944 shutdown_connections 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.758+0000 7f622c0fb740 1 -- 172.21.15.100:0/2954678944 wait complete. 2024-09-12T02:40:46.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.758+0000 7f622c0fb740 1 -- start start 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.758+0000 7f622c0fb740 1 Processor -- start 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cdeac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde8a840 0x5606cdeacf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f622c0fb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdf12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f622c0fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62241a9970 con 0x5606cde8a840 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f62237fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde8a840 0x5606cdeacf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f62237fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde8a840 0x5606cdeacf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38680/0 (socket says 172.21.15.100:38680) 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f62237fe640 1 -- 172.21.15.100:0/4145435015 learned_addr learned my addr 172.21.15.100:0/4145435015 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62241aade0 con 0x5606cde99650 2024-09-12T02:40:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f6222ffd640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cdeac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f62241aa040 con 0x5606cde89f20 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.759+0000 7f622c0fb740 10 client.0 _ll_register_callbacks cb 0x7f62180318b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f6222ffd640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdf12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f62237fe640 1 -- 172.21.15.100:0/4145435015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 msgr2=0x5606cdeac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f62237fe640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cdeac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f62237fe640 1 -- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 msgr2=0x5606cdf12a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f62237fe640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdf12a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f62237fe640 1 -- 172.21.15.100:0/4145435015 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606cdf12fd0 con 0x5606cde8a840 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f6222ffd640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdf12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f62237fe640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde8a840 0x5606cdeacf20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x5606cde95e70 tx=0x7f62140108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87df6e1a9befba13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f6202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f6202ffd640 1 -- 172.21.15.100:0/4145435015 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214029020 con 0x5606cde8a840 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f6202ffd640 1 -- 172.21.15.100:0/4145435015 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f621401f8f0 con 0x5606cde8a840 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.760+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62180049b0 con 0x5606cde8a840 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f6202ffd640 1 -- 172.21.15.100:0/4145435015 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f621401faf0 con 0x5606cde8a840 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 10 client.15666 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5606cdf14340 con 0x5606cde8a840 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f6202ffd640 1 -- 172.21.15.100:0/4145435015 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f621401fc90 con 0x5606cde8a840 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f6202ffd640 1 -- 172.21.15.100:0/4145435015 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f621402e030 con 0x5606cde8a840 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 10 client.15666 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 10 client.15666 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 20 client.15666 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdf16be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 4 client.15666 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "779547b4", "release": true, "await": true}] 2024-09-12T02:40:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.761+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "779547b4", "release": true, "await": true}) -- 0x7f62180049b0 con 0x5606cdea90d0 2024-09-12T02:40:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.762+0000 7f6222ffd640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdf16be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.762+0000 7f6202ffd640 10 client.15666 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.762+0000 7f6222ffd640 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdf16be0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3213166d3dff3ad1 server_cookie=2ec4c353b4d4e3e8 in_seq=0 out_seq=0 2024-09-12T02:40:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:46.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.844+0000 7f6202ffd640 1 -- 172.21.15.100:0/4145435015 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f62180049b0 con 0x5606cdea90d0 2024-09-12T02:40:46.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.844+0000 7f6202ffd640 10 client.15666 handle_command_reply: tid=0 2024-09-12T02:40:46.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.845+0000 7f622c0fb740 1 client.15666 shutdown 2024-09-12T02:40:46.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde8a840 msgr2=0x5606cdeacf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde8a840 0x5606cdeacf20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x5606cde95e70 tx=0x7f62140108c0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 shutdown_connections 2024-09-12T02:40:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5606cdea90d0 0x5606cdf16be0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5606cde99650 0x5606cdf12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606cde8a840 0x5606cdeacf20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 --2- 172.21.15.100:0/4145435015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606cde89f20 0x5606cdeac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 >> 172.21.15.100:0/4145435015 conn(0x5606cde865f0 msgr2=0x5606cde956d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.846+0000 7f6202ffd640 0 client.15666 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.847+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 shutdown_connections 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.847+0000 7f622c0fb740 1 -- 172.21.15.100:0/4145435015 wait complete. 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.847+0000 7f622c0fb740 20 client.15666 trim_cache size 0 max 16384 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 26, 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 8, 2024-09-12T02:40:46.850 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "779547b4": { 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 8, 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 133.4, 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:40:46.851 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:40:46.852 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:40:46.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:46.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:46.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:46.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:46.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:46.852 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f620c0a2b80 msgr2=0x7f620c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f620c0a2b80 0x7f620c0a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f621c09b880 tx=0x7f621c0664c0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224106f10 msgr2=0x7f622419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224106f10 0x7f622419cc60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f621c00cad0 tx=0x7f621c00ced0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 shutdown_connections 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f620c0a2b80 0x7f620c0a5040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224106f10 0x7f622419cc60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6224102790 0x7f62241988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 --2- 172.21.15.100:0/2323499020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224101de0 0x7f6224198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 >> 172.21.15.100:0/2323499020 conn(0x7f62240fd8c0 msgr2=0x7f62240fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 shutdown_connections 2024-09-12T02:40:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:46.849+0000 7f6229d22640 1 -- 172.21.15.100:0/2323499020 wait complete. 2024-09-12T02:40:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:46 smithi189 ceph-mon[35196]: pgmap v399: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 288 op/s 2024-09-12T02:40:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:46 smithi117 ceph-mon[34898]: pgmap v399: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 288 op/s 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.943+0000 7f50cc4be640 1 -- 172.21.15.100:0/1106260215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4101420 msgr2=0x7f50c410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.943+0000 7f50cc4be640 1 --2- 172.21.15.100:0/1106260215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4101420 0x7f50c410d950 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009cd0 tx=0x7f50bc02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.944+0000 7f50cc4be640 1 -- 172.21.15.100:0/1106260215 shutdown_connections 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.944+0000 7f50cc4be640 1 --2- 172.21.15.100:0/1106260215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4101420 0x7f50c410d950 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.944+0000 7f50cc4be640 1 --2- 172.21.15.100:0/1106260215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4100a80 0x7f50c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.944+0000 7f50cc4be640 1 --2- 172.21.15.100:0/1106260215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.944+0000 7f50cc4be640 1 -- 172.21.15.100:0/1106260215 >> 172.21.15.100:0/1106260215 conn(0x7f50c40fc7a0 msgr2=0x7f50c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.945+0000 7f50cc4be640 1 -- 172.21.15.100:0/1106260215 shutdown_connections 2024-09-12T02:40:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.945+0000 7f50cc4be640 1 -- 172.21.15.100:0/1106260215 wait complete. 2024-09-12T02:40:47.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.946+0000 7f50cc4be640 1 Processor -- start 2024-09-12T02:40:47.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.946+0000 7f50cc4be640 1 -- start start 2024-09-12T02:40:47.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50cc4be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c410a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:47.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50cc4be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c410aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50cc4be640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c41a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50cc4be640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50c410f760 con 0x7f50c4100a80 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50cc4be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50c410f5e0 con 0x7f50c4101420 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50cc4be640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50c410f8e0 con 0x7f50c4106a80 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50c9a59640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c410aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50ca25a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c410a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50c9a59640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c410aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53446/0 (socket says 172.21.15.100:53446) 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50c9a59640 1 -- 172.21.15.100:0/3501619212 learned_addr learned my addr 172.21.15.100:0/3501619212 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.947+0000 7f50caa5b640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c41a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:47.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50ca25a640 1 -- 172.21.15.100:0/3501619212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 msgr2=0x7f50c41a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:47.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50ca25a640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c41a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:47.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50ca25a640 1 -- 172.21.15.100:0/3501619212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 msgr2=0x7f50c410aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50ca25a640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c410aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50ca25a640 1 -- 172.21.15.100:0/3501619212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c41a4b80 con 0x7f50c4100a80 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50caa5b640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c41a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50ca25a640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c410a4e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f50c000d720 tx=0x7f50c000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50bb7fe640 1 -- 172.21.15.100:0/3501619212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0017070 con 0x7f50c4100a80 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50bb7fe640 1 -- 172.21.15.100:0/3501619212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50c000de30 con 0x7f50c4100a80 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50bb7fe640 1 -- 172.21.15.100:0/3501619212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c00047a0 con 0x7f50c4100a80 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.948+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c41a4e70 con 0x7f50c4100a80 2024-09-12T02:40:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.949+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c41a52a0 con 0x7f50c4100a80 2024-09-12T02:40:47.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.950+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c4100ee0 con 0x7f50c4100a80 2024-09-12T02:40:47.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.952+0000 7f50bb7fe640 1 -- 172.21.15.100:0/3501619212 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f50c00099d0 con 0x7f50c4100a80 2024-09-12T02:40:47.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.954+0000 7f50bb7fe640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2d90 0x7f50b00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:47.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.955+0000 7f50c9a59640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2d90 0x7f50b00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:47.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.955+0000 7f50bb7fe640 1 -- 172.21.15.100:0/3501619212 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f50c00cef80 con 0x7f50c4100a80 2024-09-12T02:40:47.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.956+0000 7f50c9a59640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2d90 0x7f50b00a5250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50c4110290 tx=0x7f50b400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:47.960+0000 7f50bb7fe640 1 -- 172.21.15.100:0/3501619212 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50c0020020 con 0x7f50c4100a80 2024-09-12T02:40:48.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.290+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50c410b7a0 con 0x7f50c4100a80 2024-09-12T02:40:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.291+0000 7f50bb7fe640 1 -- 172.21.15.100:0/3501619212 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7f50c009bf70 con 0x7f50c4100a80 2024-09-12T02:40:48.293 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:40:48.293 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:38:59:560858+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:38:59.510722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24448,24466,24473]},"id":1}]} 2024-09-12T02:40:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2d90 msgr2=0x7f50b00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2d90 0x7f50b00a5250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50c4110290 tx=0x7f50b400b480 comp rx=0 tx=0).stop 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 msgr2=0x7f50c410a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c410a4e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f50c000d720 tx=0x7f50c000dbe0 comp rx=0 tx=0).stop 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 shutdown_connections 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50b00a2d90 0x7f50b00a5250 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c4106a80 0x7f50c41a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c4101420 0x7f50c410aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 --2- 172.21.15.100:0/3501619212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c4100a80 0x7f50c410a4e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 >> 172.21.15.100:0/3501619212 conn(0x7f50c40fc7a0 msgr2=0x7f50c4104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 shutdown_connections 2024-09-12T02:40:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:48.295+0000 7f50cc4be640 1 -- 172.21.15.100:0/3501619212 wait complete. 2024-09-12T02:40:48.433 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '779547b4', total seconds elapsed: 18.3 2024-09-12T02:40:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:48 smithi189 ceph-mon[35196]: pgmap v400: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 204 op/s 2024-09-12T02:40:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3501619212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:49.063 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:48 smithi100 ceph-mon[31390]: pgmap v400: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 204 op/s 2024-09-12T02:40:49.063 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3501619212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:48 smithi117 ceph-mon[34898]: pgmap v400: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 204 op/s 2024-09-12T02:40:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3501619212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:40:49.104 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:40:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 -- 172.21.15.100:0/1161631395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0103670 msgr2=0x7f33e010bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 --2- 172.21.15.100:0/1161631395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0103670 0x7f33e010bb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009900 tx=0x7f33d002a480 comp rx=0 tx=0).stop 2024-09-12T02:40:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 -- 172.21.15.100:0/1161631395 shutdown_connections 2024-09-12T02:40:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 --2- 172.21.15.100:0/1161631395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33e010c180 0x7f33e010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 --2- 172.21.15.100:0/1161631395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0103670 0x7f33e010bb60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 --2- 172.21.15.100:0/1161631395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0102d50 0x7f33e0103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 -- 172.21.15.100:0/1161631395 >> 172.21.15.100:0/1161631395 conn(0x7f33e00fc7d0 msgr2=0x7f33e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 -- 172.21.15.100:0/1161631395 shutdown_connections 2024-09-12T02:40:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.054+0000 7f33e8173640 1 -- 172.21.15.100:0/1161631395 wait complete. 2024-09-12T02:40:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.055+0000 7f33e8173640 1 Processor -- start 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e8173640 1 -- start start 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e8173640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0102d50 0x7f33e019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e8173640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0103670 0x7f33e019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e8173640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33e010c180 0x7f33e010acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e8173640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33e0111f80 con 0x7f33e0103670 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e8173640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33e0111e00 con 0x7f33e0102d50 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e8173640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33e0112100 con 0x7f33e010c180 2024-09-12T02:40:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0103670 0x7f33e019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e5f0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0102d50 0x7f33e019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0103670 0x7f33e019f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38720/0 (socket says 172.21.15.100:38720) 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e5f0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0102d50 0x7f33e019ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53476/0 (socket says 172.21.15.100:53476) 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e570e640 1 -- 172.21.15.100:0/3750908765 learned_addr learned my addr 172.21.15.100:0/3750908765 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.056+0000 7f33e6710640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33e010c180 0x7f33e010acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e570e640 1 -- 172.21.15.100:0/3750908765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33e010c180 msgr2=0x7f33e010acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e570e640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33e010c180 0x7f33e010acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e570e640 1 -- 172.21.15.100:0/3750908765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0102d50 msgr2=0x7f33e019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e6710640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33e010c180 0x7f33e010acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e570e640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0102d50 0x7f33e019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e570e640 1 -- 172.21.15.100:0/3750908765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e010b590 con 0x7f33e0103670 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0102d50 0x7f33e019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.057+0000 7f33e570e640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0103670 0x7f33e019f4d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f33d0006010 tx=0x7f33d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.058+0000 7f33d6ffd640 1 -- 172.21.15.100:0/3750908765 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d003f030 con 0x7f33e0103670 2024-09-12T02:40:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.058+0000 7f33d6ffd640 1 -- 172.21.15.100:0/3750908765 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d0003ce0 con 0x7f33e0103670 2024-09-12T02:40:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.058+0000 7f33d6ffd640 1 -- 172.21.15.100:0/3750908765 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0035070 con 0x7f33e0103670 2024-09-12T02:40:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.058+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e010b820 con 0x7f33e0103670 2024-09-12T02:40:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.058+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e019aad0 con 0x7f33e0103670 2024-09-12T02:40:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.062+0000 7f33d6ffd640 1 -- 172.21.15.100:0/3750908765 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f33d0042030 con 0x7f33e0103670 2024-09-12T02:40:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.062+0000 7f33ea54c740 1 Processor -- start 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.062+0000 7f33ea54c740 1 -- start start 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b09768db40 0x55b09768c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b09768ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b097697370 0x55b097699760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33ea54c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b0975f22f0 con 0x55b09768db40 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33ea54c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b097599cf0 con 0x55b097697370 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33ea54c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b0975ee2b0 con 0x55b09768c5d0 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33e6710640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b09768db40 0x55b09768c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33e6710640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b09768db40 0x55b09768c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38724/0 (socket says 172.21.15.100:38724) 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33e6710640 1 -- 172.21.15.100:0/3561892092 learned_addr learned my addr 172.21.15.100:0/3561892092 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33e570e640 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b097697370 0x55b097699760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33d6ffd640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33cc0a2cd0 0x7f33cc0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.063+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b09768ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.064+0000 7f33d6ffd640 1 -- 172.21.15.100:0/3750908765 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f33d00ef620 con 0x7f33e0103670 2024-09-12T02:40:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.064+0000 7f33e5f0f640 1 -- 172.21.15.100:0/3561892092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b097697370 msgr2=0x55b097699760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.064+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b097697370 0x55b097699760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.064+0000 7f33e5f0f640 1 -- 172.21.15.100:0/3561892092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b09768db40 msgr2=0x55b09768c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.064+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b09768db40 0x55b09768c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.064+0000 7f33e5f0f640 1 -- 172.21.15.100:0/3561892092 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09757e3a0 con 0x55b09768c5d0 2024-09-12T02:40:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.064+0000 7f33e6710640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33cc0a2cd0 0x7f33cc0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.065+0000 7f33e570e640 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b097697370 0x55b097699760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.065+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b09768ca10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00afc0 tx=0x7f33dc00f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb447e7fae8ade48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.065+0000 7f33cbfff640 1 -- 172.21.15.100:0/3561892092 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc005220 con 0x55b09768c5d0 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.065+0000 7f33cbfff640 1 -- 172.21.15.100:0/3561892092 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33dc0047a0 con 0x55b09768c5d0 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.065+0000 7f33cbfff640 1 -- 172.21.15.100:0/3561892092 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc010bd0 con 0x55b09768c5d0 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 -- 172.21.15.100:0/3561892092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 msgr2=0x55b09768ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b09768ca10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00afc0 tx=0x7f33dc00f850 comp rx=0 tx=0).stop 2024-09-12T02:40:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33e6710640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33cc0a2cd0 0x7f33cc0a5190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f33d8005c20 tx=0x7f33d8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 -- 172.21.15.100:0/3561892092 shutdown_connections 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b097697370 0x55b097699760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b09768ca10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3561892092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b09768db40 0x55b09768c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 -- 172.21.15.100:0/3561892092 >> 172.21.15.100:0/3561892092 conn(0x55b097655310 msgr2=0x55b097688c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 -- 172.21.15.100:0/3561892092 shutdown_connections 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 -- 172.21.15.100:0/3561892092 wait complete. 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 -- start start 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.066+0000 7f33ea54c740 1 Processor -- start 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b097696ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768db40 0x55b097693f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b097694490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33ea54c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b09769a070 con 0x55b097697370 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33ea54c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b0975ad060 con 0x55b09768db40 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33ea54c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b09769a1f0 con 0x55b09768c5d0 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33ea54c740 10 client.0 _ll_register_callbacks cb 0x55b0973008c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e6710640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b097694490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768db40 0x55b097693f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768db40 0x55b097693f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53500/0 (socket says 172.21.15.100:53500) 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 -- 172.21.15.100:0/1620831229 learned_addr learned my addr 172.21.15.100:0/1620831229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b097696ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 -- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 msgr2=0x55b097696ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b097696ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 -- 172.21.15.100:0/1620831229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 msgr2=0x55b097694490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b097694490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.067+0000 7f33e570e640 1 -- 172.21.15.100:0/1620831229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0973633c0 con 0x55b09768db40 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33e570e640 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768db40 0x55b097693f50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f33d00ed110 tx=0x7f33d003b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc11322da9a9dffe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33c97fa640 1 -- 172.21.15.100:0/1620831229 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0049070 con 0x55b09768db40 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33c97fa640 1 -- 172.21.15.100:0/1620831229 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f33d00bc0d0 con 0x55b09768db40 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33dc0047a0 con 0x55b09768db40 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33c97fa640 1 -- 172.21.15.100:0/1620831229 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f33d00bbc40 con 0x55b09768db40 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33ea54c740 10 client.25166 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b0976a5a60 con 0x55b09768db40 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33c97fa640 1 -- 172.21.15.100:0/1620831229 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33dc0047a0 con 0x55b09768db40 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33c97fa640 1 -- 172.21.15.100:0/1620831229 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f33d00c4650 con 0x55b09768db40 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.070+0000 7f33ea54c740 10 client.25166 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33ea54c740 10 client.25166 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33ea54c740 20 client.25166 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33ea54c740 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b0976a6f10 0x55b0976a9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33ea54c740 4 client.25166 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0975ff860 con 0x55b0976a6f10 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b0976a6f10 0x55b0976a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33c97fa640 10 client.25166 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.071+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b0976a6f10 0x55b0976a9360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=799d471ea2dd30f4 server_cookie=4c302686a9a34b20 in_seq=0 out_seq=0 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.072+0000 7f33c97fa640 1 -- 172.21.15.100:0/1620831229 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0975ff860 con 0x55b0976a6f10 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.072+0000 7f33c97fa640 10 client.25166 handle_command_reply: tid=0 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.072+0000 7f33ea54c740 1 client.25166 shutdown 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.072+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768db40 msgr2=0x55b097693f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.072+0000 7f33ea54c740 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768db40 0x55b097693f50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f33d00ed110 tx=0x7f33d003b5d0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 shutdown_connections 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b0976a6f10 0x55b0976a9360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b097694490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768db40 0x55b097693f50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 --2- 172.21.15.100:0/1620831229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768c5d0 0x55b097696ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 >> 172.21.15.100:0/1620831229 conn(0x55b097655310 msgr2=0x55b09768e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33c97fa640 0 client.25166 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 shutdown_connections 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 1 -- 172.21.15.100:0/1620831229 wait complete. 2024-09-12T02:40:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.073+0000 7f33ea54c740 20 client.25166 trim_cache size 0 max 16384 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.090+0000 7f33ea54c740 1 Processor -- start 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.090+0000 7f33ea54c740 1 -- start start 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768c5d0 0x55b0976a3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b097695ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09768f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33ea54c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01bec30 con 0x55b097697370 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33ea54c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01bc500 con 0x55b09768c5d0 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33ea54c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01ba350 con 0x55b09768db40 2024-09-12T02:40:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768c5d0 0x55b0976a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768c5d0 0x55b0976a3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53516/0 (socket says 172.21.15.100:53516) 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 -- 172.21.15.100:0/3223600687 learned_addr learned my addr 172.21.15.100:0/3223600687 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e6710640 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09768f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e570e640 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b097695ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 -- 172.21.15.100:0/3223600687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 msgr2=0x55b097695ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b097695ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 -- 172.21.15.100:0/3223600687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 msgr2=0x55b09768f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09768f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 -- 172.21.15.100:0/3223600687 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b097683f90 con 0x55b09768c5d0 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.091+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768c5d0 0x55b0976a3310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00ad50 tx=0x7f33dc00fe80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2613896680f5d57c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.092+0000 7f33cb7fe640 1 -- 172.21.15.100:0/3223600687 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc004660 con 0x55b09768c5d0 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.092+0000 7f33cb7fe640 1 -- 172.21.15.100:0/3223600687 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33dc02e030 con 0x55b09768c5d0 2024-09-12T02:40:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.092+0000 7f33cb7fe640 1 -- 172.21.15.100:0/3223600687 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc005000 con 0x55b09768c5d0 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 -- 172.21.15.100:0/3223600687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768c5d0 msgr2=0x55b0976a3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768c5d0 0x55b0976a3310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00ad50 tx=0x7f33dc00fe80 comp rx=0 tx=0).stop 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 -- 172.21.15.100:0/3223600687 shutdown_connections 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09768f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b097695ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 --2- 172.21.15.100:0/3223600687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b09768c5d0 0x55b0976a3310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 -- 172.21.15.100:0/3223600687 >> 172.21.15.100:0/3223600687 conn(0x55b097655310 msgr2=0x55b0976957b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 -- 172.21.15.100:0/3223600687 shutdown_connections 2024-09-12T02:40:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 -- 172.21.15.100:0/3223600687 wait complete. 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.093+0000 7f33ea54c740 1 -- start start 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 1 Processor -- start 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b09769f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09769f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0976905d0 0x55b097690a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01ba9c0 con 0x55b097697370 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01bbe30 con 0x55b0976905d0 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01bb090 con 0x55b09768db40 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33ea54c740 10 client.0 _ll_register_callbacks cb 0x7f33d00314b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09769f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09769f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38750/0 (socket says 172.21.15.100:38750) 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e570e640 1 -- 172.21.15.100:0/18650916 learned_addr learned my addr 172.21.15.100:0/18650916 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e6710640 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0976905d0 0x55b097690a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b09769f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e6710640 1 -- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 msgr2=0x55b09769f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e6710640 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b09769f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e6710640 1 -- 172.21.15.100:0/18650916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 msgr2=0x55b09769f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e6710640 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09769f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.094+0000 7f33e6710640 1 -- 172.21.15.100:0/18650916 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b097690f90 con 0x55b0976905d0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33e6710640 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0976905d0 0x55b097690a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009da0 tx=0x7f33d8009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a4b8f40a426bcf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33c97fa640 1 -- 172.21.15.100:0/18650916 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8022a20 con 0x55b0976905d0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33c97fa640 1 -- 172.21.15.100:0/18650916 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f33d8022bc0 con 0x55b0976905d0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33dc02e030 con 0x55b0976905d0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33c97fa640 1 -- 172.21.15.100:0/18650916 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f33d8022dc0 con 0x55b0976905d0 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 10 client.25172 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b0977118c0 con 0x55b0976905d0 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33c97fa640 1 -- 172.21.15.100:0/18650916 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33dc02e030 con 0x55b0976905d0 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33c97fa640 1 -- 172.21.15.100:0/18650916 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f33d800f040 con 0x55b0976905d0 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 10 client.25172 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 10 client.25172 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 20 client.25172 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b097712010 0x55b097714400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 4 client.25172 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.095+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0975f9d70 con 0x55b097712010 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b097712010 0x55b097714400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33c97fa640 10 client.25172 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33e5f0f640 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b097712010 0x55b097714400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f508cbe254e3a474 server_cookie=e3d9504d10ec591c in_seq=0 out_seq=0 2024-09-12T02:40:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33c97fa640 1 -- 172.21.15.100:0/18650916 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0975f9d70 con 0x55b097712010 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33c97fa640 10 client.25172 handle_command_reply: tid=0 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 client.25172 shutdown 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0976905d0 msgr2=0x55b097690a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0976905d0 0x55b097690a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009da0 tx=0x7f33d8009600 comp rx=0 tx=0).stop 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 shutdown_connections 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b097712010 0x55b097714400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b0976905d0 0x55b097690a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b097697370 0x55b09769f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 --2- 172.21.15.100:0/18650916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b09768db40 0x55b09769f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 >> 172.21.15.100:0/18650916 conn(0x55b097655310 msgr2=0x55b097695fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.096+0000 7f33c97fa640 0 client.25172 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:40:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.097+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 shutdown_connections 2024-09-12T02:40:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.097+0000 7f33ea54c740 1 -- 172.21.15.100:0/18650916 wait complete. 2024-09-12T02:40:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.097+0000 7f33ea54c740 20 client.25172 trim_cache size 0 max 16384 2024-09-12T02:40:50.104 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:40:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.098+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33cc0a2cd0 msgr2=0x7f33cc0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.098+0000 7f33e8173640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33cc0a2cd0 0x7f33cc0a5190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f33d8005c20 tx=0x7f33d8004ab0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0103670 msgr2=0x7f33e019f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0103670 0x7f33e019f4d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f33d0006010 tx=0x7f33d00042f0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 shutdown_connections 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33cc0a2cd0 0x7f33cc0a5190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33e010c180 0x7f33e010acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33e0103670 0x7f33e019f4d0 secure :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f33d0006010 tx=0x7f33d00042f0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 --2- 172.21.15.100:0/3750908765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e0102d50 0x7f33e019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 >> 172.21.15.100:0/3750908765 conn(0x7f33e00fc7d0 msgr2=0x7f33e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 shutdown_connections 2024-09-12T02:40:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:50.099+0000 7f33e8173640 1 -- 172.21.15.100:0/3750908765 wait complete. 2024-09-12T02:40:50.855 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:40:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:50 smithi189 ceph-mon[35196]: pgmap v401: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 150 op/s 2024-09-12T02:40:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:50 smithi117 ceph-mon[34898]: pgmap v401: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 150 op/s 2024-09-12T02:40:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:50 smithi100 ceph-mon[31390]: pgmap v401: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.9 MiB/s wr, 150 op/s 2024-09-12T02:40:51.201 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 100.0 s, 3182.0 tps, lat 109.461 ms stddev 1029.242 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 -- 172.21.15.100:0/3109282716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28780ffff0 msgr2=0x7f28781003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 --2- 172.21.15.100:0/3109282716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28780ffff0 0x7f28781003d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2870005fd0 tx=0x7f287002b3f0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 -- 172.21.15.100:0/3109282716 shutdown_connections 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 --2- 172.21.15.100:0/3109282716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2878105120 0x7f287810cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 --2- 172.21.15.100:0/3109282716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28781009a0 0x7f28781049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 --2- 172.21.15.100:0/3109282716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28780ffff0 0x7f28781003d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 -- 172.21.15.100:0/3109282716 >> 172.21.15.100:0/3109282716 conn(0x7f28780fba90 msgr2=0x7f28780fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 -- 172.21.15.100:0/3109282716 shutdown_connections 2024-09-12T02:40:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.727+0000 7f287fff6640 1 -- 172.21.15.100:0/3109282716 wait complete. 2024-09-12T02:40:51.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 Processor -- start 2024-09-12T02:40:51.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 -- start start 2024-09-12T02:40:51.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28780ffff0 0x7f287819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28781009a0 0x7f287819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2878105120 0x7f287819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f287810fd00 con 0x7f2878105120 2024-09-12T02:40:51.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f287810fb80 con 0x7f28780ffff0 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287fff6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f287810fe80 con 0x7f28781009a0 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287d591640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28781009a0 0x7f287819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287e593640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2878105120 0x7f287819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287d591640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28781009a0 0x7f287819acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:36954/0 (socket says 172.21.15.100:36954) 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287d591640 1 -- 172.21.15.100:0/2853883025 learned_addr learned my addr 172.21.15.100:0/2853883025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.728+0000 7f287dd92640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28780ffff0 0x7f287819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.729+0000 7f287e593640 1 -- 172.21.15.100:0/2853883025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28781009a0 msgr2=0x7f287819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.729+0000 7f287e593640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28781009a0 0x7f287819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.729+0000 7f287e593640 1 -- 172.21.15.100:0/2853883025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28780ffff0 msgr2=0x7f287819a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.729+0000 7f287e593640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28780ffff0 0x7f287819a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.729+0000 7f287e593640 1 -- 172.21.15.100:0/2853883025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287819e6d0 con 0x7f2878105120 2024-09-12T02:40:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.730+0000 7f287e593640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2878105120 0x7f287819dfa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f287400d680 tx=0x7f287400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.730+0000 7f286effd640 1 -- 172.21.15.100:0/2853883025 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874017070 con 0x7f2878105120 2024-09-12T02:40:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.730+0000 7f286effd640 1 -- 172.21.15.100:0/2853883025 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2874009820 con 0x7f2878105120 2024-09-12T02:40:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.730+0000 7f286effd640 1 -- 172.21.15.100:0/2853883025 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874004e00 con 0x7f2878105120 2024-09-12T02:40:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.731+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287819e9c0 con 0x7f2878105120 2024-09-12T02:40:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.731+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28781a7330 con 0x7f2878105120 2024-09-12T02:40:51.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.735+0000 7f28823cf740 1 Processor -- start 2024-09-12T02:40:51.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.735+0000 7f286effd640 1 -- 172.21.15.100:0/2853883025 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f28740099d0 con 0x7f2878105120 2024-09-12T02:40:51.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.735+0000 7f28823cf740 1 -- start start 2024-09-12T02:40:51.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f28823cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88959350 0x561e889578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f28823cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88957de0 0x561e88958220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f28823cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88962b80 0x561e88964f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f28823cf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561e888b52f0 con 0x561e88959350 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f28823cf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561e8885ccf0 con 0x561e88962b80 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f28823cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e888b12b0 con 0x561e88957de0 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88957de0 0x561e88958220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88957de0 0x561e88958220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:36970/0 (socket says 172.21.15.100:36970) 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 -- 172.21.15.100:0/1707481635 learned_addr learned my addr 172.21.15.100:0/1707481635 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287d591640 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88959350 0x561e889578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 -- 172.21.15.100:0/1707481635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88962b80 msgr2=0x561e88964f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88962b80 0x561e88964f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 -- 172.21.15.100:0/1707481635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88959350 msgr2=0x561e889578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88959350 0x561e889578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f287dd92640 1 -- 172.21.15.100:0/1707481635 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e888413a0 con 0x561e88957de0 2024-09-12T02:40:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.736+0000 7f286effd640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28640a2bf0 0x7f28640a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.737+0000 7f287dd92640 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88957de0 0x561e88958220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f287000afd0 tx=0x7f28700075b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d081ef9cc33a42b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.737+0000 7f287d591640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28640a2bf0 0x7f28640a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.737+0000 7f286effd640 1 -- 172.21.15.100:0/2853883025 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f28740ce790 con 0x7f2878105120 2024-09-12T02:40:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.737+0000 7f2863fff640 1 -- 172.21.15.100:0/1707481635 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870041070 con 0x561e88957de0 2024-09-12T02:40:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.737+0000 7f2863fff640 1 -- 172.21.15.100:0/1707481635 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2870032850 con 0x561e88957de0 2024-09-12T02:40:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.737+0000 7f2863fff640 1 -- 172.21.15.100:0/1707481635 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870037040 con 0x561e88957de0 2024-09-12T02:40:51.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 -- 172.21.15.100:0/1707481635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88957de0 msgr2=0x561e88958220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88957de0 0x561e88958220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f287000afd0 tx=0x7f28700075b0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f287d591640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28640a2bf0 0x7f28640a50b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fa0 tx=0x7f2868005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 -- 172.21.15.100:0/1707481635 shutdown_connections 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88962b80 0x561e88964f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88957de0 0x561e88958220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 --2- 172.21.15.100:0/1707481635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88959350 0x561e889578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 -- 172.21.15.100:0/1707481635 >> 172.21.15.100:0/1707481635 conn(0x561e88918310 msgr2=0x561e88954470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 -- 172.21.15.100:0/1707481635 shutdown_connections 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 -- 172.21.15.100:0/1707481635 wait complete. 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 -- start start 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.738+0000 7f28823cf740 1 Processor -- start 2024-09-12T02:40:51.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f28823cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e889624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f28823cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e8895f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f28823cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88962b80 0x561e8895fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f287dd92640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e889624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f287dd92640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e889624a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38772/0 (socket says 172.21.15.100:38772) 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f287dd92640 1 -- 172.21.15.100:0/3579940870 learned_addr learned my addr 172.21.15.100:0/3579940870 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f287d591640 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e8895f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561e88965820 con 0x561e88957de0 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f287e593640 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88962b80 0x561e8895fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561e88870060 con 0x561e88959350 2024-09-12T02:40:51.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e889659a0 con 0x561e88962b80 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.739+0000 7f28823cf740 10 client.0 _ll_register_callbacks cb 0x561e885c38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.740+0000 7f287dd92640 1 -- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88962b80 msgr2=0x561e8895fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.740+0000 7f287dd92640 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88962b80 0x561e8895fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.740+0000 7f287dd92640 1 -- 172.21.15.100:0/3579940870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 msgr2=0x561e8895f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.740+0000 7f287dd92640 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e8895f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.740+0000 7f287dd92640 1 -- 172.21.15.100:0/3579940870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e886263c0 con 0x561e88957de0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.740+0000 7f287dd92640 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e889624a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2870035040 tx=0x7f2870004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f8fd912fbad50d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.740+0000 7f28617fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.741+0000 7f28617fa640 1 -- 172.21.15.100:0/3579940870 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870037040 con 0x561e88957de0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.741+0000 7f28617fa640 1 -- 172.21.15.100:0/3579940870 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2870007c50 con 0x561e88957de0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.741+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2870032850 con 0x561e88957de0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.741+0000 7f28617fa640 1 -- 172.21.15.100:0/3579940870 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2870041040 con 0x561e88957de0 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.741+0000 7f28823cf740 10 client.15699 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:51.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.741+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561e88971220 con 0x561e88957de0 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28617fa640 1 -- 172.21.15.100:0/3579940870 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f287000a990 con 0x561e88957de0 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28617fa640 1 -- 172.21.15.100:0/3579940870 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f287004f430 con 0x561e88957de0 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28823cf740 10 client.15699 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28823cf740 10 client.15699 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28823cf740 20 client.15699 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28823cf740 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88972570 0x561e88974960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28823cf740 4 client.15699 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2870032850 con 0x561e88972570 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.742+0000 7f287d591640 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88972570 0x561e88974960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.743+0000 7f287d591640 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88972570 0x561e88974960 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=672ccf2340f47b31 server_cookie=6579aeae199138a1 in_seq=0 out_seq=0 2024-09-12T02:40:51.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.743+0000 7f28617fa640 10 client.15699 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:51.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.743+0000 7f28617fa640 1 -- 172.21.15.100:0/3579940870 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2870032850 con 0x561e88972570 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.743+0000 7f28617fa640 10 client.15699 handle_command_reply: tid=0 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.743+0000 7f28823cf740 1 client.15699 shutdown 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.743+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 msgr2=0x561e889624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.743+0000 7f28823cf740 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e889624a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2870035040 tx=0x7f2870004a80 comp rx=0 tx=0).stop 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 shutdown_connections 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88972570 0x561e88974960 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88962b80 0x561e8895fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e8895f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28617fa640 0 client.15699 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 --2- 172.21.15.100:0/3579940870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e889624a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 >> 172.21.15.100:0/3579940870 conn(0x561e88918310 msgr2=0x561e8895a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 shutdown_connections 2024-09-12T02:40:51.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 1 -- 172.21.15.100:0/3579940870 wait complete. 2024-09-12T02:40:51.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.744+0000 7f28823cf740 20 client.15699 trim_cache size 0 max 16384 2024-09-12T02:40:51.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.762+0000 7f28823cf740 1 Processor -- start 2024-09-12T02:40:51.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.762+0000 7f28823cf740 1 -- start start 2024-09-12T02:40:51.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.762+0000 7f28823cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88918310 0x561e88964b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.762+0000 7f28823cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e88963f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.762+0000 7f28823cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e889644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f28823cf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28781adcb0 con 0x561e88957de0 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f28823cf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28781ab580 con 0x561e88959350 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f28823cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28781a93f0 con 0x561e88918310 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88918310 0x561e88964b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287d591640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e88963f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88918310 0x561e88964b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:36990/0 (socket says 172.21.15.100:36990) 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 -- 172.21.15.100:0/4159768289 learned_addr learned my addr 172.21.15.100:0/4159768289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287e593640 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e889644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 -- 172.21.15.100:0/4159768289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 msgr2=0x561e889644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e889644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 -- 172.21.15.100:0/4159768289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 msgr2=0x561e88963f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e88963f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 -- 172.21.15.100:0/4159768289 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8895dca0 con 0x561e88918310 2024-09-12T02:40:51.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f287dd92640 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88918310 0x561e88964b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f287000c000 tx=0x7f287002b3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823c89eea0173b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:51.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f28637fe640 1 -- 172.21.15.100:0/4159768289 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870037040 con 0x561e88918310 2024-09-12T02:40:51.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f28637fe640 1 -- 172.21.15.100:0/4159768289 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2870032850 con 0x561e88918310 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.763+0000 7f28637fe640 1 -- 172.21.15.100:0/4159768289 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287000a180 con 0x561e88918310 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 -- 172.21.15.100:0/4159768289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88918310 msgr2=0x561e88964b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88918310 0x561e88964b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f287000c000 tx=0x7f287002b3f0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 -- 172.21.15.100:0/4159768289 shutdown_connections 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88959350 0x561e889644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88957de0 0x561e88963f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 --2- 172.21.15.100:0/4159768289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88918310 0x561e88964b40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 -- 172.21.15.100:0/4159768289 >> 172.21.15.100:0/4159768289 conn(0x561e8895fdf0 msgr2=0x561e8895e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 -- 172.21.15.100:0/4159768289 shutdown_connections 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 -- 172.21.15.100:0/4159768289 wait complete. 2024-09-12T02:40:51.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.765+0000 7f28823cf740 1 -- start start 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f28823cf740 1 Processor -- start 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f28823cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88918310 0x561e889780e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f28823cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88957de0 0x561e88973410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f28823cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88959350 0x561e88973950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f28823cf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28781a9a40 con 0x561e88918310 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f28823cf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28781aaeb0 con 0x561e88957de0 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f287d591640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88957de0 0x561e88973410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f287d591640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88957de0 0x561e88973410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53566/0 (socket says 172.21.15.100:53566) 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f287d591640 1 -- 172.21.15.100:0/2002415242 learned_addr learned my addr 172.21.15.100:0/2002415242 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f287dd92640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88918310 0x561e889780e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f287e593640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88959350 0x561e88973950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.766+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28781aa110 con 0x561e88959350 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28823cf740 10 client.0 _ll_register_callbacks cb 0x7f287000ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f287d591640 1 -- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88959350 msgr2=0x561e88973950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f287d591640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88959350 0x561e88973950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f287d591640 1 -- 172.21.15.100:0/2002415242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88918310 msgr2=0x561e889780e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f287d591640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88918310 0x561e889780e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f287d591640 1 -- 172.21.15.100:0/2002415242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e88974130 con 0x561e88957de0 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f287e593640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88959350 0x561e88973950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f287d591640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88957de0 0x561e88973410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2868004230 tx=0x7f28680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee2779dd0afe2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28617fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28617fa640 1 -- 172.21.15.100:0/2002415242 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286802d070 con 0x561e88957de0 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2870032850 con 0x561e88957de0 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28617fa640 1 -- 172.21.15.100:0/2002415242 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2868005220 con 0x561e88957de0 2024-09-12T02:40:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28617fa640 1 -- 172.21.15.100:0/2002415242 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2868038050 con 0x561e88957de0 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28823cf740 10 client.25187 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.767+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561e889dcf10 con 0x561e88957de0 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.768+0000 7f28617fa640 1 -- 172.21.15.100:0/2002415242 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2870032850 con 0x561e88957de0 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.768+0000 7f28617fa640 1 -- 172.21.15.100:0/2002415242 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f2868019040 con 0x561e88957de0 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.768+0000 7f28823cf740 10 client.25187 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.769+0000 7f28823cf740 10 client.25187 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.769+0000 7f28823cf740 20 client.25187 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.769+0000 7f28823cf740 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88962b80 0x561e889df680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.769+0000 7f28823cf740 4 client.25187 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:40:51.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.769+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e888c2860 con 0x561e88962b80 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.769+0000 7f287dd92640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88962b80 0x561e889df680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f287dd92640 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88962b80 0x561e889df680 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cf410a94315fa09 server_cookie=b836ffe964de887 in_seq=0 out_seq=0 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28617fa640 10 client.25187 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28617fa640 1 -- 172.21.15.100:0/2002415242 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e888c2860 con 0x561e88962b80 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28617fa640 10 client.25187 handle_command_reply: tid=0 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 client.25187 shutdown 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88957de0 msgr2=0x561e88973410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88957de0 0x561e88973410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2868004230 tx=0x7f28680046c0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 shutdown_connections 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561e88962b80 0x561e889df680 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e88959350 0x561e88973950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561e88957de0 0x561e88973410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 --2- 172.21.15.100:0/2002415242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e88918310 0x561e889780e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28617fa640 0 client.25187 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 >> 172.21.15.100:0/2002415242 conn(0x561e8895fdf0 msgr2=0x561e8895e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 shutdown_connections 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.770+0000 7f28823cf740 1 -- 172.21.15.100:0/2002415242 wait complete. 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f28823cf740 20 client.25187 trim_cache size 0 max 16384 2024-09-12T02:40:51.776 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:40:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28640a2bf0 msgr2=0x7f28640a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28640a2bf0 0x7f28640a50b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fa0 tx=0x7f2868005f30 comp rx=0 tx=0).stop 2024-09-12T02:40:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2878105120 msgr2=0x7f287819dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2878105120 0x7f287819dfa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f287400d680 tx=0x7f287400db40 comp rx=0 tx=0).stop 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 shutdown_connections 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28640a2bf0 0x7f28640a50b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2878105120 0x7f287819dfa0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28781009a0 0x7f287819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 --2- 172.21.15.100:0/2853883025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28780ffff0 0x7f287819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 >> 172.21.15.100:0/2853883025 conn(0x7f28780fba90 msgr2=0x7f28780fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 shutdown_connections 2024-09-12T02:40:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:51.771+0000 7f287fff6640 1 -- 172.21.15.100:0/2853883025 wait complete. 2024-09-12T02:40:52.614 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:40:52.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:52 smithi100 ceph-mon[31390]: pgmap v402: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 MiB/s wr, 233 op/s 2024-09-12T02:40:52.976 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:52 smithi189 ceph-mon[35196]: pgmap v402: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 MiB/s wr, 233 op/s 2024-09-12T02:40:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:52 smithi117 ceph-mon[34898]: pgmap v402: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 MiB/s wr, 233 op/s 2024-09-12T02:40:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 -- 172.21.15.100:0/2508201265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0100e20 msgr2=0x7f4ca0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/2508201265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0100e20 0x7f4ca0101200 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009ca0 tx=0x7f4c9802a950 comp rx=0 tx=0).stop 2024-09-12T02:40:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 -- 172.21.15.100:0/2508201265 shutdown_connections 2024-09-12T02:40:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/2508201265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ca0102ef0 0x7f4ca010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/2508201265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca0102570 0x7f4ca01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/2508201265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0100e20 0x7f4ca0101200 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 -- 172.21.15.100:0/2508201265 >> 172.21.15.100:0/2508201265 conn(0x7f4ca00fc7d0 msgr2=0x7f4ca00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 -- 172.21.15.100:0/2508201265 shutdown_connections 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.670+0000 7f4ca52c9640 1 -- 172.21.15.100:0/2508201265 wait complete. 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.671+0000 7f4ca52c9640 1 Processor -- start 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.671+0000 7f4ca52c9640 1 -- start start 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.671+0000 7f4ca52c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca0100e20 0x7f4ca00739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4ca52c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0102570 0x7f4ca006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4ca52c9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ca0102ef0 0x7f4ca006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4ca52c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0110f80 con 0x7f4ca0102570 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4ca52c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0110e00 con 0x7f4ca0100e20 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4ca52c9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0111100 con 0x7f4ca0102ef0 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0102570 0x7f4ca006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0102570 0x7f4ca006ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38832/0 (socket says 172.21.15.100:38832) 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9e7fc640 1 -- 172.21.15.100:0/1462603151 learned_addr learned my addr 172.21.15.100:0/1462603151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca0100e20 0x7f4ca00739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9f7fe640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ca0102ef0 0x7f4ca006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9effd640 1 -- 172.21.15.100:0/1462603151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ca0102ef0 msgr2=0x7f4ca006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ca0102ef0 0x7f4ca006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9effd640 1 -- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0102570 msgr2=0x7f4ca006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0102570 0x7f4ca006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.672+0000 7f4c9effd640 1 -- 172.21.15.100:0/1462603151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca006d580 con 0x7f4ca0100e20 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.673+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca0100e20 0x7f4ca00739f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c98006010 tx=0x7f4c9802fb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.673+0000 7f4c87fff640 1 -- 172.21.15.100:0/1462603151 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98050070 con 0x7f4ca0100e20 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.673+0000 7f4c87fff640 1 -- 172.21.15.100:0/1462603151 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c98003e50 con 0x7f4ca0100e20 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.673+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca006d810 con 0x7f4ca0100e20 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.673+0000 7f4c87fff640 1 -- 172.21.15.100:0/1462603151 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98034040 con 0x7f4ca0100e20 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.673+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca0071800 con 0x7f4ca0100e20 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.675+0000 7f4c87fff640 1 -- 172.21.15.100:0/1462603151 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4c98053070 con 0x7f4ca0100e20 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 Processor -- start 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 -- start start 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae555b40 0x55aeae554090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae5545d0 0x55aeae554a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae572770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aeae4ba2f0 con 0x55aeae555b40 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55aeae461cf0 con 0x55aeae5545d0 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.676+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55aeae4b62b0 con 0x55aeae570380 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae5545d0 0x55aeae554a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae5545d0 0x55aeae554a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53582/0 (socket says 172.21.15.100:53582) 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 -- 172.21.15.100:0/369982995 learned_addr learned my addr 172.21.15.100:0/369982995 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c87fff640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4c880a2c00 0x7f4c880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9f7fe640 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae555b40 0x55aeae554090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae572770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 -- 172.21.15.100:0/369982995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 msgr2=0x55aeae572770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae572770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 -- 172.21.15.100:0/369982995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae555b40 msgr2=0x55aeae554090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae555b40 0x55aeae554090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c87fff640 1 -- 172.21.15.100:0/1462603151 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4c980f7a60 con 0x7f4ca0100e20 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 -- 172.21.15.100:0/369982995 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeae4463a0 con 0x55aeae5545d0 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9f7fe640 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae555b40 0x55aeae554090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9f7fe640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4c880a2c00 0x7f4c880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c9effd640 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae5545d0 0x55aeae554a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c980c4060 tx=0x7f4c980095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a67081f7af12666 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.677+0000 7f4c857fa640 1 -- 172.21.15.100:0/369982995 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c980c3cc0 con 0x55aeae5545d0 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4c857fa640 1 -- 172.21.15.100:0/369982995 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c9802c030 con 0x55aeae5545d0 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4c857fa640 1 -- 172.21.15.100:0/369982995 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c980c4360 con 0x55aeae5545d0 2024-09-12T02:40:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 -- 172.21.15.100:0/369982995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae5545d0 msgr2=0x55aeae554a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae5545d0 0x55aeae554a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c980c4060 tx=0x7f4c980095c0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4c9f7fe640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4c880a2c00 0x7f4c880a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009ca0 tx=0x7f4c940046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 -- 172.21.15.100:0/369982995 shutdown_connections 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae572770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae5545d0 0x55aeae554a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/369982995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae555b40 0x55aeae554090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 -- 172.21.15.100:0/369982995 >> 172.21.15.100:0/369982995 conn(0x55aeae51d310 msgr2=0x55aeae550c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 -- 172.21.15.100:0/369982995 shutdown_connections 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.678+0000 7f4ca76a2740 1 -- 172.21.15.100:0/369982995 wait complete. 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 -- start start 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 Processor -- start 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae560db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae5612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae55c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aeae4ba2f0 con 0x55aeae5545d0 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55aeae475060 con 0x55aeae555b40 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55aeae461cf0 con 0x55aeae570380 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4ca76a2740 10 client.0 _ll_register_callbacks cb 0x55aeae1c88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae560db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae560db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38846/0 (socket says 172.21.15.100:38846) 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4c9e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae5612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4c9effd640 1 -- 172.21.15.100:0/2836373170 learned_addr learned my addr 172.21.15.100:0/2836373170 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.679+0000 7f4c9f7fe640 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae55c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c9e7fc640 1 -- 172.21.15.100:0/2836373170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 msgr2=0x55aeae55c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae55c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c9e7fc640 1 -- 172.21.15.100:0/2836373170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 msgr2=0x55aeae560db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae560db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c9e7fc640 1 -- 172.21.15.100:0/2836373170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeae22b3c0 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c9effd640 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae560db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae5612f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009620 tx=0x7f4c90009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2ee0ab8088297e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c82ff5640 1 -- 172.21.15.100:0/2836373170 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c900035f0 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4c82ff5640 1 -- 172.21.15.100:0/2836373170 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4c90003790 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.680+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c9802c030 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4c82ff5640 1 -- 172.21.15.100:0/2836373170 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c90003990 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 10 client.25199 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aeae56ab30 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4c82ff5640 1 -- 172.21.15.100:0/2836373170 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c9802c030 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4c82ff5640 1 -- 172.21.15.100:0/2836373170 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f4c900173c0 con 0x55aeae555b40 2024-09-12T02:40:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 10 client.25199 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 10 client.25199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 20 client.25199 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae56c090 0x55aeae56e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 4 client.25199 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.681+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aeae4c7860 con 0x55aeae56c090 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.682+0000 7f4c9effd640 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae56c090 0x55aeae56e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.684+0000 7f4c82ff5640 10 client.25199 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.684+0000 7f4c9effd640 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae56c090 0x55aeae56e4d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5ecdd30abd8a1a server_cookie=ccc48790c23183cc in_seq=0 out_seq=0 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4c82ff5640 1 -- 172.21.15.100:0/2836373170 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aeae4c7860 con 0x55aeae56c090 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4c82ff5640 10 client.25199 handle_command_reply: tid=0 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 client.25199 shutdown 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 msgr2=0x55aeae5612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae5612f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009620 tx=0x7f4c90009f90 comp rx=0 tx=0).stop 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 shutdown_connections 2024-09-12T02:40:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae56c090 0x55aeae56e4d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae570380 0x55aeae55c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae5612f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/2836373170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae560db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4c82ff5640 0 client.25199 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 >> 172.21.15.100:0/2836373170 conn(0x55aeae51d310 msgr2=0x55aeae556930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 shutdown_connections 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 1 -- 172.21.15.100:0/2836373170 wait complete. 2024-09-12T02:40:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.685+0000 7f4ca76a2740 20 client.25199 trim_cache size 0 max 16384 2024-09-12T02:40:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.703+0000 7f4ca76a2740 1 Processor -- start 2024-09-12T02:40:53.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.705+0000 7f4ca76a2740 1 -- start start 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.705+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae56fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.705+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae555b40 0x55aeae559350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.705+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae570380 0x55aeae559890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.705+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01a3590 con 0x55aeae5545d0 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.705+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01a0e60 con 0x55aeae570380 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.705+0000 7f4ca76a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca019ecb0 con 0x55aeae555b40 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae56fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae56fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38848/0 (socket says 172.21.15.100:38848) 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 -- 172.21.15.100:0/1490268834 learned_addr learned my addr 172.21.15.100:0/1490268834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae555b40 0x55aeae559350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9f7fe640 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae570380 0x55aeae559890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 -- 172.21.15.100:0/1490268834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae555b40 msgr2=0x55aeae559350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae555b40 0x55aeae559350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 -- 172.21.15.100:0/1490268834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae570380 msgr2=0x55aeae559890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae570380 0x55aeae559890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 -- 172.21.15.100:0/1490268834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeae55a620 con 0x55aeae5545d0 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae555b40 0x55aeae559350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae56fd80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4c980c0d30 tx=0x7f4c9802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4ea6138bba089d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c84ff9640 1 -- 172.21.15.100:0/1490268834 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9802c040 con 0x55aeae5545d0 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c84ff9640 1 -- 172.21.15.100:0/1490268834 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c98030440 con 0x55aeae5545d0 2024-09-12T02:40:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.706+0000 7f4c84ff9640 1 -- 172.21.15.100:0/1490268834 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c980ccf20 con 0x55aeae5545d0 2024-09-12T02:40:53.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1490268834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 msgr2=0x55aeae56fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae56fd80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4c980c0d30 tx=0x7f4c9802a950 comp rx=0 tx=0).stop 2024-09-12T02:40:53.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1490268834 shutdown_connections 2024-09-12T02:40:53.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae570380 0x55aeae559890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae555b40 0x55aeae559350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1490268834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae5545d0 0x55aeae56fd80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1490268834 >> 172.21.15.100:0/1490268834 conn(0x55aeae51d310 msgr2=0x55aeae54fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1490268834 shutdown_connections 2024-09-12T02:40:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1490268834 wait complete. 2024-09-12T02:40:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.708+0000 7f4ca76a2740 1 -- start start 2024-09-12T02:40:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.709+0000 7f4ca76a2740 1 Processor -- start 2024-09-12T02:40:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.709+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae5545d0 0x55aeae568580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.709+0000 7f4ca76a2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae564910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.709+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae5545d0 0x55aeae568580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae5545d0 0x55aeae568580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37052/0 (socket says 172.21.15.100:37052) 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4c9effd640 1 -- 172.21.15.100:0/1918372865 learned_addr learned my addr 172.21.15.100:0/1918372865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae570380 0x55aeae564e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae564910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca019f320 con 0x55aeae570380 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01a0790 con 0x55aeae555b40 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca019f9f0 con 0x55aeae5545d0 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.710+0000 7f4ca76a2740 10 client.0 _ll_register_callbacks cb 0x7f4c900099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c9e7fc640 1 -- 172.21.15.100:0/1918372865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae5545d0 msgr2=0x55aeae568580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae5545d0 0x55aeae568580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c9e7fc640 1 -- 172.21.15.100:0/1918372865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae570380 msgr2=0x55aeae564e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae570380 0x55aeae564e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c9e7fc640 1 -- 172.21.15.100:0/1918372865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeae565390 con 0x55aeae555b40 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae5545d0 0x55aeae568580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c9e7fc640 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae564910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c90017790 tx=0x7f4c90017fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6808ce929475274 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.711+0000 7f4c82ff5640 1 -- 172.21.15.100:0/1918372865 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90031070 con 0x55aeae555b40 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.712+0000 7f4c82ff5640 1 -- 172.21.15.100:0/1918372865 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4c90005390 con 0x55aeae555b40 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.712+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aeae578b10 con 0x55aeae555b40 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.712+0000 7f4c82ff5640 1 -- 172.21.15.100:0/1918372865 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c9003c050 con 0x55aeae555b40 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.712+0000 7f4ca76a2740 10 client.25205 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:53.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.712+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aeae5d9b30 con 0x55aeae555b40 2024-09-12T02:40:53.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4c82ff5640 1 -- 172.21.15.100:0/1918372865 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c9001d070 con 0x55aeae555b40 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4c82ff5640 1 -- 172.21.15.100:0/1918372865 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f4c90018580 con 0x55aeae555b40 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4ca76a2740 10 client.25205 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4ca76a2740 10 client.25205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4ca76a2740 20 client.25205 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae5da280 0x55aeae5dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4ca76a2740 4 client.25205 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.713+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aeae578b10 con 0x55aeae5da280 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae5da280 0x55aeae5dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4c82ff5640 10 client.25205 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4c9effd640 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae5da280 0x55aeae5dc6a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b6cb90d7020ba5e server_cookie=74471ae47f527311 in_seq=0 out_seq=0 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4c82ff5640 1 -- 172.21.15.100:0/1918372865 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aeae578b10 con 0x55aeae5da280 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4c82ff5640 10 client.25205 handle_command_reply: tid=0 2024-09-12T02:40:53.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 client.25205 shutdown 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 msgr2=0x55aeae564910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae564910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c90017790 tx=0x7f4c90017fe0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 shutdown_connections 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55aeae5da280 0x55aeae5dc6a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aeae570380 0x55aeae564e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aeae555b40 0x55aeae564910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 --2- 172.21.15.100:0/1918372865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aeae5545d0 0x55aeae568580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4c82ff5640 0 client.25205 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 >> 172.21.15.100:0/1918372865 conn(0x55aeae51d310 msgr2=0x55aeae55a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 shutdown_connections 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.714+0000 7f4ca76a2740 1 -- 172.21.15.100:0/1918372865 wait complete. 2024-09-12T02:40:53.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca76a2740 20 client.25205 trim_cache size 0 max 16384 2024-09-12T02:40:53.720 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4c880a2c00 msgr2=0x7f4c880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4c880a2c00 0x7f4c880a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009ca0 tx=0x7f4c940046c0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca0100e20 msgr2=0x7f4ca00739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca0100e20 0x7f4ca00739f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c98006010 tx=0x7f4c9802fb60 comp rx=0 tx=0).stop 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 shutdown_connections 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4c880a2c00 0x7f4c880a50c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ca0102ef0 0x7f4ca006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ca0102570 0x7f4ca006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 --2- 172.21.15.100:0/1462603151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ca0100e20 0x7f4ca00739f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 >> 172.21.15.100:0/1462603151 conn(0x7f4ca00fc7d0 msgr2=0x7f4ca00fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:53.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 shutdown_connections 2024-09-12T02:40:53.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:53.715+0000 7f4ca52c9640 1 -- 172.21.15.100:0/1462603151 wait complete. 2024-09-12T02:40:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:54 smithi100 ceph-mon[31390]: pgmap v403: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 218 op/s 2024-09-12T02:40:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:54 smithi189 ceph-mon[35196]: pgmap v403: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 218 op/s 2024-09-12T02:40:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:54 smithi117 ceph-mon[34898]: pgmap v403: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 218 op/s 2024-09-12T02:40:55.529 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:40:55.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:40:55.901 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 105.0 s, 3475.4 tps, lat 28.824 ms stddev 29.031 2024-09-12T02:40:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.455+0000 7fb67874a640 1 -- 172.21.15.100:0/2996833268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6701091f0 msgr2=0x7fb6701095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.455+0000 7fb67874a640 1 --2- 172.21.15.100:0/2996833268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6701091f0 0x7fb6701095d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009900 tx=0x7fb66c02a410 comp rx=0 tx=0).stop 2024-09-12T02:40:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 -- 172.21.15.100:0/2996833268 shutdown_connections 2024-09-12T02:40:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 --2- 172.21.15.100:0/2996833268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb670116ea0 0x7fb670119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 --2- 172.21.15.100:0/2996833268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb670109b10 0x7fb670116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 --2- 172.21.15.100:0/2996833268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6701091f0 0x7fb6701095d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 -- 172.21.15.100:0/2996833268 >> 172.21.15.100:0/2996833268 conn(0x7fb67006e2d0 msgr2=0x7fb67006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 -- 172.21.15.100:0/2996833268 shutdown_connections 2024-09-12T02:40:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 -- 172.21.15.100:0/2996833268 wait complete. 2024-09-12T02:40:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.456+0000 7fb67874a640 1 Processor -- start 2024-09-12T02:40:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb67874a640 1 -- start start 2024-09-12T02:40:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb67874a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6701091f0 0x7fb6701a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb67874a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb670109b10 0x7fb6701a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb67874a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb670116ea0 0x7fb6701a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb67874a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb67011ca20 con 0x7fb670109b10 2024-09-12T02:40:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb67874a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb67011c8a0 con 0x7fb6701091f0 2024-09-12T02:40:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb67874a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb67011cba0 con 0x7fb670116ea0 2024-09-12T02:40:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb675ce5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb670109b10 0x7fb6701a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb675ce5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb670109b10 0x7fb6701a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52936/0 (socket says 172.21.15.100:52936) 2024-09-12T02:40:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb675ce5640 1 -- 172.21.15.100:0/3971922565 learned_addr learned my addr 172.21.15.100:0/3971922565 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb6764e6640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6701091f0 0x7fb6701a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.457+0000 7fb676ce7640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb670116ea0 0x7fb6701a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.458+0000 7fb675ce5640 1 -- 172.21.15.100:0/3971922565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb670116ea0 msgr2=0x7fb6701a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.458+0000 7fb675ce5640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb670116ea0 0x7fb6701a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.458+0000 7fb675ce5640 1 -- 172.21.15.100:0/3971922565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6701091f0 msgr2=0x7fb6701a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.458+0000 7fb675ce5640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6701091f0 0x7fb6701a2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.458+0000 7fb675ce5640 1 -- 172.21.15.100:0/3971922565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6701a7e30 con 0x7fb670109b10 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.458+0000 7fb6764e6640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6701091f0 0x7fb6701a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.458+0000 7fb675ce5640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb670109b10 0x7fb6701a33c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb66400e9f0 tx=0x7fb66400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.459+0000 7fb6637fe640 1 -- 172.21.15.100:0/3971922565 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66400cd80 con 0x7fb670109b10 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.459+0000 7fb6637fe640 1 -- 172.21.15.100:0/3971922565 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb664005500 con 0x7fb670109b10 2024-09-12T02:40:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.459+0000 7fb6637fe640 1 -- 172.21.15.100:0/3971922565 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664010690 con 0x7fb670109b10 2024-09-12T02:40:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.459+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6701a8120 con 0x7fb670109b10 2024-09-12T02:40:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.459+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6701afa00 con 0x7fb670109b10 2024-09-12T02:40:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.461+0000 7fb6637fe640 1 -- 172.21.15.100:0/3971922565 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb6640046c0 con 0x7fb670109b10 2024-09-12T02:40:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.461+0000 7fb67ab23740 1 Processor -- start 2024-09-12T02:40:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.462+0000 7fb67ab23740 1 -- start start 2024-09-12T02:40:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.463+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eaa80 0x562b098eae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.463+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.463+0000 7fb6637fe640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb65c0a2c00 0x7fb65c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.463+0000 7fb676ce7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eaa80 0x562b098eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.463+0000 7fb675ce5640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb65c0a2c00 0x7fb65c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.463+0000 7fb6764e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098fe550 0x562b09900940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb676ce7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eaa80 0x562b098eae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:58082/0 (socket says 172.21.15.100:58082) 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb6637fe640 1 -- 172.21.15.100:0/3971922565 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb6640cf430 con 0x7fb670109b10 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb6764e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098fe010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52946/0 (socket says 172.21.15.100:52946) 2024-09-12T02:40:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb676ce7640 1 -- 172.21.15.100:0/2407394792 learned_addr learned my addr 172.21.15.100:0/2407394792 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb675ce5640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb65c0a2c00 0x7fb65c0a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb6640a4360 tx=0x7fb664097810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562b09850280 con 0x562b098eb3a0 2024-09-12T02:40:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562b097f7b10 con 0x562b098eaa80 2024-09-12T02:40:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b0984c240 con 0x562b098fe550 2024-09-12T02:40:56.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb6764e6640 1 -- 172.21.15.100:0/2407394792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098fe550 msgr2=0x562b09900940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:56.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb676ce7640 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098fe550 0x562b09900940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb6764e6640 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098fe550 0x562b09900940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb6764e6640 1 -- 172.21.15.100:0/2407394792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eaa80 msgr2=0x562b098eae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb6764e6640 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eaa80 0x562b098eae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb6764e6640 1 -- 172.21.15.100:0/2407394792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b098041f0 con 0x562b098eb3a0 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.464+0000 7fb676ce7640 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098fe550 0x562b09900940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.465+0000 7fb6764e6640 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098fe010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb66c02aa00 tx=0x7fb66c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d766e4ca6ad52f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.465+0000 7fb660ff9640 1 -- 172.21.15.100:0/2407394792 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035040 con 0x562b098eb3a0 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.465+0000 7fb660ff9640 1 -- 172.21.15.100:0/2407394792 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb66c004760 con 0x562b098eb3a0 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.465+0000 7fb660ff9640 1 -- 172.21.15.100:0/2407394792 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0038e0 con 0x562b098eb3a0 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 msgr2=0x562b098fe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098fe010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb66c02aa00 tx=0x7fb66c005de0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 shutdown_connections 2024-09-12T02:40:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098fe550 0x562b09900940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098fe010 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2407394792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eaa80 0x562b098eae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 >> 172.21.15.100:0/2407394792 conn(0x562b098e70f0 msgr2=0x562b098e74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 shutdown_connections 2024-09-12T02:40:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.466+0000 7fb67ab23740 1 -- 172.21.15.100:0/2407394792 wait complete. 2024-09-12T02:40:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 -- start start 2024-09-12T02:40:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 Processor -- start 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eaa80 0x562b098fb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eb3a0 0x562b098fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 0x562b098fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562b09901060 con 0x562b098eaa80 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562b0980af10 con 0x562b098fe550 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b099011e0 con 0x562b098eb3a0 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb67ab23740 10 client.0 _ll_register_callbacks cb 0x562b097d3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.467+0000 7fb6764e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eb3a0 0x562b098fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.468+0000 7fb6764e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eb3a0 0x562b098fbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:45278/0 (socket says 172.21.15.100:45278) 2024-09-12T02:40:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.468+0000 7fb6764e6640 1 -- 172.21.15.100:0/1350228765 learned_addr learned my addr 172.21.15.100:0/1350228765 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.468+0000 7fb676ce7640 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eaa80 0x562b098fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.468+0000 7fb6764e6640 1 -- 172.21.15.100:0/1350228765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 msgr2=0x562b098fbff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:40:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.468+0000 7fb6764e6640 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 0x562b098fbff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.468+0000 7fb6764e6640 1 -- 172.21.15.100:0/1350228765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eaa80 msgr2=0x562b098fb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.470+0000 7fb6764e6640 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eaa80 0x562b098fb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.470+0000 7fb6764e6640 1 -- 172.21.15.100:0/1350228765 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b095c16a0 con 0x562b098eb3a0 2024-09-12T02:40:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.470+0000 7fb676ce7640 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eaa80 0x562b098fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.472+0000 7fb6764e6640 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eb3a0 0x562b098fbab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c003890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=254280274ccda9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.472+0000 7fb659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:40:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.473+0000 7fb659ffb640 1 -- 172.21.15.100:0/1350228765 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035070 con 0x562b098eb3a0 2024-09-12T02:40:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.473+0000 7fb659ffb640 1 -- 172.21.15.100:0/1350228765 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb66c003c10 con 0x562b098eb3a0 2024-09-12T02:40:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.473+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb66c004760 con 0x562b098eb3a0 2024-09-12T02:40:56.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.474+0000 7fb659ffb640 1 -- 172.21.15.100:0/1350228765 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb66c003e10 con 0x562b098eb3a0 2024-09-12T02:40:56.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.474+0000 7fb67ab23740 10 client.25201 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:56.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.474+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b09901060 con 0x562b098eb3a0 2024-09-12T02:40:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.477+0000 7fb659ffb640 1 -- 172.21.15.100:0/1350228765 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb66c031a90 con 0x562b098eb3a0 2024-09-12T02:40:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.477+0000 7fb659ffb640 1 -- 172.21.15.100:0/1350228765 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb66c03c980 con 0x562b098eb3a0 2024-09-12T02:40:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.478+0000 7fb67ab23740 10 client.25201 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.478+0000 7fb67ab23740 10 client.25201 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.478+0000 7fb67ab23740 20 client.25201 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.478+0000 7fb67ab23740 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b0990dec0 0x562b099102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.478+0000 7fb67ab23740 4 client.25201 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.478+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb66c004760 con 0x562b0990dec0 2024-09-12T02:40:56.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.480+0000 7fb676ce7640 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b0990dec0 0x562b099102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.482+0000 7fb676ce7640 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b0990dec0 0x562b099102b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3ea29f775361b3 server_cookie=495630a7cdd118bd in_seq=0 out_seq=0 2024-09-12T02:40:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.482+0000 7fb659ffb640 10 client.25201 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb659ffb640 1 -- 172.21.15.100:0/1350228765 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb66c004760 con 0x562b0990dec0 2024-09-12T02:40:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb659ffb640 10 client.25201 handle_command_reply: tid=0 2024-09-12T02:40:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 client.25201 shutdown 2024-09-12T02:40:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eb3a0 msgr2=0x562b098fbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eb3a0 0x562b098fbab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c003890 comp rx=0 tx=0).stop 2024-09-12T02:40:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 shutdown_connections 2024-09-12T02:40:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b0990dec0 0x562b099102b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 0x562b098fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eb3a0 0x562b098fbab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 --2- 172.21.15.100:0/1350228765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eaa80 0x562b098fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.484+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 >> 172.21.15.100:0/1350228765 conn(0x562b098e70f0 msgr2=0x562b098ecd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.485+0000 7fb659ffb640 0 client.25201 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.485+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 shutdown_connections 2024-09-12T02:40:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.485+0000 7fb67ab23740 1 -- 172.21.15.100:0/1350228765 wait complete. 2024-09-12T02:40:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.485+0000 7fb67ab23740 20 client.25201 trim_cache size 0 max 16384 2024-09-12T02:40:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.508+0000 7fb67ab23740 1 Processor -- start 2024-09-12T02:40:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.508+0000 7fb67ab23740 1 -- start start 2024-09-12T02:40:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b098fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eb3a0 0x562b098fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098fe550 0x562b099159a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb67ab23740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701b6470 con 0x562b098fe550 2024-09-12T02:40:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb67ab23740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701b3d40 con 0x562b098eb3a0 2024-09-12T02:40:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb67ab23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701b1bf0 con 0x562b098eaa80 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb676ce7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098fe550 0x562b099159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb676ce7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098fe550 0x562b099159a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52974/0 (socket says 172.21.15.100:52974) 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb676ce7640 1 -- 172.21.15.100:0/3228991125 learned_addr learned my addr 172.21.15.100:0/3228991125 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb6764e6640 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eb3a0 0x562b098fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.509+0000 7fb676ce7640 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b098fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb6764e6640 1 -- 172.21.15.100:0/3228991125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 msgr2=0x562b098fbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb6764e6640 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b098fbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb6764e6640 1 -- 172.21.15.100:0/3228991125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098fe550 msgr2=0x562b099159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb6764e6640 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098fe550 0x562b099159a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb6764e6640 1 -- 172.21.15.100:0/3228991125 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b098fa540 con 0x562b098eb3a0 2024-09-12T02:40:56.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb6764e6640 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eb3a0 0x562b098fd3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb66c03cef0 tx=0x7fb66c005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62eba0ef2bb3395 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:56.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb65bfff640 1 -- 172.21.15.100:0/3228991125 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035040 con 0x562b098eb3a0 2024-09-12T02:40:56.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb65bfff640 1 -- 172.21.15.100:0/3228991125 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb66c0043f0 con 0x562b098eb3a0 2024-09-12T02:40:56.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.510+0000 7fb65bfff640 1 -- 172.21.15.100:0/3228991125 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c03c440 con 0x562b098eb3a0 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 -- 172.21.15.100:0/3228991125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eb3a0 msgr2=0x562b098fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eb3a0 0x562b098fd3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb66c03cef0 tx=0x7fb66c005de0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 -- 172.21.15.100:0/3228991125 shutdown_connections 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098fe550 0x562b099159a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098eb3a0 0x562b098fd3d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 --2- 172.21.15.100:0/3228991125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b098fbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 -- 172.21.15.100:0/3228991125 >> 172.21.15.100:0/3228991125 conn(0x562b098e70f0 msgr2=0x562b098fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 -- 172.21.15.100:0/3228991125 shutdown_connections 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.511+0000 7fb67ab23740 1 -- 172.21.15.100:0/3228991125 wait complete. 2024-09-12T02:40:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 -- start start 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 Processor -- start 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b09906ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098f8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 0x562b098f8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701b2240 con 0x562b098eb3a0 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701b3670 con 0x562b098fe550 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701b28d0 con 0x562b098eaa80 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb67ab23740 10 client.0 _ll_register_callbacks cb 0x7fb668009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb676ce7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b09906ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52986/0 (socket says 172.21.15.100:52986) 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 -- 172.21.15.100:0/2798738021 learned_addr learned my addr 172.21.15.100:0/2798738021 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb676ce7640 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 0x562b098f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 -- 172.21.15.100:0/2798738021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 msgr2=0x562b09906ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b09906ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 -- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 msgr2=0x562b098f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 0x562b098f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb6764e6640 1 -- 172.21.15.100:0/2798738021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b098f91b0 con 0x562b098eb3a0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.512+0000 7fb676ce7640 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b09906ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb6764e6640 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098f8390 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb66c005940 tx=0x7fb66c031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a811f6d7c68dd76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb659ffb640 1 -- 172.21.15.100:0/2798738021 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035070 con 0x562b098eb3a0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb659ffb640 1 -- 172.21.15.100:0/2798738021 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb66c03ca80 con 0x562b098eb3a0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb66c0043f0 con 0x562b098eb3a0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb659ffb640 1 -- 172.21.15.100:0/2798738021 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb66c009520 con 0x562b098eb3a0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb67ab23740 10 client.15738 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b09978a90 con 0x562b098eb3a0 2024-09-12T02:40:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb659ffb640 1 -- 172.21.15.100:0/2798738021 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb66c0043f0 con 0x562b098eb3a0 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.513+0000 7fb659ffb640 1 -- 172.21.15.100:0/2798738021 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb66c004ea0 con 0x562b098eb3a0 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.514+0000 7fb67ab23740 10 client.15738 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.514+0000 7fb67ab23740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.514+0000 7fb67ab23740 20 client.15738 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.514+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b09978f60 0x562b0997b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.514+0000 7fb67ab23740 4 client.15738 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.514+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562b0985d7f0 con 0x562b09978f60 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.514+0000 7fb676ce7640 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b09978f60 0x562b0997b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.515+0000 7fb676ce7640 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b09978f60 0x562b0997b380 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368611eb5ded6bcd server_cookie=a3558269787663ba in_seq=0 out_seq=0 2024-09-12T02:40:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.515+0000 7fb659ffb640 10 client.15738 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.516+0000 7fb659ffb640 1 -- 172.21.15.100:0/2798738021 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562b0985d7f0 con 0x562b09978f60 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.516+0000 7fb659ffb640 10 client.15738 handle_command_reply: tid=0 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.516+0000 7fb67ab23740 1 client.15738 shutdown 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 msgr2=0x562b098f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098f8390 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb66c005940 tx=0x7fb66c031510 comp rx=0 tx=0).stop 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 shutdown_connections 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562b09978f60 0x562b0997b380 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b098fe550 0x562b098f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b098eb3a0 0x562b098f8390 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 --2- 172.21.15.100:0/2798738021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b098eaa80 0x562b09906ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 >> 172.21.15.100:0/2798738021 conn(0x562b098e70f0 msgr2=0x562b098e6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb659ffb640 0 client.15738 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 shutdown_connections 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 1 -- 172.21.15.100:0/2798738021 wait complete. 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.517+0000 7fb67ab23740 20 client.15738 trim_cache size 0 max 16384 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "ab0a1927-19bd-457f-b067-ca6606c713d3", 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:40:56.523 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:56.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb65c0a2c00 msgr2=0x7fb65c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb65c0a2c00 0x7fb65c0a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb6640a4360 tx=0x7fb664097810 comp rx=0 tx=0).stop 2024-09-12T02:40:56.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb670109b10 msgr2=0x7fb6701a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:56.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb670109b10 0x7fb6701a33c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb66400e9f0 tx=0x7fb66400edf0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 shutdown_connections 2024-09-12T02:40:56.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb65c0a2c00 0x7fb65c0a50c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb670116ea0 0x7fb6701a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb670109b10 0x7fb6701a33c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 --2- 172.21.15.100:0/3971922565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6701091f0 0x7fb6701a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 >> 172.21.15.100:0/3971922565 conn(0x7fb67006e2d0 msgr2=0x7fb670117380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 shutdown_connections 2024-09-12T02:40:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:56.518+0000 7fb67874a640 1 -- 172.21.15.100:0/3971922565 wait complete. 2024-09-12T02:40:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:56 smithi189 ceph-mon[35196]: pgmap v404: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 415 op/s 2024-09-12T02:40:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:56 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:40:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:56 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:56 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:40:57.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:56 smithi100 ceph-mon[31390]: pgmap v404: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 415 op/s 2024-09-12T02:40:57.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:56 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:40:57.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:56 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:57.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:56 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:40:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:56 smithi117 ceph-mon[34898]: pgmap v404: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 415 op/s 2024-09-12T02:40:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:56 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:40:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:56 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:56 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:40:57.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:40:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:57 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:40:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:57 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:57 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:58.005 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:58.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:57 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:40:58.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:57 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:58.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:57 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:57 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:40:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:57 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:57 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:40:58.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/1708409802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0100e20 msgr2=0x7fc3d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/1708409802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0100e20 0x7fc3d0101200 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009900 tx=0x7fc3c002a480 comp rx=0 tx=0).stop 2024-09-12T02:40:58.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/1708409802 shutdown_connections 2024-09-12T02:40:58.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/1708409802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d0102ef0 0x7fc3d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/1708409802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3d0102570 0x7fc3d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/1708409802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0100e20 0x7fc3d0101200 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/1708409802 >> 172.21.15.100:0/1708409802 conn(0x7fc3d00fc7d0 msgr2=0x7fc3d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.496+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/1708409802 shutdown_connections 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.497+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/1708409802 wait complete. 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 Processor -- start 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 -- start start 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3d0100e20 0x7fc3d0197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d0102570 0x7fc3d0197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0102ef0 0x7fc3d019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0110f80 con 0x7fc3d0102ef0 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0110e00 con 0x7fc3d0102570 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.498+0000 7fc3d4e4e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0111100 con 0x7fc3d0100e20 2024-09-12T02:40:58.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0102ef0 0x7fc3d019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3d0100e20 0x7fc3d0197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0102ef0 0x7fc3d019c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53014/0 (socket says 172.21.15.100:53014) 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ced9d640 1 -- 172.21.15.100:0/698597266 learned_addr learned my addr 172.21.15.100:0/698597266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d0102570 0x7fc3d0197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ce59c640 1 -- 172.21.15.100:0/698597266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d0102570 msgr2=0x7fc3d0197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d0102570 0x7fc3d0197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ce59c640 1 -- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0102ef0 msgr2=0x7fc3d019c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0102ef0 0x7fc3d019c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ce59c640 1 -- 172.21.15.100:0/698597266 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d019c6c0 con 0x7fc3d0100e20 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d0102570 0x7fc3d0197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ced9d640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0102ef0 0x7fc3d019c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:58.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3d0100e20 0x7fc3d0197130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005940 tx=0x7fc3c0003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3c77fe640 1 -- 172.21.15.100:0/698597266 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c003f070 con 0x7fc3d0100e20 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d019c950 con 0x7fc3d0100e20 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3c77fe640 1 -- 172.21.15.100:0/698597266 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c0031c30 con 0x7fc3d0100e20 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3c77fe640 1 -- 172.21.15.100:0/698597266 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0035030 con 0x7fc3d0100e20 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.499+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d019ce30 con 0x7fc3d0100e20 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.503+0000 7fc3c77fe640 1 -- 172.21.15.100:0/698597266 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fc3c0042070 con 0x7fc3d0100e20 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.503+0000 7fc3d7227740 1 Processor -- start 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.503+0000 7fc3d7227740 1 -- start start 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.503+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a2654a0 0x55853a265880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.503+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a265dc0 0x55853a270140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ced9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a2654a0 0x55853a265880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ced9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a2654a0 0x55853a265880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:45310/0 (socket says 172.21.15.100:45310) 2024-09-12T02:40:58.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a272a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55853a1cb2e0 con 0x55853a265dc0 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ced9d640 1 -- 172.21.15.100:0/46453649 learned_addr learned my addr 172.21.15.100:0/46453649 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55853a172ce0 con 0x55853a270680 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55853a1c72a0 con 0x55853a2654a0 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a265dc0 0x55853a270140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a272a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ce59c640 1 -- 172.21.15.100:0/46453649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a2654a0 msgr2=0x55853a265880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a2654a0 0x55853a265880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ce59c640 1 -- 172.21.15.100:0/46453649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 msgr2=0x55853a272a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a272a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.504+0000 7fc3ce59c640 1 -- 172.21.15.100:0/46453649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853a157440 con 0x55853a265dc0 2024-09-12T02:40:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.505+0000 7fc3c77fe640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc3bc0a2b80 0x7fc3bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.505+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a265dc0 0x55853a270140 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00ed0d0 tx=0x7fc3c00f5bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97562d14d7fcec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.505+0000 7fc3ced9d640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc3bc0a2b80 0x7fc3bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.505+0000 7fc3c77fe640 1 -- 172.21.15.100:0/698597266 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc3c00ef6a0 con 0x7fc3d0100e20 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.505+0000 7fc3c4ff9640 1 -- 172.21.15.100:0/46453649 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00fe070 con 0x55853a265dc0 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3c4ff9640 1 -- 172.21.15.100:0/46453649 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c00f5e40 con 0x55853a265dc0 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3c4ff9640 1 -- 172.21.15.100:0/46453649 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00bb9d0 con 0x55853a265dc0 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a265dc0 msgr2=0x55853a270140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3ced9d640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc3bc0a2b80 0x7fc3bc0a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80116f0 tx=0x7fc3c8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a265dc0 0x55853a270140 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00ed0d0 tx=0x7fc3c00f5bf0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 shutdown_connections 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a272a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a265dc0 0x55853a270140 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 --2- 172.21.15.100:0/46453649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a2654a0 0x55853a265880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 >> 172.21.15.100:0/46453649 conn(0x55853a261a30 msgr2=0x55853a261e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 shutdown_connections 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.506+0000 7fc3d7227740 1 -- 172.21.15.100:0/46453649 wait complete. 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 -- start start 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 Processor -- start 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a2654a0 0x55853a26ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a26d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a26d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55853a273010 con 0x55853a2654a0 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55853a186050 con 0x55853a270680 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55853a273190 con 0x55853a265dc0 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3d7227740 10 client.0 _ll_register_callbacks cb 0x55853a1c6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a2654a0 0x55853a26ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a2654a0 0x55853a26ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53022/0 (socket says 172.21.15.100:53022) 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3ce59c640 1 -- 172.21.15.100:0/3954173394 learned_addr learned my addr 172.21.15.100:0/3954173394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3ced9d640 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a26d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.507+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a26d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3ce59c640 1 -- 172.21.15.100:0/3954173394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 msgr2=0x55853a26d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a26d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3ce59c640 1 -- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 msgr2=0x55853a26d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a26d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3ce59c640 1 -- 172.21.15.100:0/3954173394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558539f3c3c0 con 0x55853a2654a0 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a2654a0 0x55853a26ffa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00ef990 tx=0x7fc3c003b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc4b47b373a8229 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/3954173394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0049030 con 0x55853a2654a0 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/3954173394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc3c00ba190 con 0x55853a2654a0 2024-09-12T02:40:58.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.508+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55853a1d8850 con 0x55853a2654a0 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/3954173394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc3c00fe070 con 0x55853a2654a0 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 10 client.15750 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55853a273010 con 0x55853a2654a0 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/3954173394 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55853a1d8850 con 0x55853a2654a0 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/3954173394 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc3c00b8500 con 0x55853a2654a0 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 10 client.15750 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 20 client.15750 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a27fb90 0x55853a281f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 4 client.15750 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.509+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55853a1d2d60 con 0x55853a27fb90 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.510+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a27fb90 0x55853a281f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.510+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a27fb90 0x55853a281f80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f10b6f44874200b0 server_cookie=6ece237183bb0d36 in_seq=0 out_seq=0 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.510+0000 7fc3b5ffb640 10 client.15750 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/3954173394 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55853a1d2d60 con 0x55853a27fb90 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3b5ffb640 10 client.15750 handle_command_reply: tid=0 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 client.15750 shutdown 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a2654a0 msgr2=0x55853a26ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a2654a0 0x55853a26ffa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00ef990 tx=0x7fc3c003b6b0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 shutdown_connections 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a27fb90 0x55853a281f80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a270680 0x55853a26d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a26d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3b5ffb640 0 client.15750 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 --2- 172.21.15.100:0/3954173394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a2654a0 0x55853a26ffa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 >> 172.21.15.100:0/3954173394 conn(0x55853a261a30 msgr2=0x55853a267710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 shutdown_connections 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 1 -- 172.21.15.100:0/3954173394 wait complete. 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.511+0000 7fc3d7227740 20 client.15750 trim_cache size 0 max 16384 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 Processor -- start 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 -- start start 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a2654a0 0x55853a287890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a287dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a26a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b6480 con 0x55853a270680 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b3d50 con 0x55853a2654a0 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.535+0000 7fc3d7227740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b1ba0 con 0x55853a265dc0 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a2654a0 0x55853a287890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a26a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a2654a0 0x55853a287890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:58166/0 (socket says 172.21.15.100:58166) 2024-09-12T02:40:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a287dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 -- 172.21.15.100:0/261095571 learned_addr learned my addr 172.21.15.100:0/261095571 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 -- 172.21.15.100:0/261095571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 msgr2=0x55853a287dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a287dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 -- 172.21.15.100:0/261095571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 msgr2=0x55853a26a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a26a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ce59c640 1 -- 172.21.15.100:0/261095571 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853a282600 con 0x55853a2654a0 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.536+0000 7fc3ced9d640 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a26a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.537+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a2654a0 0x55853a287890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005ec0 tx=0x7fc3c00f5bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbe02bcf053a64bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.537+0000 7fc3b7fff640 1 -- 172.21.15.100:0/261095571 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0049070 con 0x55853a2654a0 2024-09-12T02:40:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.537+0000 7fc3b7fff640 1 -- 172.21.15.100:0/261095571 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c00f5810 con 0x55853a2654a0 2024-09-12T02:40:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.537+0000 7fc3b7fff640 1 -- 172.21.15.100:0/261095571 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00bb7f0 con 0x55853a2654a0 2024-09-12T02:40:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.538+0000 7fc3d7227740 1 -- 172.21.15.100:0/261095571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a2654a0 msgr2=0x55853a287890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.538+0000 7fc3d7227740 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a2654a0 0x55853a287890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005ec0 tx=0x7fc3c00f5bf0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.539+0000 7fc3d7227740 1 -- 172.21.15.100:0/261095571 shutdown_connections 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.539+0000 7fc3d7227740 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a26a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.539+0000 7fc3d7227740 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a287dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.539+0000 7fc3d7227740 1 --2- 172.21.15.100:0/261095571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a2654a0 0x55853a287890 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005ec0 tx=0x7fc3c00f5bf0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.539+0000 7fc3d7227740 1 -- 172.21.15.100:0/261095571 >> 172.21.15.100:0/261095571 conn(0x55853a261a30 msgr2=0x55853a26d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.539+0000 7fc3d7227740 1 -- 172.21.15.100:0/261095571 shutdown_connections 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.540+0000 7fc3d7227740 1 -- 172.21.15.100:0/261095571 wait complete. 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.540+0000 7fc3d7227740 1 -- start start 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 1 Processor -- start 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a276150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a276690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a276bd0 0x55853a2e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b2210 con 0x55853a270680 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b3680 con 0x55853a276bd0 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b28e0 con 0x55853a265dc0 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3d7227740 10 client.0 _ll_register_callbacks cb 0x7fc3c00f5a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a276690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a276690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53036/0 (socket says 172.21.15.100:53036) 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3c7fff640 1 -- 172.21.15.100:0/630384929 learned_addr learned my addr 172.21.15.100:0/630384929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a276150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.541+0000 7fc3ced9d640 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a276bd0 0x55853a2e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3c7fff640 1 -- 172.21.15.100:0/630384929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 msgr2=0x55853a276150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a276150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3c7fff640 1 -- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a276bd0 msgr2=0x55853a2e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a276bd0 0x55853a2e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3c7fff640 1 -- 172.21.15.100:0/630384929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55853a2e9db0 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3ced9d640 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a276bd0 0x55853a2e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3c7fff640 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a276690 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55853a26cae0 tx=0x7fc3b80044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926859d5b824db95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/630384929 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b801e600 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c00f5810 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.542+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/630384929 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc3b801e7a0 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/630384929 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc3b801e9a0 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 10 client.15756 fetch_fsmap learned FSMap version 26 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55853a2eb0f0 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/630384929 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c00f5810 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/630384929 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc3b802f050 con 0x55853a270680 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 10 client.15756 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:40:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 20 client.15756 populate_metadata read hostname 'smithi100' 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a2eb8d0 0x55853a2edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 4 client.15756 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55853a14f210 con 0x55853a2eb8d0 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.543+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a2eb8d0 0x55853a2edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3b5ffb640 10 client.15756 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3ce59c640 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a2eb8d0 0x55853a2edcf0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ae3a0bbc10e0e2c server_cookie=b442797d9f651cde in_seq=0 out_seq=0 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3b5ffb640 1 -- 172.21.15.100:0/630384929 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55853a14f210 con 0x55853a2eb8d0 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3b5ffb640 10 client.15756 handle_command_reply: tid=0 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3d7227740 1 client.15756 shutdown 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 msgr2=0x55853a276690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3d7227740 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a276690 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55853a26cae0 tx=0x7fc3b80044d0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 shutdown_connections 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.544+0000 7fc3d7227740 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55853a2eb8d0 0x55853a2edcf0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3d7227740 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853a276bd0 0x55853a2e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3b5ffb640 0 client.15756 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3d7227740 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55853a270680 0x55853a276690 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3d7227740 1 --2- 172.21.15.100:0/630384929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55853a265dc0 0x55853a276150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 >> 172.21.15.100:0/630384929 conn(0x55853a261a30 msgr2=0x55853a26eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 shutdown_connections 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3d7227740 1 -- 172.21.15.100:0/630384929 wait complete. 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.545+0000 7fc3d7227740 20 client.15756 trim_cache size 0 max 16384 2024-09-12T02:40:58.556 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: "ab0a1927-19bd-457f-b067-ca6606c713d3": { 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "ab0a1927-19bd-457f-b067-ca6606c713d3", 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:40:58.557 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:40:58.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.546+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc3bc0a2b80 msgr2=0x7fc3bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.546+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc3bc0a2b80 0x7fc3bc0a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80116f0 tx=0x7fc3c8009500 comp rx=0 tx=0).stop 2024-09-12T02:40:58.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.546+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3d0100e20 msgr2=0x7fc3d0197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.546+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3d0100e20 0x7fc3d0197130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005940 tx=0x7fc3c0003c10 comp rx=0 tx=0).stop 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 shutdown_connections 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc3bc0a2b80 0x7fc3bc0a5040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3d0102ef0 0x7fc3d019c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d0102570 0x7fc3d0197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 --2- 172.21.15.100:0/698597266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3d0100e20 0x7fc3d0197130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 >> 172.21.15.100:0/698597266 conn(0x7fc3d00fc7d0 msgr2=0x7fc3d00fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 shutdown_connections 2024-09-12T02:40:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:40:58.547+0000 7fc3d4e4e640 1 -- 172.21.15.100:0/698597266 wait complete. 2024-09-12T02:40:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:58 smithi189 ceph-mon[35196]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.8 MiB/s wr, 508 op/s 2024-09-12T02:40:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:58 smithi117 ceph-mon[34898]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.8 MiB/s wr, 508 op/s 2024-09-12T02:40:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:58 smithi100 ceph-mon[31390]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.8 MiB/s wr, 508 op/s 2024-09-12T02:40:59.419 INFO:tasks.cephfs.filesystem:scrub status for tag:ab0a1927-19bd-457f-b067-ca6606c713d3 - {'path': '/', 'tag': 'ab0a1927-19bd-457f-b067-ca6606c713d3', 'options': 'recursive,force'} 2024-09-12T02:41:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:40:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:40:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:00.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:00.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:40:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:00 smithi189 ceph-mon[35196]: pgmap v406: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.2 MiB/s wr, 648 op/s 2024-09-12T02:41:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:00 smithi117 ceph-mon[34898]: pgmap v406: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.2 MiB/s wr, 648 op/s 2024-09-12T02:41:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:00 smithi100 ceph-mon[31390]: pgmap v406: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.2 MiB/s wr, 648 op/s 2024-09-12T02:41:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:01.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:01.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:41:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 110.0 s, 3816.0 tps, lat 26.304 ms stddev 26.689 2024-09-12T02:41:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:02 smithi189 ceph-mon[35196]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.4 MiB/s wr, 767 op/s 2024-09-12T02:41:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:02 smithi117 ceph-mon[34898]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.4 MiB/s wr, 767 op/s 2024-09-12T02:41:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:02 smithi100 ceph-mon[31390]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.4 MiB/s wr, 767 op/s 2024-09-12T02:41:05.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:04 smithi189 ceph-mon[35196]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.3 MiB/s wr, 682 op/s 2024-09-12T02:41:05.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:04 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:41:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:04 smithi117 ceph-mon[34898]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.3 MiB/s wr, 682 op/s 2024-09-12T02:41:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:04 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:41:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:04 smithi100 ceph-mon[31390]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.3 MiB/s wr, 682 op/s 2024-09-12T02:41:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:04 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:41:06.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:05 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:41:06.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:05 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:41:06.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:05 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:41:06.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:05 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:41:06.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:05 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:41:06.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:05 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:41:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 115.0 s, 3613.6 tps, lat 27.652 ms stddev 28.226 2024-09-12T02:41:06.994 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:06 smithi117 ceph-mon[34898]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-09-12T02:41:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:06 smithi189 ceph-mon[35196]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-09-12T02:41:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:06 smithi100 ceph-mon[31390]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-09-12T02:41:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:08 smithi189 ceph-mon[35196]: pgmap v410: 97 pgs: 97 active+clean; 1.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 747 op/s 2024-09-12T02:41:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:08 smithi117 ceph-mon[34898]: pgmap v410: 97 pgs: 97 active+clean; 1.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 747 op/s 2024-09-12T02:41:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:08 smithi100 ceph-mon[31390]: pgmap v410: 97 pgs: 97 active+clean; 1.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 747 op/s 2024-09-12T02:41:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:10 smithi189 ceph-mon[35196]: pgmap v411: 97 pgs: 97 active+clean; 1.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.9 MiB/s wr, 841 op/s 2024-09-12T02:41:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:10 smithi117 ceph-mon[34898]: pgmap v411: 97 pgs: 97 active+clean; 1.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.9 MiB/s wr, 841 op/s 2024-09-12T02:41:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:10 smithi100 ceph-mon[31390]: pgmap v411: 97 pgs: 97 active+clean; 1.1 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.9 MiB/s wr, 841 op/s 2024-09-12T02:41:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 120.0 s, 3706.0 tps, lat 26.962 ms stddev 28.236 2024-09-12T02:41:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:12 smithi189 ceph-mon[35196]: pgmap v412: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.1 MiB/s wr, 790 op/s 2024-09-12T02:41:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:12 smithi117 ceph-mon[34898]: pgmap v412: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.1 MiB/s wr, 790 op/s 2024-09-12T02:41:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:12 smithi100 ceph-mon[31390]: pgmap v412: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.1 MiB/s wr, 790 op/s 2024-09-12T02:41:13.320 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-12T02:41:13.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:41:13.667 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 -- 172.21.15.100:0/3654706195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20103670 msgr2=0x7f2b2010bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 --2- 172.21.15.100:0/3654706195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20103670 0x7f2b2010bb60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009900 tx=0x7f2b1402a480 comp rx=0 tx=0).stop 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 -- 172.21.15.100:0/3654706195 shutdown_connections 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 --2- 172.21.15.100:0/3654706195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b2010c180 0x7f2b2010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 --2- 172.21.15.100:0/3654706195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20103670 0x7f2b2010bb60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 --2- 172.21.15.100:0/3654706195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b20102d50 0x7f2b20103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 -- 172.21.15.100:0/3654706195 >> 172.21.15.100:0/3654706195 conn(0x7f2b200fc7d0 msgr2=0x7f2b200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 -- 172.21.15.100:0/3654706195 shutdown_connections 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 -- 172.21.15.100:0/3654706195 wait complete. 2024-09-12T02:41:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.188+0000 7f2b261e5640 1 Processor -- start 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b261e5640 1 -- start start 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b261e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20102d50 0x7f2b201984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b261e5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b20103670 0x7f2b20198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b261e5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b2010c180 0x7f2b2019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b261e5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b20111f80 con 0x7f2b20102d50 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b261e5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b20111e00 con 0x7f2b20103670 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b261e5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b20112100 con 0x7f2b2010c180 2024-09-12T02:41:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20102d50 0x7f2b201984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20102d50 0x7f2b201984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60818/0 (socket says 172.21.15.100:60818) 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 -- 172.21.15.100:0/1480690817 learned_addr learned my addr 172.21.15.100:0/1480690817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1effd640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b20103670 0x7f2b20198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1ffff640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b2010c180 0x7f2b2019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 -- 172.21.15.100:0/1480690817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b2010c180 msgr2=0x7f2b2019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b2010c180 0x7f2b2019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 -- 172.21.15.100:0/1480690817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b20103670 msgr2=0x7f2b20198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b20103670 0x7f2b20198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 -- 172.21.15.100:0/1480690817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2019d470 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.189+0000 7f2b1f7fe640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20102d50 0x7f2b201984c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000e9f0 tx=0x7f2b1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.190+0000 7f2b1cff9640 1 -- 172.21.15.100:0/1480690817 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000cd80 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.190+0000 7f2b1cff9640 1 -- 172.21.15.100:0/1480690817 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b10010910 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.190+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2019d760 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.190+0000 7f2b1cff9640 1 -- 172.21.15.100:0/1480690817 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10018990 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.190+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b201a5040 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.191+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b20103130 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.193+0000 7f2b1cff9640 1 -- 172.21.15.100:0/1480690817 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2b10010ac0 con 0x7f2b20102d50 2024-09-12T02:41:14.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.194+0000 7f2b1cff9640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2b080a2c80 0x7f2b080a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:14.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.194+0000 7f2b1cff9640 1 -- 172.21.15.100:0/1480690817 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2b100cf320 con 0x7f2b20102d50 2024-09-12T02:41:14.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.195+0000 7f2b1effd640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2b080a2c80 0x7f2b080a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:14.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.195+0000 7f2b1effd640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2b080a2c80 0x7f2b080a5140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009230 tx=0x7f2b140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:14.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.201+0000 7f2b1cff9640 1 -- 172.21.15.100:0/1480690817 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b1009bbc0 con 0x7f2b20102d50 2024-09-12T02:41:14.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.528+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b20199820 con 0x7f2b20102d50 2024-09-12T02:41:14.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.529+0000 7f2b1cff9640 1 -- 172.21.15.100:0/1480690817 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f2b1009fec0 con 0x7f2b20102d50 2024-09-12T02:41:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:41:14.530 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:41:14.530 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:41:14.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2b080a2c80 msgr2=0x7f2b080a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2b080a2c80 0x7f2b080a5140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009230 tx=0x7f2b140058d0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20102d50 msgr2=0x7f2b201984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20102d50 0x7f2b201984c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000e9f0 tx=0x7f2b1000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 shutdown_connections 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2b080a2c80 0x7f2b080a5140 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b2010c180 0x7f2b2019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b20103670 0x7f2b20198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 --2- 172.21.15.100:0/1480690817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b20102d50 0x7f2b201984c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 >> 172.21.15.100:0/1480690817 conn(0x7f2b200fc7d0 msgr2=0x7f2b200fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 shutdown_connections 2024-09-12T02:41:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:14.531+0000 7f2b261e5640 1 -- 172.21.15.100:0/1480690817 wait complete. 2024-09-12T02:41:14.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:14 smithi100 ceph-mon[31390]: pgmap v413: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.7 MiB/s wr, 671 op/s 2024-09-12T02:41:14.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:14 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1480690817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:14 smithi189 ceph-mon[35196]: pgmap v413: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.7 MiB/s wr, 671 op/s 2024-09-12T02:41:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:14 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1480690817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:14 smithi117 ceph-mon[34898]: pgmap v413: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.7 MiB/s wr, 671 op/s 2024-09-12T02:41:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:14 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1480690817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:16.160 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-12T02:41:16.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-12T02:41:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 125.0 s, 3613.2 tps, lat 27.748 ms stddev 27.777 2024-09-12T02:41:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:16.900 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:16 smithi100 ceph-mon[31390]: pgmap v414: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 842 op/s 2024-09-12T02:41:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:16 smithi189 ceph-mon[35196]: pgmap v414: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 842 op/s 2024-09-12T02:41:17.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.034+0000 7f5077268640 1 -- 172.21.15.100:0/907279218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102570 msgr2=0x7f50701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.034+0000 7f5077268640 1 --2- 172.21.15.100:0/907279218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102570 0x7f50701029b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5060009860 tx=0x7f506002a3d0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.034+0000 7f5077268640 1 -- 172.21.15.100:0/907279218 shutdown_connections 2024-09-12T02:41:17.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.034+0000 7f5077268640 1 --2- 172.21.15.100:0/907279218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070102ef0 0x7f507010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.034+0000 7f5077268640 1 --2- 172.21.15.100:0/907279218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102570 0x7f50701029b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.034+0000 7f5077268640 1 --2- 172.21.15.100:0/907279218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5070100e20 0x7f5070101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.034+0000 7f5077268640 1 -- 172.21.15.100:0/907279218 >> 172.21.15.100:0/907279218 conn(0x7f50700fc7d0 msgr2=0x7f50700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:17.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.035+0000 7f5077268640 1 -- 172.21.15.100:0/907279218 shutdown_connections 2024-09-12T02:41:17.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.035+0000 7f5077268640 1 -- 172.21.15.100:0/907279218 wait complete. 2024-09-12T02:41:17.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.036+0000 7f5077268640 1 Processor -- start 2024-09-12T02:41:17.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.036+0000 7f5077268640 1 -- start start 2024-09-12T02:41:17.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.036+0000 7f5077268640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5070100e20 0x7f50701a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.037+0000 7f5077268640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070102570 0x7f50701a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.037+0000 7f5077268640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102ef0 0x7f507010cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.037+0000 7f5077268640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5070112090 con 0x7f5070102ef0 2024-09-12T02:41:17.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.037+0000 7f5077268640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5070111f10 con 0x7f5070102570 2024-09-12T02:41:17.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.037+0000 7f5077268640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5070112210 con 0x7f5070100e20 2024-09-12T02:41:17.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5074803640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070102570 0x7f50701a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075805640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102ef0 0x7f507010cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5074803640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070102570 0x7f50701a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:35552/0 (socket says 172.21.15.100:35552) 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075805640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102ef0 0x7f507010cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39768/0 (socket says 172.21.15.100:39768) 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5074803640 1 -- 172.21.15.100:0/556785140 learned_addr learned my addr 172.21.15.100:0/556785140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075004640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5070100e20 0x7f50701a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075004640 1 -- 172.21.15.100:0/556785140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070102570 msgr2=0x7f50701a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075004640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070102570 0x7f50701a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075004640 1 -- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102ef0 msgr2=0x7f507010cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075004640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102ef0 0x7f507010cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075004640 1 -- 172.21.15.100:0/556785140 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507010d440 con 0x7f5070100e20 2024-09-12T02:41:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.038+0000 7f5075004640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5070100e20 0x7f50701a4810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f506c00e9f0 tx=0x7f506c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:17.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.039+0000 7f50667fc640 1 -- 172.21.15.100:0/556785140 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c00ccc0 con 0x7f5070100e20 2024-09-12T02:41:17.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.039+0000 7f50667fc640 1 -- 172.21.15.100:0/556785140 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f506c005020 con 0x7f5070100e20 2024-09-12T02:41:17.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.039+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f507010d730 con 0x7f5070100e20 2024-09-12T02:41:17.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.039+0000 7f50667fc640 1 -- 172.21.15.100:0/556785140 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c0049e0 con 0x7f5070100e20 2024-09-12T02:41:17.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.039+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50701ab7d0 con 0x7f5070100e20 2024-09-12T02:41:17.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.042+0000 7f50667fc640 1 -- 172.21.15.100:0/556785140 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f506c005560 con 0x7f5070100e20 2024-09-12T02:41:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 Processor -- start 2024-09-12T02:41:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 -- start start 2024-09-12T02:41:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f50667fc640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f505c0a2c00 0x7f505c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca376400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca376940 0x564eca378d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564eca2d12a0 con 0x564eca36b760 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564eca278b10 con 0x564eca36c080 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5079641740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564eca2cd260 con 0x564eca376940 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5075805640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f505c0a2c00 0x7f505c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5075004640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5075004640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39784/0 (socket says 172.21.15.100:39784) 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5074803640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca376400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5075004640 1 -- 172.21.15.100:0/63694890 learned_addr learned my addr 172.21.15.100:0/63694890 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f5075805640 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca376940 0x564eca378d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.043+0000 7f50667fc640 1 -- 172.21.15.100:0/556785140 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f506c0cefc0 con 0x7f5070100e20 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5074803640 1 -- 172.21.15.100:0/63694890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca376940 msgr2=0x564eca378d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5074803640 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca376940 0x564eca378d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5074803640 1 -- 172.21.15.100:0/63694890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 msgr2=0x564eca36bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5074803640 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5074803640 1 -- 172.21.15.100:0/63694890 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eca042b90 con 0x564eca36c080 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5075805640 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca376940 0x564eca378d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5074803640 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca376400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5060005e00 tx=0x7f506002f300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa23495d3ce6fee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f5075805640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f505c0a2c00 0x7f505c0a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x564eca369070 tx=0x7f5068009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f505b7fe640 1 -- 172.21.15.100:0/63694890 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060030ce0 con 0x564eca36c080 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f505b7fe640 1 -- 172.21.15.100:0/63694890 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5060030e80 con 0x564eca36c080 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.044+0000 7f505b7fe640 1 -- 172.21.15.100:0/63694890 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060005330 con 0x564eca36c080 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 -- 172.21.15.100:0/63694890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 msgr2=0x564eca376400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca376400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5060005e00 tx=0x7f506002f300 comp rx=0 tx=0).stop 2024-09-12T02:41:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 -- 172.21.15.100:0/63694890 shutdown_connections 2024-09-12T02:41:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca376940 0x564eca378d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca376400 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 --2- 172.21.15.100:0/63694890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 -- 172.21.15.100:0/63694890 >> 172.21.15.100:0/63694890 conn(0x564eca367cf0 msgr2=0x564eca3680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 -- 172.21.15.100:0/63694890 shutdown_connections 2024-09-12T02:41:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.045+0000 7f5079641740 1 -- 172.21.15.100:0/63694890 wait complete. 2024-09-12T02:41:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.046+0000 7f5079641740 1 -- start start 2024-09-12T02:41:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.046+0000 7f5079641740 1 Processor -- start 2024-09-12T02:41:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5079641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca373820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5079641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36c080 0x564eca373d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5079641740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca3742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5075004640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca373820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5075004640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca373820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33586/0 (socket says 172.21.15.100:33586) 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5075004640 1 -- 172.21.15.100:0/2694876439 learned_addr learned my addr 172.21.15.100:0/2694876439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5074803640 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36c080 0x564eca373d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5075805640 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca3742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564eca379510 con 0x564eca36c080 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564eca2596e0 con 0x564eca376940 2024-09-12T02:41:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.047+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564eca379690 con 0x564eca36b760 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.048+0000 7f5079641740 10 client.0 _ll_register_callbacks cb 0x564eca27da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.048+0000 7f5074803640 1 -- 172.21.15.100:0/2694876439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 msgr2=0x564eca373820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.048+0000 7f5074803640 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca373820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.048+0000 7f5074803640 1 -- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 msgr2=0x564eca3742a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.048+0000 7f5074803640 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca3742a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.048+0000 7f5074803640 1 -- 172.21.15.100:0/2694876439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eca382a00 con 0x564eca36c080 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5074803640 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36c080 0x564eca373d60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f506002a8f0 tx=0x7f5060030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a796dae4a3a5cc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5058ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5058ff9640 1 -- 172.21.15.100:0/2694876439 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060030840 con 0x564eca36c080 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5058ff9640 1 -- 172.21.15.100:0/2694876439 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5060004430 con 0x564eca36c080 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5060030e80 con 0x564eca36c080 2024-09-12T02:41:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5058ff9640 1 -- 172.21.15.100:0/2694876439 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50600050b0 con 0x564eca36c080 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5079641740 10 client.15774 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.049+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564eca379510 con 0x564eca36c080 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.050+0000 7f5058ff9640 1 -- 172.21.15.100:0/2694876439 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5060030e80 con 0x564eca36c080 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.050+0000 7f5058ff9640 1 -- 172.21.15.100:0/2694876439 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5060044030 con 0x564eca36c080 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5079641740 10 client.15774 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5079641740 10 client.15774 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5079641740 20 client.15774 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5079641740 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca386510 0x564eca388900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5079641740 4 client.15774 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eca2de9d0 con 0x564eca386510 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5075004640 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca386510 0x564eca388900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5058ff9640 10 client.15774 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.051+0000 7f5075004640 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca386510 0x564eca388900 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f71ac1b01ee552e server_cookie=29c3065adea11571 in_seq=0 out_seq=0 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5058ff9640 1 -- 172.21.15.100:0/2694876439 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564eca2de9d0 con 0x564eca386510 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5058ff9640 10 client.15774 handle_command_reply: tid=0 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 client.15774 shutdown 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36c080 msgr2=0x564eca373d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36c080 0x564eca373d60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f506002a8f0 tx=0x7f5060030650 comp rx=0 tx=0).stop 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 shutdown_connections 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca386510 0x564eca388900 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5058ff9640 0 client.15774 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca3742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36c080 0x564eca373d60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 --2- 172.21.15.100:0/2694876439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca373820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.052+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 >> 172.21.15.100:0/2694876439 conn(0x564eca367cf0 msgr2=0x564eca36da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.053+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 shutdown_connections 2024-09-12T02:41:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.054+0000 7f5079641740 1 -- 172.21.15.100:0/2694876439 wait complete. 2024-09-12T02:41:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.054+0000 7f5079641740 20 client.15774 trim_cache size 0 max 16384 2024-09-12T02:41:17.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.078+0000 7f5079641740 1 Processor -- start 2024-09-12T02:41:17.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.079+0000 7f5079641740 1 -- start start 2024-09-12T02:41:17.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.079+0000 7f5079641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.079+0000 7f5079641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36c080 0x564eca366d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.079+0000 7f5079641740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca38e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5079641740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50701b63d0 con 0x564eca36b760 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5079641740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50701b3ca0 con 0x564eca376940 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075805640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca38e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39812/0 (socket says 172.21.15.100:39812) 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075805640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca38e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:35576/0 (socket says 172.21.15.100:35576) 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 -- 172.21.15.100:0/3073893917 learned_addr learned my addr 172.21.15.100:0/3073893917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5079641740 1 -- 172.21.15.100:0/3073893917 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50701b1af0 con 0x564eca36c080 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5074803640 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36c080 0x564eca366d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 -- 172.21.15.100:0/3073893917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36c080 msgr2=0x564eca366d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36c080 0x564eca366d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 -- 172.21.15.100:0/3073893917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 msgr2=0x564eca38e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca38e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.080+0000 7f5075004640 1 -- 172.21.15.100:0/3073893917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eca367b20 con 0x564eca36b760 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.081+0000 7f5075004640 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36e1c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f506c009230 tx=0x7f506c0960f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f3a5b76e3d9979 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.081+0000 7f505affd640 1 -- 172.21.15.100:0/3073893917 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c01c040 con 0x564eca36b760 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.081+0000 7f505affd640 1 -- 172.21.15.100:0/3073893917 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f506c0051d0 con 0x564eca36b760 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.081+0000 7f505affd640 1 -- 172.21.15.100:0/3073893917 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c099ab0 con 0x564eca36b760 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 -- 172.21.15.100:0/3073893917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 msgr2=0x564eca36e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36e1c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f506c009230 tx=0x7f506c0960f0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 -- 172.21.15.100:0/3073893917 shutdown_connections 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca376940 0x564eca38e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36c080 0x564eca366d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 --2- 172.21.15.100:0/3073893917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca36b760 0x564eca36e1c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 -- 172.21.15.100:0/3073893917 >> 172.21.15.100:0/3073893917 conn(0x564eca367cf0 msgr2=0x564eca366650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 -- 172.21.15.100:0/3073893917 shutdown_connections 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 -- 172.21.15.100:0/3073893917 wait complete. 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 -- start start 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.082+0000 7f5079641740 1 Processor -- start 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5079641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca37ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5079641740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca37b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5079641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca376940 0x564eca37b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5079641740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50701b2160 con 0x564eca376940 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5075805640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca376940 0x564eca37b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5075004640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca37ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5075805640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca376940 0x564eca37b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39816/0 (socket says 172.21.15.100:39816) 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5075805640 1 -- 172.21.15.100:0/1032668762 learned_addr learned my addr 172.21.15.100:0/1032668762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50701b35d0 con 0x564eca36c080 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.083+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50701b2830 con 0x564eca36b760 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5074803640 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca37b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5079641740 10 client.0 _ll_register_callbacks cb 0x7f5060009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5074803640 1 -- 172.21.15.100:0/1032668762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 msgr2=0x564eca37ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5074803640 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca37ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5074803640 1 -- 172.21.15.100:0/1032668762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca376940 msgr2=0x564eca37b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5074803640 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca376940 0x564eca37b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5074803640 1 -- 172.21.15.100:0/1032668762 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eca363260 con 0x564eca36c080 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5075004640 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca37ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5074803640 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca37b270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x564eca374dd0 tx=0x7f506002aad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=122ab1a71940238f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5058ff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:41:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5058ff9640 1 -- 172.21.15.100:0/1032668762 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060060060 con 0x564eca36c080 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5058ff9640 1 -- 172.21.15.100:0/1032668762 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5060004430 con 0x564eca36c080 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f506c0051d0 con 0x564eca36c080 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5058ff9640 1 -- 172.21.15.100:0/1032668762 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50600096b0 con 0x564eca36c080 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5079641740 10 client.25259 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.084+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564eca3f1d00 con 0x564eca36c080 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5058ff9640 1 -- 172.21.15.100:0/1032668762 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f506c0051d0 con 0x564eca36c080 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5058ff9640 1 -- 172.21.15.100:0/1032668762 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5060044070 con 0x564eca36c080 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5079641740 10 client.25259 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5079641740 10 client.25259 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5079641740 20 client.25259 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5079641740 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca3f23d0 0x564eca3f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5079641740 4 client.25259 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-12T02:41:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x564eca2d8d20 con 0x564eca3f23d0 2024-09-12T02:41:17.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.085+0000 7f5075004640 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca3f23d0 0x564eca3f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:17.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.086+0000 7f5058ff9640 10 client.25259 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:17.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.086+0000 7f5075004640 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca3f23d0 0x564eca3f47f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9766fe3178100a server_cookie=59e865f6695bff93 in_seq=0 out_seq=0 2024-09-12T02:41:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:16 smithi117 ceph-mon[34898]: pgmap v414: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 842 op/s 2024-09-12T02:41:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5058ff9640 1 -- 172.21.15.100:0/1032668762 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564eca2d8d20 con 0x564eca3f23d0 2024-09-12T02:41:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5058ff9640 10 client.25259 handle_command_reply: tid=0 2024-09-12T02:41:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 client.25259 shutdown 2024-09-12T02:41:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 msgr2=0x564eca37b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca37b270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x564eca374dd0 tx=0x7f506002aad0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 shutdown_connections 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564eca3f23d0 0x564eca3f47f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eca376940 0x564eca37b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564eca36c080 0x564eca37b270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 --2- 172.21.15.100:0/1032668762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564eca36b760 0x564eca37ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 >> 172.21.15.100:0/1032668762 conn(0x564eca367cf0 msgr2=0x564eca366e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5058ff9640 0 client.25259 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 shutdown_connections 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.341+0000 7f5079641740 1 -- 172.21.15.100:0/1032668762 wait complete. 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.342+0000 7f5079641740 20 client.25259 trim_cache size 0 max 16384 2024-09-12T02:41:17.343 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 10, 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "ea76450": { 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 10, 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:41:17.344 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 144.7, 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:17.345 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.342+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f505c0a2c00 msgr2=0x7f505c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.342+0000 7f5077268640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f505c0a2c00 0x7f505c0a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x564eca369070 tx=0x7f5068009b30 comp rx=0 tx=0).stop 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.342+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5070100e20 msgr2=0x7f50701a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.342+0000 7f5077268640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5070100e20 0x7f50701a4810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f506c00e9f0 tx=0x7f506c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 shutdown_connections 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f505c0a2c00 0x7f505c0a50c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5070102ef0 0x7f507010cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070102570 0x7f50701a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 --2- 172.21.15.100:0/556785140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5070100e20 0x7f50701a4810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 >> 172.21.15.100:0/556785140 conn(0x7f50700fc7d0 msgr2=0x7f5070105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 shutdown_connections 2024-09-12T02:41:17.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:17.343+0000 7f5077268640 1 -- 172.21.15.100:0/556785140 wait complete. 2024-09-12T02:41:18.074 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ea76450', quiesce took 4.8 seconds. Will release after: 19.9 2024-09-12T02:41:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:18 smithi189 ceph-mon[35196]: pgmap v415: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.8 MiB/s wr, 806 op/s 2024-09-12T02:41:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:18 smithi117 ceph-mon[34898]: pgmap v415: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.8 MiB/s wr, 806 op/s 2024-09-12T02:41:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:18 smithi100 ceph-mon[31390]: pgmap v415: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.8 MiB/s wr, 806 op/s 2024-09-12T02:41:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:20 smithi189 ceph-mon[35196]: pgmap v416: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-09-12T02:41:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:20 smithi117 ceph-mon[34898]: pgmap v416: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-09-12T02:41:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:20 smithi100 ceph-mon[31390]: pgmap v416: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-09-12T02:41:21.302 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 130.0 s, 593.7 tps, lat 26.865 ms stddev 26.248 2024-09-12T02:41:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:22 smithi189 ceph-mon[35196]: pgmap v417: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.4 MiB/s wr, 631 op/s 2024-09-12T02:41:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:22 smithi117 ceph-mon[34898]: pgmap v417: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.4 MiB/s wr, 631 op/s 2024-09-12T02:41:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:22 smithi100 ceph-mon[31390]: pgmap v417: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.4 MiB/s wr, 631 op/s 2024-09-12T02:41:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:24 smithi189 ceph-mon[35196]: pgmap v418: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 537 op/s 2024-09-12T02:41:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:24 smithi117 ceph-mon[34898]: pgmap v418: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 537 op/s 2024-09-12T02:41:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:24 smithi100 ceph-mon[31390]: pgmap v418: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 537 op/s 2024-09-12T02:41:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:41:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:26 smithi189 ceph-mon[35196]: pgmap v419: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.2 MiB/s wr, 500 op/s 2024-09-12T02:41:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:26 smithi117 ceph-mon[34898]: pgmap v419: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.2 MiB/s wr, 500 op/s 2024-09-12T02:41:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:26 smithi100 ceph-mon[31390]: pgmap v419: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.2 MiB/s wr, 500 op/s 2024-09-12T02:41:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:28 smithi189 ceph-mon[35196]: pgmap v420: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.2 MiB/s wr, 293 op/s 2024-09-12T02:41:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:28 smithi117 ceph-mon[34898]: pgmap v420: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.2 MiB/s wr, 293 op/s 2024-09-12T02:41:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:28 smithi100 ceph-mon[31390]: pgmap v420: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.2 MiB/s wr, 293 op/s 2024-09-12T02:41:29.420 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:41:29.678 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.131+0000 7fce58b1c640 1 -- 172.21.15.100:0/195861257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54102da0 msgr2=0x7fce54103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.131+0000 7fce58b1c640 1 --2- 172.21.15.100:0/195861257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54102da0 0x7fce54103180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce44009ca0 tx=0x7fce4402a950 comp rx=0 tx=0).stop 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.131+0000 7fce58b1c640 1 -- 172.21.15.100:0/195861257 shutdown_connections 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.131+0000 7fce58b1c640 1 --2- 172.21.15.100:0/195861257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce5410c180 0x7fce5410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.131+0000 7fce58b1c640 1 --2- 172.21.15.100:0/195861257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce541036c0 0x7fce5410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.131+0000 7fce58b1c640 1 --2- 172.21.15.100:0/195861257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54102da0 0x7fce54103180 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.132+0000 7fce58b1c640 1 -- 172.21.15.100:0/195861257 >> 172.21.15.100:0/195861257 conn(0x7fce540fc7a0 msgr2=0x7fce540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.132+0000 7fce58b1c640 1 -- 172.21.15.100:0/195861257 shutdown_connections 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.132+0000 7fce58b1c640 1 -- 172.21.15.100:0/195861257 wait complete. 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.132+0000 7fce58b1c640 1 Processor -- start 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.132+0000 7fce58b1c640 1 -- start start 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce54102da0 0x7fce54100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce541036c0 0x7fce54100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5410c180 0x7fce54101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce54112020 con 0x7fce5410c180 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce54111ea0 con 0x7fce541036c0 2024-09-12T02:41:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce541121a0 con 0x7fce54102da0 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5410c180 0x7fce54101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5410c180 0x7fce54101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52762/0 (socket says 172.21.15.100:52762) 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 -- 172.21.15.100:0/1481331140 learned_addr learned my addr 172.21.15.100:0/1481331140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce51d9b640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce541036c0 0x7fce54100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce5259c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce54102da0 0x7fce54100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 -- 172.21.15.100:0/1481331140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce54102da0 msgr2=0x7fce54100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce54102da0 0x7fce54100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 -- 172.21.15.100:0/1481331140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce541036c0 msgr2=0x7fce54100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce541036c0 0x7fce54100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 -- 172.21.15.100:0/1481331140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce541a6a60 con 0x7fce5410c180 2024-09-12T02:41:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce5259c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce54102da0 0x7fce54100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce52d9d640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5410c180 0x7fce54101480 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009fd0 tx=0x7fce4c00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce4b7fe640 1 -- 172.21.15.100:0/1481331140 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c015020 con 0x7fce5410c180 2024-09-12T02:41:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce541a6d50 con 0x7fce5410c180 2024-09-12T02:41:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce4b7fe640 1 -- 172.21.15.100:0/1481331140 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce4c011d10 con 0x7fce5410c180 2024-09-12T02:41:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce4b7fe640 1 -- 172.21.15.100:0/1481331140 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00f2e0 con 0x7fce5410c180 2024-09-12T02:41:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.133+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce541a7240 con 0x7fce5410c180 2024-09-12T02:41:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.135+0000 7fce4b7fe640 1 -- 172.21.15.100:0/1481331140 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fce4c018020 con 0x7fce5410c180 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 Processor -- start 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 -- start start 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e174880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e17f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e17f680 0x55a35e181a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a35e0da2e0 con 0x55a35e174dc0 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a35e081ce0 con 0x55a35e17f680 2024-09-12T02:41:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5aef5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a35e0d62a0 con 0x55a35e1744a0 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e17f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce4b7fe640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce400a2b80 0x7fce400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e17f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52776/0 (socket says 172.21.15.100:52776) 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce5259c640 1 -- 172.21.15.100:0/1816893954 learned_addr learned my addr 172.21.15.100:0/1816893954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.136+0000 7fce51d9b640 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e174880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce52d9d640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce400a2b80 0x7fce400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce51d9b640 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e17f680 0x55a35e181a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce4b7fe640 1 -- 172.21.15.100:0/1481331140 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fce4c0ce960 con 0x7fce5410c180 2024-09-12T02:41:30.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce5259c640 1 -- 172.21.15.100:0/1816893954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 msgr2=0x55a35e174880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce5259c640 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e174880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce5259c640 1 -- 172.21.15.100:0/1816893954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e17f680 msgr2=0x55a35e181a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce5259c640 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e17f680 0x55a35e181a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce5259c640 1 -- 172.21.15.100:0/1816893954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35e066440 con 0x55a35e174dc0 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce51d9b640 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e17f680 0x55a35e181a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce5259c640 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e17f140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce44035000 tx=0x7fce44009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca3d77cdea5166a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce52d9d640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce400a2b80 0x7fce400a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce4c09aeb0 tx=0x7fce4c090690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce48ff9640 1 -- 172.21.15.100:0/1816893954 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44034040 con 0x55a35e174dc0 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce48ff9640 1 -- 172.21.15.100:0/1816893954 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce44003970 con 0x55a35e174dc0 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.137+0000 7fce48ff9640 1 -- 172.21.15.100:0/1816893954 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44004720 con 0x55a35e174dc0 2024-09-12T02:41:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 -- 172.21.15.100:0/1816893954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 msgr2=0x55a35e17f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e17f140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce44035000 tx=0x7fce44009a20 comp rx=0 tx=0).stop 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 -- 172.21.15.100:0/1816893954 shutdown_connections 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e17f680 0x55a35e181a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e17f140 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 --2- 172.21.15.100:0/1816893954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e174880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 -- 172.21.15.100:0/1816893954 >> 172.21.15.100:0/1816893954 conn(0x55a35e170a30 msgr2=0x55a35e170e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 -- 172.21.15.100:0/1816893954 shutdown_connections 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 -- 172.21.15.100:0/1816893954 wait complete. 2024-09-12T02:41:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 -- start start 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.138+0000 7fce5aef5740 1 Processor -- start 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e17ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e174dc0 0x55a35e17c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e17f680 0x55a35e17c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a35e182250 con 0x55a35e17f680 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a35e095050 con 0x55a35e174dc0 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a35e1823d0 con 0x55a35e1744a0 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 10 client.0 _ll_register_callbacks cb 0x55a35e0d5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e17f680 0x55a35e17c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e17f680 0x55a35e17c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52780/0 (socket says 172.21.15.100:52780) 2024-09-12T02:41:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565640238 learned_addr learned my addr 172.21.15.100:0/2565640238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e17ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5259c640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e174dc0 0x55a35e17c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565640238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 msgr2=0x55a35e17ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e17ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e174dc0 msgr2=0x55a35e17c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e174dc0 0x55a35e17c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565640238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35de4b3c0 con 0x55a35e17f680 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5259c640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e174dc0 0x55a35e17c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e17f680 0x55a35e17c710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009650 tx=0x7fce3c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12ba8970de6c392 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce39ffb640 1 -- 172.21.15.100:0/2565640238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c017e80 con 0x55a35e17f680 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce39ffb640 1 -- 172.21.15.100:0/2565640238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fce3c01a110 con 0x55a35e17f680 2024-09-12T02:41:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.139+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce44003970 con 0x55a35e17f680 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce39ffb640 1 -- 172.21.15.100:0/2565640238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce3c018450 con 0x55a35e17f680 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 10 client.15792 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a35e18dbd0 con 0x55a35e17f680 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce39ffb640 1 -- 172.21.15.100:0/2565640238 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce44003970 con 0x55a35e17f680 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce39ffb640 1 -- 172.21.15.100:0/2565640238 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fce3c025440 con 0x55a35e17f680 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 10 client.15792 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 20 client.15792 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e18f090 0x55a35e1914c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 4 client.15792 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a35e0e7850 con 0x55a35e18f090 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.140+0000 7fce5259c640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e18f090 0x55a35e1914c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.141+0000 7fce39ffb640 10 client.15792 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.141+0000 7fce5259c640 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e18f090 0x55a35e1914c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8dc44a2a6ce0aee server_cookie=b31435c49b5ddd2e in_seq=0 out_seq=0 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.141+0000 7fce39ffb640 1 -- 172.21.15.100:0/2565640238 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a35e0e7850 con 0x55a35e18f090 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.141+0000 7fce39ffb640 10 client.15792 handle_command_reply: tid=0 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.141+0000 7fce5aef5740 1 client.15792 shutdown 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.141+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e17f680 msgr2=0x55a35e17c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.141+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e17f680 0x55a35e17c710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009650 tx=0x7fce3c0047d0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 shutdown_connections 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e18f090 0x55a35e1914c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce39ffb640 0 client.15792 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e17f680 0x55a35e17c710 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e174dc0 0x55a35e17c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565640238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e17ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 >> 172.21.15.100:0/2565640238 conn(0x55a35e170a30 msgr2=0x55a35e176710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 shutdown_connections 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565640238 wait complete. 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.142+0000 7fce5aef5740 20 client.15792 trim_cache size 0 max 16384 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 Processor -- start 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 -- start start 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e17e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e196d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce541b2180 con 0x55a35e174dc0 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce541afa50 con 0x55a35e170a30 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5aef5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce541ad8a0 con 0x55a35e1744a0 2024-09-12T02:41:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e1972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52788/0 (socket says 172.21.15.100:52788) 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565080392 learned_addr learned my addr 172.21.15.100:0/2565080392 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e17e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5259c640 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565080392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 msgr2=0x55a35e196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565080392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 msgr2=0x55a35e17e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e17e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 -- 172.21.15.100:0/2565080392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35e17f290 con 0x55a35e174dc0 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce5259c640 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.159+0000 7fce51d9b640 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e1972d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fce3c01a810 tx=0x7fce3c0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2c17fc3308aa4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce3bfff640 1 -- 172.21.15.100:0/2565080392 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c033070 con 0x55a35e174dc0 2024-09-12T02:41:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce3bfff640 1 -- 172.21.15.100:0/2565080392 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce3c017e80 con 0x55a35e174dc0 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce3bfff640 1 -- 172.21.15.100:0/2565080392 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c018850 con 0x55a35e174dc0 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565080392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 msgr2=0x55a35e1972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e1972d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fce3c01a810 tx=0x7fce3c0096e0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565080392 shutdown_connections 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e174dc0 0x55a35e1972d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e1744a0 0x55a35e196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 --2- 172.21.15.100:0/2565080392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e17e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565080392 >> 172.21.15.100:0/2565080392 conn(0x55a35e17c870 msgr2=0x55a35e17da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565080392 shutdown_connections 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.160+0000 7fce5aef5740 1 -- 172.21.15.100:0/2565080392 wait complete. 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 -- start start 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 Processor -- start 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e185690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e1744a0 0x55a35e185bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e174dc0 0x55a35e186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce541adf10 con 0x55a35e1744a0 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce541af380 con 0x55a35e170a30 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce541ae5e0 con 0x55a35e174dc0 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5aef5740 10 client.0 _ll_register_callbacks cb 0x7fce3c009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e1744a0 0x55a35e185bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e1744a0 0x55a35e185bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52790/0 (socket says 172.21.15.100:52790) 2024-09-12T02:41:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 -- 172.21.15.100:0/417590078 learned_addr learned my addr 172.21.15.100:0/417590078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce51d9b640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e174dc0 0x55a35e186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce51d9b640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e185690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 -- 172.21.15.100:0/417590078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e174dc0 msgr2=0x55a35e186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e174dc0 0x55a35e186130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 -- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 msgr2=0x55a35e185690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e185690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce5259c640 1 -- 172.21.15.100:0/417590078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35e1f9040 con 0x55a35e1744a0 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.161+0000 7fce51d9b640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e185690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5259c640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e1744a0 0x55a35e185bd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fce440093a0 tx=0x7fce44004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d7c34d01529d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:30.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce39ffb640 1 -- 172.21.15.100:0/417590078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44034040 con 0x55a35e1744a0 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce39ffb640 1 -- 172.21.15.100:0/417590078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fce44049050 con 0x55a35e1744a0 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a35e0e1d60 con 0x55a35e1744a0 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce39ffb640 1 -- 172.21.15.100:0/417590078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce4405d050 con 0x55a35e1744a0 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 10 client.15798 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a35e1fa320 con 0x55a35e1744a0 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce39ffb640 1 -- 172.21.15.100:0/417590078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a35e0e1d60 con 0x55a35e1744a0 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce39ffb640 1 -- 172.21.15.100:0/417590078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fce44042070 con 0x55a35e1744a0 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 10 client.15798 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 20 client.15798 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e17f680 0x55a35e1fc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 4 client.15798 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a35e05e210 con 0x55a35e17f680 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.162+0000 7fce51d9b640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e17f680 0x55a35e1fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce51d9b640 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e17f680 0x55a35e1fc730 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=774cf6aa5e7a4f67 server_cookie=8f7e6e592d05cf75 in_seq=0 out_seq=0 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce39ffb640 10 client.15798 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce39ffb640 1 -- 172.21.15.100:0/417590078 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a35e05e210 con 0x55a35e17f680 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce39ffb640 10 client.15798 handle_command_reply: tid=0 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 client.15798 shutdown 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e1744a0 msgr2=0x55a35e185bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e1744a0 0x55a35e185bd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fce440093a0 tx=0x7fce44004200 comp rx=0 tx=0).stop 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 shutdown_connections 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55a35e17f680 0x55a35e1fc730 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce39ffb640 0 client.15798 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a35e174dc0 0x55a35e186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a35e1744a0 0x55a35e185bd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 --2- 172.21.15.100:0/417590078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a35e170a30 0x55a35e185690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 >> 172.21.15.100:0/417590078 conn(0x55a35e17c870 msgr2=0x55a35e17e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 shutdown_connections 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 1 -- 172.21.15.100:0/417590078 wait complete. 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.163+0000 7fce5aef5740 20 client.15798 trim_cache size 0 max 16384 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:41:30.187 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:41:30.188 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:41:30.188 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:41:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce400a2b80 msgr2=0x7fce400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce400a2b80 0x7fce400a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce4c09aeb0 tx=0x7fce4c090690 comp rx=0 tx=0).stop 2024-09-12T02:41:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5410c180 msgr2=0x7fce54101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5410c180 0x7fce54101480 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009fd0 tx=0x7fce4c00b820 comp rx=0 tx=0).stop 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 shutdown_connections 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce400a2b80 0x7fce400a5040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5410c180 0x7fce54101480 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce541036c0 0x7fce54100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 --2- 172.21.15.100:0/1481331140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce54102da0 0x7fce54100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 >> 172.21.15.100:0/1481331140 conn(0x7fce540fc7a0 msgr2=0x7fce540fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 shutdown_connections 2024-09-12T02:41:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:30.164+0000 7fce58b1c640 1 -- 172.21.15.100:0/1481331140 wait complete. 2024-09-12T02:41:30.951 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:41:30.951 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:41:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:30 smithi189 ceph-mon[35196]: pgmap v421: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.4 MiB/s wr, 191 op/s 2024-09-12T02:41:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:30 smithi117 ceph-mon[34898]: pgmap v421: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.4 MiB/s wr, 191 op/s 2024-09-12T02:41:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:30 smithi100 ceph-mon[31390]: pgmap v421: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.4 MiB/s wr, 191 op/s 2024-09-12T02:41:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 140.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:41:31.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 -- 172.21.15.100:0/956006077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 msgr2=0x7f25e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 --2- 172.21.15.100:0/956006077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0101200 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009900 tx=0x7f25dc02a480 comp rx=0 tx=0).stop 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 -- 172.21.15.100:0/956006077 shutdown_connections 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 --2- 172.21.15.100:0/956006077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25e0102ef0 0x7f25e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 --2- 172.21.15.100:0/956006077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0102570 0x7f25e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 --2- 172.21.15.100:0/956006077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0101200 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 -- 172.21.15.100:0/956006077 >> 172.21.15.100:0/956006077 conn(0x7f25e00fc7d0 msgr2=0x7f25e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 -- 172.21.15.100:0/956006077 shutdown_connections 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 -- 172.21.15.100:0/956006077 wait complete. 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 Processor -- start 2024-09-12T02:41:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 -- start start 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.663+0000 7f25e7238640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25e0102570 0x7f25e0197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e7238640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0102ef0 0x7f25e019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e7238640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0110f50 con 0x7f25e0100e20 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e7238640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0110dd0 con 0x7f25e0102ef0 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e7238640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01110d0 con 0x7f25e0102570 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52808/0 (socket says 172.21.15.100:52808) 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 -- 172.21.15.100:0/2997741380 learned_addr learned my addr 172.21.15.100:0/2997741380 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e57d5640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0102ef0 0x7f25e019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25d7fff640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25e0102570 0x7f25e0197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 -- 172.21.15.100:0/2997741380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25e0102570 msgr2=0x7f25e0197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25e0102570 0x7f25e0197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 -- 172.21.15.100:0/2997741380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0102ef0 msgr2=0x7f25e019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0102ef0 0x7f25e019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 -- 172.21.15.100:0/2997741380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e019c3e0 con 0x7f25e0100e20 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e4fd4640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0197430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006010 tx=0x7f25dc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25d5ffb640 1 -- 172.21.15.100:0/2997741380 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc03f070 con 0x7f25e0100e20 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25d5ffb640 1 -- 172.21.15.100:0/2997741380 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25dc031c30 con 0x7f25e0100e20 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25d5ffb640 1 -- 172.21.15.100:0/2997741380 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc035030 con 0x7f25e0100e20 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.664+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e019c670 con 0x7f25e0100e20 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.665+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a3fb0 con 0x7f25e0100e20 2024-09-12T02:41:31.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.665+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0101200 con 0x7f25e0100e20 2024-09-12T02:41:31.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.667+0000 7f25d5ffb640 1 -- 172.21.15.100:0/2997741380 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f25dc042070 con 0x7f25e0100e20 2024-09-12T02:41:31.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.667+0000 7f25d5ffb640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25c80a2c00 0x7f25c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:31.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.667+0000 7f25d7fff640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25c80a2c00 0x7f25c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:31.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.667+0000 7f25d5ffb640 1 -- 172.21.15.100:0/2997741380 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f25dc0efce0 con 0x7f25e0100e20 2024-09-12T02:41:31.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.668+0000 7f25d7fff640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25c80a2c00 0x7f25c80a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f25e00ffee0 tx=0x7f25d000b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:31.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.671+0000 7f25d5ffb640 1 -- 172.21.15.100:0/2997741380 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25dc031de0 con 0x7f25e0100e20 2024-09-12T02:41:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.874+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25e0198790 con 0x7f25e0100e20 2024-09-12T02:41:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.874+0000 7f25d5ffb640 1 -- 172.21.15.100:0/2997741380 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f25dc0bccf0 con 0x7f25e0100e20 2024-09-12T02:41:31.876 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:41:31.876 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:41:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.876+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25c80a2c00 msgr2=0x7f25c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.876+0000 7f25e7238640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25c80a2c00 0x7f25c80a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f25e00ffee0 tx=0x7f25d000b590 comp rx=0 tx=0).stop 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.876+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 msgr2=0x7f25e0197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.876+0000 7f25e7238640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0197430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006010 tx=0x7f25dc003c10 comp rx=0 tx=0).stop 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.876+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 shutdown_connections 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.876+0000 7f25e7238640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25c80a2c00 0x7f25c80a50c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.877+0000 7f25e7238640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25e0102ef0 0x7f25e019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.877+0000 7f25e7238640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25e0102570 0x7f25e0197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.877+0000 7f25e7238640 1 --2- 172.21.15.100:0/2997741380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25e0100e20 0x7f25e0197430 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.877+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 >> 172.21.15.100:0/2997741380 conn(0x7f25e00fc7d0 msgr2=0x7f25e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.877+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 shutdown_connections 2024-09-12T02:41:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:31.877+0000 7f25e7238640 1 -- 172.21.15.100:0/2997741380 wait complete. 2024-09-12T02:41:32.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:41:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:32 smithi100 ceph-mon[31390]: pgmap v422: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1016 KiB/s wr, 41 op/s 2024-09-12T02:41:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:32 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2997741380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:32 smithi189 ceph-mon[35196]: pgmap v422: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1016 KiB/s wr, 41 op/s 2024-09-12T02:41:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:32 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2997741380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:32 smithi117 ceph-mon[34898]: pgmap v422: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1016 KiB/s wr, 41 op/s 2024-09-12T02:41:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:32 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2997741380' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:33.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.287+0000 7f20fec8b640 1 -- 172.21.15.100:0/143529995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 msgr2=0x7f20f81108b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.287+0000 7f20fec8b640 1 --2- 172.21.15.100:0/143529995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f81108b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ca0 tx=0x7f20f002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- 172.21.15.100:0/143529995 shutdown_connections 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 --2- 172.21.15.100:0/143529995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f81108b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 --2- 172.21.15.100:0/143529995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f81012c0 0x7f20f810df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 --2- 172.21.15.100:0/143529995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f8100910 0x7f20f8100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- 172.21.15.100:0/143529995 >> 172.21.15.100:0/143529995 conn(0x7f20f80fc7a0 msgr2=0x7f20f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- 172.21.15.100:0/143529995 shutdown_connections 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- 172.21.15.100:0/143529995 wait complete. 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 Processor -- start 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- start start 2024-09-12T02:41:33.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f8100910 0x7f20f819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f81012c0 0x7f20f819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8114170 con 0x7f20f810e4c0 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8113ff0 con 0x7f20f8100910 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.288+0000 7f20fec8b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81142f0 con 0x7f20f81012c0 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52828/0 (socket says 172.21.15.100:52828) 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 -- 172.21.15.100:0/1300120681 learned_addr learned my addr 172.21.15.100:0/1300120681 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fca27640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f8100910 0x7f20f819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20f7fff640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f81012c0 0x7f20f819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 -- 172.21.15.100:0/1300120681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f81012c0 msgr2=0x7f20f819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f81012c0 0x7f20f819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 -- 172.21.15.100:0/1300120681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f8100910 msgr2=0x7f20f819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f8100910 0x7f20f819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 -- 172.21.15.100:0/1300120681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f819f5c0 con 0x7f20f810e4c0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fd228640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f819eee0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f20f00319f0 tx=0x7f20f0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20f5ffb640 1 -- 172.21.15.100:0/1300120681 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0003c30 con 0x7f20f810e4c0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f819f850 con 0x7f20f810e4c0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20f5ffb640 1 -- 172.21.15.100:0/1300120681 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20f0003dd0 con 0x7f20f810e4c0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20f5ffb640 1 -- 172.21.15.100:0/1300120681 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0004790 con 0x7f20f810e4c0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.289+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81a7190 con 0x7f20f810e4c0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.292+0000 7f20f5ffb640 1 -- 172.21.15.100:0/1300120681 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f20f002f6d0 con 0x7f20f810e4c0 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.292+0000 7f2101064740 1 Processor -- start 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.292+0000 7f2101064740 1 -- start start 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f2101064740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d764b40 0x560a1d763090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f2101064740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d7635d0 0x560a1d763a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f2101064740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d770760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f2101064740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560a1d6c92f0 con 0x560a1d764b40 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f2101064740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560a1d670cf0 con 0x560a1d76e370 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f2101064740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a1d6c52b0 con 0x560a1d7635d0 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d764b40 0x560a1d763090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d764b40 0x560a1d763090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52832/0 (socket says 172.21.15.100:52832) 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 -- 172.21.15.100:0/4104804886 learned_addr learned my addr 172.21.15.100:0/4104804886 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d770760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f5ffb640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f20e80a2b80 0x7f20e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20fca27640 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d7635d0 0x560a1d763a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 -- 172.21.15.100:0/4104804886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d7635d0 msgr2=0x560a1d763a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d7635d0 0x560a1d763a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 -- 172.21.15.100:0/4104804886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 msgr2=0x560a1d770760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d770760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 -- 172.21.15.100:0/4104804886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a1d6553a0 con 0x560a1d764b40 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20fca27640 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d7635d0 0x560a1d763a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20fd228640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f20e80a2b80 0x7f20e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f7fff640 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d764b40 0x560a1d763090 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f20e40124c0 tx=0x7f20e400c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9309908e65fa958 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20f5ffb640 1 -- 172.21.15.100:0/1300120681 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f20f00f02a0 con 0x7f20f810e4c0 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20e2ffd640 1 -- 172.21.15.100:0/4104804886 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4018020 con 0x560a1d764b40 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20e2ffd640 1 -- 172.21.15.100:0/4104804886 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e400dc30 con 0x560a1d764b40 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.293+0000 7f20e2ffd640 1 -- 172.21.15.100:0/4104804886 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e400fd60 con 0x560a1d764b40 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 -- 172.21.15.100:0/4104804886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d764b40 msgr2=0x560a1d763090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d764b40 0x560a1d763090 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f20e40124c0 tx=0x7f20e400c5c0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f20fd228640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f20e80a2b80 0x7f20e80a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20f00ee100 tx=0x7f20f008cbe0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 -- 172.21.15.100:0/4104804886 shutdown_connections 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d770760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d7635d0 0x560a1d763a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 --2- 172.21.15.100:0/4104804886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d764b40 0x560a1d763090 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 -- 172.21.15.100:0/4104804886 >> 172.21.15.100:0/4104804886 conn(0x560a1d72c310 msgr2=0x560a1d75fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 -- 172.21.15.100:0/4104804886 shutdown_connections 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.294+0000 7f2101064740 1 -- 172.21.15.100:0/4104804886 wait complete. 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 -- start start 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 Processor -- start 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d7635d0 0x560a1d76ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d76b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d76e370 0x560a1d76b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560a1d771070 con 0x560a1d76e370 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560a1d684060 con 0x560a1d7635d0 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a1d7711f0 con 0x560a1d764b40 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f2101064740 10 client.0 _ll_register_callbacks cb 0x560a1d3d78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d76e370 0x560a1d76b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d76e370 0x560a1d76b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52844/0 (socket says 172.21.15.100:52844) 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 -- 172.21.15.100:0/3030862535 learned_addr learned my addr 172.21.15.100:0/3030862535 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:33.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20fca27640 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d76b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d7635d0 0x560a1d76ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 -- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 msgr2=0x560a1d76b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d76b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 -- 172.21.15.100:0/3030862535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d7635d0 msgr2=0x560a1d76ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.295+0000 7f20f7fff640 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d7635d0 0x560a1d76ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20f7fff640 1 -- 172.21.15.100:0/3030862535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a1d43a3c0 con 0x560a1d76e370 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20f7fff640 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d76e370 0x560a1d76b7e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f20e4011010 tx=0x7f20e4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f334e5fb5efdf8ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20d7fff640 1 -- 172.21.15.100:0/3030862535 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4018040 con 0x560a1d76e370 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20d7fff640 1 -- 172.21.15.100:0/3030862535 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f20e4004260 con 0x560a1d76e370 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e400dc30 con 0x560a1d76e370 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20d7fff640 1 -- 172.21.15.100:0/3030862535 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20e4004460 con 0x560a1d76e370 2024-09-12T02:41:33.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 10 client.15816 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a1d77cb10 con 0x560a1d76e370 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20d7fff640 1 -- 172.21.15.100:0/3030862535 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e400dc30 con 0x560a1d76e370 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f20d7fff640 1 -- 172.21.15.100:0/3030862535 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f20e402b060 con 0x560a1d76e370 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 10 client.15816 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 10 client.15816 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 20 client.15816 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d77de60 0x560a1d780250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 4 client.15816 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.296+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a1d6d6860 con 0x560a1d77de60 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.297+0000 7f20fca27640 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d77de60 0x560a1d780250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.297+0000 7f20fca27640 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d77de60 0x560a1d780250 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c111f5ed000cb40a server_cookie=ec4ff485b940c39f in_seq=0 out_seq=0 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.297+0000 7f20d7fff640 10 client.15816 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f20d7fff640 1 -- 172.21.15.100:0/3030862535 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a1d6d6860 con 0x560a1d77de60 2024-09-12T02:41:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f20d7fff640 10 client.15816 handle_command_reply: tid=0 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 client.15816 shutdown 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d76e370 msgr2=0x560a1d76b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d76e370 0x560a1d76b7e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f20e4011010 tx=0x7f20e4014040 comp rx=0 tx=0).stop 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 shutdown_connections 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d77de60 0x560a1d780250 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d76e370 0x560a1d76b7e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d76b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 --2- 172.21.15.100:0/3030862535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d7635d0 0x560a1d76ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f20d7fff640 0 client.15816 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 >> 172.21.15.100:0/3030862535 conn(0x560a1d72c310 msgr2=0x560a1d765960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 shutdown_connections 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 1 -- 172.21.15.100:0/3030862535 wait complete. 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.298+0000 7f2101064740 20 client.15816 trim_cache size 0 max 16384 2024-09-12T02:41:33.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 Processor -- start 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 -- start start 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d766120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d764b40 0x560a1d766660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d76e370 0x560a1d7859c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81b20b0 con 0x560a1d7635d0 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81af980 con 0x560a1d764b40 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f2101064740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81ad7d0 con 0x560a1d76e370 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d766120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d766120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52848/0 (socket says 172.21.15.100:52848) 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 -- 172.21.15.100:0/2143817726 learned_addr learned my addr 172.21.15.100:0/2143817726 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d76e370 0x560a1d7859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 -- 172.21.15.100:0/2143817726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d76e370 msgr2=0x560a1d7859c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d76e370 0x560a1d7859c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 -- 172.21.15.100:0/2143817726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d764b40 msgr2=0x560a1d766660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d764b40 0x560a1d766660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 -- 172.21.15.100:0/2143817726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a1d75f510 con 0x560a1d7635d0 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.311+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d766120 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827723412d7cc528 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f20e27fc640 1 -- 172.21.15.100:0/2143817726 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e403c070 con 0x560a1d7635d0 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f20e27fc640 1 -- 172.21.15.100:0/2143817726 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e4023070 con 0x560a1d7635d0 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f20e27fc640 1 -- 172.21.15.100:0/2143817726 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4018040 con 0x560a1d7635d0 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 -- 172.21.15.100:0/2143817726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 msgr2=0x560a1d766120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d766120 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e4005b10 comp rx=0 tx=0).stop 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 -- 172.21.15.100:0/2143817726 shutdown_connections 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d76e370 0x560a1d7859c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d764b40 0x560a1d766660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 --2- 172.21.15.100:0/2143817726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d766120 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 -- 172.21.15.100:0/2143817726 >> 172.21.15.100:0/2143817726 conn(0x560a1d72c310 msgr2=0x560a1d76d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 -- 172.21.15.100:0/2143817726 shutdown_connections 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 -- 172.21.15.100:0/2143817726 wait complete. 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.312+0000 7f2101064740 1 -- start start 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 1 Processor -- start 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d7681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d7686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d768c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81ade40 con 0x560a1d7635d0 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81af2b0 con 0x560a1d76e370 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81ae510 con 0x560a1d764b40 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f2101064740 10 client.0 _ll_register_callbacks cb 0x7f20e400cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d7681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d7681b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52854/0 (socket says 172.21.15.100:52854) 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 -- 172.21.15.100:0/2154310394 learned_addr learned my addr 172.21.15.100:0/2154310394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d768c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20fca27640 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d7686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 -- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 msgr2=0x560a1d7686f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d7686f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 -- 172.21.15.100:0/2154310394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 msgr2=0x560a1d768c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d768c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.313+0000 7f20f7fff640 1 -- 172.21.15.100:0/2154310394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a1d7e7a40 con 0x560a1d7635d0 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f20f7fff640 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d7681b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f20e400cad0 tx=0x7f20e4003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f47eecb39ff4631 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f20d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f20d7fff640 1 -- 172.21.15.100:0/2154310394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e403c040 con 0x560a1d7635d0 2024-09-12T02:41:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f20d7fff640 1 -- 172.21.15.100:0/2154310394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f20e40056d0 con 0x560a1d7635d0 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e4023070 con 0x560a1d7635d0 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f20d7fff640 1 -- 172.21.15.100:0/2154310394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20e40035f0 con 0x560a1d7635d0 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 10 client.15822 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a1d7e8d20 con 0x560a1d7635d0 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f20d7fff640 1 -- 172.21.15.100:0/2154310394 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e4023070 con 0x560a1d7635d0 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f20d7fff640 1 -- 172.21.15.100:0/2154310394 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f20e402b070 con 0x560a1d7635d0 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 10 client.15822 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 10 client.15822 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 20 client.15822 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d7e91f0 0x560a1d7eb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 4 client.15822 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.314+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a1d6d0d70 con 0x560a1d7e91f0 2024-09-12T02:41:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.315+0000 7f20fca27640 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d7e91f0 0x560a1d7eb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.315+0000 7f20fca27640 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d7e91f0 0x560a1d7eb5e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b5896f8bcdf79de server_cookie=69ffbea5027d3fab in_seq=0 out_seq=0 2024-09-12T02:41:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.315+0000 7f20d7fff640 10 client.15822 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:41:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.315+0000 7f20d7fff640 1 -- 172.21.15.100:0/2154310394 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a1d6d0d70 con 0x560a1d7e91f0 2024-09-12T02:41:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.315+0000 7f20d7fff640 10 client.15822 handle_command_reply: tid=0 2024-09-12T02:41:33.396 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.315+0000 7f2101064740 1 client.15822 shutdown 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 msgr2=0x560a1d7681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d7681b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f20e400cad0 tx=0x7f20e4003d30 comp rx=0 tx=0).stop 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 shutdown_connections 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560a1d7e91f0 0x560a1d7eb5e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560a1d76e370 0x560a1d768c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a1d764b40 0x560a1d7686f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20d7fff640 0 client.15822 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 --2- 172.21.15.100:0/2154310394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a1d7635d0 0x560a1d7681b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 >> 172.21.15.100:0/2154310394 conn(0x560a1d72c310 msgr2=0x560a1d75e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 shutdown_connections 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 1 -- 172.21.15.100:0/2154310394 wait complete. 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f2101064740 20 client.15822 trim_cache size 0 max 16384 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f20e80a2b80 msgr2=0x7f20e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f20e80a2b80 0x7f20e80a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20f00ee100 tx=0x7f20f008cbe0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 msgr2=0x7f20f819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f819eee0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f20f00319f0 tx=0x7f20f0031a20 comp rx=0 tx=0).stop 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 shutdown_connections 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f20e80a2b80 0x7f20e80a5040 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20f810e4c0 0x7f20f819eee0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f81012c0 0x7f20f819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 --2- 172.21.15.100:0/1300120681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f8100910 0x7f20f819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:33.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 >> 172.21.15.100:0/1300120681 conn(0x7f20f80fc7a0 msgr2=0x7f20f80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 shutdown_connections 2024-09-12T02:41:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:33.316+0000 7f20fec8b640 1 -- 172.21.15.100:0/1300120681 wait complete. 2024-09-12T02:41:34.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:41:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:34.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:34 smithi100 ceph-mon[31390]: pgmap v423: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-09-12T02:41:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 -- 172.21.15.100:0/929263191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 msgr2=0x7ff86c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 --2- 172.21.15.100:0/929263191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1021c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009900 tx=0x7ff85c02a410 comp rx=0 tx=0).stop 2024-09-12T02:41:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 -- 172.21.15.100:0/929263191 shutdown_connections 2024-09-12T02:41:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 --2- 172.21.15.100:0/929263191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff86c106f10 0x7ff86c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 --2- 172.21.15.100:0/929263191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c102790 0x7ff86c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 --2- 172.21.15.100:0/929263191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1021c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 -- 172.21.15.100:0/929263191 >> 172.21.15.100:0/929263191 conn(0x7ff86c0fd8c0 msgr2=0x7ff86c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 -- 172.21.15.100:0/929263191 shutdown_connections 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.898+0000 7ff8729b1640 1 -- 172.21.15.100:0/929263191 wait complete. 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 Processor -- start 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 -- start start 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c102790 0x7ff86c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff86c106f10 0x7ff86c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c111f90 con 0x7ff86c101de0 2024-09-12T02:41:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c111e10 con 0x7ff86c102790 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.899+0000 7ff8729b1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c112110 con 0x7ff86c106f10 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43268/0 (socket says 172.21.15.100:43268) 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 -- 172.21.15.100:0/2327731368 learned_addr learned my addr 172.21.15.100:0/2327731368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff870f4e640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff86c106f10 0x7ff86c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c102790 0x7ff86c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 -- 172.21.15.100:0/2327731368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff86c106f10 msgr2=0x7ff86c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff86c106f10 0x7ff86c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 -- 172.21.15.100:0/2327731368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c102790 msgr2=0x7ff86c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c102790 0x7ff86c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 -- 172.21.15.100:0/2327731368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c19d380 con 0x7ff86c101de0 2024-09-12T02:41:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff86bfff640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1983d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff85c005ab0 tx=0x7ff85c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff8697fa640 1 -- 172.21.15.100:0/2327731368 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c03f030 con 0x7ff86c101de0 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86c19d610 con 0x7ff86c101de0 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff8697fa640 1 -- 172.21.15.100:0/2327731368 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff85c003ce0 con 0x7ff86c101de0 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff8697fa640 1 -- 172.21.15.100:0/2327731368 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c035070 con 0x7ff86c101de0 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.900+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86c1a4f50 con 0x7ff86c101de0 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff8697fa640 1 -- 172.21.15.100:0/2327731368 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff85c042030 con 0x7ff86c101de0 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 Processor -- start 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 -- start start 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff8697fa640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8540a2b80 0x7ff8540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cbc370 0x55f6a9cbe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f6a9c172f0 con 0x55f6a9cb2b40 2024-09-12T02:41:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6a9bbecf0 con 0x55f6a9cbc370 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff874d8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f6a9c132b0 con 0x55f6a9cb15d0 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff870f4e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff86bfff640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8540a2b80 0x7ff8540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff870f4e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43284/0 (socket says 172.21.15.100:43284) 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff870f4e640 1 -- 172.21.15.100:0/2816783332 learned_addr learned my addr 172.21.15.100:0/2816783332 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.903+0000 7ff8697fa640 1 -- 172.21.15.100:0/2327731368 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff85c0ef9f0 con 0x7ff86c101de0 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff870f4e640 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cbc370 0x55f6a9cbe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff870f4e640 1 -- 172.21.15.100:0/2816783332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cb15d0 msgr2=0x55f6a9cb1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff870f4e640 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff870f4e640 1 -- 172.21.15.100:0/2816783332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cbc370 msgr2=0x55f6a9cbe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff870f4e640 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cbc370 0x55f6a9cbe760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff870f4e640 1 -- 172.21.15.100:0/2816783332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a9ba33a0 con 0x55f6a9cb2b40 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff86bfff640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8540a2b80 0x7ff8540a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0bc1d0 tx=0x7ff85c0b1720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff870f4e640 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb1090 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff8640070b0 tx=0x7ff864009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689bc45af28306da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.904+0000 7ff8527fc640 1 -- 172.21.15.100:0/2816783332 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86400c0d0 con 0x55f6a9cb2b40 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff8527fc640 1 -- 172.21.15.100:0/2816783332 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff86400c270 con 0x55f6a9cb2b40 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff8527fc640 1 -- 172.21.15.100:0/2816783332 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864019af0 con 0x55f6a9cb2b40 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 -- 172.21.15.100:0/2816783332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 msgr2=0x55f6a9cb1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb1090 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff8640070b0 tx=0x7ff864009c50 comp rx=0 tx=0).stop 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 -- 172.21.15.100:0/2816783332 shutdown_connections 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cbc370 0x55f6a9cbe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 --2- 172.21.15.100:0/2816783332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb1090 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 -- 172.21.15.100:0/2816783332 >> 172.21.15.100:0/2816783332 conn(0x55f6a9c7a310 msgr2=0x55f6a9cadc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:34.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 -- 172.21.15.100:0/2816783332 shutdown_connections 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.905+0000 7ff874d8a740 1 -- 172.21.15.100:0/2816783332 wait complete. 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 -- start start 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 Processor -- start 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f6a9cbf070 con 0x55f6a9cb15d0 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6a9bd2060 con 0x55f6a9cb2b40 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f6a9cbf1f0 con 0x55f6a9cbc370 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff874d8a740 10 client.0 _ll_register_callbacks cb 0x55f6a99258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff870f4e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff870f4e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43298/0 (socket says 172.21.15.100:43298) 2024-09-12T02:41:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff870f4e640 1 -- 172.21.15.100:0/1279529416 learned_addr learned my addr 172.21.15.100:0/1279529416 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff870f4e640 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff870f4e640 1 -- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 msgr2=0x55f6a9cb97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.906+0000 7ff870f4e640 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff870f4e640 1 -- 172.21.15.100:0/1279529416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb2b40 msgr2=0x55f6a9cb90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff870f4e640 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff870f4e640 1 -- 172.21.15.100:0/1279529416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a99883c0 con 0x55f6a9cb15d0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff870f4e640 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbbdf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff864009970 tx=0x7ff864007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a01b516442af376 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff84b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff84b7fe640 1 -- 172.21.15.100:0/1279529416 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86400c0d0 con 0x55f6a9cb15d0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff84b7fe640 1 -- 172.21.15.100:0/1279529416 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff864007ac0 con 0x55f6a9cb15d0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff86400c270 con 0x55f6a9cb15d0 2024-09-12T02:41:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff84b7fe640 1 -- 172.21.15.100:0/1279529416 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff864009d20 con 0x55f6a9cb15d0 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 10 client.15834 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6a9ccaba0 con 0x55f6a9cb15d0 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff84b7fe640 1 -- 172.21.15.100:0/1279529416 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff86400c270 con 0x55f6a9cb15d0 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff84b7fe640 1 -- 172.21.15.100:0/1279529416 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff86401b410 con 0x55f6a9cb15d0 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 10 client.15834 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 10 client.15834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 20 client.15834 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9ccbf50 0x55f6a9cce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 4 client.15834 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.907+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6a9c24860 con 0x55f6a9ccbf50 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.908+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9ccbf50 0x55f6a9cce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.908+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9ccbf50 0x55f6a9cce340 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8477fbe8b0991e21 server_cookie=c9a55c95e830e4b0 in_seq=0 out_seq=0 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.908+0000 7ff84b7fe640 10 client.15834 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:41:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff84b7fe640 1 -- 172.21.15.100:0/1279529416 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6a9c24860 con 0x55f6a9ccbf50 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff84b7fe640 10 client.15834 handle_command_reply: tid=0 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 client.15834 shutdown 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb15d0 msgr2=0x55f6a9cbbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbbdf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff864009970 tx=0x7ff864007000 comp rx=0 tx=0).stop 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 shutdown_connections 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9ccbf50 0x55f6a9cce340 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 --2- 172.21.15.100:0/1279529416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbbdf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 >> 172.21.15.100:0/1279529416 conn(0x55f6a9c7a310 msgr2=0x55f6a9cb3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff84b7fe640 0 client.15834 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 shutdown_connections 2024-09-12T02:41:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 1 -- 172.21.15.100:0/1279529416 wait complete. 2024-09-12T02:41:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.909+0000 7ff874d8a740 20 client.15834 trim_cache size 0 max 16384 2024-09-12T02:41:34.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 Processor -- start 2024-09-12T02:41:34.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 -- start start 2024-09-12T02:41:34.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cc8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c1afe60 con 0x55f6a9cb2b40 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c1ad730 con 0x55f6a9cb15d0 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.922+0000 7ff874d8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c1ab580 con 0x55f6a9cbc370 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cc8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cc8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43312/0 (socket says 172.21.15.100:43312) 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 -- 172.21.15.100:0/465523640 learned_addr learned my addr 172.21.15.100:0/465523640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 -- 172.21.15.100:0/465523640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 msgr2=0x55f6a9cb4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/465523640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 -- 172.21.15.100:0/465523640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 msgr2=0x55f6a9cbb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/465523640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 -- 172.21.15.100:0/465523640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a9cc8850 con 0x55f6a9cb2b40 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/465523640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cc8310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff860004700 tx=0x7ff86000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f0e6685f8b7fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff851ffb640 1 -- 172.21.15.100:0/465523640 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860003de0 con 0x55f6a9cb2b40 2024-09-12T02:41:34.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff851ffb640 1 -- 172.21.15.100:0/465523640 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff860003f80 con 0x55f6a9cb2b40 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.923+0000 7ff851ffb640 1 -- 172.21.15.100:0/465523640 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860011860 con 0x55f6a9cb2b40 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 -- 172.21.15.100:0/465523640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 msgr2=0x55f6a9cc8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 --2- 172.21.15.100:0/465523640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cc8310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff860004700 tx=0x7ff86000edc0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 -- 172.21.15.100:0/465523640 shutdown_connections 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 --2- 172.21.15.100:0/465523640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 --2- 172.21.15.100:0/465523640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cc8310 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 --2- 172.21.15.100:0/465523640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cbb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 -- 172.21.15.100:0/465523640 >> 172.21.15.100:0/465523640 conn(0x55f6a9c7a310 msgr2=0x55f6a9cb7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 -- 172.21.15.100:0/465523640 shutdown_connections 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 -- 172.21.15.100:0/465523640 wait complete. 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.924+0000 7ff874d8a740 1 -- start start 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 1 Processor -- start 2024-09-12T02:41:34.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c1abbf0 con 0x55f6a9cb2b40 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c1ad060 con 0x55f6a9cb15d0 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c1ac2c0 con 0x55f6a9cbc370 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff874d8a740 10 client.0 _ll_register_callbacks cb 0x7ff86400c4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43318/0 (socket says 172.21.15.100:43318) 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 -- 172.21.15.100:0/373910993 learned_addr learned my addr 172.21.15.100:0/373910993 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff870f4e640 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff870f4e640 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 -- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 msgr2=0x55f6a9cb6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 -- 172.21.15.100:0/373910993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 msgr2=0x55f6a9cb5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.925+0000 7ff86b7fe640 1 -- 172.21.15.100:0/373910993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a9d35a80 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff86b7fe640 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb6520 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff860000c00 tx=0x7ff860003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1293b302734c5aee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff84b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff84b7fe640 1 -- 172.21.15.100:0/373910993 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860035060 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff84b7fe640 1 -- 172.21.15.100:0/373910993 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff86001c650 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff860003f80 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff84b7fe640 1 -- 172.21.15.100:0/373910993 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff86001c850 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 10 client.15840 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6a9d36c80 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff84b7fe640 1 -- 172.21.15.100:0/373910993 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff860003f80 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff84b7fe640 1 -- 172.21.15.100:0/373910993 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff860026470 con 0x55f6a9cb2b40 2024-09-12T02:41:34.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 10 client.15840 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 10 client.15840 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 20 client.15840 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9d372b0 0x55f6a9d396d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 4 client.15840 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.926+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f6a9c1ed70 con 0x55f6a9d372b0 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.927+0000 7ff870f4e640 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9d372b0 0x55f6a9d396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.927+0000 7ff84b7fe640 10 client.15840 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.927+0000 7ff870f4e640 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9d372b0 0x55f6a9d396d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2c5df67f684d302a server_cookie=2c44ff4c9a96a252 in_seq=0 out_seq=0 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.927+0000 7ff84b7fe640 1 -- 172.21.15.100:0/373910993 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f6a9c1ed70 con 0x55f6a9d372b0 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.927+0000 7ff84b7fe640 10 client.15840 handle_command_reply: tid=0 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.927+0000 7ff874d8a740 1 client.15840 shutdown 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 msgr2=0x55f6a9cb6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb6520 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff860000c00 tx=0x7ff860003e10 comp rx=0 tx=0).stop 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 shutdown_connections 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f6a9d372b0 0x55f6a9d396d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f6a9cbc370 0x55f6a9cb6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6a9cb2b40 0x55f6a9cb6520 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff84b7fe640 0 client.15840 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 --2- 172.21.15.100:0/373910993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6a9cb15d0 0x55f6a9cb5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 >> 172.21.15.100:0/373910993 conn(0x55f6a9c7a310 msgr2=0x55f6a9cc7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 shutdown_connections 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 1 -- 172.21.15.100:0/373910993 wait complete. 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff874d8a740 20 client.15840 trim_cache size 0 max 16384 2024-09-12T02:41:34.936 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:41:34.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8540a2b80 msgr2=0x7ff8540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8540a2b80 0x7ff8540a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0bc1d0 tx=0x7ff85c0b1720 comp rx=0 tx=0).stop 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 msgr2=0x7ff86c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1983d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff85c005ab0 tx=0x7ff85c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 shutdown_connections 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff8540a2b80 0x7ff8540a5040 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff86c106f10 0x7ff86c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c102790 0x7ff86c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 --2- 172.21.15.100:0/2327731368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff86c101de0 0x7ff86c1983d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.928+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 >> 172.21.15.100:0/2327731368 conn(0x7ff86c0fd8c0 msgr2=0x7ff86c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.929+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 shutdown_connections 2024-09-12T02:41:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:34.929+0000 7ff8729b1640 1 -- 172.21.15.100:0/2327731368 wait complete. 2024-09-12T02:41:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:34 smithi189 ceph-mon[35196]: pgmap v423: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-09-12T02:41:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:34 smithi117 ceph-mon[34898]: pgmap v423: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-09-12T02:41:35.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:41:36.002 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:41:36.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.499+0000 7fe1a77e7640 1 -- 172.21.15.100:0/851794260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 msgr2=0x7fe1a0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.499+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/851794260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a0103110 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe198009ca0 tx=0x7fe19802a950 comp rx=0 tx=0).stop 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.499+0000 7fe1a77e7640 1 -- 172.21.15.100:0/851794260 shutdown_connections 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.499+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/851794260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1a010c160 0x7fe1a010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.499+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/851794260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a0103650 0x7fe1a010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.499+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/851794260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a0103110 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.499+0000 7fe1a77e7640 1 -- 172.21.15.100:0/851794260 >> 172.21.15.100:0/851794260 conn(0x7fe1a00fc7d0 msgr2=0x7fe1a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.500+0000 7fe1a77e7640 1 -- 172.21.15.100:0/851794260 shutdown_connections 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.500+0000 7fe1a77e7640 1 -- 172.21.15.100:0/851794260 wait complete. 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.500+0000 7fe1a77e7640 1 Processor -- start 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.500+0000 7fe1a77e7640 1 -- start start 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a77e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a77e7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1a0103650 0x7fe1a01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a77e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a010c160 0x7fe1a019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a77e7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0111fa0 con 0x7fe1a0102d30 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a77e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0111e20 con 0x7fe1a010c160 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a77e7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0112120 con 0x7fe1a0103650 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a01984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43348/0 (socket says 172.21.15.100:43348) 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 -- 172.21.15.100:0/3158372931 learned_addr learned my addr 172.21.15.100:0/3158372931 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1a0103650 0x7fe1a01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a010c160 0x7fe1a019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 -- 172.21.15.100:0/3158372931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1a0103650 msgr2=0x7fe1a01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1a0103650 0x7fe1a01989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 -- 172.21.15.100:0/3158372931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a010c160 msgr2=0x7fe1a019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a010c160 0x7fe1a019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 -- 172.21.15.100:0/3158372931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a019d450 con 0x7fe1a0102d30 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1a0103650 0x7fe1a01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a010c160 0x7fe1a019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a5583640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a01984a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe198005cc0 tx=0x7fe19802f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe19e7fc640 1 -- 172.21.15.100:0/3158372931 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198034040 con 0x7fe1a0102d30 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe19e7fc640 1 -- 172.21.15.100:0/3158372931 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe198030920 con 0x7fe1a0102d30 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a019d6e0 con 0x7fe1a0102d30 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.501+0000 7fe19e7fc640 1 -- 172.21.15.100:0/3158372931 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198004830 con 0x7fe1a0102d30 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.502+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a01a5020 con 0x7fe1a0102d30 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe19e7fc640 1 -- 172.21.15.100:0/3158372931 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe198037020 con 0x7fe1a0102d30 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 Processor -- start 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 -- start start 2024-09-12T02:41:36.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b006b40 0x56013b005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe19e7fc640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe1880a2b80 0x7fe1880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b005a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b010370 0x56013b012760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56013af6b2f0 con 0x56013b0055d0 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56013af12cf0 con 0x56013b010370 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.504+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56013af672b0 con 0x56013b006b40 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b005a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe1880a2b80 0x7fe1880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b005a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43350/0 (socket says 172.21.15.100:43350) 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 -- 172.21.15.100:0/2766751518 learned_addr learned my addr 172.21.15.100:0/2766751518 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe19e7fc640 1 -- 172.21.15.100:0/3158372931 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe1980f0100 con 0x7fe1a0102d30 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a5583640 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b006b40 0x56013b005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b010370 0x56013b012760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 -- 172.21.15.100:0/2766751518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b006b40 msgr2=0x56013b005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b006b40 0x56013b005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 -- 172.21.15.100:0/2766751518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b010370 msgr2=0x56013b012760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b010370 0x56013b012760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 -- 172.21.15.100:0/2766751518 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56013aef73a0 con 0x56013b0055d0 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe1880a2b80 0x7fe1880a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1900153c0 tx=0x7fe1900077a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b005a10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe194009c90 tx=0x7fe19400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cb3ccdd8e077b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1877fe640 1 -- 172.21.15.100:0/2766751518 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194016070 con 0x56013b0055d0 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1877fe640 1 -- 172.21.15.100:0/2766751518 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe194011950 con 0x56013b0055d0 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.505+0000 7fe1877fe640 1 -- 172.21.15.100:0/2766751518 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194010930 con 0x56013b0055d0 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/2766751518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 msgr2=0x56013b005a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b005a10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe194009c90 tx=0x7fe19400e6c0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/2766751518 shutdown_connections 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b010370 0x56013b012760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b005a10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/2766751518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b006b40 0x56013b005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/2766751518 >> 172.21.15.100:0/2766751518 conn(0x56013afce310 msgr2=0x56013b001c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/2766751518 shutdown_connections 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.506+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/2766751518 wait complete. 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 -- start start 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 Processor -- start 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b0055d0 0x56013b00fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b00cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b010370 0x56013b00d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56013b013070 con 0x56013b010370 2024-09-12T02:41:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56013af26060 con 0x56013b006b40 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56013b0131f0 con 0x56013b0055d0 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a9bc0740 10 client.0 _ll_register_callbacks cb 0x56013ac798c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b010370 0x56013b00d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b010370 0x56013b00d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43362/0 (socket says 172.21.15.100:43362) 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 -- 172.21.15.100:0/1461956692 learned_addr learned my addr 172.21.15.100:0/1461956692 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b00cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 -- 172.21.15.100:0/1461956692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b0055d0 msgr2=0x56013b00fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b0055d0 0x56013b00fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 -- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 msgr2=0x56013b00cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b00cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.507+0000 7fe1a5d84640 1 -- 172.21.15.100:0/1461956692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56013acdc3c0 con 0x56013b010370 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b010370 0x56013b00d570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe190018bb0 tx=0x7fe1900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ec4a4648509ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe184ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe184ff9640 1 -- 172.21.15.100:0/1461956692 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190027060 con 0x56013b010370 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe184ff9640 1 -- 172.21.15.100:0/1461956692 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe190017d70 con 0x56013b010370 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe194011950 con 0x56013b010370 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe184ff9640 1 -- 172.21.15.100:0/1461956692 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe19000f040 con 0x56013b010370 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 10 client.15852 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56013b01eac0 con 0x56013b010370 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe184ff9640 1 -- 172.21.15.100:0/1461956692 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe194011950 con 0x56013b010370 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe184ff9640 1 -- 172.21.15.100:0/1461956692 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe190021070 con 0x56013b010370 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 10 client.15852 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 20 client.15852 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b01ff80 0x56013b022410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 4 client.15852 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.508+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56013af78860 con 0x56013b01ff80 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.509+0000 7fe1a5583640 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b01ff80 0x56013b022410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.509+0000 7fe1a5583640 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b01ff80 0x56013b022410 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea8aa976c0d99dd server_cookie=54ddedb318caac64 in_seq=0 out_seq=0 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.509+0000 7fe184ff9640 10 client.15852 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe184ff9640 1 -- 172.21.15.100:0/1461956692 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56013af78860 con 0x56013b01ff80 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe184ff9640 10 client.15852 handle_command_reply: tid=0 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 client.15852 shutdown 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b010370 msgr2=0x56013b00d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b010370 0x56013b00d570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe190018bb0 tx=0x7fe1900046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 shutdown_connections 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b01ff80 0x56013b022410 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b010370 0x56013b00d570 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b00cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe184ff9640 0 client.15852 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:36.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/1461956692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b0055d0 0x56013b00fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 >> 172.21.15.100:0/1461956692 conn(0x56013afce310 msgr2=0x56013b007960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 shutdown_connections 2024-09-12T02:41:36.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/1461956692 wait complete. 2024-09-12T02:41:36.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.510+0000 7fe1a9bc0740 20 client.15852 trim_cache size 0 max 16384 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 Processor -- start 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 -- start start 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b01c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b0123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b011760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01afe00 con 0x56013b0055d0 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ad6d0 con 0x56013b006b40 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ab520 con 0x56013b010370 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a5583640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b01c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a5583640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b01c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43374/0 (socket says 172.21.15.100:43374) 2024-09-12T02:41:36.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.523+0000 7fe1a5583640 1 -- 172.21.15.100:0/3948610556 learned_addr learned my addr 172.21.15.100:0/3948610556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a5583640 1 -- 172.21.15.100:0/3948610556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 msgr2=0x56013b011760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a5583640 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b011760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a5583640 1 -- 172.21.15.100:0/3948610556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 msgr2=0x56013b0123d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b0123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a5583640 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b0123d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a5583640 1 -- 172.21.15.100:0/3948610556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56013b008120 con 0x56013b0055d0 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b0123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe1a5583640 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b01c310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe1980edc40 tx=0x7fe198004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d056646fee61be91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe186ffd640 1 -- 172.21.15.100:0/3948610556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980bc950 con 0x56013b0055d0 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe186ffd640 1 -- 172.21.15.100:0/3948610556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1980c0d00 con 0x56013b0055d0 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.524+0000 7fe186ffd640 1 -- 172.21.15.100:0/3948610556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198004040 con 0x56013b0055d0 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/3948610556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 msgr2=0x56013b01c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b01c310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe1980edc40 tx=0x7fe198004300 comp rx=0 tx=0).stop 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/3948610556 shutdown_connections 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b011760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b006b40 0x56013b0123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/3948610556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b0055d0 0x56013b01c310 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/3948610556 >> 172.21.15.100:0/3948610556 conn(0x56013afce310 msgr2=0x56013b00b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/3948610556 shutdown_connections 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/3948610556 wait complete. 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 -- start start 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.525+0000 7fe1a9bc0740 1 Processor -- start 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b0055d0 0x56013b018670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b006b40 0x56013b018bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a9bc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b013440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01abb90 con 0x56013b006b40 2024-09-12T02:41:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ad000 con 0x56013b0055d0 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a9bc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a01ac260 con 0x56013b010370 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a9bc0740 10 client.0 _ll_register_callbacks cb 0x7fe190007890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b006b40 0x56013b018bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b006b40 0x56013b018bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43376/0 (socket says 172.21.15.100:43376) 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 -- 172.21.15.100:0/214430620 learned_addr learned my addr 172.21.15.100:0/214430620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a5583640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b0055d0 0x56013b018670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b013440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 -- 172.21.15.100:0/214430620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 msgr2=0x56013b013440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b013440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 -- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b0055d0 msgr2=0x56013b018670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b0055d0 0x56013b018670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 -- 172.21.15.100:0/214430620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56013b013ab0 con 0x56013b006b40 2024-09-12T02:41:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a5d84640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b013440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a5583640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b0055d0 0x56013b018670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe1a4d82640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b006b40 0x56013b018bb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe194010440 tx=0x7fe194005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb65db01ca8621fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe184ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.526+0000 7fe184ff9640 1 -- 172.21.15.100:0/214430620 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19402a060 con 0x56013b006b40 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe184ff9640 1 -- 172.21.15.100:0/214430620 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe194004680 con 0x56013b006b40 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1980c0d00 con 0x56013b006b40 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe184ff9640 1 -- 172.21.15.100:0/214430620 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe194016040 con 0x56013b006b40 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 10 client.15858 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56013b08b580 con 0x56013b006b40 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe184ff9640 1 -- 172.21.15.100:0/214430620 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1980c0d00 con 0x56013b006b40 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe184ff9640 1 -- 172.21.15.100:0/214430620 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe194024070 con 0x56013b006b40 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 10 client.15858 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 20 client.15858 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b08b9f0 0x56013b08de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 4 client.15858 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56013af72d70 con 0x56013b08b9f0 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.527+0000 7fe1a5583640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b08b9f0 0x56013b08de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe184ff9640 10 client.15858 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a5583640 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b08b9f0 0x56013b08de10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29662b863fced47f server_cookie=7e7af5cf7b560676 in_seq=0 out_seq=0 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe184ff9640 1 -- 172.21.15.100:0/214430620 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56013af72d70 con 0x56013b08b9f0 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe184ff9640 10 client.15858 handle_command_reply: tid=0 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 client.15858 shutdown 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b006b40 msgr2=0x56013b018bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b006b40 0x56013b018bb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe194010440 tx=0x7fe194005710 comp rx=0 tx=0).stop 2024-09-12T02:41:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 shutdown_connections 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56013b08b9f0 0x56013b08de10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56013b010370 0x56013b013440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56013b006b40 0x56013b018bb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 --2- 172.21.15.100:0/214430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56013b0055d0 0x56013b018670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 >> 172.21.15.100:0/214430620 conn(0x56013afce310 msgr2=0x56013b0004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe184ff9640 0 client.15858 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 shutdown_connections 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 1 -- 172.21.15.100:0/214430620 wait complete. 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.528+0000 7fe1a9bc0740 20 client.15858 trim_cache size 0 max 16384 2024-09-12T02:41:36.539 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:41:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe1880a2b80 msgr2=0x7fe1880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe1880a2b80 0x7fe1880a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1900153c0 tx=0x7fe1900077a0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 msgr2=0x7fe1a01984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a01984a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe198005cc0 tx=0x7fe19802f630 comp rx=0 tx=0).stop 2024-09-12T02:41:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 shutdown_connections 2024-09-12T02:41:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe1880a2b80 0x7fe1880a5040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a010c160 0x7fe1a019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1a0103650 0x7fe1a01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 --2- 172.21.15.100:0/3158372931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1a0102d30 0x7fe1a01984a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 >> 172.21.15.100:0/3158372931 conn(0x7fe1a00fc7d0 msgr2=0x7fe1a00fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 shutdown_connections 2024-09-12T02:41:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:36.529+0000 7fe1a77e7640 1 -- 172.21.15.100:0/3158372931 wait complete. 2024-09-12T02:41:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:36 smithi189 ceph-mon[35196]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 46 KiB/s wr, 8 op/s 2024-09-12T02:41:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:36 smithi117 ceph-mon[34898]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 46 KiB/s wr, 8 op/s 2024-09-12T02:41:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:36 smithi100 ceph-mon[31390]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 46 KiB/s wr, 8 op/s 2024-09-12T02:41:37.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:41:38.209 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:41:38.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:41:38.220 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:38.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 -- 172.21.15.100:0/525912641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0488107af0 msgr2=0x7f0488107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 --2- 172.21.15.100:0/525912641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0488107af0 0x7f0488107ed0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0478009cd0 tx=0x7f047802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 -- 172.21.15.100:0/525912641 shutdown_connections 2024-09-12T02:41:38.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 --2- 172.21.15.100:0/525912641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0488102380 0x7f048810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 --2- 172.21.15.100:0/525912641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04881019e0 0x7f0488101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 --2- 172.21.15.100:0/525912641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0488107af0 0x7f0488107ed0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 -- 172.21.15.100:0/525912641 >> 172.21.15.100:0/525912641 conn(0x7f04880fd700 msgr2=0x7f04880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 -- 172.21.15.100:0/525912641 shutdown_connections 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 -- 172.21.15.100:0/525912641 wait complete. 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 Processor -- start 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 -- start start 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.691+0000 7f048eba0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04881019e0 0x7f04881983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048eba0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0488102380 0x7f0488198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048eba0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0488107af0 0x7f048819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048eba0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0488111ef0 con 0x7f04881019e0 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048eba0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0488111d70 con 0x7f0488102380 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048eba0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0488112070 con 0x7f0488107af0 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04881019e0 0x7f04881983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04881019e0 0x7f04881983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43384/0 (socket says 172.21.15.100:43384) 2024-09-12T02:41:38.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 -- 172.21.15.100:0/1656180700 learned_addr learned my addr 172.21.15.100:0/1656180700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048e39f640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0488107af0 0x7f048819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048d39d640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0488102380 0x7f0488198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 -- 172.21.15.100:0/1656180700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0488107af0 msgr2=0x7f048819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0488107af0 0x7f048819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 -- 172.21.15.100:0/1656180700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0488102380 msgr2=0x7f0488198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0488102380 0x7f0488198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 -- 172.21.15.100:0/1656180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048819d3a0 con 0x7f04881019e0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048db9e640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04881019e0 0x7f04881983f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f047802ae00 tx=0x7f0478003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f0486ffd640 1 -- 172.21.15.100:0/1656180700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478004040 con 0x7f04881019e0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f0486ffd640 1 -- 172.21.15.100:0/1656180700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04780046c0 con 0x7f04881019e0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048819d630 con 0x7f04881019e0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f0486ffd640 1 -- 172.21.15.100:0/1656180700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478046480 con 0x7f04881019e0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.692+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04881a4f70 con 0x7f04881019e0 2024-09-12T02:41:38.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.693+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0488101e40 con 0x7f04881019e0 2024-09-12T02:41:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.695+0000 7f0486ffd640 1 -- 172.21.15.100:0/1656180700 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f04780305a0 con 0x7f04881019e0 2024-09-12T02:41:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.695+0000 7f0486ffd640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04700a2b80 0x7f04700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.695+0000 7f048d39d640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04700a2b80 0x7f04700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.695+0000 7f0486ffd640 1 -- 172.21.15.100:0/1656180700 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f047802e030 con 0x7f04881019e0 2024-09-12T02:41:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.696+0000 7f048d39d640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04700a2b80 0x7f04700a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f047c005fd0 tx=0x7f047c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.699+0000 7f0486ffd640 1 -- 172.21.15.100:0/1656180700 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f047804b060 con 0x7f04881019e0 2024-09-12T02:41:38.739 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:38.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:38 smithi100 ceph-mon[31390]: pgmap v425: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-12T02:41:38.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.913+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0488103120 con 0x7f04881019e0 2024-09-12T02:41:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.914+0000 7f0486ffd640 1 -- 172.21.15.100:0/1656180700 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f0478030890 con 0x7f04881019e0 2024-09-12T02:41:38.914 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:41:38.914 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:41:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:41:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04700a2b80 msgr2=0x7f04700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04700a2b80 0x7f04700a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f047c005fd0 tx=0x7f047c005850 comp rx=0 tx=0).stop 2024-09-12T02:41:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04881019e0 msgr2=0x7f04881983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04881019e0 0x7f04881983f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f047802ae00 tx=0x7f0478003970 comp rx=0 tx=0).stop 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 shutdown_connections 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04700a2b80 0x7f04700a5040 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0488107af0 0x7f048819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0488102380 0x7f0488198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 --2- 172.21.15.100:0/1656180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04881019e0 0x7f04881983f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 >> 172.21.15.100:0/1656180700 conn(0x7f04880fd700 msgr2=0x7f04880fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 shutdown_connections 2024-09-12T02:41:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:38.916+0000 7f048eba0640 1 -- 172.21.15.100:0/1656180700 wait complete. 2024-09-12T02:41:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:38 smithi189 ceph-mon[35196]: pgmap v425: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-12T02:41:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:38 smithi117 ceph-mon[34898]: pgmap v425: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-12T02:41:39.739 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id ea76450 --release --await' 2024-09-12T02:41:39.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id ea76450 --release --await 2024-09-12T02:41:39.962 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:39 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1656180700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 -- 172.21.15.100:0/1256658953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14106a90 msgr2=0x7f4d14106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 --2- 172.21.15.100:0/1256658953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14106a90 0x7f4d14106e70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009930 tx=0x7f4d0402a420 comp rx=0 tx=0).stop 2024-09-12T02:41:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 -- 172.21.15.100:0/1256658953 shutdown_connections 2024-09-12T02:41:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 --2- 172.21.15.100:0/1256658953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d14101430 0x7f4d1410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 --2- 172.21.15.100:0/1256658953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d14100a90 0x7f4d14100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 --2- 172.21.15.100:0/1256658953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14106a90 0x7f4d14106e70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 -- 172.21.15.100:0/1256658953 >> 172.21.15.100:0/1256658953 conn(0x7f4d140fc7d0 msgr2=0x7f4d140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 -- 172.21.15.100:0/1256658953 shutdown_connections 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.956+0000 7f4d18948640 1 -- 172.21.15.100:0/1256658953 wait complete. 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 Processor -- start 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 -- start start 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14100a90 0x7f4d14199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d14101430 0x7f4d141997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d14106a90 0x7f4d141a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14110e90 con 0x7f4d14100a90 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14110d10 con 0x7f4d14101430 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d18948640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14111010 con 0x7f4d14106a90 2024-09-12T02:41:39.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14100a90 0x7f4d14199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14100a90 0x7f4d14199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43402/0 (socket says 172.21.15.100:43402) 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 -- 172.21.15.100:0/1726624421 learned_addr learned my addr 172.21.15.100:0/1726624421 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d14101430 0x7f4d141997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d12d9d640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d14106a90 0x7f4d141a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 -- 172.21.15.100:0/1726624421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d14106a90 msgr2=0x7f4d141a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d14106a90 0x7f4d141a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 -- 172.21.15.100:0/1726624421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d14101430 msgr2=0x7f4d141997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d14101430 0x7f4d141997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.957+0000 7f4d1259c640 1 -- 172.21.15.100:0/1726624421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d141a4820 con 0x7f4d14100a90 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.958+0000 7f4d1259c640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14100a90 0x7f4d14199260 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009230 tx=0x7f4d04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.958+0000 7f4d037fe640 1 -- 172.21.15.100:0/1726624421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0403f030 con 0x7f4d14100a90 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.958+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d141a49f0 con 0x7f4d14100a90 2024-09-12T02:41:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.958+0000 7f4d037fe640 1 -- 172.21.15.100:0/1726624421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d04003ad0 con 0x7f4d14100a90 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.958+0000 7f4d037fe640 1 -- 172.21.15.100:0/1726624421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04035070 con 0x7f4d14100a90 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.958+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d141a4ea0 con 0x7f4d14100a90 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.960+0000 7f4d037fe640 1 -- 172.21.15.100:0/1726624421 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4d04042030 con 0x7f4d14100a90 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.961+0000 7f4d037fe640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4cfc0a2b80 0x7f4cfc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.961+0000 7f4d1ad21740 1 Processor -- start 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.961+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4cfc0a2b80 0x7f4cfc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.961+0000 7f4d037fe640 1 -- 172.21.15.100:0/1726624421 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4d040ef540 con 0x7f4d14100a90 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.962+0000 7f4d1ad21740 1 -- start start 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4cfc0a2b80 0x7f4cfc0a5040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4d1406b2e0 tx=0x7f4d0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee3664f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3672130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ee35ca280 con 0x558ee3664b60 2024-09-12T02:41:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558ee3571b10 con 0x558ee366fd40 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ee35c6240 con 0x558ee3665480 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee3664f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee3664f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43410/0 (socket says 172.21.15.100:43410) 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 -- 172.21.15.100:0/135511117 learned_addr learned my addr 172.21.15.100:0/135511117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 -- 172.21.15.100:0/135511117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 msgr2=0x558ee366f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 -- 172.21.15.100:0/135511117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 msgr2=0x558ee3672130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3672130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 -- 172.21.15.100:0/135511117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee357e1f0 con 0x558ee3664b60 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d1259c640 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee3664f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4d040c44d0 tx=0x7f4d04009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e8d8c7fa3fbc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d00ff9640 1 -- 172.21.15.100:0/135511117 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04049040 con 0x558ee3664b60 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d00ff9640 1 -- 172.21.15.100:0/135511117 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d040c4a00 con 0x558ee3664b60 2024-09-12T02:41:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.963+0000 7f4d00ff9640 1 -- 172.21.15.100:0/135511117 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040bbff0 con 0x558ee3664b60 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 -- 172.21.15.100:0/135511117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 msgr2=0x558ee3664f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee3664f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4d040c44d0 tx=0x7f4d04009260 comp rx=0 tx=0).stop 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 -- 172.21.15.100:0/135511117 shutdown_connections 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3672130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/135511117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee3664f40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 -- 172.21.15.100:0/135511117 >> 172.21.15.100:0/135511117 conn(0x558ee36610f0 msgr2=0x558ee36614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 -- 172.21.15.100:0/135511117 shutdown_connections 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.964+0000 7f4d1ad21740 1 -- 172.21.15.100:0/135511117 wait complete. 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 -- start start 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 Processor -- start 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee366cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee366d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ee36726d0 con 0x558ee3664b60 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558ee3584f10 con 0x558ee366fd40 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ee3672850 con 0x558ee3665480 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1ad21740 10 client.0 _ll_register_callbacks cb 0x558ee354da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee366cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee366cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43424/0 (socket says 172.21.15.100:43424) 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1259c640 1 -- 172.21.15.100:0/904833539 learned_addr learned my addr 172.21.15.100:0/904833539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d12d9d640 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee366d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1259c640 1 -- 172.21.15.100:0/904833539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 msgr2=0x558ee366d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1259c640 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1259c640 1 -- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 msgr2=0x558ee366d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.965+0000 7f4d1259c640 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee366d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4d1259c640 1 -- 172.21.15.100:0/904833539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee333b6a0 con 0x558ee3664b60 2024-09-12T02:41:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4d1259c640 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee366cbf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d0403d040 tx=0x7f4d04003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b126b50205e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4cf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/904833539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0409f060 con 0x558ee3664b60 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/904833539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4d040ef110 con 0x558ee3664b60 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d040c4a00 con 0x558ee3664b60 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/904833539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d040da070 con 0x558ee3664b60 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4d1ad21740 10 client.15876 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ee36726d0 con 0x558ee3664b60 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.966+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/904833539 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d040c4a00 con 0x558ee3664b60 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/904833539 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d040c4570 con 0x558ee3664b60 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d1ad21740 10 client.15876 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d1ad21740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d1ad21740 20 client.15876 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee367f400 0x558ee3681810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d1ad21740 4 client.15876 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ee35d77f0 con 0x558ee367f400 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee367f400 0x558ee3681810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee367f400 0x558ee3681810 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d10f3fb53d8513 server_cookie=ac132df20e10dba6 in_seq=0 out_seq=0 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.967+0000 7f4cf9ffb640 10 client.15876 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/904833539 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ee35d77f0 con 0x558ee367f400 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4cf9ffb640 10 client.15876 handle_command_reply: tid=0 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 client.15876 shutdown 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 msgr2=0x558ee366cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee366cbf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d0403d040 tx=0x7f4d04003c80 comp rx=0 tx=0).stop 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 shutdown_connections 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee367f400 0x558ee3681810 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee366d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4cf9ffb640 0 client.15876 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:39.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee366d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/904833539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3664b60 0x558ee366cbf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 >> 172.21.15.100:0/904833539 conn(0x558ee36610f0 msgr2=0x558ee3666dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 shutdown_connections 2024-09-12T02:41:39.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 1 -- 172.21.15.100:0/904833539 wait complete. 2024-09-12T02:41:39.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.968+0000 7f4d1ad21740 20 client.15876 trim_cache size 0 max 16384 2024-09-12T02:41:39.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.987+0000 7f4d1ad21740 1 Processor -- start 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.987+0000 7f4d1ad21740 1 -- start start 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.987+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3664b60 0x558ee366baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.987+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3665480 0x558ee3687100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3687640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141afd00 con 0x558ee3665480 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141ad5d0 con 0x558ee366fd40 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141ab420 con 0x558ee3664b60 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3665480 0x558ee3687100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3665480 0x558ee3687100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43436/0 (socket says 172.21.15.100:43436) 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 -- 172.21.15.100:0/4179213587 learned_addr learned my addr 172.21.15.100:0/4179213587 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d12d9d640 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3687640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d1259c640 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3664b60 0x558ee366baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 -- 172.21.15.100:0/4179213587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3664b60 msgr2=0x558ee366baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3664b60 0x558ee366baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 -- 172.21.15.100:0/4179213587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 msgr2=0x558ee3687640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3687640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 -- 172.21.15.100:0/4179213587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee3660f20 con 0x558ee3665480 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d12d9d640 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3687640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3665480 0x558ee3687100 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d08004010 tx=0x7f4d08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83857f0f54c7868 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4cfbfff640 1 -- 172.21.15.100:0/4179213587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08005220 con 0x558ee3665480 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4cfbfff640 1 -- 172.21.15.100:0/4179213587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d08004c80 con 0x558ee3665480 2024-09-12T02:41:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.988+0000 7f4cfbfff640 1 -- 172.21.15.100:0/4179213587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0802a880 con 0x558ee3665480 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 -- 172.21.15.100:0/4179213587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3665480 msgr2=0x558ee3687100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3665480 0x558ee3687100 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d08004010 tx=0x7f4d08013000 comp rx=0 tx=0).stop 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 -- 172.21.15.100:0/4179213587 shutdown_connections 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee366fd40 0x558ee3687640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee3665480 0x558ee3687100 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/4179213587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3664b60 0x558ee366baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 -- 172.21.15.100:0/4179213587 >> 172.21.15.100:0/4179213587 conn(0x558ee36610f0 msgr2=0x558ee366b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 -- 172.21.15.100:0/4179213587 shutdown_connections 2024-09-12T02:41:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.989+0000 7f4d1ad21740 1 -- 172.21.15.100:0/4179213587 wait complete. 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 -- start start 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 Processor -- start 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee3664b60 0x558ee3677990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee3677ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee366fd40 0x558ee36e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141aba90 con 0x558ee366fd40 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141acf00 con 0x558ee3664b60 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141ac160 con 0x558ee3665480 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1ad21740 10 client.0 _ll_register_callbacks cb 0x7f4d080042a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee366fd40 0x558ee36e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee366fd40 0x558ee36e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43446/0 (socket says 172.21.15.100:43446) 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 -- 172.21.15.100:0/1634858144 learned_addr learned my addr 172.21.15.100:0/1634858144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d11d9b640 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee3677ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d1259c640 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee3664b60 0x558ee3677990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 -- 172.21.15.100:0/1634858144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 msgr2=0x558ee3677ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee3677ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 -- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee3664b60 msgr2=0x558ee3677990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee3664b60 0x558ee3677990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.990+0000 7f4d12d9d640 1 -- 172.21.15.100:0/1634858144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee36e5c00 con 0x558ee366fd40 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4d12d9d640 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee366fd40 0x558ee36e2f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c012af0 tx=0x7f4d0c007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387bbba324c9a500 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4cf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/1634858144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c010e80 con 0x558ee366fd40 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/1634858144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4d0c00e3b0 con 0x558ee366fd40 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d08004c80 con 0x558ee366fd40 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/1634858144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d0c00e5b0 con 0x558ee366fd40 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4d1ad21740 10 client.15882 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ee36ee8a0 con 0x558ee366fd40 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/1634858144 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d08004c80 con 0x558ee366fd40 2024-09-12T02:41:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.991+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/1634858144 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d0c026ab0 con 0x558ee366fd40 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1ad21740 10 client.15882 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1ad21740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1ad21740 20 client.15882 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee36eefd0 0x558ee36f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1ad21740 4 client.15882 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558ee35d1d00 con 0x558ee36eefd0 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1259c640 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee36eefd0 0x558ee36f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4cf9ffb640 10 client.15882 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.992+0000 7f4d1259c640 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee36eefd0 0x558ee36f13f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f91f8b6fa77c700d server_cookie=d75b375a6db4bd0d in_seq=0 out_seq=0 2024-09-12T02:41:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4cf9ffb640 1 -- 172.21.15.100:0/1634858144 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558ee35d1d00 con 0x558ee36eefd0 2024-09-12T02:41:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4cf9ffb640 10 client.15882 handle_command_reply: tid=0 2024-09-12T02:41:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4d1ad21740 1 client.15882 shutdown 2024-09-12T02:41:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee366fd40 msgr2=0x558ee36e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee366fd40 0x558ee36e2f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c012af0 tx=0x7f4d0c007e20 comp rx=0 tx=0).stop 2024-09-12T02:41:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 shutdown_connections 2024-09-12T02:41:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ee36eefd0 0x558ee36f13f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.993+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ee366fd40 0x558ee36e2f20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.994+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ee3665480 0x558ee3677ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.994+0000 7f4d1ad21740 1 --2- 172.21.15.100:0/1634858144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ee3664b60 0x558ee3677990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.994+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 >> 172.21.15.100:0/1634858144 conn(0x558ee36610f0 msgr2=0x558ee3666dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.994+0000 7f4cf9ffb640 0 client.15882 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.994+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 shutdown_connections 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.994+0000 7f4d1ad21740 1 -- 172.21.15.100:0/1634858144 wait complete. 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.994+0000 7f4d1ad21740 20 client.15882 trim_cache size 0 max 16384 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:41:39.998 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "b057f7ab-38ca-4a8b-a320-c223b8b1bbb8", 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4cfc0a2b80 msgr2=0x7f4cfc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4cfc0a2b80 0x7f4cfc0a5040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4d1406b2e0 tx=0x7f4d0800b390 comp rx=0 tx=0).stop 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14100a90 msgr2=0x7f4d14199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14100a90 0x7f4d14199260 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009230 tx=0x7f4d04004270 comp rx=0 tx=0).stop 2024-09-12T02:41:39.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 shutdown_connections 2024-09-12T02:41:40.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4cfc0a2b80 0x7f4cfc0a5040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d14106a90 0x7f4d141a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d14101430 0x7f4d141997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 --2- 172.21.15.100:0/1726624421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d14100a90 0x7f4d14199260 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 >> 172.21.15.100:0/1726624421 conn(0x7f4d140fc7d0 msgr2=0x7f4d140fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:40.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 shutdown_connections 2024-09-12T02:41:40.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:39.995+0000 7f4d18948640 1 -- 172.21.15.100:0/1726624421 wait complete. 2024-09-12T02:41:40.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:39 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1656180700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:40.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:39 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1656180700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:41:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:40.741 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:41:40.972 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:40 smithi100 ceph-mon[31390]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-09-12T02:41:40.973 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:40 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:41:40.973 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:40.973 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:40 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:41:40.973 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:40 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:41:40.973 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:40.973 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:40 smithi189 ceph-mon[35196]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-09-12T02:41:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:40 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:41:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:40 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:41:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:40 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:41:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:40 smithi117 ceph-mon[34898]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-09-12T02:41:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:40 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:41:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:40 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:41:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:40 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:41:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 -- 172.21.15.100:0/607027247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201036e0 msgr2=0x7f1920107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 --2- 172.21.15.100:0/607027247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201036e0 0x7f1920107b90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1914009930 tx=0x7f191402a420 comp rx=0 tx=0).stop 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 -- 172.21.15.100:0/607027247 shutdown_connections 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 --2- 172.21.15.100:0/607027247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19201082a0 0x7f192010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 --2- 172.21.15.100:0/607027247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201036e0 0x7f1920107b90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 --2- 172.21.15.100:0/607027247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1920102d30 0x7f1920103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 -- 172.21.15.100:0/607027247 >> 172.21.15.100:0/607027247 conn(0x7f19200fc7d0 msgr2=0x7f19200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 -- 172.21.15.100:0/607027247 shutdown_connections 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.199+0000 7f1925c02640 1 -- 172.21.15.100:0/607027247 wait complete. 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 Processor -- start 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 -- start start 2024-09-12T02:41:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1920102d30 0x7f192019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19201036e0 0x7f192019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201082a0 0x7f19201985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1920112140 con 0x7f19201082a0 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1920111fc0 con 0x7f1920102d30 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.200+0000 7f1925c02640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19201122c0 con 0x7f19201036e0 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201082a0 0x7f19201985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201082a0 0x7f19201985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43456/0 (socket says 172.21.15.100:43456) 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 -- 172.21.15.100:0/561270111 learned_addr learned my addr 172.21.15.100:0/561270111 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 -- 172.21.15.100:0/561270111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19201036e0 msgr2=0x7f192019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191f7fe640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1920102d30 0x7f192019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19201036e0 0x7f192019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 -- 172.21.15.100:0/561270111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1920102d30 msgr2=0x7f192019e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1920102d30 0x7f192019e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 -- 172.21.15.100:0/561270111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1920198cd0 con 0x7f19201082a0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191f7fe640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1920102d30 0x7f192019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191ffff640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201082a0 0x7f19201985a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1918009fd0 tx=0x7f191800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191cff9640 1 -- 172.21.15.100:0/561270111 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918011830 con 0x7f19201082a0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191cff9640 1 -- 172.21.15.100:0/561270111 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1918016070 con 0x7f19201082a0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1920198fc0 con 0x7f19201082a0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f191cff9640 1 -- 172.21.15.100:0/561270111 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191800f2e0 con 0x7f19201082a0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.201+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19201a52b0 con 0x7f19201082a0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.203+0000 7f191cff9640 1 -- 172.21.15.100:0/561270111 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f19180119d0 con 0x7f19201082a0 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 Processor -- start 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 -- start start 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191cff9640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19080a2b80 0x7f19080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca4fad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191effd640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19080a2b80 0x7f19080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca4fd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191cff9640 1 -- 172.21.15.100:0/561270111 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f19180ce810 con 0x7f19201082a0 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561eca455620 con 0x561eca4fb240 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561eca3fce50 con 0x561eca4f0060 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f1927fdb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561eca4515e0 con 0x561eca4f0980 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca4fd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca4fd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43466/0 (socket says 172.21.15.100:43466) 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191ffff640 1 -- 172.21.15.100:0/3058853045 learned_addr learned my addr 172.21.15.100:0/3058853045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191ffff640 1 -- 172.21.15.100:0/3058853045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 msgr2=0x561eca4fad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191ffff640 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca4fad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191f7fe640 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.204+0000 7f191ffff640 1 -- 172.21.15.100:0/3058853045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 msgr2=0x561eca4f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.205+0000 7f191ffff640 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.205+0000 7f191ffff640 1 -- 172.21.15.100:0/3058853045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eca3edd40 con 0x561eca4fb240 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.205+0000 7f191effd640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19080a2b80 0x7f19080a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f191402a940 tx=0x7f1914005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.205+0000 7f191ffff640 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca4fd630 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1918006fd0 tx=0x7f191809ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3501e879cc845af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.205+0000 7f1905ffb640 1 -- 172.21.15.100:0/3058853045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191809b000 con 0x561eca4fb240 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.205+0000 7f1905ffb640 1 -- 172.21.15.100:0/3058853045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191809f3b0 con 0x561eca4fb240 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.205+0000 7f1905ffb640 1 -- 172.21.15.100:0/3058853045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918097670 con 0x561eca4fb240 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 -- 172.21.15.100:0/3058853045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 msgr2=0x561eca4fd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca4fd630 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1918006fd0 tx=0x7f191809ac00 comp rx=0 tx=0).stop 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 -- 172.21.15.100:0/3058853045 shutdown_connections 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca4fd630 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca4fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3058853045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 -- 172.21.15.100:0/3058853045 >> 172.21.15.100:0/3058853045 conn(0x561eca4ec5f0 msgr2=0x561eca4ec9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 -- 172.21.15.100:0/3058853045 shutdown_connections 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 -- 172.21.15.100:0/3058853045 wait complete. 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 -- start start 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.206+0000 7f1927fdb740 1 Processor -- start 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0980 0x561eca4f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4fb240 0x561eca4f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561eca4fde10 con 0x561eca4f0980 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561eca3ddf10 con 0x561eca4f0060 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561eca4fdf90 con 0x561eca4fb240 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 10 client.0 _ll_register_callbacks cb 0x561eca401db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0980 0x561eca4f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0980 0x561eca4f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43480/0 (socket says 172.21.15.100:43480) 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 -- 172.21.15.100:0/602162237 learned_addr learned my addr 172.21.15.100:0/602162237 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191ffff640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4fb240 0x561eca4f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191f7fe640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 -- 172.21.15.100:0/602162237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4fb240 msgr2=0x561eca4f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4fb240 0x561eca4f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 -- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 msgr2=0x561eca4f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 -- 172.21.15.100:0/602162237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eca164580 con 0x561eca4f0980 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191f7fe640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f191effd640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0980 0x561eca4f86f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1914009930 tx=0x7f1914009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ee308103ae6ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f18feffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f18feffd640 1 -- 172.21.15.100:0/602162237 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191404d020 con 0x561eca4f0980 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f18feffd640 1 -- 172.21.15.100:0/602162237 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1914004330 con 0x561eca4f0980 2024-09-12T02:41:41.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.207+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191809f3b0 con 0x561eca4f0980 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f18feffd640 1 -- 172.21.15.100:0/602162237 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1914058050 con 0x561eca4f0980 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 10 client.15894 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561eca22e960 con 0x561eca4f0980 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f18feffd640 1 -- 172.21.15.100:0/602162237 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191809f3b0 con 0x561eca4f0980 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f18feffd640 1 -- 172.21.15.100:0/602162237 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1914048030 con 0x561eca4f0980 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 10 client.15894 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 20 client.15894 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca50ae30 0x561eca50d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 4 client.15894 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eca462b90 con 0x561eca50ae30 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.208+0000 7f191f7fe640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca50ae30 0x561eca50d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.209+0000 7f191f7fe640 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca50ae30 0x561eca50d2a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafdf0167f45b700 server_cookie=1d840ab419a5d59b in_seq=0 out_seq=0 2024-09-12T02:41:41.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.209+0000 7f18feffd640 10 client.15894 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.209+0000 7f18feffd640 1 -- 172.21.15.100:0/602162237 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561eca462b90 con 0x561eca50ae30 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.209+0000 7f18feffd640 10 client.15894 handle_command_reply: tid=0 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.209+0000 7f1927fdb740 1 client.15894 shutdown 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0980 msgr2=0x561eca4f86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0980 0x561eca4f86f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1914009930 tx=0x7f1914009260 comp rx=0 tx=0).stop 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 shutdown_connections 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca50ae30 0x561eca50d2a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4fb240 0x561eca4f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0980 0x561eca4f86f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 --2- 172.21.15.100:0/602162237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4f0060 0x561eca4f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f18feffd640 0 client.15894 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 >> 172.21.15.100:0/602162237 conn(0x561eca4ec5f0 msgr2=0x561eca4f22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 shutdown_connections 2024-09-12T02:41:41.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 1 -- 172.21.15.100:0/602162237 wait complete. 2024-09-12T02:41:41.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.210+0000 7f1927fdb740 20 client.15894 trim_cache size 0 max 16384 2024-09-12T02:41:41.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.227+0000 7f1927fdb740 1 Processor -- start 2024-09-12T02:41:41.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.227+0000 7f1927fdb740 1 -- start start 2024-09-12T02:41:41.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.227+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0060 0x561eca512b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.227+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4fb240 0x561eca4f5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f1927fdb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f19201b00a0 con 0x561eca4f0060 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f1927fdb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f19201ad970 con 0x561eca4fb240 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f1927fdb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19201ab7c0 con 0x561eca4f0980 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0060 0x561eca512b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0060 0x561eca512b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43490/0 (socket says 172.21.15.100:43490) 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 -- 172.21.15.100:0/3320039228 learned_addr learned my addr 172.21.15.100:0/3320039228 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191effd640 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191ffff640 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4fb240 0x561eca4f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 -- 172.21.15.100:0/3320039228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 msgr2=0x561eca5130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5130b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 -- 172.21.15.100:0/3320039228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4fb240 msgr2=0x561eca4f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4fb240 0x561eca4f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 -- 172.21.15.100:0/3320039228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eca4fd9a0 con 0x561eca4f0060 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f191f7fe640 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0060 0x561eca512b70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1910000f80 tx=0x7f1910008630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846ab5b9e1d8c77d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.228+0000 7f19057fa640 1 -- 172.21.15.100:0/3320039228 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100195f0 con 0x561eca4f0060 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.229+0000 7f19057fa640 1 -- 172.21.15.100:0/3320039228 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191000fe90 con 0x561eca4f0060 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.229+0000 7f19057fa640 1 -- 172.21.15.100:0/3320039228 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910010e20 con 0x561eca4f0060 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 -- 172.21.15.100:0/3320039228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0060 msgr2=0x561eca512b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0060 0x561eca512b70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1910000f80 tx=0x7f1910008630 comp rx=0 tx=0).stop 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 -- 172.21.15.100:0/3320039228 shutdown_connections 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca4fb240 0x561eca4f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 --2- 172.21.15.100:0/3320039228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4f0060 0x561eca512b70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 -- 172.21.15.100:0/3320039228 >> 172.21.15.100:0/3320039228 conn(0x561eca4ec5f0 msgr2=0x561eca4fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 -- 172.21.15.100:0/3320039228 shutdown_connections 2024-09-12T02:41:41.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 -- 172.21.15.100:0/3320039228 wait complete. 2024-09-12T02:41:41.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.230+0000 7f1927fdb740 1 -- start start 2024-09-12T02:41:41.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.231+0000 7f1927fdb740 1 Processor -- start 2024-09-12T02:41:41.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.231+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.231+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca503900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.231+0000 7f1927fdb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca5001b0 0x561eca500630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.231+0000 7f191effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca503900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.231+0000 7f1927fdb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f19201abe30 con 0x561eca4fb240 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca503900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43494/0 (socket says 172.21.15.100:43494) 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 -- 172.21.15.100:0/561418456 learned_addr learned my addr 172.21.15.100:0/561418456 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f1927fdb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f19201ad2a0 con 0x561eca5001b0 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191f7fe640 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19201ac500 con 0x561eca4f0980 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f1927fdb740 10 client.0 _ll_register_callbacks cb 0x7f1914031a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191ffff640 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca5001b0 0x561eca500630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 -- 172.21.15.100:0/561418456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 msgr2=0x561eca5033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 -- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca5001b0 msgr2=0x561eca500630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca5001b0 0x561eca500630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 -- 172.21.15.100:0/561418456 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eca500dc0 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f191effd640 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca503900 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x561eca4f97f0 tx=0x7f19140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c004e1b200fb95c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.232+0000 7f18feffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.233+0000 7f18feffd640 1 -- 172.21.15.100:0/561418456 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914060030 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.233+0000 7f18feffd640 1 -- 172.21.15.100:0/561418456 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1914003bd0 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.233+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191000fe90 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.233+0000 7f18feffd640 1 -- 172.21.15.100:0/561418456 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f191404d040 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.233+0000 7f1927fdb740 10 client.15900 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.233+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561eca576ad0 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f18feffd640 1 -- 172.21.15.100:0/561418456 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191000fe90 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f18feffd640 1 -- 172.21.15.100:0/561418456 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1914048040 con 0x561eca4fb240 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f1927fdb740 10 client.15900 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f1927fdb740 10 client.15900 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:41:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f1927fdb740 20 client.15900 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f1927fdb740 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca577280 0x561eca5796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f1927fdb740 4 client.15900 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ea76450", "release": true, "await": true}] 2024-09-12T02:41:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ea76450", "release": true, "await": true}) -- 0x561eca45d0a0 con 0x561eca577280 2024-09-12T02:41:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.234+0000 7f191f7fe640 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca577280 0x561eca5796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.235+0000 7f191f7fe640 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca577280 0x561eca5796a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d8d5cbde15268e3 server_cookie=d1136f7061a82ef8 in_seq=0 out_seq=0 2024-09-12T02:41:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.235+0000 7f18feffd640 10 client.15900 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:41.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f18feffd640 1 -- 172.21.15.100:0/561418456 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x561eca45d0a0 con 0x561eca577280 2024-09-12T02:41:41.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f18feffd640 10 client.15900 handle_command_reply: tid=0 2024-09-12T02:41:41.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 client.15900 shutdown 2024-09-12T02:41:41.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 msgr2=0x561eca503900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca503900 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x561eca4f97f0 tx=0x7f19140045e0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.292 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:41:41.292 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:41:41.292 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 12, 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "ea76450": { 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 12, 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 144.7, 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:41:41.293 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:41.294 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 shutdown_connections 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561eca577280 0x561eca5796a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f18feffd640 0 client.15900 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561eca5001b0 0x561eca500630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561eca4fb240 0x561eca503900 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 --2- 172.21.15.100:0/561418456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561eca4f0980 0x561eca5033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 >> 172.21.15.100:0/561418456 conn(0x561eca4ec5f0 msgr2=0x561eca4f1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.291+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 shutdown_connections 2024-09-12T02:41:41.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.292+0000 7f1927fdb740 1 -- 172.21.15.100:0/561418456 wait complete. 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.292+0000 7f1927fdb740 20 client.15900 trim_cache size 0 max 16384 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19080a2b80 msgr2=0x7f19080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19080a2b80 0x7f19080a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f191402a940 tx=0x7f1914005760 comp rx=0 tx=0).stop 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201082a0 msgr2=0x7f19201985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201082a0 0x7f19201985a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1918009fd0 tx=0x7f191800b8e0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 shutdown_connections 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19080a2b80 0x7f19080a5040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19201082a0 0x7f19201985a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19201036e0 0x7f192019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 --2- 172.21.15.100:0/561270111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1920102d30 0x7f192019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 >> 172.21.15.100:0/561270111 conn(0x7f19200fc7d0 msgr2=0x7f1920105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.293+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 shutdown_connections 2024-09-12T02:41:41.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.294+0000 7f1925c02640 1 -- 172.21.15.100:0/561270111 wait complete. 2024-09-12T02:41:41.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 150.0 s, 2.8 tps, lat 24217.826 ms stddev 35.072 2024-09-12T02:41:41.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 -- 172.21.15.100:0/1396885700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410a560 msgr2=0x7fc57410a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 --2- 172.21.15.100:0/1396885700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410a560 0x7fc57410a940 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009900 tx=0x7fc56c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 -- 172.21.15.100:0/1396885700 shutdown_connections 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 --2- 172.21.15.100:0/1396885700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc574113940 0x7fc574115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 --2- 172.21.15.100:0/1396885700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57410ae80 0x7fc574113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 --2- 172.21.15.100:0/1396885700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410a560 0x7fc57410a940 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 -- 172.21.15.100:0/1396885700 >> 172.21.15.100:0/1396885700 conn(0x7fc57406e140 msgr2=0x7fc57406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 -- 172.21.15.100:0/1396885700 shutdown_connections 2024-09-12T02:41:41.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.829+0000 7fc579965640 1 -- 172.21.15.100:0/1396885700 wait complete. 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 Processor -- start 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 -- start start 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57410a560 0x7fc5741a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410ae80 0x7fc5741a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc574113940 0x7fc5741acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741196b0 con 0x7fc57410ae80 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc574119530 con 0x7fc574113940 2024-09-12T02:41:41.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc579965640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc574119830 con 0x7fc57410a560 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc5727fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410ae80 0x7fc5741a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc5727fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410ae80 0x7fc5741a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43500/0 (socket says 172.21.15.100:43500) 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc5727fc640 1 -- 172.21.15.100:0/3473955583 learned_addr learned my addr 172.21.15.100:0/3473955583 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.830+0000 7fc572ffd640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57410a560 0x7fc5741a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc5737fe640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc574113940 0x7fc5741acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc572ffd640 1 -- 172.21.15.100:0/3473955583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc574113940 msgr2=0x7fc5741acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc572ffd640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc574113940 0x7fc5741acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc572ffd640 1 -- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410ae80 msgr2=0x7fc5741a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc572ffd640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410ae80 0x7fc5741a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc572ffd640 1 -- 172.21.15.100:0/3473955583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5741ad060 con 0x7fc57410a560 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc5727fc640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410ae80 0x7fc5741a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.831+0000 7fc572ffd640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57410a560 0x7fc5741a1aa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc56c02a9e0 tx=0x7fc56c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.832+0000 7fc578963640 1 -- 172.21.15.100:0/3473955583 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c03f070 con 0x7fc57410a560 2024-09-12T02:41:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.832+0000 7fc578963640 1 -- 172.21.15.100:0/3473955583 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56c031c90 con 0x7fc57410a560 2024-09-12T02:41:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.832+0000 7fc578963640 1 -- 172.21.15.100:0/3473955583 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c035030 con 0x7fc57410a560 2024-09-12T02:41:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.832+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5741ad230 con 0x7fc57410a560 2024-09-12T02:41:41.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.832+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5741ad630 con 0x7fc57410a560 2024-09-12T02:41:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.836+0000 7fc578963640 1 -- 172.21.15.100:0/3473955583 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fc56c042070 con 0x7fc57410a560 2024-09-12T02:41:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 Processor -- start 2024-09-12T02:41:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 -- start start 2024-09-12T02:41:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb265a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 0x55ebb2655d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2661c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ebb25ba2e0 con 0x55ebb26562d0 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ebb2561ce0 con 0x55ebb2659d70 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ebb25b62a0 con 0x55ebb2655950 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb265a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb265a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44852/0 (socket says 172.21.15.100:44852) 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.837+0000 7fc5737fe640 1 -- 172.21.15.100:0/4060570604 learned_addr learned my addr 172.21.15.100:0/4060570604 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5727fc640 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2661c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5737fe640 1 -- 172.21.15.100:0/4060570604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 msgr2=0x55ebb2655d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5737fe640 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 0x55ebb2655d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5737fe640 1 -- 172.21.15.100:0/4060570604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 msgr2=0x55ebb2661c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5737fe640 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2661c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5737fe640 1 -- 172.21.15.100:0/4060570604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebb2546440 con 0x55ebb2659d70 2024-09-12T02:41:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5727fc640 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2661c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:41.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc578963640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc55c0ab520 0x7fc55c0ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc5737fe640 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb265a150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc564009f50 tx=0x7fc5640118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47ad2715d30e9cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc559ffb640 1 -- 172.21.15.100:0/4060570604 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564004b20 con 0x55ebb2659d70 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc559ffb640 1 -- 172.21.15.100:0/4060570604 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564003e50 con 0x55ebb2659d70 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc559ffb640 1 -- 172.21.15.100:0/4060570604 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56400f540 con 0x55ebb2659d70 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.838+0000 7fc572ffd640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc55c0ab520 0x7fc55c0ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.839+0000 7fc57bd3e740 1 -- 172.21.15.100:0/4060570604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 msgr2=0x55ebb265a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.839+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb265a150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc564009f50 tx=0x7fc5640118d0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.839+0000 7fc578963640 1 -- 172.21.15.100:0/3473955583 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc56c0ef9a0 con 0x7fc57410a560 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc572ffd640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc55c0ab520 0x7fc55c0ad9e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0c48d0 tx=0x7fc56c03b720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 -- 172.21.15.100:0/4060570604 shutdown_connections 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2661c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 0x55ebb2655d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/4060570604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb265a150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 -- 172.21.15.100:0/4060570604 >> 172.21.15.100:0/4060570604 conn(0x55ebb2650ca0 msgr2=0x55ebb2653090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 -- 172.21.15.100:0/4060570604 shutdown_connections 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 -- 172.21.15.100:0/4060570604 wait complete. 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.840+0000 7fc57bd3e740 1 -- start start 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 1 Processor -- start 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2655950 0x55ebb2661b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb26562d0 0x55ebb265edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2659d70 0x55ebb265f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ebb26622f0 con 0x55ebb2659d70 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ebb2575050 con 0x55ebb2655950 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ebb2662470 con 0x55ebb26562d0 2024-09-12T02:41:41.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc57bd3e740 10 client.0 _ll_register_callbacks cb 0x55ebb25b5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2659d70 0x55ebb265f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2659d70 0x55ebb265f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43518/0 (socket says 172.21.15.100:43518) 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 -- 172.21.15.100:0/471248402 learned_addr learned my addr 172.21.15.100:0/471248402 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2655950 0x55ebb2661b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5727fc640 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb26562d0 0x55ebb265edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 -- 172.21.15.100:0/471248402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb26562d0 msgr2=0x55ebb265edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb26562d0 0x55ebb265edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 -- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2655950 msgr2=0x55ebb2661b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2655950 0x55ebb2661b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.841+0000 7fc5737fe640 1 -- 172.21.15.100:0/471248402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebb232b3c0 con 0x55ebb2659d70 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.842+0000 7fc5737fe640 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2659d70 0x55ebb265f2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc564009250 tx=0x7fc564004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7d8f188685a8f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.842+0000 7fc552ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:41:41.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.842+0000 7fc552ffd640 1 -- 172.21.15.100:0/471248402 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564004b00 con 0x55ebb2659d70 2024-09-12T02:41:41.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.843+0000 7fc552ffd640 1 -- 172.21.15.100:0/471248402 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc564016040 con 0x55ebb2659d70 2024-09-12T02:41:41.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.843+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc564003e50 con 0x55ebb2659d70 2024-09-12T02:41:41.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.843+0000 7fc552ffd640 1 -- 172.21.15.100:0/471248402 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc564004ca0 con 0x55ebb2659d70 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.843+0000 7fc57bd3e740 10 client.15909 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.843+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ebb266dcb0 con 0x55ebb2659d70 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.843+0000 7fc552ffd640 1 -- 172.21.15.100:0/471248402 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564003e50 con 0x55ebb2659d70 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.843+0000 7fc552ffd640 1 -- 172.21.15.100:0/471248402 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc564028560 con 0x55ebb2659d70 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.844+0000 7fc57bd3e740 10 client.15909 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.844+0000 7fc57bd3e740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.844+0000 7fc57bd3e740 20 client.15909 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.844+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb266f000 0x55ebb26713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.844+0000 7fc57bd3e740 4 client.15909 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.844+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebb25c7850 con 0x55ebb266f000 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.845+0000 7fc5727fc640 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb266f000 0x55ebb26713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.845+0000 7fc552ffd640 10 client.15909 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.845+0000 7fc5727fc640 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb266f000 0x55ebb26713f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a55736ceec447ba0 server_cookie=a355844b796d950e in_seq=0 out_seq=0 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc552ffd640 1 -- 172.21.15.100:0/471248402 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebb25c7850 con 0x55ebb266f000 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc552ffd640 10 client.15909 handle_command_reply: tid=0 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 client.15909 shutdown 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2659d70 msgr2=0x55ebb265f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2659d70 0x55ebb265f2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc564009250 tx=0x7fc564004470 comp rx=0 tx=0).stop 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 shutdown_connections 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb266f000 0x55ebb26713f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2659d70 0x55ebb265f2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb26562d0 0x55ebb265edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/471248402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2655950 0x55ebb2661b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 >> 172.21.15.100:0/471248402 conn(0x55ebb2650ca0 msgr2=0x55ebb2653090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc552ffd640 0 client.15909 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 shutdown_connections 2024-09-12T02:41:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 1 -- 172.21.15.100:0/471248402 wait complete. 2024-09-12T02:41:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.846+0000 7fc57bd3e740 20 client.15909 trim_cache size 0 max 16384 2024-09-12T02:41:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 Processor -- start 2024-09-12T02:41:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 -- start start 2024-09-12T02:41:41.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2655950 0x55ebb266b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb26562d0 0x55ebb2660610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2659d70 0x55ebb2660b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741b65b0 con 0x55ebb2655950 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741b3e80 con 0x55ebb26562d0 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741b1cd0 con 0x55ebb2659d70 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2655950 0x55ebb266b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc5727fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb26562d0 0x55ebb2660610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc5727fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb26562d0 0x55ebb2660610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44870/0 (socket says 172.21.15.100:44870) 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2655950 0x55ebb266b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43526/0 (socket says 172.21.15.100:43526) 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.872+0000 7fc5727fc640 1 -- 172.21.15.100:0/2300065199 learned_addr learned my addr 172.21.15.100:0/2300065199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5737fe640 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2659d70 0x55ebb2660b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5727fc640 1 -- 172.21.15.100:0/2300065199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2659d70 msgr2=0x55ebb2660b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5727fc640 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2659d70 0x55ebb2660b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5727fc640 1 -- 172.21.15.100:0/2300065199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2655950 msgr2=0x55ebb266b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5727fc640 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2655950 0x55ebb266b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5727fc640 1 -- 172.21.15.100:0/2300065199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebb2650980 con 0x55ebb26562d0 2024-09-12T02:41:41.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5727fc640 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb26562d0 0x55ebb2660610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ebb265e640 tx=0x7fc568015b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1f8718093e95afb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5597fa640 1 -- 172.21.15.100:0/2300065199 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568023030 con 0x55ebb26562d0 2024-09-12T02:41:41.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5597fa640 1 -- 172.21.15.100:0/2300065199 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5680155b0 con 0x55ebb26562d0 2024-09-12T02:41:41.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.873+0000 7fc5597fa640 1 -- 172.21.15.100:0/2300065199 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568005280 con 0x55ebb26562d0 2024-09-12T02:41:41.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.874+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2300065199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb26562d0 msgr2=0x55ebb2660610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.874+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb26562d0 0x55ebb2660610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ebb265e640 tx=0x7fc568015b50 comp rx=0 tx=0).stop 2024-09-12T02:41:41.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.874+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2300065199 shutdown_connections 2024-09-12T02:41:41.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.874+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2659d70 0x55ebb2660b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.874+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb26562d0 0x55ebb2660610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.874+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2300065199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb2655950 0x55ebb266b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.874+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2300065199 >> 172.21.15.100:0/2300065199 conn(0x55ebb2650ca0 msgr2=0x55ebb265d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.875+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2300065199 shutdown_connections 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.875+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2300065199 wait complete. 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.875+0000 7fc57bd3e740 1 -- start start 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.875+0000 7fc57bd3e740 1 Processor -- start 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 0x55ebb2667ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2668010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc57bd3e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb2676260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741b2340 con 0x55ebb26562d0 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741b37b0 con 0x55ebb2659d70 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc57bd3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741b2a10 con 0x55ebb2655950 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc57bd3e740 10 client.0 _ll_register_callbacks cb 0x7fc564009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 0x55ebb2667ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5727fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2668010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb2676260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5727fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2668010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43530/0 (socket says 172.21.15.100:43530) 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5727fc640 1 -- 172.21.15.100:0/2597876657 learned_addr learned my addr 172.21.15.100:0/2597876657 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb2676260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44882/0 (socket says 172.21.15.100:44882) 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 -- 172.21.15.100:0/2597876657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 msgr2=0x55ebb2667ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 0x55ebb2667ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 -- 172.21.15.100:0/2597876657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 msgr2=0x55ebb2668010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2668010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 -- 172.21.15.100:0/2597876657 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebb2676a90 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc5737fe640 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb2676260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc564028980 tx=0x7fc564009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b84e9dc7818d3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.876+0000 7fc552ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc552ffd640 1 -- 172.21.15.100:0/2597876657 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564028d70 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc552ffd640 1 -- 172.21.15.100:0/2597876657 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc564028450 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5680155b0 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc552ffd640 1 -- 172.21.15.100:0/2597876657 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc564028650 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 10 client.25355 fetch_fsmap learned FSMap version 27 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ebb26d9750 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc552ffd640 1 -- 172.21.15.100:0/2597876657 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56402d070 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc552ffd640 1 -- 172.21.15.100:0/2597876657 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc56404a050 con 0x55ebb2659d70 2024-09-12T02:41:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 10 client.25355 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 10 client.25355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 20 client.25355 populate_metadata read hostname 'smithi100' 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb26d9dc0 0x55ebb26dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 4 client.25355 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc5680155b0 con 0x55ebb26d9dc0 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.877+0000 7fc5727fc640 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb26d9dc0 0x55ebb26dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc552ffd640 10 client.25355 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc5727fc640 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb26d9dc0 0x55ebb26dc1e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85a03e95a05aec53 server_cookie=8a19572ae2f151a in_seq=0 out_seq=0 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc552ffd640 1 -- 172.21.15.100:0/2597876657 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fc5680155b0 con 0x55ebb26d9dc0 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc552ffd640 10 client.25355 handle_command_reply: tid=0 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 client.25355 shutdown 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 msgr2=0x55ebb2676260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb2676260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc564028980 tx=0x7fc564009b30 comp rx=0 tx=0).stop 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 shutdown_connections 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ebb26d9dc0 0x55ebb26dc1e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebb2659d70 0x55ebb2676260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebb26562d0 0x55ebb2668010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 --2- 172.21.15.100:0/2597876657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebb2655950 0x55ebb2667ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 >> 172.21.15.100:0/2597876657 conn(0x55ebb2650ca0 msgr2=0x55ebb2660610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc552ffd640 0 client.25355 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 shutdown_connections 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.878+0000 7fc57bd3e740 1 -- 172.21.15.100:0/2597876657 wait complete. 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.879+0000 7fc57bd3e740 20 client.25355 trim_cache size 0 max 16384 2024-09-12T02:41:41.884 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: "b057f7ab-38ca-4a8b-a320-c223b8b1bbb8": { 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "b057f7ab-38ca-4a8b-a320-c223b8b1bbb8", 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:41:41.885 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc55c0ab520 msgr2=0x7fc55c0ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc55c0ab520 0x7fc55c0ad9e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0c48d0 tx=0x7fc56c03b720 comp rx=0 tx=0).stop 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57410a560 msgr2=0x7fc5741a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57410a560 0x7fc5741a1aa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc56c02a9e0 tx=0x7fc56c003b90 comp rx=0 tx=0).stop 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 shutdown_connections 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc55c0ab520 0x7fc55c0ad9e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc574113940 0x7fc5741acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc57410ae80 0x7fc5741a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 --2- 172.21.15.100:0/3473955583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57410a560 0x7fc5741a1aa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.880+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 >> 172.21.15.100:0/3473955583 conn(0x7fc57406e140 msgr2=0x7fc5740708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.881+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 shutdown_connections 2024-09-12T02:41:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:41:41.881+0000 7fc579965640 1 -- 172.21.15.100:0/3473955583 wait complete. 2024-09-12T02:41:42.831 INFO:tasks.cephfs.filesystem:scrub status for tag:b057f7ab-38ca-4a8b-a320-c223b8b1bbb8 - {'path': '/', 'tag': 'b057f7ab-38ca-4a8b-a320-c223b8b1bbb8', 'options': 'recursive,force'} 2024-09-12T02:41:43.006 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:42 smithi100 ceph-mon[31390]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-12T02:41:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:42 smithi189 ceph-mon[35196]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-12T02:41:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:42 smithi117 ceph-mon[34898]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-12T02:41:43.457 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ea76450', total seconds elapsed: 30.1 2024-09-12T02:41:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:44 smithi189 ceph-mon[35196]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 131 KiB/s wr, 20 op/s 2024-09-12T02:41:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:44 smithi117 ceph-mon[34898]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 131 KiB/s wr, 20 op/s 2024-09-12T02:41:45.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:44 smithi100 ceph-mon[31390]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 131 KiB/s wr, 20 op/s 2024-09-12T02:41:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 155.0 s, 3991.0 tps, lat 129.349 ms stddev 1586.651 2024-09-12T02:41:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:46 smithi189 ceph-mon[35196]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2024-09-12T02:41:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:46 smithi117 ceph-mon[34898]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2024-09-12T02:41:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:46 smithi100 ceph-mon[31390]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2024-09-12T02:41:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:48 smithi189 ceph-mon[35196]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-09-12T02:41:49.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:48 smithi117 ceph-mon[34898]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-09-12T02:41:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:48 smithi100 ceph-mon[31390]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-09-12T02:41:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:49 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:41:50.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:49 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:41:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:49 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:41:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:50 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:41:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:50 smithi117 ceph-mon[34898]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.9 MiB/s wr, 441 op/s 2024-09-12T02:41:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:50 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:41:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:50 smithi100 ceph-mon[31390]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.9 MiB/s wr, 441 op/s 2024-09-12T02:41:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:50 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:41:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:50 smithi189 ceph-mon[35196]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.9 MiB/s wr, 441 op/s 2024-09-12T02:41:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 160.0 s, 3494.6 tps, lat 28.542 ms stddev 28.261 2024-09-12T02:41:52.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:51 smithi117 ceph-mon[34898]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.2 MiB/s wr, 576 op/s 2024-09-12T02:41:52.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:51 smithi100 ceph-mon[31390]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.2 MiB/s wr, 576 op/s 2024-09-12T02:41:52.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:51 smithi189 ceph-mon[35196]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.2 MiB/s wr, 576 op/s 2024-09-12T02:41:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:54 smithi189 ceph-mon[35196]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.6 MiB/s wr, 700 op/s 2024-09-12T02:41:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:54 smithi117 ceph-mon[34898]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.6 MiB/s wr, 700 op/s 2024-09-12T02:41:55.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:54 smithi100 ceph-mon[31390]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.6 MiB/s wr, 700 op/s 2024-09-12T02:41:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 165.0 s, 3515.6 tps, lat 28.435 ms stddev 29.352 2024-09-12T02:41:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:56 smithi189 ceph-mon[35196]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 10 MiB/s wr, 750 op/s 2024-09-12T02:41:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:56 smithi117 ceph-mon[34898]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 10 MiB/s wr, 750 op/s 2024-09-12T02:41:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:56 smithi100 ceph-mon[31390]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 10 MiB/s wr, 750 op/s 2024-09-12T02:41:59.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:41:58 smithi189 ceph-mon[35196]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-12T02:41:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:41:58 smithi117 ceph-mon[34898]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-12T02:41:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:41:58 smithi100 ceph-mon[31390]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-12T02:42:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:00 smithi189 ceph-mon[35196]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 788 op/s 2024-09-12T02:42:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:42:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:00 smithi117 ceph-mon[34898]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 788 op/s 2024-09-12T02:42:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:42:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:00 smithi100 ceph-mon[31390]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 788 op/s 2024-09-12T02:42:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:01.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:01.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:42:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 170.0 s, 3356.4 tps, lat 29.682 ms stddev 29.772 2024-09-12T02:42:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:02 smithi189 ceph-mon[35196]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.0 MiB/s wr, 706 op/s 2024-09-12T02:42:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:02 smithi117 ceph-mon[34898]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.0 MiB/s wr, 706 op/s 2024-09-12T02:42:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:02 smithi100 ceph-mon[31390]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.0 MiB/s wr, 706 op/s 2024-09-12T02:42:05.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:04 smithi189 ceph-mon[35196]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.7 MiB/s wr, 656 op/s 2024-09-12T02:42:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:04 smithi117 ceph-mon[34898]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.7 MiB/s wr, 656 op/s 2024-09-12T02:42:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:04 smithi100 ceph-mon[31390]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.7 MiB/s wr, 656 op/s 2024-09-12T02:42:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 175.0 s, 3380.0 tps, lat 29.724 ms stddev 31.420 2024-09-12T02:42:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:06 smithi189 ceph-mon[35196]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 MiB/s wr, 667 op/s 2024-09-12T02:42:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:06 smithi117 ceph-mon[34898]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 MiB/s wr, 667 op/s 2024-09-12T02:42:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:06 smithi100 ceph-mon[31390]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 MiB/s wr, 667 op/s 2024-09-12T02:42:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:08 smithi189 ceph-mon[35196]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.4 MiB/s wr, 765 op/s 2024-09-12T02:42:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:08 smithi117 ceph-mon[34898]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.4 MiB/s wr, 765 op/s 2024-09-12T02:42:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:08 smithi100 ceph-mon[31390]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.4 MiB/s wr, 765 op/s 2024-09-12T02:42:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:10 smithi189 ceph-mon[35196]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-12T02:42:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:10 smithi117 ceph-mon[34898]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-12T02:42:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:10 smithi100 ceph-mon[31390]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-12T02:42:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 180.0 s, 3426.2 tps, lat 29.198 ms stddev 31.888 2024-09-12T02:42:12.833 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:42:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:12 smithi189 ceph-mon[35196]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.2 MiB/s wr, 799 op/s 2024-09-12T02:42:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:12 smithi117 ceph-mon[34898]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.2 MiB/s wr, 799 op/s 2024-09-12T02:42:13.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:12 smithi100 ceph-mon[31390]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.2 MiB/s wr, 799 op/s 2024-09-12T02:42:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:13.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.779+0000 7fb3cddff640 1 -- 172.21.15.100:0/3003472788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 msgr2=0x7fb3c8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.779+0000 7fb3cddff640 1 --2- 172.21.15.100:0/3003472788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c8108830 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009900 tx=0x7fb3b802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.779+0000 7fb3cddff640 1 -- 172.21.15.100:0/3003472788 shutdown_connections 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.779+0000 7fb3cddff640 1 --2- 172.21.15.100:0/3003472788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c810d530 0x7fb3c81150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.779+0000 7fb3cddff640 1 --2- 172.21.15.100:0/3003472788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3c8108e00 0x7fb3c810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.779+0000 7fb3cddff640 1 --2- 172.21.15.100:0/3003472788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c8108830 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.779+0000 7fb3cddff640 1 -- 172.21.15.100:0/3003472788 >> 172.21.15.100:0/3003472788 conn(0x7fb3c8077ba0 msgr2=0x7fb3c8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.780+0000 7fb3cddff640 1 -- 172.21.15.100:0/3003472788 shutdown_connections 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.780+0000 7fb3cddff640 1 -- 172.21.15.100:0/3003472788 wait complete. 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.780+0000 7fb3cddff640 1 Processor -- start 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.780+0000 7fb3cddff640 1 -- start start 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3cddff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c81a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3cddff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3c8108e00 0x7fb3c81a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3cddff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c810d530 0x7fb3c819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3cddff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8118580 con 0x7fb3c8108450 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3cddff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8118400 con 0x7fb3c810d530 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3cddff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8118700 con 0x7fb3c8108e00 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c81a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3c8108e00 0x7fb3c81a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c81a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45300/0 (socket says 172.21.15.100:45300) 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c77fe640 1 -- 172.21.15.100:0/2940111670 learned_addr learned my addr 172.21.15.100:0/2940111670 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c810d530 0x7fb3c819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c6ffd640 1 -- 172.21.15.100:0/2940111670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c810d530 msgr2=0x7fb3c819e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c810d530 0x7fb3c819e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c6ffd640 1 -- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 msgr2=0x7fb3c81a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c81a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c6ffd640 1 -- 172.21.15.100:0/2940111670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c819efd0 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c81a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.781+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3c8108e00 0x7fb3c81a4bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc005fd0 tx=0x7fb3bc00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.782+0000 7fb3c4ff9640 1 -- 172.21.15.100:0/2940111670 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc009c30 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.782+0000 7fb3c4ff9640 1 -- 172.21.15.100:0/2940111670 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3bc009dd0 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.782+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c819f2c0 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.782+0000 7fb3c4ff9640 1 -- 172.21.15.100:0/2940111670 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc010460 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.782+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c81ab510 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.785+0000 7fb3c4ff9640 1 -- 172.21.15.100:0/2940111670 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb3bc003f50 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.785+0000 7fb3c4ff9640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb3b00a2c00 0x7fb3b00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.786+0000 7fb3c4ff9640 1 -- 172.21.15.100:0/2940111670 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb3bc0ceec0 con 0x7fb3c8108e00 2024-09-12T02:42:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.786+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb3b00a2c00 0x7fb3b00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 Processor -- start 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 -- start start 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e83880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e90a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c901de92e0 con 0x55c901e834a0 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c901d90ce0 con 0x55c901e8e680 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c901de52a0 con 0x55c901e83dc0 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e83880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e90a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e83880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45306/0 (socket says 172.21.15.100:45306) 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e90a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56728/0 (socket says 172.21.15.100:56728) 2024-09-12T02:42:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c77fe640 1 -- 172.21.15.100:0/3208451458 learned_addr learned my addr 172.21.15.100:0/3208451458 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb3b00a2c00 0x7fb3b00a50c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80096c0 tx=0x7fb3b80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c7fff640 1 -- 172.21.15.100:0/3208451458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 msgr2=0x55c901e8e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c7fff640 1 -- 172.21.15.100:0/3208451458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 msgr2=0x55c901e83880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e83880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.787+0000 7fb3c7fff640 1 -- 172.21.15.100:0/3208451458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c901d75440 con 0x55c901e8e680 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.788+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e90a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009ea0 tx=0x7fb3c0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4efd26305fec3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.788+0000 7fb3adffb640 1 -- 172.21.15.100:0/3208451458 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0016070 con 0x55c901e8e680 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.788+0000 7fb3adffb640 1 -- 172.21.15.100:0/3208451458 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c0004d20 con 0x55c901e8e680 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.788+0000 7fb3adffb640 1 -- 172.21.15.100:0/3208451458 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0012850 con 0x55c901e8e680 2024-09-12T02:42:13.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.788+0000 7fb3d01d8740 1 -- 172.21.15.100:0/3208451458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 msgr2=0x55c901e90a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.788+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e90a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009ea0 tx=0x7fb3c0009f90 comp rx=0 tx=0).stop 2024-09-12T02:42:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.788+0000 7fb3d01d8740 1 -- 172.21.15.100:0/3208451458 shutdown_connections 2024-09-12T02:42:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e90a70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/3208451458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e83880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 -- 172.21.15.100:0/3208451458 >> 172.21.15.100:0/3208451458 conn(0x55c901e7fa30 msgr2=0x55c901e7fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 -- 172.21.15.100:0/3208451458 shutdown_connections 2024-09-12T02:42:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 -- 172.21.15.100:0/3208451458 wait complete. 2024-09-12T02:42:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 -- start start 2024-09-12T02:42:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.789+0000 7fb3d01d8740 1 Processor -- start 2024-09-12T02:42:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e8df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e8b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c901e91250 con 0x55c901e834a0 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c901da4050 con 0x55c901e8e680 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c901e913d0 con 0x55c901e83dc0 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3d01d8740 10 client.0 _ll_register_callbacks cb 0x55c901de4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3c6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3c6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:34430/0 (socket says 172.21.15.100:34430) 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.790+0000 7fb3c6ffd640 1 -- 172.21.15.100:0/2867179051 learned_addr learned my addr 172.21.15.100:0/2867179051 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e8b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c6ffd640 1 -- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 msgr2=0x55c901e8b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e8b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c6ffd640 1 -- 172.21.15.100:0/2867179051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 msgr2=0x55c901e8df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e8df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c6ffd640 1 -- 172.21.15.100:0/2867179051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c901b5a3c0 con 0x55c901e83dc0 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e8b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8b200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc09b6f0 tx=0x7fb3bc09b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=544fbc3b2c5ff722 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/2867179051 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc020040 con 0x55c901e83dc0 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/2867179051 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb3bc0035f0 con 0x55c901e83dc0 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3c0004d20 con 0x55c901e83dc0 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.791+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/2867179051 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb3bc097dd0 con 0x55c901e83dc0 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 10 client.25351 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c901e9cc00 con 0x55c901e83dc0 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/2867179051 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c0004d20 con 0x55c901e83dc0 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/2867179051 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb3bc0bb040 con 0x55c901e83dc0 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 10 client.25351 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 10 client.25351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 20 client.25351 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e9e110 0x55c901ea0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 4 client.25351 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.792+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c901df6850 con 0x55c901e9e110 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.793+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e9e110 0x55c901ea0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.793+0000 7fb3a6ffd640 10 client.25351 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.794+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e9e110 0x55c901ea0580 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9820e4de4ea26b68 server_cookie=9d1b8537ff2296e2 in_seq=0 out_seq=0 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.795+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/2867179051 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c901df6850 con 0x55c901e9e110 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.795+0000 7fb3a6ffd640 10 client.25351 handle_command_reply: tid=0 2024-09-12T02:42:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.795+0000 7fb3d01d8740 1 client.25351 shutdown 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.795+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 msgr2=0x55c901e8b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.795+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8b200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc09b6f0 tx=0x7fb3bc09b760 comp rx=0 tx=0).stop 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.795+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 shutdown_connections 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.795+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e9e110 0x55c901ea0580 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e8e680 0x55c901e8b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3a6ffd640 0 client.25351 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e83dc0 0x55c901e8b200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/2867179051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e834a0 0x55c901e8df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 >> 172.21.15.100:0/2867179051 conn(0x55c901e7fa30 msgr2=0x55c901e85760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 shutdown_connections 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3d01d8740 1 -- 172.21.15.100:0/2867179051 wait complete. 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.796+0000 7fb3d01d8740 20 client.25351 trim_cache size 0 max 16384 2024-09-12T02:42:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 Processor -- start 2024-09-12T02:42:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 -- start start 2024-09-12T02:42:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e7fa30 0x55c901e9a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e834a0 0x55c901ea5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e83dc0 0x55c901ea6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81b6540 con 0x55c901e83dc0 2024-09-12T02:42:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81b3e10 con 0x55c901e834a0 2024-09-12T02:42:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81b1c60 con 0x55c901e7fa30 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e83dc0 0x55c901ea6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e83dc0 0x55c901ea6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45334/0 (socket says 172.21.15.100:45334) 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e834a0 0x55c901ea5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c7fff640 1 -- 172.21.15.100:0/713968207 learned_addr learned my addr 172.21.15.100:0/713968207 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e7fa30 0x55c901e9a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c7fff640 1 -- 172.21.15.100:0/713968207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e7fa30 msgr2=0x55c901e9a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e7fa30 0x55c901e9a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c7fff640 1 -- 172.21.15.100:0/713968207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e834a0 msgr2=0x55c901ea5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.818+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e834a0 0x55c901ea5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.819+0000 7fb3c7fff640 1 -- 172.21.15.100:0/713968207 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c901e8e2c0 con 0x55c901e83dc0 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.819+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e834a0 0x55c901ea5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.819+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e83dc0 0x55c901ea6390 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0000f80 tx=0x7fb3c0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a97176660d8438 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.819+0000 7fb3ad7fa640 1 -- 172.21.15.100:0/713968207 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0016050 con 0x55c901e83dc0 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.819+0000 7fb3ad7fa640 1 -- 172.21.15.100:0/713968207 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c0003e50 con 0x55c901e83dc0 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.819+0000 7fb3ad7fa640 1 -- 172.21.15.100:0/713968207 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0012450 con 0x55c901e83dc0 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.820+0000 7fb3d01d8740 1 -- 172.21.15.100:0/713968207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e83dc0 msgr2=0x55c901ea6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.820+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e83dc0 0x55c901ea6390 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0000f80 tx=0x7fb3c0005bd0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.820+0000 7fb3d01d8740 1 -- 172.21.15.100:0/713968207 shutdown_connections 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.820+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e83dc0 0x55c901ea6390 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.820+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e834a0 0x55c901ea5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.820+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/713968207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e7fa30 0x55c901e9a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.820+0000 7fb3d01d8740 1 -- 172.21.15.100:0/713968207 >> 172.21.15.100:0/713968207 conn(0x55c901e8b8a0 msgr2=0x55c901e89af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.821+0000 7fb3d01d8740 1 -- 172.21.15.100:0/713968207 shutdown_connections 2024-09-12T02:42:13.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.821+0000 7fb3d01d8740 1 -- 172.21.15.100:0/713968207 wait complete. 2024-09-12T02:42:13.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 -- start start 2024-09-12T02:42:13.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 Processor -- start 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e7fa30 0x55c901e88260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e834a0 0x55c901e887a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e83dc0 0x55c901e88ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81b22d0 con 0x55c901e7fa30 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81b3740 con 0x55c901e83dc0 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81b29a0 con 0x55c901e834a0 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3d01d8740 10 client.0 _ll_register_callbacks cb 0x7fb3bc09b5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e7fa30 0x55c901e88260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.822+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e83dc0 0x55c901e88ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e83dc0 0x55c901e88ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56754/0 (socket says 172.21.15.100:56754) 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 -- 172.21.15.100:0/1140726053 learned_addr learned my addr 172.21.15.100:0/1140726053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c6ffd640 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e834a0 0x55c901e887a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 -- 172.21.15.100:0/1140726053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e834a0 msgr2=0x55c901e887a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e834a0 0x55c901e887a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 -- 172.21.15.100:0/1140726053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e7fa30 msgr2=0x55c901e88260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e7fa30 0x55c901e88260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 -- 172.21.15.100:0/1140726053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c901f07e70 con 0x55c901e83dc0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3c7fff640 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e83dc0 0x55c901e88ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0003e20 tx=0x7fb3c0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1614c829846f70cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/1140726053 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0005590 con 0x55c901e83dc0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/1140726053 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb3c0005730 con 0x55c901e83dc0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3c0003e50 con 0x55c901e83dc0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/1140726053 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb3c0005930 con 0x55c901e83dc0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3d01d8740 10 client.25370 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.823+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c901f09160 con 0x55c901e83dc0 2024-09-12T02:42:13.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/1140726053 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c0003e50 con 0x55c901e83dc0 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/1140726053 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb3c000f040 con 0x55c901e83dc0 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3d01d8740 10 client.25370 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3d01d8740 10 client.25370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3d01d8740 20 client.25370 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e8e680 0x55c901f0b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3d01d8740 4 client.25370 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c901df0d60 con 0x55c901e8e680 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e8e680 0x55c901f0b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3c77fe640 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e8e680 0x55c901f0b630 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33188d1c55505fc server_cookie=6e167ed9556bb08a in_seq=0 out_seq=0 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.824+0000 7fb3a6ffd640 10 client.25370 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3a6ffd640 1 -- 172.21.15.100:0/1140726053 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c901df0d60 con 0x55c901e8e680 2024-09-12T02:42:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3a6ffd640 10 client.25370 handle_command_reply: tid=0 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 client.25370 shutdown 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e83dc0 msgr2=0x55c901e88ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e83dc0 0x55c901e88ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0003e20 tx=0x7fb3c0009f90 comp rx=0 tx=0).stop 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 shutdown_connections 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c901e8e680 0x55c901f0b630 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3a6ffd640 0 client.25370 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c901e83dc0 0x55c901e88ce0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c901e834a0 0x55c901e887a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 --2- 172.21.15.100:0/1140726053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c901e7fa30 0x55c901e88260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 >> 172.21.15.100:0/1140726053 conn(0x55c901e8b8a0 msgr2=0x55c901e8d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.825+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 shutdown_connections 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3d01d8740 1 -- 172.21.15.100:0/1140726053 wait complete. 2024-09-12T02:42:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3d01d8740 20 client.25370 trim_cache size 0 max 16384 2024-09-12T02:42:13.847 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:42:13.847 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:42:13.847 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:42:13.847 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:42:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb3b00a2c00 msgr2=0x7fb3b00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb3b00a2c00 0x7fb3b00a50c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80096c0 tx=0x7fb3b80046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3c8108e00 msgr2=0x7fb3c81a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3c8108e00 0x7fb3c81a4bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc005fd0 tx=0x7fb3bc00dde0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 shutdown_connections 2024-09-12T02:42:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb3b00a2c00 0x7fb3b00a50c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c810d530 0x7fb3c819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.826+0000 7fb3cddff640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3c8108e00 0x7fb3c81a4bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.827+0000 7fb3cddff640 1 --2- 172.21.15.100:0/2940111670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c8108450 0x7fb3c81a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.827+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 >> 172.21.15.100:0/2940111670 conn(0x7fb3c8077ba0 msgr2=0x7fb3c8078e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.827+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 shutdown_connections 2024-09-12T02:42:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:13.827+0000 7fb3cddff640 1 -- 172.21.15.100:0/2940111670 wait complete. 2024-09-12T02:42:14.744 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:42:14.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:42:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:14 smithi189 ceph-mon[35196]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.4 MiB/s wr, 783 op/s 2024-09-12T02:42:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:14 smithi117 ceph-mon[34898]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.4 MiB/s wr, 783 op/s 2024-09-12T02:42:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:14 smithi100 ceph-mon[31390]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.4 MiB/s wr, 783 op/s 2024-09-12T02:42:15.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.686+0000 7f1536e9b640 1 -- 172.21.15.100:0/2004003643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 msgr2=0x7f1530100f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.686+0000 7f1536e9b640 1 --2- 172.21.15.100:0/2004003643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 0x7f1530100f20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1524009900 tx=0x7f152402a490 comp rx=0 tx=0).stop 2024-09-12T02:42:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.690+0000 7f1536e9b640 1 -- 172.21.15.100:0/2004003643 shutdown_connections 2024-09-12T02:42:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.690+0000 7f1536e9b640 1 --2- 172.21.15.100:0/2004003643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1530105f50 0x7f15301063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.690+0000 7f1536e9b640 1 --2- 172.21.15.100:0/2004003643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1530101460 0x7f1530105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.690+0000 7f1536e9b640 1 --2- 172.21.15.100:0/2004003643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 0x7f1530100f20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.690+0000 7f1536e9b640 1 -- 172.21.15.100:0/2004003643 >> 172.21.15.100:0/2004003643 conn(0x7f15300fc7d0 msgr2=0x7f15300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.690+0000 7f1536e9b640 1 -- 172.21.15.100:0/2004003643 shutdown_connections 2024-09-12T02:42:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.690+0000 7f1536e9b640 1 -- 172.21.15.100:0/2004003643 wait complete. 2024-09-12T02:42:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.691+0000 7f1536e9b640 1 Processor -- start 2024-09-12T02:42:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.691+0000 7f1536e9b640 1 -- start start 2024-09-12T02:42:15.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.691+0000 7f1536e9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 0x7f153006e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.691+0000 7f1536e9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1530101460 0x7f153006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f1536e9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1530105f50 0x7f153006eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f1536e9b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f153006cb70 con 0x7f1530100b40 2024-09-12T02:42:15.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f1536e9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f153006c9f0 con 0x7f1530105f50 2024-09-12T02:42:15.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f1536e9b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f153006ccf0 con 0x7f1530101460 2024-09-12T02:42:15.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f152ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1530101460 0x7f153006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f152ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1530101460 0x7f153006e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37344/0 (socket says 172.21.15.100:37344) 2024-09-12T02:42:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f152ffff640 1 -- 172.21.15.100:0/1799214848 learned_addr learned my addr 172.21.15.100:0/1799214848 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:15.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.692+0000 7f1535438640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1530105f50 0x7f153006eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.693+0000 7f1534c37640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 0x7f153006e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.695+0000 7f1535438640 1 -- 172.21.15.100:0/1799214848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1530101460 msgr2=0x7f153006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.695+0000 7f1535438640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1530101460 0x7f153006e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.695+0000 7f1535438640 1 -- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 msgr2=0x7f153006e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.695+0000 7f1535438640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 0x7f153006e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.695+0000 7f1535438640 1 -- 172.21.15.100:0/1799214848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15301b3530 con 0x7f1530105f50 2024-09-12T02:42:15.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.695+0000 7f1535438640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1530105f50 0x7f153006eb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f152000d6b0 tx=0x7f152000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:15.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.696+0000 7f152dffb640 1 -- 172.21.15.100:0/1799214848 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520017070 con 0x7f1530105f50 2024-09-12T02:42:15.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.696+0000 7f152dffb640 1 -- 172.21.15.100:0/1799214848 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1520009820 con 0x7f1530105f50 2024-09-12T02:42:15.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.697+0000 7f152dffb640 1 -- 172.21.15.100:0/1799214848 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520004d00 con 0x7f1530105f50 2024-09-12T02:42:15.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.697+0000 7f1536e9b640 1 -- 172.21.15.100:0/1799214848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15301b3820 con 0x7f1530105f50 2024-09-12T02:42:15.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.697+0000 7f1536e9b640 1 -- 172.21.15.100:0/1799214848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15301b3c20 con 0x7f1530105f50 2024-09-12T02:42:15.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.699+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f153006b070 con 0x7f1530105f50 2024-09-12T02:42:15.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.701+0000 7f152dffb640 1 -- 172.21.15.100:0/1799214848 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1520005220 con 0x7f1530105f50 2024-09-12T02:42:15.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.702+0000 7f152dffb640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15180a2c00 0x7f15180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.702+0000 7f152dffb640 1 -- 172.21.15.100:0/1799214848 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f15200cea60 con 0x7f1530105f50 2024-09-12T02:42:15.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.702+0000 7f1534c37640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15180a2c00 0x7f15180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.702+0000 7f1534c37640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15180a2c00 0x7f15180a50c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f152402aa80 tx=0x7f152402a990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:15.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.707+0000 7f152dffb640 1 -- 172.21.15.100:0/1799214848 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1520020020 con 0x7f1530105f50 2024-09-12T02:42:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.997+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f153006f5d0 con 0x7f1530105f50 2024-09-12T02:42:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:15.998+0000 7f152dffb640 1 -- 172.21.15.100:0/1799214848 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f152009b9d0 con 0x7f1530105f50 2024-09-12T02:42:15.998 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:42:15.999 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:42:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:42:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15180a2c00 msgr2=0x7f15180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15180a2c00 0x7f15180a50c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f152402aa80 tx=0x7f152402a990 comp rx=0 tx=0).stop 2024-09-12T02:42:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1530105f50 msgr2=0x7f153006eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1530105f50 0x7f153006eb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f152000d6b0 tx=0x7f152000db70 comp rx=0 tx=0).stop 2024-09-12T02:42:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 shutdown_connections 2024-09-12T02:42:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15180a2c00 0x7f15180a50c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1530105f50 0x7f153006eb20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:16.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1530101460 0x7f153006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:16.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 --2- 172.21.15.100:0/1799214848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1530100b40 0x7f153006e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:16.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 >> 172.21.15.100:0/1799214848 conn(0x7f15300fc7d0 msgr2=0x7f1530103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:16.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 shutdown_connections 2024-09-12T02:42:16.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:16.001+0000 7f15177fe640 1 -- 172.21.15.100:0/1799214848 wait complete. 2024-09-12T02:42:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 185.0 s, 3618.0 tps, lat 27.601 ms stddev 29.672 2024-09-12T02:42:16.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:42:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:16 smithi189 ceph-mon[35196]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.2 MiB/s wr, 790 op/s 2024-09-12T02:42:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:16 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1799214848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:16 smithi117 ceph-mon[34898]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.2 MiB/s wr, 790 op/s 2024-09-12T02:42:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:16 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1799214848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:16 smithi100 ceph-mon[31390]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.2 MiB/s wr, 790 op/s 2024-09-12T02:42:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:16 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1799214848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.601+0000 7fd2d00b8640 1 -- 172.21.15.100:0/949051107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8103740 msgr2=0x7fd2c8107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.601+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/949051107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8103740 0x7fd2c8107b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009860 tx=0x7fd2b802a340 comp rx=0 tx=0).stop 2024-09-12T02:42:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.602+0000 7fd2d00b8640 1 -- 172.21.15.100:0/949051107 shutdown_connections 2024-09-12T02:42:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.602+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/949051107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2c8108290 0x7fd2c810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.602+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/949051107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8103740 0x7fd2c8107b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.602+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/949051107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2c8102d90 0x7fd2c8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.602+0000 7fd2d00b8640 1 -- 172.21.15.100:0/949051107 >> 172.21.15.100:0/949051107 conn(0x7fd2c80fc7d0 msgr2=0x7fd2c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.602+0000 7fd2d00b8640 1 -- 172.21.15.100:0/949051107 shutdown_connections 2024-09-12T02:42:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.602+0000 7fd2d00b8640 1 -- 172.21.15.100:0/949051107 wait complete. 2024-09-12T02:42:17.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.603+0000 7fd2d00b8640 1 Processor -- start 2024-09-12T02:42:17.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.603+0000 7fd2d00b8640 1 -- start start 2024-09-12T02:42:17.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.603+0000 7fd2d00b8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8102d90 0x7fd2c81009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.603+0000 7fd2d00b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2c8103740 0x7fd2c8100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.603+0000 7fd2d00b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2c8108290 0x7fd2c8101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2ce655640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2c8108290 0x7fd2c8101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2d00b8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c8112050 con 0x7fd2c8108290 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8102d90 0x7fd2c81009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2d00b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c8111ed0 con 0x7fd2c8103740 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2d00b8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81121d0 con 0x7fd2c8102d90 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2ce655640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2c8108290 0x7fd2c8101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49272/0 (socket says 172.21.15.100:49272) 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2ce655640 1 -- 172.21.15.100:0/1993368915 learned_addr learned my addr 172.21.15.100:0/1993368915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cd653640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2c8103740 0x7fd2c8100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cde54640 1 -- 172.21.15.100:0/1993368915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2c8103740 msgr2=0x7fd2c8100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cde54640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2c8103740 0x7fd2c8100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cde54640 1 -- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2c8108290 msgr2=0x7fd2c8101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cde54640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2c8108290 0x7fd2c8101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cde54640 1 -- 172.21.15.100:0/1993368915 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c81a6a10 con 0x7fd2c8102d90 2024-09-12T02:42:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.604+0000 7fd2cde54640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8102d90 0x7fd2c81009f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400d6d0 tx=0x7fd2c400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.605+0000 7fd2beffd640 1 -- 172.21.15.100:0/1993368915 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4017070 con 0x7fd2c8102d90 2024-09-12T02:42:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.605+0000 7fd2beffd640 1 -- 172.21.15.100:0/1993368915 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2c4010460 con 0x7fd2c8102d90 2024-09-12T02:42:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.605+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c81a6d00 con 0x7fd2c8102d90 2024-09-12T02:42:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.605+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c81a71c0 con 0x7fd2c8102d90 2024-09-12T02:42:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.605+0000 7fd2beffd640 1 -- 172.21.15.100:0/1993368915 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400f600 con 0x7fd2c8102d90 2024-09-12T02:42:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.609+0000 7fd2beffd640 1 -- 172.21.15.100:0/1993368915 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fd2c401a070 con 0x7fd2c8102d90 2024-09-12T02:42:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.609+0000 7fd2d2491740 1 Processor -- start 2024-09-12T02:42:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2d2491740 1 -- start start 2024-09-12T02:42:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2d2491740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55852a0122f0 con 0x55852a0adb40 2024-09-12T02:42:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2d2491740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558529fb9cf0 con 0x55852a0b7370 2024-09-12T02:42:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2d2491740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55852a00e2b0 con 0x55852a0ac5d0 2024-09-12T02:42:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2ce655640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2cd653640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37362/0 (socket says 172.21.15.100:37362) 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2ce655640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49278/0 (socket says 172.21.15.100:49278) 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.610+0000 7fd2cde54640 1 -- 172.21.15.100:0/944812392 learned_addr learned my addr 172.21.15.100:0/944812392 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.611+0000 7fd2cd653640 1 -- 172.21.15.100:0/944812392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 msgr2=0x55852a0aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.611+0000 7fd2cd653640 1 --2- 172.21.15.100:0/944812392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.611+0000 7fd2cd653640 1 -- 172.21.15.100:0/944812392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 msgr2=0x55852a0ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.611+0000 7fd2cd653640 1 --2- 172.21.15.100:0/944812392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.611+0000 7fd2cd653640 1 -- 172.21.15.100:0/944812392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558529f9e3a0 con 0x55852a0b7370 2024-09-12T02:42:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.611+0000 7fd2cd653640 1 --2- 172.21.15.100:0/944812392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b9760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c00 tx=0x7fd2b8030460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3fa9894a287d469 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:17.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2b3fff640 1 -- 172.21.15.100:0/944812392 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8041020 con 0x55852a0b7370 2024-09-12T02:42:17.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2b3fff640 1 -- 172.21.15.100:0/944812392 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b8038040 con 0x55852a0b7370 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2b3fff640 1 -- 172.21.15.100:0/944812392 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8037070 con 0x55852a0b7370 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2beffd640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2b40a2d50 0x7fd2b40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2ce655640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2b40a2d50 0x7fd2b40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2beffd640 1 -- 172.21.15.100:0/1993368915 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd2c40ce830 con 0x7fd2c8102d90 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2d2491740 1 -- 172.21.15.100:0/944812392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 msgr2=0x55852a0b9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.612+0000 7fd2d2491740 1 --2- 172.21.15.100:0/944812392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b9760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c00 tx=0x7fd2b8030460 comp rx=0 tx=0).stop 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 -- 172.21.15.100:0/944812392 shutdown_connections 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 --2- 172.21.15.100:0/944812392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b9760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 --2- 172.21.15.100:0/944812392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 --2- 172.21.15.100:0/944812392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 -- 172.21.15.100:0/944812392 >> 172.21.15.100:0/944812392 conn(0x55852a075310 msgr2=0x55852a0a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2ce655640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2b40a2d50 0x7fd2b40a5210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00049d0 tx=0x7fd2c0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 -- 172.21.15.100:0/944812392 shutdown_connections 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 -- 172.21.15.100:0/944812392 wait complete. 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 -- start start 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.613+0000 7fd2d2491740 1 Processor -- start 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0b7370 0x55852a0b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2d2491740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55852a0ba010 con 0x55852a0b7370 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2d2491740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558529fcd060 con 0x55852a0adb40 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2d2491740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55852a0ba190 con 0x55852a0ac5d0 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2d2491740 10 client.0 _ll_register_callbacks cb 0x558529d208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2ce655640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0b7370 0x55852a0b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2ce655640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0b7370 0x55852a0b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49294/0 (socket says 172.21.15.100:49294) 2024-09-12T02:42:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2ce655640 1 -- 172.21.15.100:0/1297518368 learned_addr learned my addr 172.21.15.100:0/1297518368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37378/0 (socket says 172.21.15.100:37378) 2024-09-12T02:42:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2cd653640 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2cde54640 1 -- 172.21.15.100:0/1297518368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 msgr2=0x55852a0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2cde54640 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2cde54640 1 -- 172.21.15.100:0/1297518368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0b7370 msgr2=0x55852a0b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.614+0000 7fd2cde54640 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0b7370 0x55852a0b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.616+0000 7fd2cde54640 1 -- 172.21.15.100:0/1297518368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558529d833c0 con 0x55852a0ac5d0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.616+0000 7fd2b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.616+0000 7fd2cde54640 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0b6d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40979f0 tx=0x7fd2c409b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2e5eb8a9e06c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.616+0000 7fd2b17fa640 1 -- 172.21.15.100:0/1297518368 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40bb0e0 con 0x55852a0ac5d0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.616+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2b8038040 con 0x55852a0ac5d0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.616+0000 7fd2b17fa640 1 -- 172.21.15.100:0/1297518368 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd2c409f0b0 con 0x55852a0ac5d0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.616+0000 7fd2b17fa640 1 -- 172.21.15.100:0/1297518368 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd2c409f3d0 con 0x55852a0ac5d0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 10 client.25375 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55852a0c5b30 con 0x55852a0ac5d0 2024-09-12T02:42:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2b17fa640 1 -- 172.21.15.100:0/1297518368 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b8038040 con 0x55852a0ac5d0 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2b17fa640 1 -- 172.21.15.100:0/1297518368 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd2c409a470 con 0x55852a0ac5d0 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 10 client.25375 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 10 client.25375 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 20 client.25375 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a0c6f40 0x55852a0c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 4 client.25375 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55852a01f860 con 0x55852a0c6f40 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.617+0000 7fd2cd653640 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a0c6f40 0x55852a0c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.618+0000 7fd2cd653640 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a0c6f40 0x55852a0c9330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa8168ea021acdba server_cookie=97b58fbac30aa437 in_seq=0 out_seq=0 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.618+0000 7fd2b17fa640 10 client.25375 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.618+0000 7fd2b17fa640 1 -- 172.21.15.100:0/1297518368 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55852a01f860 con 0x55852a0c6f40 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.618+0000 7fd2b17fa640 10 client.25375 handle_command_reply: tid=0 2024-09-12T02:42:17.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.618+0000 7fd2d2491740 1 client.25375 shutdown 2024-09-12T02:42:17.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.619+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 msgr2=0x55852a0b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.619+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0b6d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40979f0 tx=0x7fd2c409b720 comp rx=0 tx=0).stop 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.619+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 shutdown_connections 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a0c6f40 0x55852a0c9330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0b7370 0x55852a0b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1297518368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0b6d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 >> 172.21.15.100:0/1297518368 conn(0x55852a075310 msgr2=0x55852a0ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2b17fa640 0 client.25375 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 shutdown_connections 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 1 -- 172.21.15.100:0/1297518368 wait complete. 2024-09-12T02:42:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.620+0000 7fd2d2491740 20 client.25375 trim_cache size 0 max 16384 2024-09-12T02:42:17.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 Processor -- start 2024-09-12T02:42:17.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 -- start start 2024-09-12T02:42:17.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81b1ff0 con 0x55852a0adb40 2024-09-12T02:42:17.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81af8c0 con 0x55852a0b7370 2024-09-12T02:42:17.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.638+0000 7fd2d2491740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81ad710 con 0x55852a0ac5d0 2024-09-12T02:42:17.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2ce655640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0a8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37384/0 (socket says 172.21.15.100:37384) 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2cde54640 1 -- 172.21.15.100:0/1993163726 learned_addr learned my addr 172.21.15.100:0/1993163726 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2cd653640 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2ce655640 1 -- 172.21.15.100:0/1993163726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 msgr2=0x55852a0a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2ce655640 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0a8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2ce655640 1 -- 172.21.15.100:0/1993163726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 msgr2=0x55852a0c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2ce655640 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2ce655640 1 -- 172.21.15.100:0/1993163726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55852a0b2fe0 con 0x55852a0b7370 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2cde54640 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2ce655640 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b38f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009f20 tx=0x7fd2c0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2170cb6462edab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2b37fe640 1 -- 172.21.15.100:0/1993163726 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c001c4d0 con 0x55852a0b7370 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2b37fe640 1 -- 172.21.15.100:0/1993163726 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2c002d070 con 0x55852a0b7370 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.639+0000 7fd2b37fe640 1 -- 172.21.15.100:0/1993163726 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0028aa0 con 0x55852a0b7370 2024-09-12T02:42:17.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.640+0000 7fd2d2491740 1 -- 172.21.15.100:0/1993163726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 msgr2=0x55852a0b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.640+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b38f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009f20 tx=0x7fd2c0016000 comp rx=0 tx=0).stop 2024-09-12T02:42:17.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.640+0000 7fd2d2491740 1 -- 172.21.15.100:0/1993163726 shutdown_connections 2024-09-12T02:42:17.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.640+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0b7370 0x55852a0b38f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.640+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0adb40 0x55852a0c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.640+0000 7fd2d2491740 1 --2- 172.21.15.100:0/1993163726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0ac5d0 0x55852a0a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.640+0000 7fd2d2491740 1 -- 172.21.15.100:0/1993163726 >> 172.21.15.100:0/1993163726 conn(0x55852a075310 msgr2=0x55852a0a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.641+0000 7fd2d2491740 1 -- 172.21.15.100:0/1993163726 shutdown_connections 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.641+0000 7fd2d2491740 1 -- 172.21.15.100:0/1993163726 wait complete. 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.641+0000 7fd2d2491740 1 -- start start 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 1 Processor -- start 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0ac5d0 0x55852a0bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0bae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0b7370 0x55852a0bb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81add80 con 0x55852a0ac5d0 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81af1f0 con 0x55852a0adb40 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81ae450 con 0x55852a0b7370 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0ac5d0 0x55852a0bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2d2491740 10 client.0 _ll_register_callbacks cb 0x7fd2c409ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.642+0000 7fd2cde54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0ac5d0 0x55852a0bfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49314/0 (socket says 172.21.15.100:49314) 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cde54640 1 -- 172.21.15.100:0/2228235685 learned_addr learned my addr 172.21.15.100:0/2228235685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cd653640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0bae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2ce655640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0b7370 0x55852a0bb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cde54640 1 -- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0b7370 msgr2=0x55852a0bb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cde54640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0b7370 0x55852a0bb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cde54640 1 -- 172.21.15.100:0/2228235685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 msgr2=0x55852a0bae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cde54640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0bae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cde54640 1 -- 172.21.15.100:0/2228235685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852a0bbbe0 con 0x55852a0ac5d0 2024-09-12T02:42:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cd653640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0bae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2cde54640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0ac5d0 0x55852a0bfaa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd2c409b1e0 tx=0x7fd2c409adf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68492873952d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2b17fa640 1 -- 172.21.15.100:0/2228235685 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40a3c90 con 0x55852a0ac5d0 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2c002d070 con 0x55852a0ac5d0 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2b17fa640 1 -- 172.21.15.100:0/2228235685 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd2c409f0f0 con 0x55852a0ac5d0 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2b17fa640 1 -- 172.21.15.100:0/2228235685 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd2c40a3c90 con 0x55852a0ac5d0 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2d2491740 10 client.15954 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.643+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55852a13a2d0 con 0x55852a0ac5d0 2024-09-12T02:42:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2b17fa640 1 -- 172.21.15.100:0/2228235685 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2c002d070 con 0x55852a0ac5d0 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2b17fa640 1 -- 172.21.15.100:0/2228235685 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd2c4095b90 con 0x55852a0ac5d0 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2d2491740 10 client.15954 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2d2491740 10 client.15954 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2d2491740 20 client.15954 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2d2491740 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a13a9f0 0x55852a13cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2d2491740 4 client.15954 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.644+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55852a019d70 con 0x55852a13a9f0 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2cd653640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a13a9f0 0x55852a13cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2cd653640 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a13a9f0 0x55852a13cde0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26fb40fcd6e2a9c5 server_cookie=b94a34b5886ee837 in_seq=0 out_seq=0 2024-09-12T02:42:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2b17fa640 10 client.15954 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2b17fa640 1 -- 172.21.15.100:0/2228235685 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55852a019d70 con 0x55852a13a9f0 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2b17fa640 10 client.15954 handle_command_reply: tid=0 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 client.15954 shutdown 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0ac5d0 msgr2=0x55852a0bfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0ac5d0 0x55852a0bfaa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd2c409b1e0 tx=0x7fd2c409adf0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 shutdown_connections 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55852a13a9f0 0x55852a13cde0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2b17fa640 0 client.15954 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55852a0b7370 0x55852a0bb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55852a0adb40 0x55852a0bae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 --2- 172.21.15.100:0/2228235685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55852a0ac5d0 0x55852a0bfaa0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 >> 172.21.15.100:0/2228235685 conn(0x55852a075310 msgr2=0x55852a0a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 shutdown_connections 2024-09-12T02:42:17.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.645+0000 7fd2d2491740 1 -- 172.21.15.100:0/2228235685 wait complete. 2024-09-12T02:42:17.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d2491740 20 client.15954 trim_cache size 0 max 16384 2024-09-12T02:42:17.650 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:42:17.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2b40a2d50 msgr2=0x7fd2b40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2b40a2d50 0x7fd2b40a5210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00049d0 tx=0x7fd2c0009500 comp rx=0 tx=0).stop 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8102d90 msgr2=0x7fd2c81009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8102d90 0x7fd2c81009f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400d6d0 tx=0x7fd2c400db90 comp rx=0 tx=0).stop 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 shutdown_connections 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2b40a2d50 0x7fd2b40a5210 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2c8108290 0x7fd2c8101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2c8103740 0x7fd2c8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 --2- 172.21.15.100:0/1993368915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2c8102d90 0x7fd2c81009f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.646+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 >> 172.21.15.100:0/1993368915 conn(0x7fd2c80fc7d0 msgr2=0x7fd2c8105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.647+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 shutdown_connections 2024-09-12T02:42:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:17.648+0000 7fd2d00b8640 1 -- 172.21.15.100:0/1993368915 wait complete. 2024-09-12T02:42:18.764 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:42:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:18 smithi189 ceph-mon[35196]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.6 MiB/s wr, 760 op/s 2024-09-12T02:42:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:18 smithi117 ceph-mon[34898]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.6 MiB/s wr, 760 op/s 2024-09-12T02:42:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:18 smithi100 ceph-mon[31390]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.6 MiB/s wr, 760 op/s 2024-09-12T02:42:19.122 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 -- 172.21.15.100:0/2360754969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c81008c0 msgr2=0x7f32c8100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 --2- 172.21.15.100:0/2360754969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c81008c0 0x7f32c8100ca0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009ca0 tx=0x7f32c002a8d0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 -- 172.21.15.100:0/2360754969 shutdown_connections 2024-09-12T02:42:19.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 --2- 172.21.15.100:0/2360754969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32c8105ec0 0x7f32c8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 --2- 172.21.15.100:0/2360754969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 0x7f32c8105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 --2- 172.21.15.100:0/2360754969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c81008c0 0x7f32c8100ca0 secure :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009ca0 tx=0x7f32c002a8d0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 -- 172.21.15.100:0/2360754969 >> 172.21.15.100:0/2360754969 conn(0x7f32c80fc7d0 msgr2=0x7f32c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 -- 172.21.15.100:0/2360754969 shutdown_connections 2024-09-12T02:42:19.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.652+0000 7f32cd356640 1 -- 172.21.15.100:0/2360754969 wait complete. 2024-09-12T02:42:19.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.653+0000 7f32cd356640 1 Processor -- start 2024-09-12T02:42:19.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.653+0000 7f32cd356640 1 -- start start 2024-09-12T02:42:19.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.654+0000 7f32cd356640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 0x7f32c819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.654+0000 7f32cd356640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c8105ec0 0x7f32c819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.654+0000 7f32cd356640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32c81a37e0 0x7f32c81a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32cd356640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32c8118700 con 0x7f32c8105ec0 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32cd356640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32c8118580 con 0x7f32c81011e0 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32cd356640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32c8118880 con 0x7f32c81a37e0 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 0x7f32c819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 0x7f32c819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:55618/0 (socket says 172.21.15.100:55618) 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 -- 172.21.15.100:0/947338248 learned_addr learned my addr 172.21.15.100:0/947338248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c77fe640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32c81a37e0 0x7f32c81a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c67fc640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c8105ec0 0x7f32c819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 -- 172.21.15.100:0/947338248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32c81a37e0 msgr2=0x7f32c81a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32c81a37e0 0x7f32c81a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 -- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c8105ec0 msgr2=0x7f32c819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c8105ec0 0x7f32c819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.655+0000 7f32c6ffd640 1 -- 172.21.15.100:0/947338248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c81a42a0 con 0x7f32c81011e0 2024-09-12T02:42:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.656+0000 7f32c6ffd640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 0x7f32c819ef10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32c0005e30 tx=0x7f32c0030cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.657+0000 7f32affff640 1 -- 172.21.15.100:0/947338248 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0003b70 con 0x7f32c81011e0 2024-09-12T02:42:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.657+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c81a4530 con 0x7f32c81011e0 2024-09-12T02:42:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.657+0000 7f32affff640 1 -- 172.21.15.100:0/947338248 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c0030eb0 con 0x7f32c81011e0 2024-09-12T02:42:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.657+0000 7f32affff640 1 -- 172.21.15.100:0/947338248 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0003b70 con 0x7f32c81011e0 2024-09-12T02:42:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.657+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c81abd10 con 0x7f32c81011e0 2024-09-12T02:42:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 Processor -- start 2024-09-12T02:42:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 -- start start 2024-09-12T02:42:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e42b40 0x5635b7e41090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e41a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e4c370 0x5635b7e4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5635b7da72f0 con 0x5635b7e42b40 2024-09-12T02:42:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5635b7d4ecf0 con 0x5635b7e415d0 2024-09-12T02:42:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32cf72f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5635b7da32b0 con 0x5635b7e4c370 2024-09-12T02:42:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.660+0000 7f32affff640 1 -- 172.21.15.100:0/947338248 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f32c0003d10 con 0x7f32c81011e0 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e42b40 0x5635b7e41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e42b40 0x5635b7e41090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49354/0 (socket says 172.21.15.100:49354) 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e41a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 -- 172.21.15.100:0/405980830 learned_addr learned my addr 172.21.15.100:0/405980830 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c67fc640 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e4c370 0x5635b7e4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 -- 172.21.15.100:0/405980830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e4c370 msgr2=0x5635b7e4e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e4c370 0x5635b7e4e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 -- 172.21.15.100:0/405980830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 msgr2=0x5635b7e41a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e41a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 -- 172.21.15.100:0/405980830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b7d333a0 con 0x5635b7e42b40 2024-09-12T02:42:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c6ffd640 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e41a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.661+0000 7f32c77fe640 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e42b40 0x5635b7e41090 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b7a0 tx=0x7f32bc00bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2973f7965338012d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.662+0000 7f32affff640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f32b00a2d80 0x7f32b00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.662+0000 7f32c6ffd640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f32b00a2d80 0x7f32b00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.662+0000 7f32ad7fa640 1 -- 172.21.15.100:0/405980830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc00d950 con 0x5635b7e42b40 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.662+0000 7f32ad7fa640 1 -- 172.21.15.100:0/405980830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32bc012420 con 0x5635b7e42b40 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.662+0000 7f32ad7fa640 1 -- 172.21.15.100:0/405980830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc014630 con 0x5635b7e42b40 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.662+0000 7f32affff640 1 -- 172.21.15.100:0/947338248 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f32c00efe90 con 0x7f32c81011e0 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 -- 172.21.15.100:0/405980830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e42b40 msgr2=0x5635b7e41090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e42b40 0x5635b7e41090 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b7a0 tx=0x7f32bc00bc60 comp rx=0 tx=0).stop 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32c6ffd640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f32b00a2d80 0x7f32b00a5240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f32c00edcf0 tx=0x7f32c0000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 -- 172.21.15.100:0/405980830 shutdown_connections 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e4c370 0x5635b7e4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e41a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 --2- 172.21.15.100:0/405980830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e42b40 0x5635b7e41090 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 -- 172.21.15.100:0/405980830 >> 172.21.15.100:0/405980830 conn(0x5635b7e0a310 msgr2=0x5635b7e3dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 -- 172.21.15.100:0/405980830 shutdown_connections 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 -- 172.21.15.100:0/405980830 wait complete. 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.663+0000 7f32cf72f740 1 -- start start 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 1 Processor -- start 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e415d0 0x5635b7e4bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e42b40 0x5635b7e48ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 0x5635b7e495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5635b7e4f070 con 0x5635b7e4c370 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5635b7d62060 con 0x5635b7e42b40 2024-09-12T02:42:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5635b7e4f1f0 con 0x5635b7e415d0 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32cf72f740 10 client.0 _ll_register_callbacks cb 0x5635b7ab58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e415d0 0x5635b7e4bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e415d0 0x5635b7e4bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37440/0 (socket says 172.21.15.100:37440) 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 -- 172.21.15.100:0/3669259873 learned_addr learned my addr 172.21.15.100:0/3669259873 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c67fc640 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e42b40 0x5635b7e48ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 -- 172.21.15.100:0/3669259873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e42b40 msgr2=0x5635b7e48ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e42b40 0x5635b7e48ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 -- 172.21.15.100:0/3669259873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 msgr2=0x5635b7e495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 0x5635b7e495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.664+0000 7f32c77fe640 1 -- 172.21.15.100:0/3669259873 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b7b183c0 con 0x5635b7e415d0 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.665+0000 7f32c77fe640 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e415d0 0x5635b7e4bd40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006dc0 tx=0x7f32bc00beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4fb0ddae8ac2b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.665+0000 7f32aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:42:19.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.665+0000 7f32aaff5640 1 -- 172.21.15.100:0/3669259873 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc024070 con 0x5635b7e415d0 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.665+0000 7f32aaff5640 1 -- 172.21.15.100:0/3669259873 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f32bc00dd60 con 0x5635b7e415d0 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.665+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32bc012420 con 0x5635b7e415d0 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.666+0000 7f32aaff5640 1 -- 172.21.15.100:0/3669259873 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32bc0125d0 con 0x5635b7e415d0 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.666+0000 7f32cf72f740 10 client.25390 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.666+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5635b7e5aae0 con 0x5635b7e415d0 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32aaff5640 1 -- 172.21.15.100:0/3669259873 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32bc020430 con 0x5635b7e415d0 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32aaff5640 1 -- 172.21.15.100:0/3669259873 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f32bc013070 con 0x5635b7e415d0 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32cf72f740 10 client.25390 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32cf72f740 10 client.25390 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:42:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32cf72f740 20 client.25390 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7e5be30 0x5635b7e5e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32cf72f740 4 client.25390 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.667+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f32bc012420 con 0x5635b7e5be30 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.668+0000 7f32c67fc640 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7e5be30 0x5635b7e5e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.668+0000 7f32c67fc640 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7e5be30 0x5635b7e5e220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c180a234c23252c server_cookie=53de4095f94cc9fc in_seq=0 out_seq=0 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.668+0000 7f32aaff5640 10 client.25390 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32aaff5640 1 -- 172.21.15.100:0/3669259873 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f32bc012420 con 0x5635b7e5be30 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32aaff5640 10 client.25390 handle_command_reply: tid=0 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 client.25390 shutdown 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e415d0 msgr2=0x5635b7e4bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e415d0 0x5635b7e4bd40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006dc0 tx=0x7f32bc00beb0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 shutdown_connections 2024-09-12T02:42:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7e5be30 0x5635b7e5e220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 0x5635b7e495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32aaff5640 0 client.25390 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e42b40 0x5635b7e48ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3669259873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e415d0 0x5635b7e4bd40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 >> 172.21.15.100:0/3669259873 conn(0x5635b7e0a310 msgr2=0x5635b7e43930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.669+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 shutdown_connections 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.670+0000 7f32cf72f740 1 -- 172.21.15.100:0/3669259873 wait complete. 2024-09-12T02:42:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.670+0000 7f32cf72f740 20 client.25390 trim_cache size 0 max 16384 2024-09-12T02:42:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.685+0000 7f32cf72f740 1 Processor -- start 2024-09-12T02:42:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.685+0000 7f32cf72f740 1 -- start start 2024-09-12T02:42:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e415d0 0x5635b7e44120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e4c370 0x5635b7e57b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32cf72f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32c81b6bc0 con 0x5635b7e415d0 2024-09-12T02:42:19.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32cf72f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32c81b4490 con 0x5635b7e4c370 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32cf72f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32c81b22e0 con 0x5635b7e42b40 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32c67fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32c67fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e44660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37456/0 (socket says 172.21.15.100:37456) 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32c67fc640 1 -- 172.21.15.100:0/3292200700 learned_addr learned my addr 172.21.15.100:0/3292200700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.686+0000 7f32c77fe640 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e4c370 0x5635b7e57b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32c67fc640 1 -- 172.21.15.100:0/3292200700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e4c370 msgr2=0x5635b7e57b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32c67fc640 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e4c370 0x5635b7e57b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32c67fc640 1 -- 172.21.15.100:0/3292200700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e415d0 msgr2=0x5635b7e44120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32c67fc640 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e415d0 0x5635b7e44120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32c67fc640 1 -- 172.21.15.100:0/3292200700 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b7e3e730 con 0x5635b7e42b40 2024-09-12T02:42:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32c67fc640 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e44660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5635b7e48880 tx=0x7f32b8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2c9979d56f337d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32acff9640 1 -- 172.21.15.100:0/3292200700 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8022030 con 0x5635b7e42b40 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32acff9640 1 -- 172.21.15.100:0/3292200700 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8005020 con 0x5635b7e42b40 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.687+0000 7f32acff9640 1 -- 172.21.15.100:0/3292200700 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8004ca0 con 0x5635b7e42b40 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 -- 172.21.15.100:0/3292200700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 msgr2=0x5635b7e44660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e44660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5635b7e48880 tx=0x7f32b8005f90 comp rx=0 tx=0).stop 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 -- 172.21.15.100:0/3292200700 shutdown_connections 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e4c370 0x5635b7e57b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e44660 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 --2- 172.21.15.100:0/3292200700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e415d0 0x5635b7e44120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 -- 172.21.15.100:0/3292200700 >> 172.21.15.100:0/3292200700 conn(0x5635b7e0a310 msgr2=0x5635b7e57480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 -- 172.21.15.100:0/3292200700 shutdown_connections 2024-09-12T02:42:19.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.688+0000 7f32cf72f740 1 -- 172.21.15.100:0/3292200700 wait complete. 2024-09-12T02:42:19.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.689+0000 7f32cf72f740 1 -- start start 2024-09-12T02:42:19.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.689+0000 7f32cf72f740 1 Processor -- start 2024-09-12T02:42:19.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e5f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e5f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32cf72f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 0x5635b7e5fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32cf72f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32c81b2950 con 0x5635b7e4c370 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32cf72f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32c81b3dc0 con 0x5635b7e415d0 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32cf72f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32c81b3020 con 0x5635b7e42b40 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32cf72f740 10 client.0 _ll_register_callbacks cb 0x7f32b80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e5f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e5f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:55664/0 (socket says 172.21.15.100:55664) 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 -- 172.21.15.100:0/2883115742 learned_addr learned my addr 172.21.15.100:0/2883115742 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c67fc640 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e5f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 0x5635b7e5fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 -- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 msgr2=0x5635b7e5f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e5f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 -- 172.21.15.100:0/2883115742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 msgr2=0x5635b7e5fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 0x5635b7e5fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 -- 172.21.15.100:0/2883115742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b7ec57f0 con 0x5635b7e415d0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32c77fe640 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e5f040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32bc012d10 tx=0x7f32bc012d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98cd1f85229f8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.690+0000 7f32aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32aaff5640 1 -- 172.21.15.100:0/2883115742 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc024040 con 0x5635b7e415d0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32b8005020 con 0x5635b7e415d0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32aaff5640 1 -- 172.21.15.100:0/2883115742 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f32bc01fc50 con 0x5635b7e415d0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32aaff5640 1 -- 172.21.15.100:0/2883115742 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32bc012420 con 0x5635b7e415d0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 10 client.25412 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5635b7ec6ad0 con 0x5635b7e415d0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32aaff5640 1 -- 172.21.15.100:0/2883115742 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8005020 con 0x5635b7e415d0 2024-09-12T02:42:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32aaff5640 1 -- 172.21.15.100:0/2883115742 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f32bc03d050 con 0x5635b7e415d0 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 10 client.25412 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 10 client.25412 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 20 client.25412 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7ec6f50 0x5635b7ec9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 4 client.25412 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.691+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635b7db4860 con 0x5635b7ec6f50 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32c67fc640 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7ec6f50 0x5635b7ec9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32aaff5640 10 client.25412 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32c67fc640 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7ec6f50 0x5635b7ec9340 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e335854e10b32dbe server_cookie=56d1ea49039273c1 in_seq=0 out_seq=0 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32aaff5640 1 -- 172.21.15.100:0/2883115742 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635b7db4860 con 0x5635b7ec6f50 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32aaff5640 10 client.25412 handle_command_reply: tid=0 2024-09-12T02:42:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 client.25412 shutdown 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 msgr2=0x5635b7e5f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e5f040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32bc012d10 tx=0x7f32bc012d40 comp rx=0 tx=0).stop 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 shutdown_connections 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5635b7ec6f50 0x5635b7ec9340 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635b7e4c370 0x5635b7e5fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32aaff5640 0 client.25412 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635b7e42b40 0x5635b7e5f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 --2- 172.21.15.100:0/2883115742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5635b7e415d0 0x5635b7e5f040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 >> 172.21.15.100:0/2883115742 conn(0x5635b7e0a310 msgr2=0x5635b7e57ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 shutdown_connections 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.692+0000 7f32cf72f740 1 -- 172.21.15.100:0/2883115742 wait complete. 2024-09-12T02:42:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.693+0000 7f32cf72f740 20 client.25412 trim_cache size 0 max 16384 2024-09-12T02:42:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:42:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.694+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f32b00a2d80 msgr2=0x7f32b00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.694+0000 7f32cd356640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f32b00a2d80 0x7f32b00a5240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f32c00edcf0 tx=0x7f32c0000f40 comp rx=0 tx=0).stop 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 msgr2=0x7f32c819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 0x7f32c819ef10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32c0005e30 tx=0x7f32c0030cc0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 shutdown_connections 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f32b00a2d80 0x7f32b00a5240 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32c81a37e0 0x7f32c81a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c8105ec0 0x7f32c819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 --2- 172.21.15.100:0/947338248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c81011e0 0x7f32c819ef10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 >> 172.21.15.100:0/947338248 conn(0x7f32c80fc7d0 msgr2=0x7f32c810f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 shutdown_connections 2024-09-12T02:42:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:19.695+0000 7f32cd356640 1 -- 172.21.15.100:0/947338248 wait complete. 2024-09-12T02:42:20.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:42:20.857 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:20.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:20 smithi100 ceph-mon[31390]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 781 op/s 2024-09-12T02:42:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:20 smithi189 ceph-mon[35196]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 781 op/s 2024-09-12T02:42:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:20 smithi117 ceph-mon[34898]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 781 op/s 2024-09-12T02:42:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 190.0 s, 3242.2 tps, lat 30.855 ms stddev 31.263 2024-09-12T02:42:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.447+0000 7f5e09800640 1 -- 172.21.15.100:0/3863227640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04100e20 msgr2=0x7f5e04101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.447+0000 7f5e09800640 1 --2- 172.21.15.100:0/3863227640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04100e20 0x7f5e04101200 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009900 tx=0x7f5df402a480 comp rx=0 tx=0).stop 2024-09-12T02:42:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.448+0000 7f5e09800640 1 -- 172.21.15.100:0/3863227640 shutdown_connections 2024-09-12T02:42:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.448+0000 7f5e09800640 1 --2- 172.21.15.100:0/3863227640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e04102ef0 0x7f5e0410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.448+0000 7f5e09800640 1 --2- 172.21.15.100:0/3863227640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e04102570 0x7f5e041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.448+0000 7f5e09800640 1 --2- 172.21.15.100:0/3863227640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04100e20 0x7f5e04101200 secure :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009900 tx=0x7f5df402a480 comp rx=0 tx=0).stop 2024-09-12T02:42:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.448+0000 7f5e09800640 1 -- 172.21.15.100:0/3863227640 >> 172.21.15.100:0/3863227640 conn(0x7f5e040fc7d0 msgr2=0x7f5e040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.450+0000 7f5e09800640 1 -- 172.21.15.100:0/3863227640 shutdown_connections 2024-09-12T02:42:21.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.451+0000 7f5e09800640 1 -- 172.21.15.100:0/3863227640 wait complete. 2024-09-12T02:42:21.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.452+0000 7f5e09800640 1 Processor -- start 2024-09-12T02:42:21.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.452+0000 7f5e09800640 1 -- start start 2024-09-12T02:42:21.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.452+0000 7f5e09800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e04102570 0x7f5e0419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.452+0000 7f5e09800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04102ef0 0x7f5e0419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e09800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e04196410 0x7f5e041968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e09800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04110f80 con 0x7f5e04102ef0 2024-09-12T02:42:21.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e09800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04110e00 con 0x7f5e04102570 2024-09-12T02:42:21.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e09800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04111100 con 0x7f5e04196410 2024-09-12T02:42:21.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04102ef0 0x7f5e0419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e037fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e04196410 0x7f5e041968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04102ef0 0x7f5e0419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49392/0 (socket says 172.21.15.100:49392) 2024-09-12T02:42:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5dfbfff640 1 -- 172.21.15.100:0/1267262876 learned_addr learned my addr 172.21.15.100:0/1267262876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e04102570 0x7f5e0419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e037fe640 1 -- 172.21.15.100:0/1267262876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e04102570 msgr2=0x7f5e0419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e037fe640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e04102570 0x7f5e0419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e037fe640 1 -- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04102ef0 msgr2=0x7f5e0419b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e037fe640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04102ef0 0x7f5e0419b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.453+0000 7f5e037fe640 1 -- 172.21.15.100:0/1267262876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e04196e80 con 0x7f5e04196410 2024-09-12T02:42:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.454+0000 7f5e037fe640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e04196410 0x7f5e041968c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ea80 tx=0x7f5dfc00ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.454+0000 7f5e00ff9640 1 -- 172.21.15.100:0/1267262876 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00ce40 con 0x7f5e04196410 2024-09-12T02:42:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.454+0000 7f5e00ff9640 1 -- 172.21.15.100:0/1267262876 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dfc005020 con 0x7f5e04196410 2024-09-12T02:42:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.454+0000 7f5e00ff9640 1 -- 172.21.15.100:0/1267262876 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc010670 con 0x7f5e04196410 2024-09-12T02:42:21.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.454+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e04197170 con 0x7f5e04196410 2024-09-12T02:42:21.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.455+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e041b42d0 con 0x7f5e04196410 2024-09-12T02:42:21.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.458+0000 7f5e00ff9640 1 -- 172.21.15.100:0/1267262876 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f5dfc0051d0 con 0x7f5e04196410 2024-09-12T02:42:21.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.459+0000 7f5e0bbd9740 1 Processor -- start 2024-09-12T02:42:21.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.459+0000 7f5e0bbd9740 1 -- start start 2024-09-12T02:42:21.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.459+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f1b40 0x56335c6f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6fb370 0x56335c6fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56335c6562f0 con 0x56335c6fb370 2024-09-12T02:42:21.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56335c5fdcf0 con 0x56335c6f05d0 2024-09-12T02:42:21.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56335c6522b0 con 0x56335c6f1b40 2024-09-12T02:42:21.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e00ff9640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5df00a2cd0 0x7f5df00a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6fb370 0x56335c6fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e02ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f1b40 0x56335c6f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6fb370 0x56335c6fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49406/0 (socket says 172.21.15.100:49406) 2024-09-12T02:42:21.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e037fe640 1 -- 172.21.15.100:0/1081394673 learned_addr learned my addr 172.21.15.100:0/1081394673 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:21.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5df00a2cd0 0x7f5df00a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5e00ff9640 1 -- 172.21.15.100:0/1267262876 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5dfc0cf0b0 con 0x7f5e04196410 2024-09-12T02:42:21.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5dfbfff640 1 -- 172.21.15.100:0/1081394673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f1b40 msgr2=0x56335c6f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/1081394673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f1b40 0x56335c6f0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5dfbfff640 1 -- 172.21.15.100:0/1081394673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6fb370 msgr2=0x56335c6fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/1081394673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6fb370 0x56335c6fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.460+0000 7f5dfbfff640 1 -- 172.21.15.100:0/1081394673 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56335c5e23a0 con 0x56335c6f05d0 2024-09-12T02:42:21.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.461+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5df00a2cd0 0x7f5df00a5190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5dec005fd0 tx=0x7f5dec017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.461+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/1081394673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6f0a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e040feaa0 tx=0x7f5dec010370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edc36973b9765be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.461+0000 7f5df97fa640 1 -- 172.21.15.100:0/1081394673 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec023070 con 0x56335c6f05d0 2024-09-12T02:42:21.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.461+0000 7f5df97fa640 1 -- 172.21.15.100:0/1081394673 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dec012620 con 0x56335c6f05d0 2024-09-12T02:42:21.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.461+0000 7f5df97fa640 1 -- 172.21.15.100:0/1081394673 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec004d70 con 0x56335c6f05d0 2024-09-12T02:42:21.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1081394673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 msgr2=0x56335c6f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1081394673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6f0a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e040feaa0 tx=0x7f5dec010370 comp rx=0 tx=0).stop 2024-09-12T02:42:21.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1081394673 shutdown_connections 2024-09-12T02:42:21.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1081394673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6fb370 0x56335c6fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1081394673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6f0a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1081394673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f1b40 0x56335c6f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1081394673 >> 172.21.15.100:0/1081394673 conn(0x56335c6b9310 msgr2=0x56335c6ecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1081394673 shutdown_connections 2024-09-12T02:42:21.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1081394673 wait complete. 2024-09-12T02:42:21.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.462+0000 7f5e0bbd9740 1 -- start start 2024-09-12T02:42:21.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 1 Processor -- start 2024-09-12T02:42:21.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6fadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c6f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6fb370 0x56335c6f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56335c6fe010 con 0x56335c6f1b40 2024-09-12T02:42:21.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56335c611060 con 0x56335c6f05d0 2024-09-12T02:42:21.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56335c6fe190 con 0x56335c6fb370 2024-09-12T02:42:21.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e0bbd9740 10 client.0 _ll_register_callbacks cb 0x56335c3648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:21.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e02ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6fadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e02ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6fadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:55706/0 (socket says 172.21.15.100:55706) 2024-09-12T02:42:21.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e02ffd640 1 -- 172.21.15.100:0/1344338713 learned_addr learned my addr 172.21.15.100:0/1344338713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:21.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.463+0000 7f5e037fe640 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6fb370 0x56335c6f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.464+0000 7f5e037fe640 1 -- 172.21.15.100:0/1344338713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 msgr2=0x56335c6fadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.464+0000 7f5e037fe640 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6fadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.464+0000 7f5e037fe640 1 -- 172.21.15.100:0/1344338713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 msgr2=0x56335c6f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.464+0000 7f5e037fe640 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c6f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.464+0000 7f5e037fe640 1 -- 172.21.15.100:0/1344338713 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56335c3c73c0 con 0x56335c6fb370 2024-09-12T02:42:21.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.465+0000 7f5e037fe640 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6fb370 0x56335c6f87e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06e9b0 tx=0x7f5dfc06b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=819e14a2dc436ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.465+0000 7f5dea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:42:21.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.465+0000 7f5dea7fc640 1 -- 172.21.15.100:0/1344338713 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc06a020 con 0x56335c6fb370 2024-09-12T02:42:21.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.465+0000 7f5dea7fc640 1 -- 172.21.15.100:0/1344338713 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5dfc09cbd0 con 0x56335c6fb370 2024-09-12T02:42:21.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.465+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dec012620 con 0x56335c6fb370 2024-09-12T02:42:21.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.465+0000 7f5dea7fc640 1 -- 172.21.15.100:0/1344338713 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5dfc09fc50 con 0x56335c6fb370 2024-09-12T02:42:21.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.465+0000 7f5e0bbd9740 10 client.25408 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:21.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56335c709b40 con 0x56335c6fb370 2024-09-12T02:42:21.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5dea7fc640 1 -- 172.21.15.100:0/1344338713 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dec012620 con 0x56335c6fb370 2024-09-12T02:42:21.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5dea7fc640 1 -- 172.21.15.100:0/1344338713 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5dfc066ab0 con 0x56335c6fb370 2024-09-12T02:42:21.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5e0bbd9740 10 client.25408 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:21.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5e0bbd9740 10 client.25408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:21.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5e0bbd9740 20 client.25408 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:21.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c70afa0 0x56335c70d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5e0bbd9740 4 client.25408 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:21.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.466+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56335c663860 con 0x56335c70afa0 2024-09-12T02:42:21.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.467+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c70afa0 0x56335c70d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.467+0000 7f5dea7fc640 10 client.25408 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:21.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.467+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c70afa0 0x56335c70d3f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465525cfe6f7acde server_cookie=70c0307070594deb in_seq=0 out_seq=0 2024-09-12T02:42:21.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5dea7fc640 1 -- 172.21.15.100:0/1344338713 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56335c663860 con 0x56335c70afa0 2024-09-12T02:42:21.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5dea7fc640 10 client.25408 handle_command_reply: tid=0 2024-09-12T02:42:21.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 client.25408 shutdown 2024-09-12T02:42:21.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6fb370 msgr2=0x56335c6f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6fb370 0x56335c6f87e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06e9b0 tx=0x7f5dfc06b7d0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 shutdown_connections 2024-09-12T02:42:21.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c70afa0 0x56335c70d3f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6fb370 0x56335c6f87e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c6f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/1344338713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6f05d0 0x56335c6fadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5dea7fc640 0 client.25408 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:21.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 >> 172.21.15.100:0/1344338713 conn(0x56335c6b9310 msgr2=0x56335c6f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 shutdown_connections 2024-09-12T02:42:21.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.468+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/1344338713 wait complete. 2024-09-12T02:42:21.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.469+0000 7f5e0bbd9740 20 client.25408 trim_cache size 0 max 16384 2024-09-12T02:42:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 Processor -- start 2024-09-12T02:42:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 -- start start 2024-09-12T02:42:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c6f1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c7072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c712cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041bf1a0 con 0x56335c6f1b40 2024-09-12T02:42:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041bca70 con 0x56335c6fb370 2024-09-12T02:42:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041ba8c0 con 0x56335c6f05d0 2024-09-12T02:42:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c7072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c7072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49426/0 (socket says 172.21.15.100:49426) 2024-09-12T02:42:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5dfbfff640 1 -- 172.21.15.100:0/2236693290 learned_addr learned my addr 172.21.15.100:0/2236693290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c6f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.493+0000 7f5e037fe640 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c712cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5e02ffd640 1 -- 172.21.15.100:0/2236693290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 msgr2=0x56335c712cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c712cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5e02ffd640 1 -- 172.21.15.100:0/2236693290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 msgr2=0x56335c7072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c7072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5e02ffd640 1 -- 172.21.15.100:0/2236693290 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56335c7077f0 con 0x56335c6f05d0 2024-09-12T02:42:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5e037fe640 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c712cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c6f1300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000c00 tx=0x7f5df4005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d678f0c2622c8c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.494+0000 7f5df8ff9640 1 -- 172.21.15.100:0/2236693290 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4000e60 con 0x56335c6f05d0 2024-09-12T02:42:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.495+0000 7f5df8ff9640 1 -- 172.21.15.100:0/2236693290 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5df4031e30 con 0x56335c6f05d0 2024-09-12T02:42:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.495+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c7072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.495+0000 7f5df8ff9640 1 -- 172.21.15.100:0/2236693290 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4035040 con 0x56335c6f05d0 2024-09-12T02:42:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/2236693290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 msgr2=0x56335c6f1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c6f1300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000c00 tx=0x7f5df4005a20 comp rx=0 tx=0).stop 2024-09-12T02:42:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/2236693290 shutdown_connections 2024-09-12T02:42:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c712cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c7072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/2236693290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c6f1300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/2236693290 >> 172.21.15.100:0/2236693290 conn(0x56335c6b9310 msgr2=0x56335c6e7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/2236693290 shutdown_connections 2024-09-12T02:42:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/2236693290 wait complete. 2024-09-12T02:42:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.496+0000 7f5e0bbd9740 1 -- start start 2024-09-12T02:42:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 1 Processor -- start 2024-09-12T02:42:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c703600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c703b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c6f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041baf30 con 0x56335c6f1b40 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041bc3a0 con 0x56335c6fb370 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041bb600 con 0x56335c6f05d0 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e0bbd9740 10 client.0 _ll_register_callbacks cb 0x7f5dfc0cca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c703b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c703b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49436/0 (socket says 172.21.15.100:49436) 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5dfbfff640 1 -- 172.21.15.100:0/995239229 learned_addr learned my addr 172.21.15.100:0/995239229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c703600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5e037fe640 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c6f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5dfbfff640 1 -- 172.21.15.100:0/995239229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 msgr2=0x56335c703600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.497+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c703600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.498+0000 7f5dfbfff640 1 -- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 msgr2=0x56335c6f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.498+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c6f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.498+0000 7f5dfbfff640 1 -- 172.21.15.100:0/995239229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56335c6f50e0 con 0x56335c6f1b40 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.498+0000 7f5dfbfff640 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c703b40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5dec012830 tx=0x7f5dec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b3f40e87ed4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.498+0000 7f5dea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.500+0000 7f5dea7fc640 1 -- 172.21.15.100:0/995239229 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec023040 con 0x56335c6f1b40 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.500+0000 7f5dea7fc640 1 -- 172.21.15.100:0/995239229 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5dec0052d0 con 0x56335c6f1b40 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.500+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df4031e30 con 0x56335c6f1b40 2024-09-12T02:42:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5dea7fc640 1 -- 172.21.15.100:0/995239229 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5dec035050 con 0x56335c6f1b40 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 10 client.15981 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56335c7756d0 con 0x56335c6f1b40 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5dea7fc640 1 -- 172.21.15.100:0/995239229 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5df4031e30 con 0x56335c6f1b40 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5dea7fc640 1 -- 172.21.15.100:0/995239229 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5dec003800 con 0x56335c6f1b40 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 10 client.15981 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 20 client.15981 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c775dc0 0x56335c7781e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 4 client.15981 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56335c65dd70 con 0x56335c775dc0 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.501+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c775dc0 0x56335c7781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e02ffd640 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c775dc0 0x56335c7781e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b128efc32888da47 server_cookie=cadd44d1de30bb48 in_seq=0 out_seq=0 2024-09-12T02:42:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5dea7fc640 10 client.15981 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5dea7fc640 1 -- 172.21.15.100:0/995239229 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56335c65dd70 con 0x56335c775dc0 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5dea7fc640 10 client.15981 handle_command_reply: tid=0 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 client.15981 shutdown 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 msgr2=0x56335c703b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c703b40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5dec012830 tx=0x7f5dec00b480 comp rx=0 tx=0).stop 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 shutdown_connections 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56335c775dc0 0x56335c7781e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56335c6fb370 0x56335c6f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5dea7fc640 0 client.15981 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56335c6f1b40 0x56335c703b40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 --2- 172.21.15.100:0/995239229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56335c6f05d0 0x56335c703600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 >> 172.21.15.100:0/995239229 conn(0x56335c6b9310 msgr2=0x56335c6f6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 shutdown_connections 2024-09-12T02:42:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.502+0000 7f5e0bbd9740 1 -- 172.21.15.100:0/995239229 wait complete. 2024-09-12T02:42:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e0bbd9740 20 client.15981 trim_cache size 0 max 16384 2024-09-12T02:42:21.517 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5df00a2cd0 msgr2=0x7f5df00a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5df00a2cd0 0x7f5df00a5190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5dec005fd0 tx=0x7f5dec017000 comp rx=0 tx=0).stop 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e04196410 msgr2=0x7f5e041968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e04196410 0x7f5e041968c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ea80 tx=0x7f5dfc00ef40 comp rx=0 tx=0).stop 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 shutdown_connections 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5df00a2cd0 0x7f5df00a5190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e04196410 0x7f5e041968c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e04102ef0 0x7f5e0419b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 --2- 172.21.15.100:0/1267262876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e04102570 0x7f5e0419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 >> 172.21.15.100:0/1267262876 conn(0x7f5e040fc7d0 msgr2=0x7f5e040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 shutdown_connections 2024-09-12T02:42:21.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:21.503+0000 7f5e09800640 1 -- 172.21.15.100:0/1267262876 wait complete. 2024-09-12T02:42:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:22 smithi189 ceph-mon[35196]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 793 op/s 2024-09-12T02:42:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:22 smithi117 ceph-mon[34898]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 793 op/s 2024-09-12T02:42:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:22 smithi100 ceph-mon[31390]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 793 op/s 2024-09-12T02:42:23.358 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:42:23.358 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:42:23.714 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:24 smithi189 ceph-mon[35196]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 752 op/s 2024-09-12T02:42:25.017 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:24 smithi100 ceph-mon[31390]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 752 op/s 2024-09-12T02:42:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:24 smithi117 ceph-mon[34898]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 752 op/s 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 -- 172.21.15.100:0/774868503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0101420 msgr2=0x7f4bb010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 --2- 172.21.15.100:0/774868503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0101420 0x7f4bb010d950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009890 tx=0x7f4ba002a380 comp rx=0 tx=0).stop 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 -- 172.21.15.100:0/774868503 shutdown_connections 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 --2- 172.21.15.100:0/774868503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0101420 0x7f4bb010d950 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 --2- 172.21.15.100:0/774868503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0100a80 0x7f4bb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 --2- 172.21.15.100:0/774868503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0106a80 0x7f4bb0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 -- 172.21.15.100:0/774868503 >> 172.21.15.100:0/774868503 conn(0x7f4bb00fc7a0 msgr2=0x7f4bb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 -- 172.21.15.100:0/774868503 shutdown_connections 2024-09-12T02:42:25.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.137+0000 7f4bb5818640 1 -- 172.21.15.100:0/774868503 wait complete. 2024-09-12T02:42:25.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.138+0000 7f4bb5818640 1 Processor -- start 2024-09-12T02:42:25.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.138+0000 7f4bb5818640 1 -- start start 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bb5818640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0100a80 0x7f4bb0109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bb5818640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0101420 0x7f4bb010a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bb5818640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0106a80 0x7f4bb010a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bb5818640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb010fdb0 con 0x7f4bb0100a80 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bb5818640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb010fc30 con 0x7f4bb0101420 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bb5818640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb010ff30 con 0x7f4bb0106a80 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0100a80 0x7f4bb0109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0101420 0x7f4bb010a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0100a80 0x7f4bb0109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33082/0 (socket says 172.21.15.100:33082) 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0101420 0x7f4bb010a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48988/0 (socket says 172.21.15.100:48988) 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 -- 172.21.15.100:0/1194944794 learned_addr learned my addr 172.21.15.100:0/1194944794 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0106a80 0x7f4bb010a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 -- 172.21.15.100:0/1194944794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0106a80 msgr2=0x7f4bb010a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0106a80 0x7f4bb010a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 -- 172.21.15.100:0/1194944794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0101420 msgr2=0x7f4bb010a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0101420 0x7f4bb010a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 -- 172.21.15.100:0/1194944794 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb01aad70 con 0x7f4bb0100a80 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4baeffd640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0100a80 0x7f4bb0109c20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800efb0 tx=0x7f4ba800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.139+0000 7f4bb4816640 1 -- 172.21.15.100:0/1194944794 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba801b070 con 0x7f4bb0100a80 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.140+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb01ab060 con 0x7f4bb0100a80 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.140+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb01ab5f0 con 0x7f4bb0100a80 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.140+0000 7f4bb4816640 1 -- 172.21.15.100:0/1194944794 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba800ba50 con 0x7f4bb0100a80 2024-09-12T02:42:25.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.140+0000 7f4bb4816640 1 -- 172.21.15.100:0/1194944794 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8016c00 con 0x7f4bb0100a80 2024-09-12T02:42:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 Processor -- start 2024-09-12T02:42:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 -- start start 2024-09-12T02:42:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c8480 0x55588c0d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55588c02d280 con 0x55588c0d2d40 2024-09-12T02:42:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55588bfd4b10 con 0x55588c0c8480 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bb7bf1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55588c029240 con 0x55588c0c7b60 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:52702/0 (socket says 172.21.15.100:52702) 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 -- 172.21.15.100:0/2175302752 learned_addr learned my addr 172.21.15.100:0/2175302752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 -- 172.21.15.100:0/2175302752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c8480 msgr2=0x55588c0d2800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c8480 0x55588c0d2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 -- 172.21.15.100:0/2175302752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 msgr2=0x55588c0d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4baf7fe640 1 -- 172.21.15.100:0/2175302752 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55588bfe11f0 con 0x55588c0c7b60 2024-09-12T02:42:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.143+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.144+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0c7f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0035040 tx=0x7f4ba0009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15657ae71d76da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.144+0000 7f4bb4816640 1 -- 172.21.15.100:0/1194944794 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4ba801e070 con 0x7f4bb0100a80 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.144+0000 7f4b95ffb640 1 -- 172.21.15.100:0/2175302752 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0041020 con 0x55588c0c7b60 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.144+0000 7f4b95ffb640 1 -- 172.21.15.100:0/2175302752 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0030e50 con 0x55588c0c7b60 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.144+0000 7f4b95ffb640 1 -- 172.21.15.100:0/2175302752 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0037040 con 0x55588c0c7b60 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.144+0000 7f4bb4816640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b980a2b80 0x7f4b980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4baeffd640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b980a2b80 0x7f4b980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb4816640 1 -- 172.21.15.100:0/1194944794 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4ba80cec10 con 0x7f4bb0100a80 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/2175302752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 msgr2=0x55588c0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0c7f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0035040 tx=0x7f4ba0009520 comp rx=0 tx=0).stop 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/2175302752 shutdown_connections 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c8480 0x55588c0d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/2175302752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0c7f40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/2175302752 >> 172.21.15.100:0/2175302752 conn(0x55588c0c40f0 msgr2=0x55588c0c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/2175302752 shutdown_connections 2024-09-12T02:42:25.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/2175302752 wait complete. 2024-09-12T02:42:25.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4baeffd640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b980a2b80 0x7f4b980a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4ba809b210 tx=0x7f4ba806b3c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.145+0000 7f4bb7bf1740 1 -- start start 2024-09-12T02:42:25.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.146+0000 7f4bb7bf1740 1 Processor -- start 2024-09-12T02:42:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.146+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.146+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c8480 0x55588c0d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4bb7bf1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55588c0d59b0 con 0x55588c0d2d40 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4bb7bf1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55588bfe7f10 con 0x55588c0c7b60 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49000/0 (socket says 172.21.15.100:49000) 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c8480 0x55588c0d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 -- 172.21.15.100:0/3140958189 learned_addr learned my addr 172.21.15.100:0/3140958189 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55588c0d5b30 con 0x55588c0c8480 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4bb7bf1740 10 client.0 _ll_register_callbacks cb 0x55588bfb0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 -- 172.21.15.100:0/3140958189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c8480 msgr2=0x55588c0d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c8480 0x55588c0d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 -- 172.21.15.100:0/3140958189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 msgr2=0x55588c0d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 -- 172.21.15.100:0/3140958189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55588bd9e6a0 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0cfbd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ba002a8a0 tx=0x7f4ba0005870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85339c57e9ee4bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.147+0000 7f4b8effd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4b8effd640 1 -- 172.21.15.100:0/3140958189 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba004c070 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4b8effd640 1 -- 172.21.15.100:0/3140958189 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4ba00036f0 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba0030e50 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4b8effd640 1 -- 172.21.15.100:0/3140958189 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ba0058050 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 10 client.25436 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55588c0e1570 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4b8effd640 1 -- 172.21.15.100:0/3140958189 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0030e50 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4b8effd640 1 -- 172.21.15.100:0/3140958189 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4ba003d7f0 con 0x55588c0c7b60 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 10 client.25436 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 10 client.25436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 20 client.25436 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c0e28c0 0x55588c0e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 4 client.25436 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55588c03a7f0 con 0x55588c0e28c0 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.148+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c0e28c0 0x55588c0e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.149+0000 7f4b8effd640 10 client.25436 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.149+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c0e28c0 0x55588c0e4cb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee8fb18cfd684099 server_cookie=cec9dc249203b4a7 in_seq=0 out_seq=0 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.150+0000 7f4b8effd640 1 -- 172.21.15.100:0/3140958189 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55588c03a7f0 con 0x55588c0e28c0 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.150+0000 7f4b8effd640 10 client.25436 handle_command_reply: tid=0 2024-09-12T02:42:25.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.150+0000 7f4bb7bf1740 1 client.25436 shutdown 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.152+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 msgr2=0x55588c0cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.152+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0cfbd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ba002a8a0 tx=0x7f4ba0005870 comp rx=0 tx=0).stop 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 shutdown_connections 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c0e28c0 0x55588c0e4cb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0d2d40 0x55588c0d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c8480 0x55588c0d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3140958189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0cfbd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4b8effd640 0 client.25436 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:25.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 >> 172.21.15.100:0/3140958189 conn(0x55588c0c40f0 msgr2=0x55588c0c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 shutdown_connections 2024-09-12T02:42:25.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3140958189 wait complete. 2024-09-12T02:42:25.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.153+0000 7f4bb7bf1740 20 client.25436 trim_cache size 0 max 16384 2024-09-12T02:42:25.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.177+0000 7f4bb7bf1740 1 Processor -- start 2024-09-12T02:42:25.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.177+0000 7f4bb7bf1740 1 -- start start 2024-09-12T02:42:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0d2d40 0x55588c0ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4bb7bf1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b64f0 con 0x55588c0c8480 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4bb7bf1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b3dc0 con 0x55588c0c7b60 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49016/0 (socket says 172.21.15.100:49016) 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4baf7fe640 1 -- 172.21.15.100:0/667411975 learned_addr learned my addr 172.21.15.100:0/667411975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/667411975 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b1c10 con 0x55588c0d2d40 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.178+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0d2d40 0x55588c0ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4bae7fc640 1 -- 172.21.15.100:0/667411975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0d2d40 msgr2=0x55588c0ea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0d2d40 0x55588c0ea2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4bae7fc640 1 -- 172.21.15.100:0/667411975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 msgr2=0x55588c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4bae7fc640 1 -- 172.21.15.100:0/667411975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55588c0c82b0 con 0x55588c0c8480 2024-09-12T02:42:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0c3160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55588c0cf460 tx=0x7f4ba40090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2124b0c95b129a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4b957fa640 1 -- 172.21.15.100:0/667411975 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40158d0 con 0x55588c0c8480 2024-09-12T02:42:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4b957fa640 1 -- 172.21.15.100:0/667411975 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba4025070 con 0x55588c0c8480 2024-09-12T02:42:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.179+0000 7f4b957fa640 1 -- 172.21.15.100:0/667411975 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4014670 con 0x55588c0c8480 2024-09-12T02:42:25.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/667411975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 msgr2=0x55588c0c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0c3160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55588c0cf460 tx=0x7f4ba40090e0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/667411975 shutdown_connections 2024-09-12T02:42:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0d2d40 0x55588c0ea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0c3160 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/667411975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0c7b60 0x55588c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/667411975 >> 172.21.15.100:0/667411975 conn(0x55588c0c40f0 msgr2=0x55588c0c2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/667411975 shutdown_connections 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.180+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/667411975 wait complete. 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.181+0000 7f4bb7bf1740 1 -- start start 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.181+0000 7f4bb7bf1740 1 Processor -- start 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0dadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bb7bf1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0d2d40 0x55588c0d7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0db2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33130/0 (socket says 172.21.15.100:33130) 2024-09-12T02:42:25.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bae7fc640 1 -- 172.21.15.100:0/3884534583 learned_addr learned my addr 172.21.15.100:0/3884534583 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:25.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b2280 con 0x55588c0c8480 2024-09-12T02:42:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b36f0 con 0x55588c0d2d40 2024-09-12T02:42:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b2950 con 0x55588c0c7b60 2024-09-12T02:42:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0d2d40 0x55588c0d7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.182+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0dadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bb7bf1740 10 client.0 _ll_register_callbacks cb 0x7f4ba40093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bae7fc640 1 -- 172.21.15.100:0/3884534583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 msgr2=0x55588c0dadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0dadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bae7fc640 1 -- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0d2d40 msgr2=0x55588c0d7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0d2d40 0x55588c0d7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bae7fc640 1 -- 172.21.15.100:0/3884534583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55588c0cdb10 con 0x55588c0c8480 2024-09-12T02:42:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0d2d40 0x55588c0d7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bae7fc640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0db2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009c10 tx=0x7f4ba401fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a733eed5683d02ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4b8effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4b8effd640 1 -- 172.21.15.100:0/3884534583 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4005970 con 0x55588c0c8480 2024-09-12T02:42:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4b8effd640 1 -- 172.21.15.100:0/3884534583 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4ba4005b10 con 0x55588c0c8480 2024-09-12T02:42:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.183+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba4025070 con 0x55588c0c8480 2024-09-12T02:42:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.184+0000 7f4b8effd640 1 -- 172.21.15.100:0/3884534583 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ba4005d10 con 0x55588c0c8480 2024-09-12T02:42:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.184+0000 7f4bb7bf1740 10 client.15996 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.184+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55588c14d7c0 con 0x55588c0c8480 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4b8effd640 1 -- 172.21.15.100:0/3884534583 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba4025070 con 0x55588c0c8480 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4b8effd640 1 -- 172.21.15.100:0/3884534583 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4ba4032030 con 0x55588c0c8480 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4bb7bf1740 10 client.15996 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4bb7bf1740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4bb7bf1740 20 client.15996 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c14df00 0x55588c150320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4bb7bf1740 4 client.15996 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.185+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55588c034d00 con 0x55588c14df00 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.186+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c14df00 0x55588c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.186+0000 7f4b8effd640 10 client.15996 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.187+0000 7f4baf7fe640 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c14df00 0x55588c150320 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d135f06f13abe8f server_cookie=b6f2221ec97682cf in_seq=0 out_seq=0 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.188+0000 7f4b8effd640 1 -- 172.21.15.100:0/3884534583 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55588c034d00 con 0x55588c14df00 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.188+0000 7f4b8effd640 10 client.15996 handle_command_reply: tid=0 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.188+0000 7f4bb7bf1740 1 client.15996 shutdown 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.188+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 msgr2=0x55588c0db2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.188+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0db2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009c10 tx=0x7f4ba401fde0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.188+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 shutdown_connections 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.188+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55588c14df00 0x55588c150320 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55588c0d2d40 0x55588c0d7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4b8effd640 0 client.15996 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55588c0c8480 0x55588c0db2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4bb7bf1740 1 --2- 172.21.15.100:0/3884534583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55588c0c7b60 0x55588c0dadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 >> 172.21.15.100:0/3884534583 conn(0x55588c0c40f0 msgr2=0x55588c0c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 shutdown_connections 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4bb7bf1740 1 -- 172.21.15.100:0/3884534583 wait complete. 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.189+0000 7f4bb7bf1740 20 client.15996 trim_cache size 0 max 16384 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "c76f998e-4ac4-451b-ba8b-828b155a695d", 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:42:25.202 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b980a2b80 msgr2=0x7f4b980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b980a2b80 0x7f4b980a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4ba809b210 tx=0x7f4ba806b3c0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0100a80 msgr2=0x7f4bb0109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0100a80 0x7f4bb0109c20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800efb0 tx=0x7f4ba800c800 comp rx=0 tx=0).stop 2024-09-12T02:42:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 shutdown_connections 2024-09-12T02:42:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b980a2b80 0x7f4b980a5040 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bb0106a80 0x7f4bb010a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0101420 0x7f4bb010a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 --2- 172.21.15.100:0/1194944794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb0100a80 0x7f4bb0109c20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 >> 172.21.15.100:0/1194944794 conn(0x7f4bb00fc7a0 msgr2=0x7f4bb00fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 shutdown_connections 2024-09-12T02:42:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:25.190+0000 7f4bb5818640 1 -- 172.21.15.100:0/1194944794 wait complete. 2024-09-12T02:42:25.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:25 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:42:25.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:25 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:25.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:25 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:42:25.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:25 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:42:25.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:25 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:25.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:25 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:25.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:42:26.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:25 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:42:26.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:25 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:26.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:25 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:42:26.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:25 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:42:26.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:25 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:26.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:25 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:26.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:25 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:42:26.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:25 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:26.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:25 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:42:26.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:25 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:42:26.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:25 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:26.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:25 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:42:26.288 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 195.0 s, 3692.1 tps, lat 27.109 ms stddev 29.772 2024-09-12T02:42:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.836+0000 7f4357fff640 1 -- 172.21.15.100:0/293044417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500ab5c0 msgr2=0x7f43500ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.836+0000 7f4357fff640 1 --2- 172.21.15.100:0/293044417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500ab5c0 0x7f43500ab9a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4348009900 tx=0x7f434802a410 comp rx=0 tx=0).stop 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.837+0000 7f4357fff640 1 -- 172.21.15.100:0/293044417 shutdown_connections 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.837+0000 7f4357fff640 1 --2- 172.21.15.100:0/293044417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43500a6b40 0x7f43500b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.837+0000 7f4357fff640 1 --2- 172.21.15.100:0/293044417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43500a61c0 0x7f43500a6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.837+0000 7f4357fff640 1 --2- 172.21.15.100:0/293044417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500ab5c0 0x7f43500ab9a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.837+0000 7f4357fff640 1 -- 172.21.15.100:0/293044417 >> 172.21.15.100:0/293044417 conn(0x7f435001a0e0 msgr2=0x7f435001a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.837+0000 7f4357fff640 1 -- 172.21.15.100:0/293044417 shutdown_connections 2024-09-12T02:42:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.837+0000 7f4357fff640 1 -- 172.21.15.100:0/293044417 wait complete. 2024-09-12T02:42:26.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.838+0000 7f4357fff640 1 Processor -- start 2024-09-12T02:42:26.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4357fff640 1 -- start start 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4357fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43500a61c0 0x7f435013f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4357fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500a6b40 0x7f435013f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4357fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43500ab5c0 0x7f4350143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4357fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43500b8c80 con 0x7f43500a6b40 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4357fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f43500b8b00 con 0x7f43500ab5c0 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4357fff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43500b8e00 con 0x7f43500a61c0 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43500a61c0 0x7f435013f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43500a61c0 0x7f435013f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:52740/0 (socket says 172.21.15.100:52740) 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f4356ffd640 1 -- 172.21.15.100:0/3465029356 learned_addr learned my addr 172.21.15.100:0/3465029356 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f43567fc640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500a6b40 0x7f435013f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.839+0000 7f43577fe640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43500ab5c0 0x7f4350143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.840+0000 7f43567fc640 1 -- 172.21.15.100:0/3465029356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43500a61c0 msgr2=0x7f435013f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.840+0000 7f43567fc640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43500a61c0 0x7f435013f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.840+0000 7f43567fc640 1 -- 172.21.15.100:0/3465029356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43500ab5c0 msgr2=0x7f4350143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.840+0000 7f43567fc640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43500ab5c0 0x7f4350143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.840+0000 7f43567fc640 1 -- 172.21.15.100:0/3465029356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43501440f0 con 0x7f43500a6b40 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.840+0000 7f43577fe640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43500ab5c0 0x7f4350143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.841+0000 7f43567fc640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500a6b40 0x7f435013f680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f434c00e9f0 tx=0x7f434c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.841+0000 7f435c955640 1 -- 172.21.15.100:0/3465029356 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c00ccc0 con 0x7f43500a6b40 2024-09-12T02:42:26.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.841+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43501443e0 con 0x7f43500a6b40 2024-09-12T02:42:26.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.841+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435014bcc0 con 0x7f43500a6b40 2024-09-12T02:42:26.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.842+0000 7f435c955640 1 -- 172.21.15.100:0/3465029356 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f434c010910 con 0x7f43500a6b40 2024-09-12T02:42:26.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.842+0000 7f435c955640 1 -- 172.21.15.100:0/3465029356 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c026060 con 0x7f43500a6b40 2024-09-12T02:42:26.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.845+0000 7f435fd30740 1 Processor -- start 2024-09-12T02:42:26.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f435fd30740 1 -- start start 2024-09-12T02:42:26.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f435fd30740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70590 0x560ea5b70970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f435fd30740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b70eb0 0x560ea5b83b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f435fd30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b84060 0x560ea5b86450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f435fd30740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560ea5ad62e0 con 0x560ea5b70590 2024-09-12T02:42:26.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f435fd30740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560ea5a7dce0 con 0x560ea5b70eb0 2024-09-12T02:42:26.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f435fd30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ea5ad22a0 con 0x560ea5b84060 2024-09-12T02:42:26.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.846+0000 7f43577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70590 0x560ea5b70970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f43577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70590 0x560ea5b70970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33164/0 (socket says 172.21.15.100:33164) 2024-09-12T02:42:26.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f43577fe640 1 -- 172.21.15.100:0/4288545133 learned_addr learned my addr 172.21.15.100:0/4288545133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:26.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f4356ffd640 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b70eb0 0x560ea5b83b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f43577fe640 1 -- 172.21.15.100:0/4288545133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b84060 msgr2=0x560ea5b86450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f43577fe640 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b84060 0x560ea5b86450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f43577fe640 1 -- 172.21.15.100:0/4288545133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b70eb0 msgr2=0x560ea5b83b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f43577fe640 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b70eb0 0x560ea5b83b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f43577fe640 1 -- 172.21.15.100:0/4288545133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ea5a62440 con 0x560ea5b70590 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.847+0000 7f435c955640 1 -- 172.21.15.100:0/3465029356 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f434c0186c0 con 0x7f43500a6b40 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.848+0000 7f43577fe640 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70590 0x560ea5b70970 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f43580680a0 tx=0x7f43580505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a5d181942479bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.848+0000 7f433dffb640 1 -- 172.21.15.100:0/4288545133 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43580796a0 con 0x560ea5b70590 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.848+0000 7f433dffb640 1 -- 172.21.15.100:0/4288545133 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4358079d20 con 0x560ea5b70590 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435c955640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43400a2d70 0x7f43400a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435c955640 1 -- 172.21.15.100:0/3465029356 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f434c0cefd0 con 0x7f43500a6b40 2024-09-12T02:42:26.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f4356ffd640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43400a2d70 0x7f43400a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435fd30740 1 -- 172.21.15.100:0/4288545133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70590 msgr2=0x560ea5b70970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435fd30740 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70590 0x560ea5b70970 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f43580680a0 tx=0x7f43580505d0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435fd30740 1 -- 172.21.15.100:0/4288545133 shutdown_connections 2024-09-12T02:42:26.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435fd30740 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b84060 0x560ea5b86450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435fd30740 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b70eb0 0x560ea5b83b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435fd30740 1 --2- 172.21.15.100:0/4288545133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70590 0x560ea5b70970 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.849+0000 7f435fd30740 1 -- 172.21.15.100:0/4288545133 >> 172.21.15.100:0/4288545133 conn(0x560ea5b6cc00 msgr2=0x560ea5b6cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.850+0000 7f4356ffd640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43400a2d70 0x7f43400a5230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f43480096c0 tx=0x7f43480046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.851+0000 7f435fd30740 1 -- 172.21.15.100:0/4288545133 shutdown_connections 2024-09-12T02:42:26.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.851+0000 7f435fd30740 1 -- 172.21.15.100:0/4288545133 wait complete. 2024-09-12T02:42:26.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.851+0000 7f435fd30740 1 -- start start 2024-09-12T02:42:26.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 1 Processor -- start 2024-09-12T02:42:26.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5b7d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5b7dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b84060 0x560ea5b83540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560ea5b734f0 con 0x560ea5b70eb0 2024-09-12T02:42:26.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560ea5a91050 con 0x560ea5b84060 2024-09-12T02:42:26.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ea5b73670 con 0x560ea5b70590 2024-09-12T02:42:26.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f435fd30740 10 client.0 _ll_register_callbacks cb 0x560ea5ad1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5b7d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5b7d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:52746/0 (socket says 172.21.15.100:52746) 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f4356ffd640 1 -- 172.21.15.100:0/2031488042 learned_addr learned my addr 172.21.15.100:0/2031488042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.852+0000 7f43577fe640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b84060 0x560ea5b83540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f43567fc640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5b7dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4356ffd640 1 -- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b84060 msgr2=0x560ea5b83540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4356ffd640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b84060 0x560ea5b83540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4356ffd640 1 -- 172.21.15.100:0/2031488042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 msgr2=0x560ea5b7dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4356ffd640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5b7dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4356ffd640 1 -- 172.21.15.100:0/2031488042 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ea58473c0 con 0x560ea5b70590 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f43577fe640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b84060 0x560ea5b83540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4356ffd640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5b7d830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43480038a0 tx=0x7f4348009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d63277a73dd4b91f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4336ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:42:26.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4336ffd640 1 -- 172.21.15.100:0/2031488042 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434804e070 con 0x560ea5b70590 2024-09-12T02:42:26.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f4336ffd640 1 -- 172.21.15.100:0/2031488042 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4348031540 con 0x560ea5b70590 2024-09-12T02:42:26.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.853+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4358079d20 con 0x560ea5b70590 2024-09-12T02:42:26.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.854+0000 7f4336ffd640 1 -- 172.21.15.100:0/2031488042 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4348035040 con 0x560ea5b70590 2024-09-12T02:42:26.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.854+0000 7f435fd30740 10 client.25441 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:26.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.854+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ea5b9b000 con 0x560ea5b70590 2024-09-12T02:42:26.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.854+0000 7f4336ffd640 1 -- 172.21.15.100:0/2031488042 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4358079d20 con 0x560ea5b70590 2024-09-12T02:42:26.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.855+0000 7f4336ffd640 1 -- 172.21.15.100:0/2031488042 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f434804a8e0 con 0x560ea5b70590 2024-09-12T02:42:26.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.855+0000 7f435fd30740 10 client.25441 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:26.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.855+0000 7f435fd30740 10 client.25441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:26.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.855+0000 7f435fd30740 20 client.25441 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:26.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.855+0000 7f435fd30740 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b9c350 0x560ea5b9e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.855+0000 7f435fd30740 4 client.25441 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.855+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ea5ae3850 con 0x560ea5b9c350 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.856+0000 7f43567fc640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b9c350 0x560ea5b9e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.856+0000 7f4336ffd640 10 client.25441 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.856+0000 7f43567fc640 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b9c350 0x560ea5b9e760 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b423a60c504e0a7 server_cookie=d36f9277b637280f in_seq=0 out_seq=0 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f4336ffd640 1 -- 172.21.15.100:0/2031488042 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ea5ae3850 con 0x560ea5b9c350 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f4336ffd640 10 client.25441 handle_command_reply: tid=0 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 client.25441 shutdown 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 msgr2=0x560ea5b7d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5b7d830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43480038a0 tx=0x7f4348009260 comp rx=0 tx=0).stop 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 shutdown_connections 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b9c350 0x560ea5b9e760 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b84060 0x560ea5b83540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5b7dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 --2- 172.21.15.100:0/2031488042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5b7d830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 >> 172.21.15.100:0/2031488042 conn(0x560ea5b6cc00 msgr2=0x560ea5b72890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f4336ffd640 0 client.25441 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 shutdown_connections 2024-09-12T02:42:26.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 1 -- 172.21.15.100:0/2031488042 wait complete. 2024-09-12T02:42:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.857+0000 7f435fd30740 20 client.25441 trim_cache size 0 max 16384 2024-09-12T02:42:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 Processor -- start 2024-09-12T02:42:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 -- start start 2024-09-12T02:42:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5b834b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5ba4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5ba4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4344010d90 con 0x560ea5b70eb0 2024-09-12T02:42:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f434400e660 con 0x560ea5b6cc00 2024-09-12T02:42:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.879+0000 7f435fd30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f434400c4b0 con 0x560ea5b70590 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5b834b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5b834b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49074/0 (socket says 172.21.15.100:49074) 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 -- 172.21.15.100:0/1665574090 learned_addr learned my addr 172.21.15.100:0/1665574090 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f43577fe640 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5ba4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f43567fc640 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5ba4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 -- 172.21.15.100:0/1665574090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 msgr2=0x560ea5ba4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5ba4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 -- 172.21.15.100:0/1665574090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 msgr2=0x560ea5ba4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5ba4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.880+0000 7f4356ffd640 1 -- 172.21.15.100:0/1665574090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ea5b86790 con 0x560ea5b6cc00 2024-09-12T02:42:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.881+0000 7f43577fe640 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5ba4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.881+0000 7f43567fc640 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5ba4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.881+0000 7f4356ffd640 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5b834b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f434804aef0 tx=0x7f434802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c47e66b17b20ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.881+0000 7f433d7fa640 1 -- 172.21.15.100:0/1665574090 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434804e070 con 0x560ea5b6cc00 2024-09-12T02:42:26.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.881+0000 7f433d7fa640 1 -- 172.21.15.100:0/1665574090 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4348004100 con 0x560ea5b6cc00 2024-09-12T02:42:26.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.881+0000 7f433d7fa640 1 -- 172.21.15.100:0/1665574090 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348031c90 con 0x560ea5b6cc00 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 -- 172.21.15.100:0/1665574090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 msgr2=0x560ea5b834b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5b834b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f434804aef0 tx=0x7f434802a410 comp rx=0 tx=0).stop 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 -- 172.21.15.100:0/1665574090 shutdown_connections 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5ba4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5ba4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 --2- 172.21.15.100:0/1665574090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5b834b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 -- 172.21.15.100:0/1665574090 >> 172.21.15.100:0/1665574090 conn(0x560ea5b74540 msgr2=0x560ea5b77420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 -- 172.21.15.100:0/1665574090 shutdown_connections 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 -- 172.21.15.100:0/1665574090 wait complete. 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.882+0000 7f435fd30740 1 -- start start 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 1 Processor -- start 2024-09-12T02:42:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5bb0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5bab630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5babb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f434400cb20 con 0x560ea5b70eb0 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f434400df90 con 0x560ea5b6cc00 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f434400d1f0 con 0x560ea5b70590 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f435fd30740 10 client.0 _ll_register_callbacks cb 0x7f4348009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5bb0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5bb0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49080/0 (socket says 172.21.15.100:49080) 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 -- 172.21.15.100:0/3088047742 learned_addr learned my addr 172.21.15.100:0/3088047742 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f43577fe640 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5babb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f43567fc640 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5bab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 -- 172.21.15.100:0/3088047742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 msgr2=0x560ea5bab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5bab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 -- 172.21.15.100:0/3088047742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 msgr2=0x560ea5babb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5babb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.883+0000 7f4356ffd640 1 -- 172.21.15.100:0/3088047742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ea5bac1b0 con 0x560ea5b6cc00 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.884+0000 7f4356ffd640 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5bb0300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4348032c80 tx=0x7f4348009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=129e15d546dee4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.884+0000 7f4336ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.884+0000 7f4336ffd640 1 -- 172.21.15.100:0/3088047742 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434804e040 con 0x560ea5b6cc00 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.884+0000 7f4336ffd640 1 -- 172.21.15.100:0/3088047742 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f434804a650 con 0x560ea5b6cc00 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.884+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4348004100 con 0x560ea5b6cc00 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.885+0000 7f4336ffd640 1 -- 172.21.15.100:0/3088047742 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f434804a850 con 0x560ea5b6cc00 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.885+0000 7f435fd30740 10 client.25457 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.885+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ea5c06c50 con 0x560ea5b6cc00 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f4336ffd640 1 -- 172.21.15.100:0/3088047742 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f434804a9f0 con 0x560ea5b6cc00 2024-09-12T02:42:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f4336ffd640 1 -- 172.21.15.100:0/3088047742 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f434805e770 con 0x560ea5b6cc00 2024-09-12T02:42:26.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f435fd30740 10 client.25457 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:26.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f435fd30740 10 client.25457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:26.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f435fd30740 20 client.25457 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:26.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f435fd30740 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b84060 0x560ea5c09290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f435fd30740 4 client.25457 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:42:26.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.886+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4348004100 con 0x560ea5b84060 2024-09-12T02:42:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.887+0000 7f43567fc640 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b84060 0x560ea5c09290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f43567fc640 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b84060 0x560ea5c09290 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aa847ea11734db3 server_cookie=cef2241d3a7cac25 in_seq=0 out_seq=0 2024-09-12T02:42:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f4336ffd640 10 client.25457 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f4336ffd640 1 -- 172.21.15.100:0/3088047742 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f4348004100 con 0x560ea5b84060 2024-09-12T02:42:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f4336ffd640 10 client.25457 handle_command_reply: tid=0 2024-09-12T02:42:26.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 client.25457 shutdown 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 msgr2=0x560ea5bb0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5bb0300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4348032c80 tx=0x7f4348009260 comp rx=0 tx=0).stop 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 shutdown_connections 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560ea5b84060 0x560ea5c09290 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ea5b70eb0 0x560ea5babb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ea5b70590 0x560ea5bab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 --2- 172.21.15.100:0/3088047742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560ea5b6cc00 0x560ea5bb0300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 >> 172.21.15.100:0/3088047742 conn(0x560ea5b74540 msgr2=0x560ea5b77810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f4336ffd640 0 client.25457 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 shutdown_connections 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 1 -- 172.21.15.100:0/3088047742 wait complete. 2024-09-12T02:42:26.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.888+0000 7f435fd30740 20 client.25457 trim_cache size 0 max 16384 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: "c76f998e-4ac4-451b-ba8b-828b155a695d": { 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "c76f998e-4ac4-451b-ba8b-828b155a695d", 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:26.893 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:42:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43400a2d70 msgr2=0x7f43400a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43400a2d70 0x7f43400a5230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f43480096c0 tx=0x7f43480046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500a6b40 msgr2=0x7f435013f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500a6b40 0x7f435013f680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f434c00e9f0 tx=0x7f434c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 shutdown_connections 2024-09-12T02:42:26.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f43400a2d70 0x7f43400a5230 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43500ab5c0 0x7f4350143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43500a6b40 0x7f435013f680 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 --2- 172.21.15.100:0/3465029356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43500a61c0 0x7f435013f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 >> 172.21.15.100:0/3465029356 conn(0x7f435001a0e0 msgr2=0x7f43500a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 shutdown_connections 2024-09-12T02:42:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:26.889+0000 7f4357fff640 1 -- 172.21.15.100:0/3465029356 wait complete. 2024-09-12T02:42:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:26 smithi189 ceph-mon[35196]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 757 op/s 2024-09-12T02:42:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:26 smithi117 ceph-mon[34898]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 757 op/s 2024-09-12T02:42:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:26 smithi100 ceph-mon[31390]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 757 op/s 2024-09-12T02:42:27.771 INFO:tasks.cephfs.filesystem:scrub status for tag:c76f998e-4ac4-451b-ba8b-828b155a695d - {'path': '/', 'tag': 'c76f998e-4ac4-451b-ba8b-828b155a695d', 'options': 'recursive,force'} 2024-09-12T02:42:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:28 smithi189 ceph-mon[35196]: pgmap v450: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-12T02:42:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:28 smithi117 ceph-mon[34898]: pgmap v450: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-12T02:42:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:28 smithi100 ceph-mon[31390]: pgmap v450: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-12T02:42:29.330 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-12T02:42:29.330 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-12T02:42:29.331 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:42:29.690 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:30.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.397+0000 7f3f56c8a640 1 -- 172.21.15.100:0/4003514703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f50105ec0 msgr2=0x7f3f50106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.397+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/4003514703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f50105ec0 0x7f3f50106340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009900 tx=0x7f3f4802a400 comp rx=0 tx=0).stop 2024-09-12T02:42:30.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.399+0000 7f3f56c8a640 1 -- 172.21.15.100:0/4003514703 shutdown_connections 2024-09-12T02:42:30.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.399+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/4003514703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f50105ec0 0x7f3f50106340 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.399+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/4003514703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501011e0 0x7f3f50105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.399+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/4003514703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f501008c0 0x7f3f50100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.399+0000 7f3f56c8a640 1 -- 172.21.15.100:0/4003514703 >> 172.21.15.100:0/4003514703 conn(0x7f3f500fc7d0 msgr2=0x7f3f500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:30.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.402+0000 7f3f56c8a640 1 -- 172.21.15.100:0/4003514703 shutdown_connections 2024-09-12T02:42:30.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.402+0000 7f3f56c8a640 1 -- 172.21.15.100:0/4003514703 wait complete. 2024-09-12T02:42:30.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.403+0000 7f3f56c8a640 1 Processor -- start 2024-09-12T02:42:30.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.403+0000 7f3f56c8a640 1 -- start start 2024-09-12T02:42:30.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f56c8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501008c0 0x7f3f50073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f56c8a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f501011e0 0x7f3f5006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f56c8a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f50105ec0 0x7f3f5006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f54a26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501008c0 0x7f3f50073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f54a26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501008c0 0x7f3f50073b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49102/0 (socket says 172.21.15.100:49102) 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f54a26640 1 -- 172.21.15.100:0/60183619 learned_addr learned my addr 172.21.15.100:0/60183619 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5006c620 con 0x7f3f50105ec0 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5006c4a0 con 0x7f3f501008c0 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.404+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5006c7a0 con 0x7f3f501011e0 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f4ffff640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f501011e0 0x7f3f5006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f54a26640 1 -- 172.21.15.100:0/60183619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f501011e0 msgr2=0x7f3f5006dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f54a26640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f501011e0 0x7f3f5006dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f54a26640 1 -- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f50105ec0 msgr2=0x7f3f5006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f54a26640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f50105ec0 0x7f3f5006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f54a26640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5006e860 con 0x7f3f501008c0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f4ffff640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f501011e0 0x7f3f5006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.405+0000 7f3f54a26640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501008c0 0x7f3f50073b70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000ebc0 tx=0x7f3f4000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.406+0000 7f3f4dffb640 1 -- 172.21.15.100:0/60183619 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40010630 con 0x7f3f501008c0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.406+0000 7f3f4dffb640 1 -- 172.21.15.100:0/60183619 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f40010cb0 con 0x7f3f501008c0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.406+0000 7f3f4dffb640 1 -- 172.21.15.100:0/60183619 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40018bd0 con 0x7f3f501008c0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.406+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f501b3950 con 0x7f3f501008c0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.406+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f501b3db0 con 0x7f3f501008c0 2024-09-12T02:42:30.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.408+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5006a850 con 0x7f3f501008c0 2024-09-12T02:42:30.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.409+0000 7f3f4dffb640 1 -- 172.21.15.100:0/60183619 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3f400107d0 con 0x7f3f501008c0 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.410+0000 7f3f4dffb640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f3c0a2d10 0x7f3f3c0a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.410+0000 7f3f4dffb640 1 -- 172.21.15.100:0/60183619 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3f400cf620 con 0x7f3f501008c0 2024-09-12T02:42:30.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.410+0000 7f3f4ffff640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f3c0a2d10 0x7f3f3c0a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.411+0000 7f3f4ffff640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f3c0a2d10 0x7f3f3c0a51d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f5006f3b0 tx=0x7f3f38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.416+0000 7f3f4dffb640 1 -- 172.21.15.100:0/60183619 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f4009c570 con 0x7f3f501008c0 2024-09-12T02:42:30.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.720+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f501b4010 con 0x7f3f501008c0 2024-09-12T02:42:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.725+0000 7f3f4dffb640 1 -- 172.21.15.100:0/60183619 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f3f4009be70 con 0x7f3f501008c0 2024-09-12T02:42:30.725 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:42:30.726 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:42:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:42:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.728+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f3c0a2d10 msgr2=0x7f3f3c0a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.728+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f3c0a2d10 0x7f3f3c0a51d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f5006f3b0 tx=0x7f3f38005f90 comp rx=0 tx=0).stop 2024-09-12T02:42:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.728+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501008c0 msgr2=0x7f3f50073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.728+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501008c0 0x7f3f50073b70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000ebc0 tx=0x7f3f4000c6a0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 shutdown_connections 2024-09-12T02:42:30.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f3c0a2d10 0x7f3f3c0a51d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f50105ec0 0x7f3f5006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f501011e0 0x7f3f5006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 --2- 172.21.15.100:0/60183619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f501008c0 0x7f3f50073b70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 >> 172.21.15.100:0/60183619 conn(0x7f3f500fc7d0 msgr2=0x7f3f50103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:30.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 shutdown_connections 2024-09-12T02:42:30.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:30.729+0000 7f3f56c8a640 1 -- 172.21.15.100:0/60183619 wait complete. 2024-09-12T02:42:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:30 smithi189 ceph-mon[35196]: pgmap v451: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 833 op/s 2024-09-12T02:42:31.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:30 smithi100 ceph-mon[31390]: pgmap v451: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 833 op/s 2024-09-12T02:42:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:30 smithi117 ceph-mon[34898]: pgmap v451: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 833 op/s 2024-09-12T02:42:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 200.0 s, 3287.2 tps, lat 30.336 ms stddev 31.626 2024-09-12T02:42:31.532 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-12T02:42:31.532 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-12T02:42:31.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:31 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/60183619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:31.891 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:32.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:31 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/60183619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:32.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:31 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/60183619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.407+0000 7f6314f0d640 1 -- 172.21.15.100:0/3186984236 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63000319b0 con 0x7f631010ae80 2024-09-12T02:42:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.407+0000 7f6318173640 1 -- 172.21.15.100:0/3186984236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 msgr2=0x7f6310113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.407+0000 7f6318173640 1 --2- 172.21.15.100:0/3186984236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 0x7f6310113370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6300009900 tx=0x7f630002a410 comp rx=0 tx=0).stop 2024-09-12T02:42:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 -- 172.21.15.100:0/3186984236 shutdown_connections 2024-09-12T02:42:32.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 --2- 172.21.15.100:0/3186984236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6310113940 0x7f6310115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 --2- 172.21.15.100:0/3186984236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 0x7f6310113370 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 --2- 172.21.15.100:0/3186984236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f631010a560 0x7f631010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 -- 172.21.15.100:0/3186984236 >> 172.21.15.100:0/3186984236 conn(0x7f631006e140 msgr2=0x7f631006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 -- 172.21.15.100:0/3186984236 shutdown_connections 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 -- 172.21.15.100:0/3186984236 wait complete. 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 Processor -- start 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.408+0000 7f6318173640 1 -- start start 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6318173640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631010a560 0x7f6310112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6318173640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 0x7f631010ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6318173640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6310113940 0x7f6310110500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6318173640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6310117e30 con 0x7f631010ae80 2024-09-12T02:42:32.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6318173640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6310117cb0 con 0x7f6310113940 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6318173640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6310117fb0 con 0x7f631010a560 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6316710640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6310113940 0x7f6310110500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6316710640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6310113940 0x7f6310110500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49120/0 (socket says 172.21.15.100:49120) 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6316710640 1 -- 172.21.15.100:0/2066010640 learned_addr learned my addr 172.21.15.100:0/2066010640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f631570e640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 0x7f631010ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.409+0000 7f6315f0f640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631010a560 0x7f6310112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6316710640 1 -- 172.21.15.100:0/2066010640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631010a560 msgr2=0x7f6310112f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6316710640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631010a560 0x7f6310112f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6316710640 1 -- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 msgr2=0x7f631010ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6316710640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 0x7f631010ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6316710640 1 -- 172.21.15.100:0/2066010640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6310110c30 con 0x7f6310113940 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6316710640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6310113940 0x7f6310110500 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f630800eaa0 tx=0x7f630800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6306ffd640 1 -- 172.21.15.100:0/2066010640 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630800cdb0 con 0x7f6310113940 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6306ffd640 1 -- 172.21.15.100:0/2066010640 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6308005020 con 0x7f6310113940 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.410+0000 7f6306ffd640 1 -- 172.21.15.100:0/2066010640 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080116b0 con 0x7f6310113940 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.411+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63101b3980 con 0x7f6310113940 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.411+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63101b3d20 con 0x7f6310113940 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.414+0000 7f631a54c740 1 Processor -- start 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f6306ffd640 1 -- 172.21.15.100:0/2066010640 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6308005560 con 0x7f6310113940 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f631a54c740 1 -- start start 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f631a54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e25850 0x55fd53e25c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f631a54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f631a54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e32e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f631a54c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fd53d8a160 con 0x55fd53e26170 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f631a54c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fd53d31720 con 0x55fd53e25850 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.415+0000 7f631a54c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fd53d86120 con 0x55fd53e30a30 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.416+0000 7f6315f0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.416+0000 7f6315f0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e304f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33250/0 (socket says 172.21.15.100:33250) 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.416+0000 7f6315f0f640 1 -- 172.21.15.100:0/3649640651 learned_addr learned my addr 172.21.15.100:0/3649640651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.416+0000 7f631570e640 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e25850 0x55fd53e25c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6315f0f640 1 -- 172.21.15.100:0/3649640651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 msgr2=0x55fd53e32e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6306ffd640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f62fc0a2d50 0x7f62fc0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6315f0f640 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e32e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6315f0f640 1 -- 172.21.15.100:0/3649640651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e25850 msgr2=0x55fd53e25c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6315f0f640 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e25850 0x55fd53e25c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6315f0f640 1 -- 172.21.15.100:0/3649640651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd53afbba0 con 0x55fd53e26170 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6306ffd640 1 -- 172.21.15.100:0/2066010640 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f63080cf080 con 0x7f6310113940 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f631570e640 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e25850 0x55fd53e25c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6315f0f640 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e304f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f630c009cf0 tx=0x7f630c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54069a562ae3fba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f6316710640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f62fc0a2d50 0x7f62fc0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.417+0000 7f62fbfff640 1 -- 172.21.15.100:0/3649640651 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c004230 con 0x55fd53e26170 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.418+0000 7f62fbfff640 1 -- 172.21.15.100:0/3649640651 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f630c0043d0 con 0x55fd53e26170 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.418+0000 7f62fbfff640 1 -- 172.21.15.100:0/3649640651 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c019960 con 0x55fd53e26170 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f6316710640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f62fc0a2d50 0x7f62fc0a5210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6308097d80 tx=0x7f6308009270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 -- 172.21.15.100:0/3649640651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 msgr2=0x55fd53e304f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e304f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f630c009cf0 tx=0x7f630c011810 comp rx=0 tx=0).stop 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 -- 172.21.15.100:0/3649640651 shutdown_connections 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e32e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e304f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 --2- 172.21.15.100:0/3649640651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e25850 0x55fd53e25c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 -- 172.21.15.100:0/3649640651 >> 172.21.15.100:0/3649640651 conn(0x55fd53e21de0 msgr2=0x55fd53e221c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.419+0000 7f631a54c740 1 -- 172.21.15.100:0/3649640651 shutdown_connections 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.420+0000 7f631a54c740 1 -- 172.21.15.100:0/3649640651 wait complete. 2024-09-12T02:42:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.420+0000 7f631a54c740 1 -- start start 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 1 Processor -- start 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e2d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e2dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e2e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fd53e446b0 con 0x55fd53e25850 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fd53d12900 con 0x55fd53e26170 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fd53e44830 con 0x55fd53e30a30 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631a54c740 10 client.0 _ll_register_callbacks cb 0x55fd53d10780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e2d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f6315f0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e2dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e2d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33256/0 (socket says 172.21.15.100:33256) 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.421+0000 7f631570e640 1 -- 172.21.15.100:0/3566682546 learned_addr learned my addr 172.21.15.100:0/3566682546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:32.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f6315f0f640 1 -- 172.21.15.100:0/3566682546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 msgr2=0x55fd53e2e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f6315f0f640 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e2e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f6315f0f640 1 -- 172.21.15.100:0/3566682546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 msgr2=0x55fd53e2d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f6315f0f640 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e2d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f6315f0f640 1 -- 172.21.15.100:0/3566682546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd53d52c50 con 0x55fd53e26170 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f6315f0f640 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e2dd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f630c01b040 tx=0x7f630c003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3bd055bae652b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f62f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f62f97fa640 1 -- 172.21.15.100:0/3566682546 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c027070 con 0x55fd53e26170 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.422+0000 7f62f97fa640 1 -- 172.21.15.100:0/3566682546 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f630c005240 con 0x55fd53e26170 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.423+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f630c0043d0 con 0x55fd53e26170 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.423+0000 7f62f97fa640 1 -- 172.21.15.100:0/3566682546 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f630c031050 con 0x55fd53e26170 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.423+0000 7f631a54c740 10 client.25475 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.423+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd53e502b0 con 0x55fd53e26170 2024-09-12T02:42:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.423+0000 7f62f97fa640 1 -- 172.21.15.100:0/3566682546 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f630c009910 con 0x55fd53e26170 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f62f97fa640 1 -- 172.21.15.100:0/3566682546 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f630c004c30 con 0x55fd53e26170 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631a54c740 10 client.25475 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631a54c740 10 client.25475 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631a54c740 20 client.25475 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631a54c740 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53e51b30 0x55fd53e53f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631a54c740 4 client.25475 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f630c0043d0 con 0x55fd53e51b30 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631570e640 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53e51b30 0x55fd53e53f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f631570e640 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53e51b30 0x55fd53e53f90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b433c65e957c78d9 server_cookie=8c34098c27efc1d3 in_seq=0 out_seq=0 2024-09-12T02:42:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.424+0000 7f62f97fa640 10 client.25475 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:32.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.425+0000 7f62f97fa640 1 -- 172.21.15.100:0/3566682546 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f630c0043d0 con 0x55fd53e51b30 2024-09-12T02:42:32.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.425+0000 7f62f97fa640 10 client.25475 handle_command_reply: tid=0 2024-09-12T02:42:32.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.425+0000 7f631a54c740 1 client.25475 shutdown 2024-09-12T02:42:32.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 msgr2=0x55fd53e2dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e2dd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f630c01b040 tx=0x7f630c003820 comp rx=0 tx=0).stop 2024-09-12T02:42:32.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 shutdown_connections 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53e51b30 0x55fd53e53f90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e2e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e2dd60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 --2- 172.21.15.100:0/3566682546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e2d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 >> 172.21.15.100:0/3566682546 conn(0x55fd53e21de0 msgr2=0x55fd53e27b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.426+0000 7f62f97fa640 0 client.25475 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.427+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 shutdown_connections 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.427+0000 7f631a54c740 1 -- 172.21.15.100:0/3566682546 wait complete. 2024-09-12T02:42:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.427+0000 7f631a54c740 20 client.25475 trim_cache size 0 max 16384 2024-09-12T02:42:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 Processor -- start 2024-09-12T02:42:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 -- start start 2024-09-12T02:42:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e25850 0x55fd53e2e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e2f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e30a30 0x55fd53e598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63101b64e0 con 0x55fd53e26170 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6310125a30 con 0x55fd53e30a30 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f631a54c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f631010a940 con 0x55fd53e25850 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.450+0000 7f6315f0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e2f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f6315f0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e2f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33272/0 (socket says 172.21.15.100:33272) 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f6315f0f640 1 -- 172.21.15.100:0/104140438 learned_addr learned my addr 172.21.15.100:0/104140438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e30a30 0x55fd53e598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e25850 0x55fd53e2e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 -- 172.21.15.100:0/104140438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e25850 msgr2=0x55fd53e2e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e25850 0x55fd53e2e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 -- 172.21.15.100:0/104140438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 msgr2=0x55fd53e2f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e2f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 -- 172.21.15.100:0/104140438 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd53e21c10 con 0x55fd53e30a30 2024-09-12T02:42:32.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.451+0000 7f631570e640 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e30a30 0x55fd53e598a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6300005c40 tx=0x7f6300005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb540752260ce7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.452+0000 7f62fb7fe640 1 -- 172.21.15.100:0/104140438 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300035040 con 0x55fd53e30a30 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.452+0000 7f62fb7fe640 1 -- 172.21.15.100:0/104140438 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63000046c0 con 0x55fd53e30a30 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.452+0000 7f62fb7fe640 1 -- 172.21.15.100:0/104140438 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300031810 con 0x55fd53e30a30 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 -- 172.21.15.100:0/104140438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e30a30 msgr2=0x55fd53e598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e30a30 0x55fd53e598a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6300005c40 tx=0x7f6300005b50 comp rx=0 tx=0).stop 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 -- 172.21.15.100:0/104140438 shutdown_connections 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e30a30 0x55fd53e598a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e26170 0x55fd53e2f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 --2- 172.21.15.100:0/104140438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e25850 0x55fd53e2e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 -- 172.21.15.100:0/104140438 >> 172.21.15.100:0/104140438 conn(0x55fd53e21de0 msgr2=0x55fd53e2f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 -- 172.21.15.100:0/104140438 shutdown_connections 2024-09-12T02:42:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.453+0000 7f631a54c740 1 -- 172.21.15.100:0/104140438 wait complete. 2024-09-12T02:42:32.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631a54c740 1 -- start start 2024-09-12T02:42:32.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631a54c740 1 Processor -- start 2024-09-12T02:42:32.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631a54c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e49cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631a54c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e4a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631a54c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e49cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f6315f0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e4a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631570e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e49cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33282/0 (socket says 172.21.15.100:33282) 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f631570e640 1 -- 172.21.15.100:0/2141925888 learned_addr learned my addr 172.21.15.100:0/2141925888 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.454+0000 7f6315f0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e4a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49174/0 (socket says 172.21.15.100:49174) 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.455+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6310123ef0 con 0x55fd53e25850 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.455+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6310125360 con 0x55fd53e26170 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.455+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63101245c0 con 0x55fd53e30a30 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.455+0000 7f631a54c740 10 client.0 _ll_register_callbacks cb 0x7f630c009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.455+0000 7f631570e640 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.456+0000 7f6315f0f640 1 -- 172.21.15.100:0/2141925888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 msgr2=0x55fd53e2a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.456+0000 7f6315f0f640 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e2a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.456+0000 7f6315f0f640 1 -- 172.21.15.100:0/2141925888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 msgr2=0x55fd53e49cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.456+0000 7f6315f0f640 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e49cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.456+0000 7f6315f0f640 1 -- 172.21.15.100:0/2141925888 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd53e2a8c0 con 0x55fd53e26170 2024-09-12T02:42:32.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f631570e640 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e49cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:32.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f6315f0f640 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e4a1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55fd53e219a0 tx=0x7f630c019a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d83c2cafcc46692b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f62f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:42:32.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f62f97fa640 1 -- 172.21.15.100:0/2141925888 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c027040 con 0x55fd53e26170 2024-09-12T02:42:32.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63000046c0 con 0x55fd53e26170 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f62f97fa640 1 -- 172.21.15.100:0/2141925888 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f630c005210 con 0x55fd53e26170 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f62f97fa640 1 -- 172.21.15.100:0/2141925888 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f630c009ea0 con 0x55fd53e26170 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f631a54c740 10 client.25481 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.457+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd53ebc270 con 0x55fd53e26170 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f62f97fa640 1 -- 172.21.15.100:0/2141925888 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63000046c0 con 0x55fd53e26170 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f62f97fa640 1 -- 172.21.15.100:0/2141925888 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f630c023ac0 con 0x55fd53e26170 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f631a54c740 10 client.25481 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f631a54c740 10 client.25481 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f631a54c740 20 client.25481 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f631a54c740 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53ebca30 0x55fd53ebee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f631a54c740 4 client.25481 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-12T02:42:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.458+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x55fd53d97890 con 0x55fd53ebca30 2024-09-12T02:42:32.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.459+0000 7f631570e640 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53ebca30 0x55fd53ebee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.459+0000 7f62f97fa640 10 client.25481 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:32.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.459+0000 7f631570e640 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53ebca30 0x55fd53ebee50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c1f6f3ff739bec server_cookie=5e0d3b86754a6f73 in_seq=0 out_seq=0 2024-09-12T02:42:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.763+0000 7f62f97fa640 1 -- 172.21.15.100:0/2141925888 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fd53d97890 con 0x55fd53ebca30 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.763+0000 7f62f97fa640 10 client.25481 handle_command_reply: tid=0 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.763+0000 7f631a54c740 1 client.25481 shutdown 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.763+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 msgr2=0x55fd53e4a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.763+0000 7f631a54c740 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e4a1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55fd53e219a0 tx=0x7f630c019a20 comp rx=0 tx=0).stop 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 shutdown_connections 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fd53ebca30 0x55fd53ebee50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd53e30a30 0x55fd53e2a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fd53e26170 0x55fd53e4a1f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f62f97fa640 0 client.25481 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 --2- 172.21.15.100:0/2141925888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd53e25850 0x55fd53e49cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 >> 172.21.15.100:0/2141925888 conn(0x55fd53e21de0 msgr2=0x55fd53e2f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 shutdown_connections 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 1 -- 172.21.15.100:0/2141925888 wait complete. 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f631a54c740 20 client.25481 trim_cache size 0 max 16384 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 14, 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:42:32.766 INFO:teuthology.orchestra.run.smithi100.stdout: "4191b2a6": { 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 14, 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 140.2, 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:42:32.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:42:32.768 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:42:32.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:32.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:32.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:32.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:32.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:32.768 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f62fc0a2d50 msgr2=0x7f62fc0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f6318173640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f62fc0a2d50 0x7f62fc0a5210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6308097d80 tx=0x7f6308009270 comp rx=0 tx=0).stop 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6310113940 msgr2=0x7f6310110500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.764+0000 7f6318173640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6310113940 0x7f6310110500 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f630800eaa0 tx=0x7f630800ef60 comp rx=0 tx=0).stop 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 shutdown_connections 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f62fc0a2d50 0x7f62fc0a5210 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6310113940 0x7f6310110500 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631010ae80 0x7f631010ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 --2- 172.21.15.100:0/2066010640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631010a560 0x7f6310112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 >> 172.21.15.100:0/2066010640 conn(0x7f631006e140 msgr2=0x7f63100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 shutdown_connections 2024-09-12T02:42:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:32.765+0000 7f6318173640 1 -- 172.21.15.100:0/2066010640 wait complete. 2024-09-12T02:42:32.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:32 smithi100 ceph-mon[31390]: pgmap v452: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-09-12T02:42:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:32 smithi189 ceph-mon[35196]: pgmap v452: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-09-12T02:42:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:32 smithi117 ceph-mon[34898]: pgmap v452: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-09-12T02:42:33.574 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4191b2a6', quiesce took 4.2 seconds. Will release after: 15.95 2024-09-12T02:42:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:34 smithi189 ceph-mon[35196]: pgmap v453: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2024-09-12T02:42:35.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:34 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:42:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:34 smithi117 ceph-mon[34898]: pgmap v453: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2024-09-12T02:42:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:34 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:42:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:34 smithi100 ceph-mon[31390]: pgmap v453: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2024-09-12T02:42:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:34 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:42:36.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:35 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:42:36.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:35 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:42:36.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:35 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:42:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 205.0 s, 758.6 tps, lat 31.563 ms stddev 33.334 2024-09-12T02:42:36.995 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:36 smithi117 ceph-mon[34898]: pgmap v454: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 672 op/s 2024-09-12T02:42:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:36 smithi189 ceph-mon[35196]: pgmap v454: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 672 op/s 2024-09-12T02:42:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:36 smithi100 ceph-mon[31390]: pgmap v454: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 672 op/s 2024-09-12T02:42:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:38 smithi189 ceph-mon[35196]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-09-12T02:42:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:38 smithi117 ceph-mon[34898]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-09-12T02:42:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:38 smithi100 ceph-mon[31390]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-09-12T02:42:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:40 smithi189 ceph-mon[35196]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-09-12T02:42:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:40 smithi117 ceph-mon[34898]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-09-12T02:42:41.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:40 smithi100 ceph-mon[31390]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 507 op/s 2024-09-12T02:42:41.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:42:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:42 smithi189 ceph-mon[35196]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 336 op/s 2024-09-12T02:42:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:42 smithi117 ceph-mon[34898]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 336 op/s 2024-09-12T02:42:43.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:42 smithi100 ceph-mon[31390]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 336 op/s 2024-09-12T02:42:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:44 smithi189 ceph-mon[35196]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-12T02:42:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:44 smithi117 ceph-mon[34898]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-12T02:42:45.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:44 smithi100 ceph-mon[31390]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-12T02:42:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:42:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:46 smithi189 ceph-mon[35196]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 MiB/s wr, 123 op/s 2024-09-12T02:42:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:46 smithi117 ceph-mon[34898]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 MiB/s wr, 123 op/s 2024-09-12T02:42:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:46 smithi100 ceph-mon[31390]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 MiB/s wr, 123 op/s 2024-09-12T02:42:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:48 smithi189 ceph-mon[35196]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 MiB/s wr, 68 op/s 2024-09-12T02:42:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:48 smithi117 ceph-mon[34898]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 MiB/s wr, 68 op/s 2024-09-12T02:42:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:48 smithi100 ceph-mon[31390]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 MiB/s wr, 68 op/s 2024-09-12T02:42:49.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:42:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 -- 172.21.15.100:0/2259190780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c102790 msgr2=0x7f968c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 --2- 172.21.15.100:0/2259190780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c102790 0x7f968c1067e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f967c009900 tx=0x7f967c02a410 comp rx=0 tx=0).stop 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 -- 172.21.15.100:0/2259190780 shutdown_connections 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 --2- 172.21.15.100:0/2259190780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f968c106f10 0x7f968c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 --2- 172.21.15.100:0/2259190780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c102790 0x7f968c1067e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 --2- 172.21.15.100:0/2259190780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968c101de0 0x7f968c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 -- 172.21.15.100:0/2259190780 >> 172.21.15.100:0/2259190780 conn(0x7f968c0fd8c0 msgr2=0x7f968c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 -- 172.21.15.100:0/2259190780 shutdown_connections 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 -- 172.21.15.100:0/2259190780 wait complete. 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.472+0000 7f9693cd9640 1 Processor -- start 2024-09-12T02:42:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9693cd9640 1 -- start start 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9693cd9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c101de0 0x7f968c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9693cd9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f968c102790 0x7f968c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9693cd9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968c106f10 0x7f968c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9693cd9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f968c111f90 con 0x7f968c101de0 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9693cd9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f968c111e10 con 0x7f968c102790 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9693cd9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f968c112110 con 0x7f968c106f10 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c101de0 0x7f968c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c101de0 0x7f968c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59834/0 (socket says 172.21.15.100:59834) 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 -- 172.21.15.100:0/1381849718 learned_addr learned my addr 172.21.15.100:0/1381849718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691274640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f968c102790 0x7f968c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9692276640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968c106f10 0x7f968c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 -- 172.21.15.100:0/1381849718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968c106f10 msgr2=0x7f968c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968c106f10 0x7f968c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 -- 172.21.15.100:0/1381849718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f968c102790 msgr2=0x7f968c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f968c102790 0x7f968c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 -- 172.21.15.100:0/1381849718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c1a68d0 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.473+0000 7f9691a75640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c101de0 0x7f968c0744f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f968800b4a0 tx=0x7f968800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.474+0000 7f9682ffd640 1 -- 172.21.15.100:0/1381849718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688014070 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.474+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c1a6bc0 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.474+0000 7f9682ffd640 1 -- 172.21.15.100:0/1381849718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9688010af0 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.474+0000 7f9682ffd640 1 -- 172.21.15.100:0/1381849718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688017d10 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.474+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1a70d0 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.475+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c1021c0 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.476+0000 7f9682ffd640 1 -- 172.21.15.100:0/1381849718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9688017070 con 0x7f968c101de0 2024-09-12T02:42:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.477+0000 7f9682ffd640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96780a2c00 0x7f96780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.477+0000 7f9691274640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96780a2c00 0x7f96780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.477+0000 7f9682ffd640 1 -- 172.21.15.100:0/1381849718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f96880ce2f0 con 0x7f968c101de0 2024-09-12T02:42:50.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.477+0000 7f9691274640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96780a2c00 0x7f96780a50c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.481+0000 7f9682ffd640 1 -- 172.21.15.100:0/1381849718 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f968809abf0 con 0x7f968c101de0 2024-09-12T02:42:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.683+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f968c10a0f0 con 0x7f968c101de0 2024-09-12T02:42:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.684+0000 7f9682ffd640 1 -- 172.21.15.100:0/1381849718 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f968809eef0 con 0x7f968c101de0 2024-09-12T02:42:50.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:42:50.685 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:42:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:42:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96780a2c00 msgr2=0x7f96780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96780a2c00 0x7f96780a50c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c101de0 msgr2=0x7f968c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c101de0 0x7f968c0744f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f968800b4a0 tx=0x7f968800b960 comp rx=0 tx=0).stop 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 shutdown_connections 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96780a2c00 0x7f96780a50c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f968c106f10 0x7f968c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f968c102790 0x7f968c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 --2- 172.21.15.100:0/1381849718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968c101de0 0x7f968c0744f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 >> 172.21.15.100:0/1381849718 conn(0x7f968c0fd8c0 msgr2=0x7f968c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 shutdown_connections 2024-09-12T02:42:50.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:50.686+0000 7f9693cd9640 1 -- 172.21.15.100:0/1381849718 wait complete. 2024-09-12T02:42:50.997 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:50 smithi100 ceph-mon[31390]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 MiB/s wr, 22 op/s 2024-09-12T02:42:50.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:50 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1381849718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:50 smithi189 ceph-mon[35196]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 MiB/s wr, 22 op/s 2024-09-12T02:42:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:50 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1381849718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:50 smithi117 ceph-mon[34898]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 MiB/s wr, 22 op/s 2024-09-12T02:42:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:50 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1381849718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 220.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:42:51.527 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 4191b2a6 --release --await' 2024-09-12T02:42:51.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 4191b2a6 --release --await 2024-09-12T02:42:51.772 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:52.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 -- 172.21.15.100:0/4038347170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102570 msgr2=0x7f57901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 --2- 172.21.15.100:0/4038347170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102570 0x7f57901029b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5784009900 tx=0x7f578402a480 comp rx=0 tx=0).stop 2024-09-12T02:42:52.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 -- 172.21.15.100:0/4038347170 shutdown_connections 2024-09-12T02:42:52.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 --2- 172.21.15.100:0/4038347170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5790102ef0 0x7f579010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 --2- 172.21.15.100:0/4038347170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102570 0x7f57901029b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 --2- 172.21.15.100:0/4038347170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 0x7f5790101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 -- 172.21.15.100:0/4038347170 >> 172.21.15.100:0/4038347170 conn(0x7f57900fc7d0 msgr2=0x7f57900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 -- 172.21.15.100:0/4038347170 shutdown_connections 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 -- 172.21.15.100:0/4038347170 wait complete. 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 Processor -- start 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.301+0000 7f57969fd640 1 -- start start 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f57969fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 0x7f5790197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f57969fd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5790102570 0x7f5790197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f57969fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102ef0 0x7f579019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f57969fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5790110fa0 con 0x7f5790102ef0 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f57969fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5790110e20 con 0x7f5790100e20 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f57969fd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5790111120 con 0x7f5790102570 2024-09-12T02:42:52.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 0x7f5790197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 0x7f5790197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53300/0 (socket says 172.21.15.100:53300) 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 -- 172.21.15.100:0/3742593773 learned_addr learned my addr 172.21.15.100:0/3742593773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f5794f9a640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102ef0 0x7f579019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578f7fe640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5790102570 0x7f5790197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 -- 172.21.15.100:0/3742593773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5790102570 msgr2=0x7f5790197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5790102570 0x7f5790197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 -- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102ef0 msgr2=0x7f579019bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102ef0 0x7f579019bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f578ffff640 1 -- 172.21.15.100:0/3742593773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579019c3d0 con 0x7f5790100e20 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.302+0000 7f5794f9a640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102ef0 0x7f579019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.303+0000 7f578ffff640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 0x7f5790197420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f578000d950 tx=0x7f578000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.303+0000 7f578d7fa640 1 -- 172.21.15.100:0/3742593773 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780017070 con 0x7f5790100e20 2024-09-12T02:42:52.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.303+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579019c6c0 con 0x7f5790100e20 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.303+0000 7f578d7fa640 1 -- 172.21.15.100:0/3742593773 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5780009c30 con 0x7f5790100e20 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.303+0000 7f578d7fa640 1 -- 172.21.15.100:0/3742593773 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780020060 con 0x7f5790100e20 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.303+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57901a3fa0 con 0x7f5790100e20 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.305+0000 7f5798dd6740 1 Processor -- start 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.305+0000 7f578d7fa640 1 -- 172.21.15.100:0/3742593773 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f57800109d0 con 0x7f5790100e20 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.305+0000 7f5798dd6740 1 -- start start 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.305+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450de5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450deff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f5798dd6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564450d48620 con 0x564450de5b90 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f5798dd6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564450cefe50 con 0x564450de5270 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f5798dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564450d445e0 con 0x564450df0450 2024-09-12T02:42:52.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450deff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450deff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59864/0 (socket says 172.21.15.100:59864) 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 -- 172.21.15.100:0/2401293521 learned_addr learned my addr 172.21.15.100:0/2401293521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f5794f9a640 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450de5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578f7fe640 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 -- 172.21.15.100:0/2401293521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 msgr2=0x564450df2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 -- 172.21.15.100:0/2401293521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 msgr2=0x564450de5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450de5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578ffff640 1 -- 172.21.15.100:0/2401293521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564450ce0d40 con 0x564450de5b90 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f5794f9a640 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450de5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.306+0000 7f578d7fa640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f57780a2b80 0x7f57780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.307+0000 7f578d7fa640 1 -- 172.21.15.100:0/3742593773 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f57800cecd0 con 0x7f5790100e20 2024-09-12T02:42:52.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.307+0000 7f578ffff640 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450deff10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f57800d2e00 tx=0x7f57800d7720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250cd9d3492e994b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.307+0000 7f5794f9a640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f57780a2b80 0x7f57780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.307+0000 7f57767fc640 1 -- 172.21.15.100:0/2401293521 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578009b340 con 0x564450de5b90 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.307+0000 7f57767fc640 1 -- 172.21.15.100:0/2401293521 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57800d7e30 con 0x564450de5b90 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.307+0000 7f57767fc640 1 -- 172.21.15.100:0/2401293521 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578009aed0 con 0x564450de5b90 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 -- 172.21.15.100:0/2401293521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 msgr2=0x564450deff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450deff10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f57800d2e00 tx=0x7f57800d7720 comp rx=0 tx=0).stop 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 -- 172.21.15.100:0/2401293521 shutdown_connections 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450deff10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2401293521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450de5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 -- 172.21.15.100:0/2401293521 >> 172.21.15.100:0/2401293521 conn(0x564450de1800 msgr2=0x564450de1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5794f9a640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f57780a2b80 0x7f57780a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f578800a910 tx=0x7f578800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 -- 172.21.15.100:0/2401293521 shutdown_connections 2024-09-12T02:42:52.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 -- 172.21.15.100:0/2401293521 wait complete. 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 -- start start 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.308+0000 7f5798dd6740 1 Processor -- start 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450deb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450debed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5798dd6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564450ddf220 con 0x564450de5b90 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5798dd6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564450cd0f10 con 0x564450de5270 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5798dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564450ddf3a0 con 0x564450df0450 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5798dd6740 10 client.0 _ll_register_callbacks cb 0x564450cf4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450debed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450debed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59876/0 (socket says 172.21.15.100:59876) 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 -- 172.21.15.100:0/2809750952 learned_addr learned my addr 172.21.15.100:0/2809750952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5794f9a640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578ffff640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450deb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 -- 172.21.15.100:0/2809750952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 msgr2=0x564450df9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 -- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 msgr2=0x564450deb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450deb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 -- 172.21.15.100:0/2809750952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564450a57580 con 0x564450de5b90 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578ffff640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450deb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f5794f9a640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f578f7fe640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450debed0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f57840314e0 tx=0x7f5784004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65597cde172173 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.309+0000 7f576f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f576f7fe640 1 -- 172.21.15.100:0/2809750952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784035070 con 0x564450de5b90 2024-09-12T02:42:52.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f576f7fe640 1 -- 172.21.15.100:0/2809750952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5784003ac0 con 0x564450de5b90 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57800d7e30 con 0x564450de5b90 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f576f7fe640 1 -- 172.21.15.100:0/2809750952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5784003cc0 con 0x564450de5b90 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 10 client.16053 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564450b21960 con 0x564450de5b90 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f576f7fe640 1 -- 172.21.15.100:0/2809750952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57800d7e30 con 0x564450de5b90 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f576f7fe640 1 -- 172.21.15.100:0/2809750952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f578403b5c0 con 0x564450de5b90 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 10 client.16053 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 10 client.16053 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 20 client.16053 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450dfde20 0x564450e002a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 4 client.16053 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564450d55b90 con 0x564450dfde20 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.310+0000 7f578ffff640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450dfde20 0x564450e002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.311+0000 7f576f7fe640 10 client.16053 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.311+0000 7f578ffff640 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450dfde20 0x564450e002a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc9e273a140447f server_cookie=a2db8f42edc924f6 in_seq=0 out_seq=0 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f576f7fe640 1 -- 172.21.15.100:0/2809750952 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564450d55b90 con 0x564450dfde20 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f576f7fe640 10 client.16053 handle_command_reply: tid=0 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 client.16053 shutdown 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 msgr2=0x564450debed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450debed0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f57840314e0 tx=0x7f5784004440 comp rx=0 tx=0).stop 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 shutdown_connections 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450dfde20 0x564450e002a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450df9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450debed0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 --2- 172.21.15.100:0/2809750952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5270 0x564450deb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 >> 172.21.15.100:0/2809750952 conn(0x564450de1800 msgr2=0x564450de7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f576f7fe640 0 client.16053 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 shutdown_connections 2024-09-12T02:42:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 1 -- 172.21.15.100:0/2809750952 wait complete. 2024-09-12T02:42:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.312+0000 7f5798dd6740 20 client.16053 trim_cache size 0 max 16384 2024-09-12T02:42:52.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 Processor -- start 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 -- start start 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5270 0x564450de05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5b90 0x564450de8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450de9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57901adcc0 con 0x564450de5270 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57901ab590 con 0x564450de5b90 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f5798dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57901a9400 con 0x564450df0450 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.329+0000 7f578ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5270 0x564450de05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5270 0x564450de05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59888/0 (socket says 172.21.15.100:59888) 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 -- 172.21.15.100:0/1683373404 learned_addr learned my addr 172.21.15.100:0/1683373404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:52.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578f7fe640 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5b90 0x564450de8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 -- 172.21.15.100:0/1683373404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 msgr2=0x564450de9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450de9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 -- 172.21.15.100:0/1683373404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5b90 msgr2=0x564450de8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5b90 0x564450de8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 -- 172.21.15.100:0/1683373404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564450de2490 con 0x564450de5270 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f578ffff640 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5270 0x564450de05c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5780010fd0 tx=0x7f57800ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c1f4e51664ae5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f5775ffb640 1 -- 172.21.15.100:0/1683373404 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57800b4070 con 0x564450de5270 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f5775ffb640 1 -- 172.21.15.100:0/1683373404 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57800d2030 con 0x564450de5270 2024-09-12T02:42:52.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.330+0000 7f5775ffb640 1 -- 172.21.15.100:0/1683373404 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578009b0b0 con 0x564450de5270 2024-09-12T02:42:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 -- 172.21.15.100:0/1683373404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5270 msgr2=0x564450de05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5270 0x564450de05c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5780010fd0 tx=0x7f57800ce040 comp rx=0 tx=0).stop 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 -- 172.21.15.100:0/1683373404 shutdown_connections 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450df0450 0x564450de9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450de5b90 0x564450de8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 --2- 172.21.15.100:0/1683373404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5270 0x564450de05c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 -- 172.21.15.100:0/1683373404 >> 172.21.15.100:0/1683373404 conn(0x564450de1800 msgr2=0x564450dea0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 -- 172.21.15.100:0/1683373404 shutdown_connections 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 -- 172.21.15.100:0/1683373404 wait complete. 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.331+0000 7f5798dd6740 1 -- start start 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 1 Processor -- start 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450de5270 0x564450e054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450e05a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450df0450 0x564450df7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57901a9a50 con 0x564450de5b90 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57901aaec0 con 0x564450df0450 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57901aa120 con 0x564450de5270 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5798dd6740 10 client.0 _ll_register_callbacks cb 0x7f57840040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450e05a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450e05a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59900/0 (socket says 172.21.15.100:59900) 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 -- 172.21.15.100:0/3753622358 learned_addr learned my addr 172.21.15.100:0/3753622358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578ffff640 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450de5270 0x564450e054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f5794f9a640 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450df0450 0x564450df7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 -- 172.21.15.100:0/3753622358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450de5270 msgr2=0x564450e054c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450de5270 0x564450e054c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 -- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450df0450 msgr2=0x564450df7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450df0450 0x564450df7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.332+0000 7f578f7fe640 1 -- 172.21.15.100:0/3753622358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564450df8440 con 0x564450de5b90 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f578f7fe640 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450e05a00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5784009900 tx=0x7f5784009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d395488f8d4bd180 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f576f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f576f7fe640 1 -- 172.21.15.100:0/3753622358 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784035040 con 0x564450de5b90 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f576f7fe640 1 -- 172.21.15.100:0/3753622358 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f578403b630 con 0x564450de5b90 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57800d2030 con 0x564450de5b90 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f576f7fe640 1 -- 172.21.15.100:0/3753622358 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5784003ad0 con 0x564450de5b90 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 10 client.16059 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564450e69300 con 0x564450de5b90 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f576f7fe640 1 -- 172.21.15.100:0/3753622358 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57800d2030 con 0x564450de5b90 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f576f7fe640 1 -- 172.21.15.100:0/3753622358 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5784004a40 con 0x564450de5b90 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 10 client.16059 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 10 client.16059 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 20 client.16059 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450e69a80 0x564450e6bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 4 client.16059 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4191b2a6", "release": true, "await": true}] 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.333+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4191b2a6", "release": true, "await": true}) -- 0x564450d500a0 con 0x564450e69a80 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.334+0000 7f578ffff640 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450e69a80 0x564450e6bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.334+0000 7f578ffff640 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450e69a80 0x564450e6bea0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a5868375ae845e server_cookie=66d3ae070b3f94be in_seq=0 out_seq=0 2024-09-12T02:42:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.334+0000 7f576f7fe640 10 client.16059 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.388+0000 7f576f7fe640 1 -- 172.21.15.100:0/3753622358 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564450d500a0 con 0x564450e69a80 2024-09-12T02:42:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.388+0000 7f576f7fe640 10 client.16059 handle_command_reply: tid=0 2024-09-12T02:42:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.388+0000 7f5798dd6740 1 client.16059 shutdown 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 msgr2=0x564450e05a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450e05a00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5784009900 tx=0x7f5784009590 comp rx=0 tx=0).stop 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 shutdown_connections 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564450e69a80 0x564450e6bea0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564450df0450 0x564450df7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564450de5b90 0x564450e05a00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 --2- 172.21.15.100:0/3753622358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564450de5270 0x564450e054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 >> 172.21.15.100:0/3753622358 conn(0x564450de1800 msgr2=0x564450de7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.390+0000 7f576f7fe640 0 client.16059 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.391+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 shutdown_connections 2024-09-12T02:42:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.391+0000 7f5798dd6740 1 -- 172.21.15.100:0/3753622358 wait complete. 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.391+0000 7f5798dd6740 20 client.16059 trim_cache size 0 max 16384 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 16, 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "4191b2a6": { 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 16, 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:42:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 140.2, 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:52.395 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:42:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f57780a2b80 msgr2=0x7f57780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f57780a2b80 0x7f57780a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f578800a910 tx=0x7f578800d040 comp rx=0 tx=0).stop 2024-09-12T02:42:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 msgr2=0x7f5790197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 0x7f5790197420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f578000d950 tx=0x7f578000de10 comp rx=0 tx=0).stop 2024-09-12T02:42:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 shutdown_connections 2024-09-12T02:42:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f57780a2b80 0x7f57780a5040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790102ef0 0x7f579019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5790102570 0x7f5790197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 --2- 172.21.15.100:0/3742593773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5790100e20 0x7f5790197420 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.392+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 >> 172.21.15.100:0/3742593773 conn(0x7f57900fc7d0 msgr2=0x7f57900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.393+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 shutdown_connections 2024-09-12T02:42:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:52.394+0000 7f57969fd640 1 -- 172.21.15.100:0/3742593773 wait complete. 2024-09-12T02:42:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:52 smithi100 ceph-mon[31390]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.0 MiB/s wr, 35 op/s 2024-09-12T02:42:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:52 smithi117 ceph-mon[34898]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.0 MiB/s wr, 35 op/s 2024-09-12T02:42:53.245 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4191b2a6', total seconds elapsed: 23.9 2024-09-12T02:42:53.246 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-12T02:42:53.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:42:53.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:52 smithi189 ceph-mon[35196]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.0 MiB/s wr, 35 op/s 2024-09-12T02:42:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:54.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.199+0000 7f281f4d6640 1 -- 172.21.15.100:0/2444071346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 msgr2=0x7f281810a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.199+0000 7f281f4d6640 1 --2- 172.21.15.100:0/2444071346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f281810a940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2814009900 tx=0x7f281402a440 comp rx=0 tx=0).stop 2024-09-12T02:42:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.199+0000 7f281f4d6640 1 -- 172.21.15.100:0/2444071346 shutdown_connections 2024-09-12T02:42:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.199+0000 7f281f4d6640 1 --2- 172.21.15.100:0/2444071346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2818109880 0x7f2818109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.199+0000 7f281f4d6640 1 --2- 172.21.15.100:0/2444071346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f281810ae80 0x7f28181091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.199+0000 7f281f4d6640 1 --2- 172.21.15.100:0/2444071346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f281810a940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.199+0000 7f281f4d6640 1 -- 172.21.15.100:0/2444071346 >> 172.21.15.100:0/2444071346 conn(0x7f281806e2d0 msgr2=0x7f281806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.200+0000 7f281f4d6640 1 -- 172.21.15.100:0/2444071346 shutdown_connections 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.200+0000 7f281f4d6640 1 -- 172.21.15.100:0/2444071346 wait complete. 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 Processor -- start 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 -- start start 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2818109880 0x7f2818117730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f2818117c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281810ae80 0x7f28181181b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f281811cac0 con 0x7f281810ae80 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f281811c940 con 0x7f281810a560 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281f4d6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f281811cc40 con 0x7f2818109880 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281ca71640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f2818117c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281da73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281810ae80 0x7f28181181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281ca71640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f2818117c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:53362/0 (socket says 172.21.15.100:53362) 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281ca71640 1 -- 172.21.15.100:0/705118965 learned_addr learned my addr 172.21.15.100:0/705118965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.201+0000 7f281d272640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2818109880 0x7f2818117730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281ca71640 1 -- 172.21.15.100:0/705118965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2818109880 msgr2=0x7f2818117730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281ca71640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2818109880 0x7f2818117730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281ca71640 1 -- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281810ae80 msgr2=0x7f28181181b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281ca71640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281810ae80 0x7f28181181b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281ca71640 1 -- 172.21.15.100:0/705118965 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28181b36a0 con 0x7f281810a560 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281ca71640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f2818117c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f280800b4b0 tx=0x7f280800b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f280e7fc640 1 -- 172.21.15.100:0/705118965 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808014070 con 0x7f281810a560 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f280e7fc640 1 -- 172.21.15.100:0/705118965 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2808010af0 con 0x7f281810a560 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28181b3990 con 0x7f281810a560 2024-09-12T02:42:54.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28181b3f50 con 0x7f281810a560 2024-09-12T02:42:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.202+0000 7f280e7fc640 1 -- 172.21.15.100:0/705118965 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808017cf0 con 0x7f281810a560 2024-09-12T02:42:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.203+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27fc005290 con 0x7f281810a560 2024-09-12T02:42:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.205+0000 7f280e7fc640 1 -- 172.21.15.100:0/705118965 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2808017070 con 0x7f281810a560 2024-09-12T02:42:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.206+0000 7f280e7fc640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28040a2c80 0x7f28040a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.206+0000 7f281d272640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28040a2c80 0x7f28040a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.206+0000 7f280e7fc640 1 -- 172.21.15.100:0/705118965 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f28080ce0f0 con 0x7f281810a560 2024-09-12T02:42:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.207+0000 7f281d272640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28040a2c80 0x7f28040a5140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2814000c00 tx=0x7f28140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:54.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.209+0000 7f280e7fc640 1 -- 172.21.15.100:0/705118965 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f280809a990 con 0x7f281810a560 2024-09-12T02:42:54.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.532+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27fc005580 con 0x7f281810a560 2024-09-12T02:42:54.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.532+0000 7f280e7fc640 1 -- 172.21.15.100:0/705118965 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f280809ec90 con 0x7f281810a560 2024-09-12T02:42:54.533 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:42:54.533 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:42:54.533 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:42:54.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.535+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28040a2c80 msgr2=0x7f28040a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.536+0000 7f281f4d6640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28040a2c80 0x7f28040a5140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2814000c00 tx=0x7f28140058d0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.536+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 msgr2=0x7f2818117c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.536+0000 7f281f4d6640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f2818117c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f280800b4b0 tx=0x7f280800b970 comp rx=0 tx=0).stop 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.537+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 shutdown_connections 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.537+0000 7f281f4d6640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28040a2c80 0x7f28040a5140 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.537+0000 7f281f4d6640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281810ae80 0x7f28181181b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.537+0000 7f281f4d6640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f281810a560 0x7f2818117c70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.537+0000 7f281f4d6640 1 --2- 172.21.15.100:0/705118965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2818109880 0x7f2818117730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.537+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 >> 172.21.15.100:0/705118965 conn(0x7f281806e2d0 msgr2=0x7f281810d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.537+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 shutdown_connections 2024-09-12T02:42:54.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:54.538+0000 7f281f4d6640 1 -- 172.21.15.100:0/705118965 wait complete. 2024-09-12T02:42:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:54 smithi100 ceph-mon[31390]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 MiB/s wr, 35 op/s 2024-09-12T02:42:54.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:54 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/705118965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:54 smithi117 ceph-mon[34898]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 MiB/s wr, 35 op/s 2024-09-12T02:42:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:54 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/705118965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:54 smithi189 ceph-mon[35196]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 MiB/s wr, 35 op/s 2024-09-12T02:42:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:54 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/705118965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:42:55.386 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-12T02:42:55.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-12T02:42:55.740 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 225.0 s, 2618.4 tps, lat 181.864 ms stddev 1736.747 2024-09-12T02:42:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 -- 172.21.15.100:0/788801529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 msgr2=0x7f4fc4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/788801529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc4101200 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009900 tx=0x7f4fb402a480 comp rx=0 tx=0).stop 2024-09-12T02:42:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 -- 172.21.15.100:0/788801529 shutdown_connections 2024-09-12T02:42:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/788801529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc4102ef0 0x7f4fc4069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/788801529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc4102570 0x7f4fc41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/788801529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc4101200 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 -- 172.21.15.100:0/788801529 >> 172.21.15.100:0/788801529 conn(0x7f4fc40fc7d0 msgr2=0x7f4fc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 -- 172.21.15.100:0/788801529 shutdown_connections 2024-09-12T02:42:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.324+0000 7f4fc9d56640 1 -- 172.21.15.100:0/788801529 wait complete. 2024-09-12T02:42:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 Processor -- start 2024-09-12T02:42:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 -- start start 2024-09-12T02:42:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc4102570 0x7f4fc419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc4102ef0 0x7f4fc419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41142d0 con 0x7f4fc4100e20 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4114150 con 0x7f4fc4102ef0 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc9d56640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4114450 con 0x7f4fc4102570 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48768/0 (socket says 172.21.15.100:48768) 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.325+0000 7f4fc37fe640 1 -- 172.21.15.100:0/1735142958 learned_addr learned my addr 172.21.15.100:0/1735142958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc4102ef0 0x7f4fc419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc2ffd640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc4102570 0x7f4fc419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc3fff640 1 -- 172.21.15.100:0/1735142958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc4102570 msgr2=0x7f4fc419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc4102570 0x7f4fc419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc3fff640 1 -- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 msgr2=0x7f4fc419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc3fff640 1 -- 172.21.15.100:0/1735142958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc419f580 con 0x7f4fc4102ef0 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc4102ef0 0x7f4fc419eea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009fd0 tx=0x7f4fbc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc0ff9640 1 -- 172.21.15.100:0/1735142958 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00ce20 con 0x7f4fc4102ef0 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc419f870 con 0x7f4fc4102ef0 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc0ff9640 1 -- 172.21.15.100:0/1735142958 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fbc005020 con 0x7f4fc4102ef0 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc0ff9640 1 -- 172.21.15.100:0/1735142958 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc010720 con 0x7f4fc4102ef0 2024-09-12T02:42:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.326+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41a7150 con 0x7f4fc4102ef0 2024-09-12T02:42:56.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.330+0000 7f4fc0ff9640 1 -- 172.21.15.100:0/1735142958 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4fbc005540 con 0x7f4fc4102ef0 2024-09-12T02:42:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.331+0000 7f4fc0ff9640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4fac0a2c00 0x7f4fac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.331+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4fac0a2c00 0x7f4fac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.331+0000 7f4fc0ff9640 1 -- 172.21.15.100:0/1735142958 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4fbc0cf790 con 0x7f4fc4102ef0 2024-09-12T02:42:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.331+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4fac0a2c00 0x7f4fac0a50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40096c0 tx=0x7f4fb4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 Processor -- start 2024-09-12T02:42:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 -- start start 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755de4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555875538160 con 0x5558755d3850 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5558754df720 con 0x5558755dea30 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.332+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555875534120 con 0x5558755d4170 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755d3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48780/0 (socket says 172.21.15.100:48780) 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc37fe640 1 -- 172.21.15.100:0/4246699494 learned_addr learned my addr 172.21.15.100:0/4246699494 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:56.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc2ffd640 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755de4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc3fff640 1 -- 172.21.15.100:0/4246699494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 msgr2=0x5558755de4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755de4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc3fff640 1 -- 172.21.15.100:0/4246699494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 msgr2=0x5558755d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc3fff640 1 -- 172.21.15.100:0/4246699494 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558752a9ba0 con 0x5558755dea30 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755e0e20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0cd280 tx=0x7f4fbc09c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c2793a9a414683 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.333+0000 7f4fa9ffb640 1 -- 172.21.15.100:0/4246699494 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0bc0c0 con 0x5558755dea30 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.334+0000 7f4fa9ffb640 1 -- 172.21.15.100:0/4246699494 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fbc0a4c50 con 0x5558755dea30 2024-09-12T02:42:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.334+0000 7f4fa9ffb640 1 -- 172.21.15.100:0/4246699494 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc096b50 con 0x5558755dea30 2024-09-12T02:42:56.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.335+0000 7f4fcc12f740 1 -- 172.21.15.100:0/4246699494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 msgr2=0x5558755e0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.335+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755e0e20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0cd280 tx=0x7f4fbc09c7a0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.336+0000 7f4fcc12f740 1 -- 172.21.15.100:0/4246699494 shutdown_connections 2024-09-12T02:42:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.336+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755e0e20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.336+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755de4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.336+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/4246699494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.336+0000 7f4fcc12f740 1 -- 172.21.15.100:0/4246699494 >> 172.21.15.100:0/4246699494 conn(0x5558755cfde0 msgr2=0x5558755d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.336+0000 7f4fcc12f740 1 -- 172.21.15.100:0/4246699494 shutdown_connections 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 -- 172.21.15.100:0/4246699494 wait complete. 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 -- start start 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 Processor -- start 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d3850 0x5558755db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755dbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755dea30 0x5558755dc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5558755e1600 con 0x5558755dea30 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5558754c0900 con 0x5558755d3850 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.337+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5558755e1780 con 0x5558755d4170 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fcc12f740 10 client.0 _ll_register_callbacks cb 0x5558754be780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:56.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d3850 0x5558755db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755dea30 0x5558755dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d3850 0x5558755db9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34598/0 (socket says 172.21.15.100:34598) 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc37fe640 1 -- 172.21.15.100:0/2352084601 learned_addr learned my addr 172.21.15.100:0/2352084601 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc2ffd640 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755dbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc3fff640 1 -- 172.21.15.100:0/2352084601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 msgr2=0x5558755dbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755dbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc3fff640 1 -- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d3850 msgr2=0x5558755db9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d3850 0x5558755db9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc3fff640 1 -- 172.21.15.100:0/2352084601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555875500c50 con 0x5558755dea30 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d3850 0x5558755db9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755dea30 0x5558755dc430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5558755d4790 tx=0x7f4fbc0bc0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6d67b571b33309 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:56.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/2352084601 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc098650 con 0x5558755dea30 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/2352084601 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4fbc096b50 con 0x5558755dea30 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.338+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fbc0a4c50 con 0x5558755dea30 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/2352084601 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4fbc096d50 con 0x5558755dea30 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 10 client.16074 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5558755ed330 con 0x5558755dea30 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/2352084601 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fbc0a4c50 con 0x5558755dea30 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/2352084601 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4fbc09af30 con 0x5558755dea30 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 10 client.16074 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 10 client.16074 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:42:56.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 20 client.16074 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:56.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x5558755f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 4 client.16074 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555875545890 con 0x5558755ee680 2024-09-12T02:42:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.339+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x5558755f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.340+0000 7f4fa2ffd640 10 client.16074 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.340+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x5558755f0a70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74e32103838e15a7 server_cookie=a8d9b80db820d6ca in_seq=0 out_seq=0 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.341+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/2352084601 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555875545890 con 0x5558755ee680 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.341+0000 7f4fa2ffd640 10 client.16074 handle_command_reply: tid=0 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.341+0000 7f4fcc12f740 1 client.16074 shutdown 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755dea30 msgr2=0x5558755dc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755dea30 0x5558755dc430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5558755d4790 tx=0x7f4fbc0bc0e0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 shutdown_connections 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x5558755f0a70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fa2ffd640 0 client.16074 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755dea30 0x5558755dc430 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755dbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/2352084601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d3850 0x5558755db9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 >> 172.21.15.100:0/2352084601 conn(0x5558755cfde0 msgr2=0x5558755d5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 shutdown_connections 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.342+0000 7f4fcc12f740 1 -- 172.21.15.100:0/2352084601 wait complete. 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.343+0000 7f4fcc12f740 20 client.16074 trim_cache size 0 max 16384 2024-09-12T02:42:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 Processor -- start 2024-09-12T02:42:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 -- start start 2024-09-12T02:42:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755dc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755d8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41b1fb0 con 0x5558755d3850 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41af880 con 0x5558755dea30 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41ad6d0 con 0x5558755d4170 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755dc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755dc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48798/0 (socket says 172.21.15.100:48798) 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fc37fe640 1 -- 172.21.15.100:0/3225016224 learned_addr learned my addr 172.21.15.100:0/3225016224 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.367+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755d8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc2ffd640 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc3fff640 1 -- 172.21.15.100:0/3225016224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 msgr2=0x5558755ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755ea0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc3fff640 1 -- 172.21.15.100:0/3225016224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 msgr2=0x5558755dc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755dc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc3fff640 1 -- 172.21.15.100:0/3225016224 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558755d0a70 con 0x5558755dea30 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755d8c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc005ba0 tx=0x7f4fbc0a47c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=497c79ecf060d77c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fa97fa640 1 -- 172.21.15.100:0/3225016224 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0051d0 con 0x5558755dea30 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fa97fa640 1 -- 172.21.15.100:0/3225016224 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fbc07ae50 con 0x5558755dea30 2024-09-12T02:42:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.368+0000 7f4fa97fa640 1 -- 172.21.15.100:0/3225016224 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0a1610 con 0x5558755dea30 2024-09-12T02:42:56.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 -- 172.21.15.100:0/3225016224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 msgr2=0x5558755d8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755d8c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc005ba0 tx=0x7f4fbc0a47c0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 -- 172.21.15.100:0/3225016224 shutdown_connections 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755dea30 0x5558755d8c10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755d4170 0x5558755ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/3225016224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 -- 172.21.15.100:0/3225016224 >> 172.21.15.100:0/3225016224 conn(0x5558755cfde0 msgr2=0x5558755e99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 -- 172.21.15.100:0/3225016224 shutdown_connections 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.369+0000 7f4fcc12f740 1 -- 172.21.15.100:0/3225016224 wait complete. 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.370+0000 7f4fcc12f740 1 -- start start 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.370+0000 7f4fcc12f740 1 Processor -- start 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d4170 0x5558755f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fcc12f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755dea30 0x5558755f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41add40 con 0x5558755d3850 2024-09-12T02:42:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41af1b0 con 0x5558755d4170 2024-09-12T02:42:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fcc12f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41ae410 con 0x5558755dea30 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fcc12f740 10 client.0 _ll_register_callbacks cb 0x7f4fb4040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fc2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d4170 0x5558755f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fc2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d4170 0x5558755f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34604/0 (socket says 172.21.15.100:34604) 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fc2ffd640 1 -- 172.21.15.100:0/1616869403 learned_addr learned my addr 172.21.15.100:0/1616869403 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.371+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755dea30 0x5558755f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.372+0000 7f4fc3fff640 1 -- 172.21.15.100:0/1616869403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d4170 msgr2=0x5558755f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.372+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d4170 0x5558755f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.372+0000 7f4fc3fff640 1 -- 172.21.15.100:0/1616869403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 msgr2=0x5558755f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.372+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.372+0000 7f4fc3fff640 1 -- 172.21.15.100:0/1616869403 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555875658210 con 0x5558755dea30 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.372+0000 7f4fc3fff640 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755dea30 0x5558755f24d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc005ba0 tx=0x7f4fbc0054b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c5f2d3347b292c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.372+0000 7f4fa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.373+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/1616869403 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0bc0e0 con 0x5558755dea30 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.373+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fbc07ae50 con 0x5558755dea30 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.373+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/1616869403 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4fbc09b430 con 0x5558755dea30 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.373+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/1616869403 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4fbc09b0b0 con 0x5558755dea30 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.373+0000 7f4fcc12f740 10 client.25495 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.373+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555875658210 con 0x5558755dea30 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/1616869403 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fbc07ae50 con 0x5558755dea30 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/1616869403 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4fbc004a40 con 0x5558755dea30 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fcc12f740 10 client.25495 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fcc12f740 10 client.25495 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fcc12f740 20 client.25495 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x55587565b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fcc12f740 4 client.25495 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-12T02:42:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.374+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x55587553fbe0 con 0x5558755ee680 2024-09-12T02:42:56.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.375+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x55587565b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.375+0000 7f4fc37fe640 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x55587565b830 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=834cda5447f26a81 server_cookie=4c50de28f11087bb in_seq=0 out_seq=0 2024-09-12T02:42:56.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.375+0000 7f4fa2ffd640 10 client.25495 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:56.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fa2ffd640 1 -- 172.21.15.100:0/1616869403 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55587553fbe0 con 0x5558755ee680 2024-09-12T02:42:56.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fa2ffd640 10 client.25495 handle_command_reply: tid=0 2024-09-12T02:42:56.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 client.25495 shutdown 2024-09-12T02:42:56.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755dea30 msgr2=0x5558755f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755dea30 0x5558755f24d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc005ba0 tx=0x7f4fbc0054b0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 shutdown_connections 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5558755ee680 0x55587565b830 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5558755dea30 0x5558755f24d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5558755d4170 0x5558755f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fa2ffd640 0 client.25495 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 --2- 172.21.15.100:0/1616869403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558755d3850 0x5558755f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 >> 172.21.15.100:0/1616869403 conn(0x5558755cfde0 msgr2=0x5558755ea1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 shutdown_connections 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 1 -- 172.21.15.100:0/1616869403 wait complete. 2024-09-12T02:42:56.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.636+0000 7f4fcc12f740 20 client.25495 trim_cache size 0 max 16384 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 18, 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout: "ee7df9b4": { 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 18, 2024-09-12T02:42:56.639 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 140.2, 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:42:56.640 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:56.641 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:42:56.642 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:42:56.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4fac0a2c00 msgr2=0x7f4fac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4fac0a2c00 0x7f4fac0a50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40096c0 tx=0x7f4fb4005a20 comp rx=0 tx=0).stop 2024-09-12T02:42:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc4102ef0 msgr2=0x7f4fc419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc4102ef0 0x7f4fc419eea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009fd0 tx=0x7f4fbc00ef10 comp rx=0 tx=0).stop 2024-09-12T02:42:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 shutdown_connections 2024-09-12T02:42:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4fac0a2c00 0x7f4fac0a50c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc4102ef0 0x7f4fc419eea0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fc4102570 0x7f4fc419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 --2- 172.21.15.100:0/1735142958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc4100e20 0x7f4fc419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 >> 172.21.15.100:0/1735142958 conn(0x7f4fc40fc7d0 msgr2=0x7f4fc4103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 shutdown_connections 2024-09-12T02:42:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:56.637+0000 7f4fc9d56640 1 -- 172.21.15.100:0/1735142958 wait complete. 2024-09-12T02:42:56.934 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:56 smithi100 ceph-mon[31390]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 MiB/s wr, 93 op/s 2024-09-12T02:42:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:56 smithi117 ceph-mon[34898]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 MiB/s wr, 93 op/s 2024-09-12T02:42:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:56 smithi189 ceph-mon[35196]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 MiB/s wr, 93 op/s 2024-09-12T02:42:57.393 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ee7df9b4', quiesce took 4.1 seconds. Will release after: 16.049999999999997 2024-09-12T02:42:57.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:42:58.018 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:42:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:42:57 smithi117 ceph-mon[34898]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.2 MiB/s wr, 183 op/s 2024-09-12T02:42:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:42:57 smithi100 ceph-mon[31390]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.2 MiB/s wr, 183 op/s 2024-09-12T02:42:58.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:42:57 smithi189 ceph-mon[35196]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.2 MiB/s wr, 183 op/s 2024-09-12T02:42:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 -- 172.21.15.100:0/192116806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc106c30 msgr2=0x7ffabc107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 --2- 172.21.15.100:0/192116806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc106c30 0x7ffabc107010 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009900 tx=0x7ffaac02a410 comp rx=0 tx=0).stop 2024-09-12T02:42:58.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 -- 172.21.15.100:0/192116806 shutdown_connections 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 --2- 172.21.15.100:0/192116806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffabc101b40 0x7ffabc10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 --2- 172.21.15.100:0/192116806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffabc1011a0 0x7ffabc101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 --2- 172.21.15.100:0/192116806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc106c30 0x7ffabc107010 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 -- 172.21.15.100:0/192116806 >> 172.21.15.100:0/192116806 conn(0x7ffabc077210 msgr2=0x7ffabc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 -- 172.21.15.100:0/192116806 shutdown_connections 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.517+0000 7ffac300c640 1 -- 172.21.15.100:0/192116806 wait complete. 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 Processor -- start 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 -- start start 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffabc1011a0 0x7ffabc197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc101b40 0x7ffabc1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffabc106c30 0x7ffabc19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc110fa0 con 0x7ffabc101b40 2024-09-12T02:42:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc110e20 con 0x7ffabc1011a0 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffac300c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc111120 con 0x7ffabc106c30 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffabbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc101b40 0x7ffabc1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffabbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc101b40 0x7ffabc1979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48808/0 (socket says 172.21.15.100:48808) 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.518+0000 7ffabbfff640 1 -- 172.21.15.100:0/1257351782 learned_addr learned my addr 172.21.15.100:0/1257351782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffac0da8640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffabc1011a0 0x7ffabc197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffac15a9640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffabc106c30 0x7ffabc19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffabbfff640 1 -- 172.21.15.100:0/1257351782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffabc106c30 msgr2=0x7ffabc19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffabbfff640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffabc106c30 0x7ffabc19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffabbfff640 1 -- 172.21.15.100:0/1257351782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffabc1011a0 msgr2=0x7ffabc197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffabbfff640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffabc1011a0 0x7ffabc197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffabbfff640 1 -- 172.21.15.100:0/1257351782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc19c410 con 0x7ffabc101b40 2024-09-12T02:42:58.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffabbfff640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc101b40 0x7ffabc1979a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d770 tx=0x7ffaa400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffab9ffb640 1 -- 172.21.15.100:0/1257351782 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4017070 con 0x7ffabc101b40 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffab9ffb640 1 -- 172.21.15.100:0/1257351782 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa4005500 con 0x7ffabc101b40 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffabc19c700 con 0x7ffabc101b40 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffab9ffb640 1 -- 172.21.15.100:0/1257351782 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004e00 con 0x7ffabc101b40 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.519+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffabc1a3fe0 con 0x7ffabc101b40 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.521+0000 7ffab9ffb640 1 -- 172.21.15.100:0/1257351782 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ffaa4004fa0 con 0x7ffabc101b40 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 Processor -- start 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 -- start start 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e9597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e966350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e968c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffab9ffb640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffaa80a2b80 0x7ffaa80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c68e8bf2e0 con 0x55c68e9593c0 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c68e866ce0 con 0x55c68e966890 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac53e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c68e8bb2a0 con 0x55c68e959ce0 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac15a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e9597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac15a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e9597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48824/0 (socket says 172.21.15.100:48824) 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac15a9640 1 -- 172.21.15.100:0/3844856676 learned_addr learned my addr 172.21.15.100:0/3844856676 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffac0da8640 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e966350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffab9ffb640 1 -- 172.21.15.100:0/1257351782 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffaa40cea20 con 0x7ffabc101b40 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.522+0000 7ffabbfff640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffaa80a2b80 0x7ffaa80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffac15a9640 1 -- 172.21.15.100:0/3844856676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 msgr2=0x55c68e966350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e966350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffac15a9640 1 -- 172.21.15.100:0/3844856676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 msgr2=0x55c68e968c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e968c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffac15a9640 1 -- 172.21.15.100:0/3844856676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c68e84b440 con 0x55c68e9593c0 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e9597a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009f80 tx=0x7ffab40139f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb6dc68dfa6d70d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffabbfff640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffaa80a2b80 0x7ffaa80a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4097cf0 tx=0x7ffaa4009c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffab2ffd640 1 -- 172.21.15.100:0/3844856676 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4003970 con 0x55c68e9593c0 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffab2ffd640 1 -- 172.21.15.100:0/3844856676 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab4017070 con 0x55c68e9593c0 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.523+0000 7ffab2ffd640 1 -- 172.21.15.100:0/3844856676 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab400f7b0 con 0x55c68e9593c0 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 -- 172.21.15.100:0/3844856676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 msgr2=0x55c68e9597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e9597a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009f80 tx=0x7ffab40139f0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 -- 172.21.15.100:0/3844856676 shutdown_connections 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e968c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e966350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3844856676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e9597a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 -- 172.21.15.100:0/3844856676 >> 172.21.15.100:0/3844856676 conn(0x55c68e955a30 msgr2=0x55c68e955e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 -- 172.21.15.100:0/3844856676 shutdown_connections 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 -- 172.21.15.100:0/3844856676 wait complete. 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 -- start start 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 Processor -- start 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.524+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e966250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e963500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e963af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c68e969400 con 0x55c68e9593c0 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c68e87a050 con 0x55c68e966890 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c68e969580 con 0x55c68e959ce0 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 10 client.0 _ll_register_callbacks cb 0x55c68e8ba160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:58.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e966250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e966250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48838/0 (socket says 172.21.15.100:48838) 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 -- 172.21.15.100:0/276219331 learned_addr learned my addr 172.21.15.100:0/276219331 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac0da8640 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e963500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 -- 172.21.15.100:0/276219331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 msgr2=0x55c68e963500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e963500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 -- 172.21.15.100:0/276219331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 msgr2=0x55c68e963af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e963af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 -- 172.21.15.100:0/276219331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c68e6303c0 con 0x55c68e9593c0 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac0da8640 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e963500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac15a9640 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e966250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ffab400a010 tx=0x7ffab4004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6c682c3ca71b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffa9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:58.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffa9bfff640 1 -- 172.21.15.100:0/276219331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4009d00 con 0x55c68e9593c0 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffa9bfff640 1 -- 172.21.15.100:0/276219331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffab4003970 con 0x55c68e9593c0 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab4017070 con 0x55c68e9593c0 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffa9bfff640 1 -- 172.21.15.100:0/276219331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffab4003b70 con 0x55c68e9593c0 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.525+0000 7ffac53e5740 10 client.16092 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c68e974e60 con 0x55c68e9593c0 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffa9bfff640 1 -- 172.21.15.100:0/276219331 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab4017070 con 0x55c68e9593c0 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffa9bfff640 1 -- 172.21.15.100:0/276219331 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ffab4010760 con 0x55c68e9593c0 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac53e5740 10 client.16092 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac53e5740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac53e5740 20 client.16092 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac53e5740 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e976270 0x55c68e978660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac53e5740 4 client.16092 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c68e8cc850 con 0x55c68e976270 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.526+0000 7ffac0da8640 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e976270 0x55c68e978660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffa9bfff640 10 client.16092 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffac0da8640 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e976270 0x55c68e978660 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef3a41b1f68ea72 server_cookie=b0385fb9c94a9bb7 in_seq=0 out_seq=0 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffa9bfff640 1 -- 172.21.15.100:0/276219331 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c68e8cc850 con 0x55c68e976270 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffa9bfff640 10 client.16092 handle_command_reply: tid=0 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffac53e5740 1 client.16092 shutdown 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 msgr2=0x55c68e966250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffac53e5740 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e966250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ffab400a010 tx=0x7ffab4004510 comp rx=0 tx=0).stop 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 shutdown_connections 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.527+0000 7ffac53e5740 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e976270 0x55c68e978660 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffac53e5740 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e963af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffa9bfff640 0 client.16092 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:58.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffac53e5740 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e963500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffac53e5740 1 --2- 172.21.15.100:0/276219331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e9593c0 0x55c68e966250 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 >> 172.21.15.100:0/276219331 conn(0x55c68e955a30 msgr2=0x55c68e95b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 shutdown_connections 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffac53e5740 1 -- 172.21.15.100:0/276219331 wait complete. 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.528+0000 7ffac53e5740 20 client.16092 trim_cache size 0 max 16384 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 Processor -- start 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 -- start start 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e9593c0 0x55c68e9726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e961dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e966890 0x55c68e95b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1add10 con 0x55c68e966890 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1ab5e0 con 0x55c68e9593c0 2024-09-12T02:42:58.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac53e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1a9430 con 0x55c68e959ce0 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e966890 0x55c68e95b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e966890 0x55c68e95b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48852/0 (socket says 172.21.15.100:48852) 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 -- 172.21.15.100:0/87398960 learned_addr learned my addr 172.21.15.100:0/87398960 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac0da8640 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e961dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e9593c0 0x55c68e9726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 -- 172.21.15.100:0/87398960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 msgr2=0x55c68e961dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e961dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 -- 172.21.15.100:0/87398960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e9593c0 msgr2=0x55c68e9726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e9593c0 0x55c68e9726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.545+0000 7ffac15a9640 1 -- 172.21.15.100:0/87398960 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c68e95a910 con 0x55c68e966890 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac15a9640 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e966890 0x55c68e95b520 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ffab400ffa0 tx=0x7ffab40139f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dd7aecd3f09bca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffab27fc640 1 -- 172.21.15.100:0/87398960 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4009d00 con 0x55c68e966890 2024-09-12T02:42:58.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffab27fc640 1 -- 172.21.15.100:0/87398960 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab4017040 con 0x55c68e966890 2024-09-12T02:42:58.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffab27fc640 1 -- 172.21.15.100:0/87398960 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4028330 con 0x55c68e966890 2024-09-12T02:42:58.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac53e5740 1 -- 172.21.15.100:0/87398960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e966890 msgr2=0x55c68e95b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac53e5740 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e966890 0x55c68e95b520 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ffab400ffa0 tx=0x7ffab40139f0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac53e5740 1 -- 172.21.15.100:0/87398960 shutdown_connections 2024-09-12T02:42:58.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac53e5740 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e966890 0x55c68e95b520 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac53e5740 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e959ce0 0x55c68e961dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac53e5740 1 --2- 172.21.15.100:0/87398960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e9593c0 0x55c68e9726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.546+0000 7ffac53e5740 1 -- 172.21.15.100:0/87398960 >> 172.21.15.100:0/87398960 conn(0x55c68e955a30 msgr2=0x55c68e95ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 -- 172.21.15.100:0/87398960 shutdown_connections 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 -- 172.21.15.100:0/87398960 wait complete. 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 -- start start 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 Processor -- start 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e9593c0 0x55c68e96ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e959ce0 0x55c68e96a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e96a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1a9aa0 con 0x55c68e959ce0 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1aaf10 con 0x55c68e966890 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1aa170 con 0x55c68e9593c0 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac53e5740 10 client.0 _ll_register_callbacks cb 0x7ffaac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac0da8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e959ce0 0x55c68e96a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac0da8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e959ce0 0x55c68e96a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48856/0 (socket says 172.21.15.100:48856) 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.547+0000 7ffac0da8640 1 -- 172.21.15.100:0/3810189184 learned_addr learned my addr 172.21.15.100:0/3810189184 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e96a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e9593c0 0x55c68e96ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac0da8640 1 -- 172.21.15.100:0/3810189184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e9593c0 msgr2=0x55c68e96ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac0da8640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e9593c0 0x55c68e96ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac0da8640 1 -- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 msgr2=0x55c68e96a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac0da8640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e96a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac0da8640 1 -- 172.21.15.100:0/3810189184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c68e96abb0 con 0x55c68e959ce0 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e9593c0 0x55c68e96ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac0da8640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e959ce0 0x55c68e96a0b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009230 tx=0x7ffaac031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8dfd669db86cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffa9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffa9bfff640 1 -- 172.21.15.100:0/3810189184 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac035040 con 0x55c68e959ce0 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffa9bfff640 1 -- 172.21.15.100:0/3810189184 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffaac004240 con 0x55c68e959ce0 2024-09-12T02:42:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab4017040 con 0x55c68e959ce0 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffa9bfff640 1 -- 172.21.15.100:0/3810189184 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffaac004440 con 0x55c68e959ce0 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac53e5740 10 client.16098 fetch_fsmap learned FSMap version 27 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.548+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c68e9e0b30 con 0x55c68e959ce0 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffa9bfff640 1 -- 172.21.15.100:0/3810189184 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab4017040 con 0x55c68e959ce0 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffa9bfff640 1 -- 172.21.15.100:0/3810189184 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ffaac04f5d0 con 0x55c68e959ce0 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac53e5740 10 client.16098 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac53e5740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac53e5740 20 client.16098 populate_metadata read hostname 'smithi100' 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e9e1290 0x55c68e9e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac53e5740 4 client.16098 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c68e8c6d60 con 0x55c68e9e1290 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e9e1290 0x55c68e9e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac15a9640 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e9e1290 0x55c68e9e36b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bccf108809532e2c server_cookie=f615f6655f72f866 in_seq=0 out_seq=0 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffa9bfff640 10 client.16098 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffa9bfff640 1 -- 172.21.15.100:0/3810189184 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c68e8c6d60 con 0x55c68e9e1290 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffa9bfff640 10 client.16098 handle_command_reply: tid=0 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.549+0000 7ffac53e5740 1 client.16098 shutdown 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e959ce0 msgr2=0x55c68e96a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e959ce0 0x55c68e96a0b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009230 tx=0x7ffaac031a20 comp rx=0 tx=0).stop 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 shutdown_connections 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c68e9e1290 0x55c68e9e36b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c68e966890 0x55c68e96a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffa9bfff640 0 client.16098 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c68e959ce0 0x55c68e96a0b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 --2- 172.21.15.100:0/3810189184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c68e9593c0 0x55c68e96ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 >> 172.21.15.100:0/3810189184 conn(0x55c68e955a30 msgr2=0x55c68e95b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 shutdown_connections 2024-09-12T02:42:58.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 1 -- 172.21.15.100:0/3810189184 wait complete. 2024-09-12T02:42:58.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac53e5740 20 client.16098 trim_cache size 0 max 16384 2024-09-12T02:42:58.566 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:42:58.566 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:42:58.566 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:42:58.566 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:42:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffaa80a2b80 msgr2=0x7ffaa80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffaa80a2b80 0x7ffaa80a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4097cf0 tx=0x7ffaa4009c30 comp rx=0 tx=0).stop 2024-09-12T02:42:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc101b40 msgr2=0x7ffabc1979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc101b40 0x7ffabc1979a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d770 tx=0x7ffaa400dc30 comp rx=0 tx=0).stop 2024-09-12T02:42:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 shutdown_connections 2024-09-12T02:42:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffaa80a2b80 0x7ffaa80a5040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffabc106c30 0x7ffabc19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffabc101b40 0x7ffabc1979a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 --2- 172.21.15.100:0/1257351782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffabc1011a0 0x7ffabc197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.550+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 >> 172.21.15.100:0/1257351782 conn(0x7ffabc077210 msgr2=0x7ffabc103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.551+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 shutdown_connections 2024-09-12T02:42:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:42:58.551+0000 7ffac300c640 1 -- 172.21.15.100:0/1257351782 wait complete. 2024-09-12T02:42:59.446 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:42:59.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:42:59.693 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 -- 172.21.15.100:0/1371259667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42010bfc0 msgr2=0x7fe42010e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 --2- 172.21.15.100:0/1371259667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42010bfc0 0x7fe42010e460 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe418009900 tx=0x7fe41802a4a0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 -- 172.21.15.100:0/1371259667 shutdown_connections 2024-09-12T02:43:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 --2- 172.21.15.100:0/1371259667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42010bfc0 0x7fe42010e460 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 --2- 172.21.15.100:0/1371259667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4201034b0 0x7fe42010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 --2- 172.21.15.100:0/1371259667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe420102b90 0x7fe420102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 -- 172.21.15.100:0/1371259667 >> 172.21.15.100:0/1371259667 conn(0x7fe4200fc610 msgr2=0x7fe4200fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 -- 172.21.15.100:0/1371259667 shutdown_connections 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.175+0000 7fe42699e640 1 -- 172.21.15.100:0/1371259667 wait complete. 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 Processor -- start 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 -- start start 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe420102b90 0x7fe420198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4201034b0 0x7fe4201988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe42010bfc0 0x7fe42019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe420111ea0 con 0x7fe4201034b0 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe420111d20 con 0x7fe420102b90 2024-09-12T02:43:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42699e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe420112020 con 0x7fe42010bfc0 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42519b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4201034b0 0x7fe4201988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42519b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4201034b0 0x7fe4201988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48876/0 (socket says 172.21.15.100:48876) 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.176+0000 7fe42519b640 1 -- 172.21.15.100:0/3795496897 learned_addr learned my addr 172.21.15.100:0/3795496897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42599c640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe420102b90 0x7fe420198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42519b640 1 -- 172.21.15.100:0/3795496897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe42010bfc0 msgr2=0x7fe42019cc60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42519b640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe42010bfc0 0x7fe42019cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42519b640 1 -- 172.21.15.100:0/3795496897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe420102b90 msgr2=0x7fe420198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42519b640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe420102b90 0x7fe420198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42519b640 1 -- 172.21.15.100:0/3795496897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42019d340 con 0x7fe4201034b0 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42519b640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4201034b0 0x7fe4201988d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe41400b3f0 tx=0x7fe41400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe41effd640 1 -- 172.21.15.100:0/3795496897 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414015020 con 0x7fe4201034b0 2024-09-12T02:43:00.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe41effd640 1 -- 172.21.15.100:0/3795496897 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe414011d10 con 0x7fe4201034b0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42019d630 con 0x7fe4201034b0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe41effd640 1 -- 172.21.15.100:0/3795496897 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41400f2e0 con 0x7fe4201034b0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.177+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4201a4f10 con 0x7fe4201034b0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.178+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe420102ff0 con 0x7fe4201034b0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.179+0000 7fe41effd640 1 -- 172.21.15.100:0/3795496897 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe414018020 con 0x7fe4201034b0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.180+0000 7fe41effd640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe4080a2b80 0x7fe4080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.180+0000 7fe42599c640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe4080a2b80 0x7fe4080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.180+0000 7fe41effd640 1 -- 172.21.15.100:0/3795496897 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe4140ce960 con 0x7fe4201034b0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.180+0000 7fe42599c640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe4080a2b80 0x7fe4080a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe410009f60 tx=0x7fe4100094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.184+0000 7fe41effd640 1 -- 172.21.15.100:0/3795496897 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe41401f020 con 0x7fe4201034b0 2024-09-12T02:43:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.383+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe42002d7c0 con 0x7fe4201034b0 2024-09-12T02:43:00.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.384+0000 7fe41effd640 1 -- 172.21.15.100:0/3795496897 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fe41409b8b0 con 0x7fe4201034b0 2024-09-12T02:43:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:43:00.385 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:43:00.385 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:43:00.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe4080a2b80 msgr2=0x7fe4080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe4080a2b80 0x7fe4080a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe410009f60 tx=0x7fe4100094f0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4201034b0 msgr2=0x7fe4201988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4201034b0 0x7fe4201988d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe41400b3f0 tx=0x7fe41400b8b0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 shutdown_connections 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe4080a2b80 0x7fe4080a5040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe42010bfc0 0x7fe42019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4201034b0 0x7fe4201988d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 --2- 172.21.15.100:0/3795496897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe420102b90 0x7fe420198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 >> 172.21.15.100:0/3795496897 conn(0x7fe4200fc610 msgr2=0x7fe4200fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 shutdown_connections 2024-09-12T02:43:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:00.386+0000 7fe42699e640 1 -- 172.21.15.100:0/3795496897 wait complete. 2024-09-12T02:43:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:00 smithi189 ceph-mon[35196]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.9 MiB/s wr, 267 op/s 2024-09-12T02:43:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:00 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3795496897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:00 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:00 smithi117 ceph-mon[34898]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.9 MiB/s wr, 267 op/s 2024-09-12T02:43:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:00 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3795496897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:00 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:00 smithi100 ceph-mon[31390]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.9 MiB/s wr, 267 op/s 2024-09-12T02:43:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:00 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3795496897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:00 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:01.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:43:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 230.0 s, 66.5 tps, lat 34.847 ms stddev 49.399 2024-09-12T02:43:01.453 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:01.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:01.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:01.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:43:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 -- 172.21.15.100:0/3804777907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 msgr2=0x7f47f01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 --2- 172.21.15.100:0/3804777907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01029b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009900 tx=0x7f47e402a480 comp rx=0 tx=0).stop 2024-09-12T02:43:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 -- 172.21.15.100:0/3804777907 shutdown_connections 2024-09-12T02:43:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 --2- 172.21.15.100:0/3804777907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0102ef0 0x7f47f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 --2- 172.21.15.100:0/3804777907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01029b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 --2- 172.21.15.100:0/3804777907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f0100e20 0x7f47f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 -- 172.21.15.100:0/3804777907 >> 172.21.15.100:0/3804777907 conn(0x7f47f00fc7d0 msgr2=0x7f47f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 -- 172.21.15.100:0/3804777907 shutdown_connections 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.922+0000 7f47f55df640 1 -- 172.21.15.100:0/3804777907 wait complete. 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 Processor -- start 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 -- start start 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f0100e20 0x7f47f0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0102ef0 0x7f47f01a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0110fa0 con 0x7f47f0102570 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0110e20 con 0x7f47f0102ef0 2024-09-12T02:43:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47f55df640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0111120 con 0x7f47f0100e20 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48892/0 (socket says 172.21.15.100:48892) 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47ee7fc640 1 -- 172.21.15.100:0/69714203 learned_addr learned my addr 172.21.15.100:0/69714203 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47eeffd640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f0100e20 0x7f47f0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.923+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0102ef0 0x7f47f01a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47ee7fc640 1 -- 172.21.15.100:0/69714203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f0100e20 msgr2=0x7f47f0199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f0100e20 0x7f47f0199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47ee7fc640 1 -- 172.21.15.100:0/69714203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0102ef0 msgr2=0x7f47f01a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0102ef0 0x7f47f01a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47ee7fc640 1 -- 172.21.15.100:0/69714203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f0197160 con 0x7f47f0102570 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0102ef0 0x7f47f01a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01998b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f47e4006010 tx=0x7f47e4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47d7fff640 1 -- 172.21.15.100:0/69714203 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e403f070 con 0x7f47f0102570 2024-09-12T02:43:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f01973f0 con 0x7f47f0102570 2024-09-12T02:43:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47d7fff640 1 -- 172.21.15.100:0/69714203 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e4031e30 con 0x7f47f0102570 2024-09-12T02:43:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47d7fff640 1 -- 172.21.15.100:0/69714203 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4035030 con 0x7f47f0102570 2024-09-12T02:43:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.924+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f01978d0 con 0x7f47f0102570 2024-09-12T02:43:01.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.926+0000 7f47d7fff640 1 -- 172.21.15.100:0/69714203 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f47e4042070 con 0x7f47f0102570 2024-09-12T02:43:01.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 Processor -- start 2024-09-12T02:43:01.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 -- start start 2024-09-12T02:43:01.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e45f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e45fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e46c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e3c52f0 con 0x55cd0e46a370 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e36ccf0 con 0x55cd0e460b40 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47f79b8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e3c12b0 con 0x55cd0e45f5d0 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e46c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47d7fff640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47d80a2b80 0x7f47d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e46c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48900/0 (socket says 172.21.15.100:48900) 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.927+0000 7f47ee7fc640 1 -- 172.21.15.100:0/1178376412 learned_addr learned my addr 172.21.15.100:0/1178376412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e45f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47eeffd640 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e45fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47d80a2b80 0x7f47d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47d7fff640 1 -- 172.21.15.100:0/69714203 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f47e40efb10 con 0x7f47f0102570 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ee7fc640 1 -- 172.21.15.100:0/1178376412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 msgr2=0x55cd0e45fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e45fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ee7fc640 1 -- 172.21.15.100:0/1178376412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 msgr2=0x55cd0e45f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e45f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ee7fc640 1 -- 172.21.15.100:0/1178376412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e3513a0 con 0x55cd0e46a370 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e45f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e46c760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b7fe0 tx=0x7f47e402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884eded242d43610 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47d80a2b80 0x7f47d80a5040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007310 tx=0x7f47e80072a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47d57fa640 1 -- 172.21.15.100:0/1178376412 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4049070 con 0x55cd0e46a370 2024-09-12T02:43:01.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47d57fa640 1 -- 172.21.15.100:0/1178376412 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e40c4f70 con 0x55cd0e46a370 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.928+0000 7f47d57fa640 1 -- 172.21.15.100:0/1178376412 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40c06b0 con 0x55cd0e46a370 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 -- 172.21.15.100:0/1178376412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 msgr2=0x55cd0e46c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e46c760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b7fe0 tx=0x7f47e402a480 comp rx=0 tx=0).stop 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 -- 172.21.15.100:0/1178376412 shutdown_connections 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e46c760 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e45fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 --2- 172.21.15.100:0/1178376412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e45f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 -- 172.21.15.100:0/1178376412 >> 172.21.15.100:0/1178376412 conn(0x55cd0e428310 msgr2=0x55cd0e45bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 -- 172.21.15.100:0/1178376412 shutdown_connections 2024-09-12T02:43:01.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 -- 172.21.15.100:0/1178376412 wait complete. 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.929+0000 7f47f79b8740 1 -- start start 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 1 Processor -- start 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e45f5d0 0x55cd0e469dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e467080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e46a370 0x55cd0e467810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e46ce30 con 0x55cd0e460b40 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e380060 con 0x55cd0e45f5d0 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e46cfb0 con 0x55cd0e46a370 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47f79b8740 10 client.0 _ll_register_callbacks cb 0x55cd0e0d38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:01.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e467080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e467080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48908/0 (socket says 172.21.15.100:48908) 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2409922021 learned_addr learned my addr 172.21.15.100:0/2409922021 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e46a370 0x55cd0e467810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e45f5d0 0x55cd0e469dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e46a370 msgr2=0x55cd0e467810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e46a370 0x55cd0e467810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2409922021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e45f5d0 msgr2=0x55cd0e469dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e45f5d0 0x55cd0e469dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2409922021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0e1363c0 con 0x55cd0e460b40 2024-09-12T02:43:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.930+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e467080 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f47e40bc000 tx=0x7f47e40bbf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9afec6492ff92c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2409922021 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4049070 con 0x55cd0e460b40 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2409922021 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f47e40c4ae0 con 0x55cd0e460b40 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd0e3d2860 con 0x55cd0e460b40 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2409922021 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47e40bbc60 con 0x55cd0e460b40 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 10 client.16116 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd0e46ce30 con 0x55cd0e460b40 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2409922021 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cd0e3d2860 con 0x55cd0e460b40 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2409922021 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f47e40dc110 con 0x55cd0e460b40 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 10 client.16116 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 10 client.16116 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:43:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 20 client.16116 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e479a80 0x55cd0e47bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 4 client.16116 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.931+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd0e3ccd70 con 0x55cd0e479a80 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.932+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e479a80 0x55cd0e47bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.932+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e479a80 0x55cd0e47bee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=374baeaab642ba73 server_cookie=37ef5d1527d3a564 in_seq=0 out_seq=0 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.932+0000 7f47d2ff5640 10 client.16116 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2409922021 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd0e3ccd70 con 0x55cd0e479a80 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47d2ff5640 10 client.16116 handle_command_reply: tid=0 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 client.16116 shutdown 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 msgr2=0x55cd0e467080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e467080 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f47e40bc000 tx=0x7f47e40bbf70 comp rx=0 tx=0).stop 2024-09-12T02:43:01.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 shutdown_connections 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e479a80 0x55cd0e47bee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e46a370 0x55cd0e467810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e467080 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2409922021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e45f5d0 0x55cd0e469dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47d2ff5640 0 client.16116 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 >> 172.21.15.100:0/2409922021 conn(0x55cd0e428310 msgr2=0x55cd0e461960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 shutdown_connections 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 1 -- 172.21.15.100:0/2409922021 wait complete. 2024-09-12T02:43:01.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.933+0000 7f47f79b8740 20 client.16116 trim_cache size 0 max 16384 2024-09-12T02:43:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 Processor -- start 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 -- start start 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e468ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e462120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e462660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47f01b2020 con 0x55cd0e46a370 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47f01af8f0 con 0x55cd0e460b40 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47f79b8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47f01ad760 con 0x55cd0e45f5d0 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e462660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e462660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48924/0 (socket says 172.21.15.100:48924) 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 -- 172.21.15.100:0/2309289595 learned_addr learned my addr 172.21.15.100:0/2309289595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 -- 172.21.15.100:0/2309289595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 msgr2=0x55cd0e468ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e462120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e468ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e468ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 -- 172.21.15.100:0/2309289595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 msgr2=0x55cd0e462120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e462120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ef7fe640 1 -- 172.21.15.100:0/2309289595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e460300 con 0x55cd0e46a370 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e462120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.946+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e468ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e462660 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f47e8010d30 tx=0x7f47e8007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aed2a0dc53a78b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47d4ff9640 1 -- 172.21.15.100:0/2309289595 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80138a0 con 0x55cd0e46a370 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47d4ff9640 1 -- 172.21.15.100:0/2309289595 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e8013a40 con 0x55cd0e46a370 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47d4ff9640 1 -- 172.21.15.100:0/2309289595 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e80207f0 con 0x55cd0e46a370 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 -- 172.21.15.100:0/2309289595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 msgr2=0x55cd0e462660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e462660 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f47e8010d30 tx=0x7f47e8007680 comp rx=0 tx=0).stop 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 -- 172.21.15.100:0/2309289595 shutdown_connections 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e46a370 0x55cd0e462660 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e460b40 0x55cd0e462120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2309289595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e468ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 -- 172.21.15.100:0/2309289595 >> 172.21.15.100:0/2309289595 conn(0x55cd0e428310 msgr2=0x55cd0e4688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 -- 172.21.15.100:0/2309289595 shutdown_connections 2024-09-12T02:43:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.947+0000 7f47f79b8740 1 -- 172.21.15.100:0/2309289595 wait complete. 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 -- start start 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 Processor -- start 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e46de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e46e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e46a370 0x55cd0e46e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47f01addb0 con 0x55cd0e460b40 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47f01af220 con 0x55cd0e46a370 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47f01ae480 con 0x55cd0e45f5d0 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47f79b8740 10 client.0 _ll_register_callbacks cb 0x7f47e8007e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e46e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e46e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48926/0 (socket says 172.21.15.100:48926) 2024-09-12T02:43:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2587281488 learned_addr learned my addr 172.21.15.100:0/2587281488 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e46de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 msgr2=0x55cd0e46de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e46de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e46a370 0x55cd0e46e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2587281488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e46a370 msgr2=0x55cd0e46e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e46a370 0x55cd0e46e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ee7fc640 1 -- 172.21.15.100:0/2587281488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0e4e3780 con 0x55cd0e460b40 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.948+0000 7f47ef7fe640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e46a370 0x55cd0e46e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47ee7fc640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e46e340 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f47e40bc240 tx=0x7f47e40dc340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f5730c9cd4fd17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2587281488 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4049070 con 0x55cd0e460b40 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2587281488 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f47e4031950 con 0x55cd0e460b40 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e8013a40 con 0x55cd0e460b40 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2587281488 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47e40bba50 con 0x55cd0e460b40 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 10 client.16122 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd0e4e3780 con 0x55cd0e460b40 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2587281488 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e8013a40 con 0x55cd0e460b40 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2587281488 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f47e40c0100 con 0x55cd0e460b40 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 10 client.16122 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 10 client.16122 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:43:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 20 client.16122 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e4e4c70 0x55cd0e4e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 4 client.16122 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.949+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd0e349170 con 0x55cd0e4e4c70 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e4e4c70 0x55cd0e4e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47eeffd640 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e4e4c70 0x55cd0e4e7090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eaad565b894f8bce server_cookie=a1ca4f9e4b3b90d1 in_seq=0 out_seq=0 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47d2ff5640 10 client.16122 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47d2ff5640 1 -- 172.21.15.100:0/2587281488 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd0e349170 con 0x55cd0e4e4c70 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47d2ff5640 10 client.16122 handle_command_reply: tid=0 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 client.16122 shutdown 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 msgr2=0x55cd0e46e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e46e340 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f47e40bc240 tx=0x7f47e40dc340 comp rx=0 tx=0).stop 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 shutdown_connections 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55cd0e4e4c70 0x55cd0e4e7090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd0e46a370 0x55cd0e46e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd0e460b40 0x55cd0e46e340 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47d2ff5640 0 client.16122 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.950+0000 7f47f79b8740 1 --2- 172.21.15.100:0/2587281488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd0e45f5d0 0x55cd0e46de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 >> 172.21.15.100:0/2587281488 conn(0x55cd0e428310 msgr2=0x55cd0e469100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 shutdown_connections 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f79b8740 1 -- 172.21.15.100:0/2587281488 wait complete. 2024-09-12T02:43:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f79b8740 20 client.16122 trim_cache size 0 max 16384 2024-09-12T02:43:01.960 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:43:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47d80a2b80 msgr2=0x7f47d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47d80a2b80 0x7f47d80a5040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007310 tx=0x7f47e80072a0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 msgr2=0x7f47f01998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01998b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f47e4006010 tx=0x7f47e4003c80 comp rx=0 tx=0).stop 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 shutdown_connections 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f47d80a2b80 0x7f47d80a5040 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0102ef0 0x7f47f01a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0102570 0x7f47f01998b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 --2- 172.21.15.100:0/69714203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f0100e20 0x7f47f0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 >> 172.21.15.100:0/69714203 conn(0x7f47f00fc7d0 msgr2=0x7f47f01068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 shutdown_connections 2024-09-12T02:43:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:01.951+0000 7f47f55df640 1 -- 172.21.15.100:0/69714203 wait complete. 2024-09-12T02:43:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:02.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:02.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:43:02.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:02.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:02.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:43:02.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:43:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:02 smithi189 ceph-mon[35196]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 291 op/s 2024-09-12T02:43:03.016 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:02 smithi117 ceph-mon[34898]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 291 op/s 2024-09-12T02:43:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:02 smithi100 ceph-mon[31390]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 291 op/s 2024-09-12T02:43:03.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 -- 172.21.15.100:0/2106290942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0112b90 msgr2=0x7f30c0114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 --2- 172.21.15.100:0/2106290942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0112b90 0x7f30c0114f80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009ca0 tx=0x7f30b802a950 comp rx=0 tx=0).stop 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 -- 172.21.15.100:0/2106290942 shutdown_connections 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 --2- 172.21.15.100:0/2106290942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0112b90 0x7f30c0114f80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 --2- 172.21.15.100:0/2106290942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30c0074eb0 0x7f30c0112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 --2- 172.21.15.100:0/2106290942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c0074590 0x7f30c0074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 -- 172.21.15.100:0/2106290942 >> 172.21.15.100:0/2106290942 conn(0x7f30c00fd8c0 msgr2=0x7f30c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 -- 172.21.15.100:0/2106290942 shutdown_connections 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.515+0000 7f30c748b640 1 -- 172.21.15.100:0/2106290942 wait complete. 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 Processor -- start 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 -- start start 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0074590 0x7f30c01a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30c0074eb0 0x7f30c01a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c0112b90 0x7f30c019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0118570 con 0x7f30c0074590 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01183f0 con 0x7f30c0112b90 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c748b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01186f0 con 0x7f30c0074eb0 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0074590 0x7f30c01a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0074590 0x7f30c01a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48944/0 (socket says 172.21.15.100:48944) 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 -- 172.21.15.100:0/1287575541 learned_addr learned my addr 172.21.15.100:0/1287575541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c4a26640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30c0074eb0 0x7f30c01a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5a28640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c0112b90 0x7f30c019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 -- 172.21.15.100:0/1287575541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30c0074eb0 msgr2=0x7f30c01a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30c0074eb0 0x7f30c01a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 -- 172.21.15.100:0/1287575541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c0112b90 msgr2=0x7f30c019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c0112b90 0x7f30c019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5227640 1 -- 172.21.15.100:0/1287575541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c019efc0 con 0x7f30c0074590 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c5a28640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c0112b90 0x7f30c019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.516+0000 7f30c4a26640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30c0074eb0 0x7f30c01a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.517+0000 7f30c5227640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0074590 0x7f30c01a46d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00d950 tx=0x7f30bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.517+0000 7f30b67fc640 1 -- 172.21.15.100:0/1287575541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc017070 con 0x7f30c0074590 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.517+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c019f2b0 con 0x7f30c0074590 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.517+0000 7f30b67fc640 1 -- 172.21.15.100:0/1287575541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30bc009c30 con 0x7f30c0074590 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.517+0000 7f30b67fc640 1 -- 172.21.15.100:0/1287575541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00f6b0 con 0x7f30c0074590 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.517+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c01ab5a0 con 0x7f30c0074590 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.519+0000 7f30b67fc640 1 -- 172.21.15.100:0/1287575541 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f30bc0109d0 con 0x7f30c0074590 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.519+0000 7f30c9864740 1 Processor -- start 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.519+0000 7f30c9864740 1 -- start start 2024-09-12T02:43:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c9864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c9864740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f05d0 0x56193a3f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c9864740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a3fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c9864740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56193a3562f0 con 0x56193a3f05d0 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c9864740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56193a2fdcf0 con 0x56193a3fb370 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c9864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56193a3522b0 con 0x56193a3f1b40 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f05d0 0x56193a3f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30b67fc640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f30ac0a2b80 0x7f30ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f05d0 0x56193a3f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48950/0 (socket says 172.21.15.100:48950) 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 -- 172.21.15.100:0/3854384467 learned_addr learned my addr 172.21.15.100:0/3854384467 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c4a26640 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a3fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5a28640 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5a28640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f30ac0a2b80 0x7f30ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30b67fc640 1 -- 172.21.15.100:0/1287575541 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f30bc0cedd0 con 0x7f30c0074590 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 -- 172.21.15.100:0/3854384467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 msgr2=0x56193a3f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 -- 172.21.15.100:0/3854384467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 msgr2=0x56193a3fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a3fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 -- 172.21.15.100:0/3854384467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193a2e23a0 con 0x56193a3f05d0 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.520+0000 7f30c5227640 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f05d0 0x56193a3f0a10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0cc860 tx=0x7f30bc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11253507fee4bf8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30ab7fe640 1 -- 172.21.15.100:0/3854384467 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc020030 con 0x56193a3f05d0 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c5a28640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f30ac0a2b80 0x7f30ac0a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30b8005fc0 tx=0x7f30b80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30ab7fe640 1 -- 172.21.15.100:0/3854384467 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30bc009de0 con 0x56193a3f05d0 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30ab7fe640 1 -- 172.21.15.100:0/3854384467 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc084b50 con 0x56193a3f05d0 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 -- 172.21.15.100:0/3854384467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f05d0 msgr2=0x56193a3f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f05d0 0x56193a3f0a10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0cc860 tx=0x7f30bc00bf60 comp rx=0 tx=0).stop 2024-09-12T02:43:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 -- 172.21.15.100:0/3854384467 shutdown_connections 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a3fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f05d0 0x56193a3f0a10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 --2- 172.21.15.100:0/3854384467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 -- 172.21.15.100:0/3854384467 >> 172.21.15.100:0/3854384467 conn(0x56193a3b9310 msgr2=0x56193a3ecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.521+0000 7f30c9864740 1 -- 172.21.15.100:0/3854384467 shutdown_connections 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 -- 172.21.15.100:0/3854384467 wait complete. 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 -- start start 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 Processor -- start 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a3fad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3fb370 0x56193a3f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56193a3fdfb0 con 0x56193a3fb370 2024-09-12T02:43:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56193a311060 con 0x56193a3f05d0 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56193a3fe130 con 0x56193a3f1b40 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c9864740 10 client.0 _ll_register_callbacks cb 0x56193a0648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.522+0000 7f30c5227640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a3fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5a28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3fb370 0x56193a3f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a3fad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34786/0 (socket says 172.21.15.100:34786) 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 -- 172.21.15.100:0/3687200611 learned_addr learned my addr 172.21.15.100:0/3687200611 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c4a26640 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 -- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 msgr2=0x56193a3f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 -- 172.21.15.100:0/3687200611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3fb370 msgr2=0x56193a3f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3fb370 0x56193a3f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 -- 172.21.15.100:0/3687200611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193a0c73c0 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c5227640 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a3fad90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0058c0 tx=0x7f30bc0cc9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69061874fa48a4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30a8ff9640 1 -- 172.21.15.100:0/3687200611 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc020040 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30a8ff9640 1 -- 172.21.15.100:0/3687200611 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f30bc084b50 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30bc009de0 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30a8ff9640 1 -- 172.21.15.100:0/3687200611 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30bc09f970 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c9864740 10 client.25559 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.523+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56193a409a80 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30a8ff9640 1 -- 172.21.15.100:0/3687200611 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30bc009de0 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30a8ff9640 1 -- 172.21.15.100:0/3687200611 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f30bc0b4220 con 0x56193a3f05d0 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c9864740 10 client.25559 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c9864740 10 client.25559 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c9864740 20 client.25559 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c9864740 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a40add0 0x56193a40d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c9864740 4 client.25559 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56193a363860 con 0x56193a40add0 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c4a26640 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a40add0 0x56193a40d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30a8ff9640 10 client.25559 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.524+0000 7f30c4a26640 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a40add0 0x56193a40d1c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71ff58371df56213 server_cookie=be9102a04a45b48f in_seq=0 out_seq=0 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30a8ff9640 1 -- 172.21.15.100:0/3687200611 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56193a363860 con 0x56193a40add0 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30a8ff9640 10 client.25559 handle_command_reply: tid=0 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 client.25559 shutdown 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 msgr2=0x56193a3fad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a3fad90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0058c0 tx=0x7f30bc0cc9f0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 shutdown_connections 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a40add0 0x56193a40d1c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3fb370 0x56193a3f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f1b40 0x56193a3f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30a8ff9640 0 client.25559 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 --2- 172.21.15.100:0/3687200611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a3fad90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.525+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 >> 172.21.15.100:0/3687200611 conn(0x56193a3b9310 msgr2=0x56193a3f2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.526+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 shutdown_connections 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.526+0000 7f30c9864740 1 -- 172.21.15.100:0/3687200611 wait complete. 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.526+0000 7f30c9864740 20 client.25559 trim_cache size 0 max 16384 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.538+0000 7f30c9864740 1 Processor -- start 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.538+0000 7f30c9864740 1 -- start start 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c9864740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a4073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c9864740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a4101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c9864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3fb370 0x56193a410720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c9864740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b6550 con 0x56193a3f1b40 2024-09-12T02:43:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c9864740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b3e20 con 0x56193a3f05d0 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c9864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b1c70 con 0x56193a3fb370 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a4101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a4101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48966/0 (socket says 172.21.15.100:48966) 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 -- 172.21.15.100:0/870938658 learned_addr learned my addr 172.21.15.100:0/870938658 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c5a28640 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3fb370 0x56193a410720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 -- 172.21.15.100:0/870938658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3fb370 msgr2=0x56193a410720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3fb370 0x56193a410720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 -- 172.21.15.100:0/870938658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 msgr2=0x56193a4073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a4073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 -- 172.21.15.100:0/870938658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193a3ed960 con 0x56193a3f1b40 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c5a28640 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3fb370 0x56193a410720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30c4a26640 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a4101e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f30b0005fd0 tx=0x7f30b00138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ecda06800a198f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30aaffd640 1 -- 172.21.15.100:0/870938658 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0005020 con 0x56193a3f1b40 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30aaffd640 1 -- 172.21.15.100:0/870938658 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30b00047a0 con 0x56193a3f1b40 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.539+0000 7f30aaffd640 1 -- 172.21.15.100:0/870938658 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b001c6c0 con 0x56193a3f1b40 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 -- 172.21.15.100:0/870938658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 msgr2=0x56193a4101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a4101e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f30b0005fd0 tx=0x7f30b00138f0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 -- 172.21.15.100:0/870938658 shutdown_connections 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3fb370 0x56193a410720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a4101e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 --2- 172.21.15.100:0/870938658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3f05d0 0x56193a4073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 -- 172.21.15.100:0/870938658 >> 172.21.15.100:0/870938658 conn(0x56193a3b9310 msgr2=0x56193a3f7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 -- 172.21.15.100:0/870938658 shutdown_connections 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 -- 172.21.15.100:0/870938658 wait complete. 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 -- start start 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.540+0000 7f30c9864740 1 Processor -- start 2024-09-12T02:43:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c9864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f05d0 0x56193a40dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c9864740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a40e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c9864740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a40ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c9864740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b22e0 con 0x56193a3f1b40 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c9864740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b3750 con 0x56193a3fb370 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c9864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b29b0 con 0x56193a3f05d0 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c9864740 10 client.0 _ll_register_callbacks cb 0x7f30b000b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a40e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a40e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48976/0 (socket says 172.21.15.100:48976) 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 -- 172.21.15.100:0/4200735770 learned_addr learned my addr 172.21.15.100:0/4200735770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c5227640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f05d0 0x56193a40dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c5a28640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a40ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 -- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f05d0 msgr2=0x56193a40dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f05d0 0x56193a40dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 -- 172.21.15.100:0/4200735770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 msgr2=0x56193a40ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a40ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 -- 172.21.15.100:0/4200735770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193a474710 con 0x56193a3f1b40 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c5a28640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a40ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30c4a26640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a40e4f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f30b000bdd0 tx=0x7f30b0013220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8613aa9ad3f868 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.541+0000 7f30a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30a8ff9640 1 -- 172.21.15.100:0/4200735770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0005000 con 0x56193a3f1b40 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30a8ff9640 1 -- 172.21.15.100:0/4200735770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f30b00051a0 con 0x56193a3f1b40 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30b00047a0 con 0x56193a3f1b40 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30a8ff9640 1 -- 172.21.15.100:0/4200735770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30b00053a0 con 0x56193a3f1b40 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 10 client.16140 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56193a475990 con 0x56193a3f1b40 2024-09-12T02:43:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30a8ff9640 1 -- 172.21.15.100:0/4200735770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30b00047a0 con 0x56193a3f1b40 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30a8ff9640 1 -- 172.21.15.100:0/4200735770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f30b0011440 con 0x56193a3f1b40 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 10 client.16140 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 10 client.16140 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 20 client.16140 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a476150 0x56193a478570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 4 client.16140 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56193a35dd70 con 0x56193a476150 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.542+0000 7f30c5227640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a476150 0x56193a478570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30a8ff9640 10 client.16140 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c5227640 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a476150 0x56193a478570 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=556961131d2426b3 server_cookie=5a477a11ac21e268 in_seq=0 out_seq=0 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30a8ff9640 1 -- 172.21.15.100:0/4200735770 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56193a35dd70 con 0x56193a476150 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30a8ff9640 10 client.16140 handle_command_reply: tid=0 2024-09-12T02:43:03.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 client.16140 shutdown 2024-09-12T02:43:03.562 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:43:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 msgr2=0x56193a40e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a40e4f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f30b000bdd0 tx=0x7f30b0013220 comp rx=0 tx=0).stop 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 shutdown_connections 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x56193a476150 0x56193a478570 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30a8ff9640 0 client.16140 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56193a3fb370 0x56193a40ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56193a3f1b40 0x56193a40e4f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 --2- 172.21.15.100:0/4200735770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56193a3f05d0 0x56193a40dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.543+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 >> 172.21.15.100:0/4200735770 conn(0x56193a3b9310 msgr2=0x56193a3eb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.544+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 shutdown_connections 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.544+0000 7f30c9864740 1 -- 172.21.15.100:0/4200735770 wait complete. 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.544+0000 7f30c9864740 20 client.16140 trim_cache size 0 max 16384 2024-09-12T02:43:03.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f30ac0a2b80 msgr2=0x7f30ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f30ac0a2b80 0x7f30ac0a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30b8005fc0 tx=0x7f30b80095c0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0074590 msgr2=0x7f30c01a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0074590 0x7f30c01a46d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00d950 tx=0x7f30bc00de10 comp rx=0 tx=0).stop 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 shutdown_connections 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f30ac0a2b80 0x7f30ac0a5040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c0112b90 0x7f30c019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30c0074eb0 0x7f30c01a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 --2- 172.21.15.100:0/1287575541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30c0074590 0x7f30c01a46d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 >> 172.21.15.100:0/1287575541 conn(0x7f30c00fd8c0 msgr2=0x7f30c00ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 shutdown_connections 2024-09-12T02:43:03.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:03.545+0000 7f30c748b640 1 -- 172.21.15.100:0/1287575541 wait complete. 2024-09-12T02:43:04.327 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:43:04.570 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:04.978 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:04 smithi100 ceph-mon[31390]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.3 MiB/s wr, 278 op/s 2024-09-12T02:43:05.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:04 smithi189 ceph-mon[35196]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.3 MiB/s wr, 278 op/s 2024-09-12T02:43:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 -- 172.21.15.100:0/3535934993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 msgr2=0x7f8d80106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/3535934993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d80106800 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009900 tx=0x7f8d6c02a410 comp rx=0 tx=0).stop 2024-09-12T02:43:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 -- 172.21.15.100:0/3535934993 shutdown_connections 2024-09-12T02:43:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/3535934993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d80106f30 0x7f8d8010eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/3535934993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d80106800 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/3535934993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d80100310 0x7f8d801006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 -- 172.21.15.100:0/3535934993 >> 172.21.15.100:0/3535934993 conn(0x7f8d80077210 msgr2=0x7f8d800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 -- 172.21.15.100:0/3535934993 shutdown_connections 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.058+0000 7f8d86dfb640 1 -- 172.21.15.100:0/3535934993 wait complete. 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 Processor -- start 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 -- start start 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d80100310 0x7f8d80198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d801989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d80106f30 0x7f8d8019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80111fb0 con 0x7f8d80100cc0 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80111e30 con 0x7f8d80100310 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d86dfb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80112130 con 0x7f8d80106f30 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d801989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d801989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50858/0 (socket says 172.21.15.100:50858) 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 -- 172.21.15.100:0/290440538 learned_addr learned my addr 172.21.15.100:0/290440538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d84b97640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d80100310 0x7f8d80198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 -- 172.21.15.100:0/290440538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d80106f30 msgr2=0x7f8d8019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d80106f30 0x7f8d8019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 -- 172.21.15.100:0/290440538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d80100310 msgr2=0x7f8d80198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d80100310 0x7f8d80198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.059+0000 7f8d7ffff640 1 -- 172.21.15.100:0/290440538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8019d420 con 0x7f8d80100cc0 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.060+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d801989b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005ab0 tx=0x7f8d6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.060+0000 7f8d7dffb640 1 -- 172.21.15.100:0/290440538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c03f030 con 0x7f8d80100cc0 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.060+0000 7f8d7dffb640 1 -- 172.21.15.100:0/290440538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d6c003ce0 con 0x7f8d80100cc0 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.060+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8019d6b0 con 0x7f8d80100cc0 2024-09-12T02:43:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.060+0000 7f8d7dffb640 1 -- 172.21.15.100:0/290440538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c035070 con 0x7f8d80100cc0 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.060+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d801a4ff0 con 0x7f8d80100cc0 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.062+0000 7f8d7dffb640 1 -- 172.21.15.100:0/290440538 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8d6c042030 con 0x7f8d80100cc0 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.062+0000 7f8d891d4740 1 Processor -- start 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.062+0000 7f8d891d4740 1 -- start start 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c237090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c237a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c244760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d891d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55589c19d2f0 con 0x55589c238b40 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d891d4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55589c144cf0 con 0x55589c2375d0 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d891d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55589c1992b0 con 0x55589c242370 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c237090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c237090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50870/0 (socket says 172.21.15.100:50870) 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 -- 172.21.15.100:0/1560283391 learned_addr learned my addr 172.21.15.100:0/1560283391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c244760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d7dffb640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8d700a2c00 0x7f8d700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d84b97640 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c237a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 -- 172.21.15.100:0/1560283391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 msgr2=0x55589c244760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c244760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 -- 172.21.15.100:0/1560283391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 msgr2=0x55589c237a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c237a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 -- 172.21.15.100:0/1560283391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589c1293a0 con 0x55589c238b40 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d84b97640 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c237a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d7dffb640 1 -- 172.21.15.100:0/290440538 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8d6c0ef950 con 0x7f8d80100cc0 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8d700a2c00 0x7f8d700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.063+0000 7f8d85398640 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c237090 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8d78007e70 tx=0x7f8d7800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c0a9ac3685bf4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d6affd640 1 -- 172.21.15.100:0/1560283391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78016070 con 0x55589c238b40 2024-09-12T02:43:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d6affd640 1 -- 172.21.15.100:0/1560283391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d78004710 con 0x55589c238b40 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d6affd640 1 -- 172.21.15.100:0/1560283391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7801c6e0 con 0x55589c238b40 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 -- 172.21.15.100:0/1560283391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 msgr2=0x55589c237090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d85398640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8d700a2c00 0x7f8d700a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8d7801d000 tx=0x7f8d7801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c237090 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8d78007e70 tx=0x7f8d7800c6a0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 -- 172.21.15.100:0/1560283391 shutdown_connections 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c244760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c237a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 --2- 172.21.15.100:0/1560283391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c237090 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 -- 172.21.15.100:0/1560283391 >> 172.21.15.100:0/1560283391 conn(0x55589c200310 msgr2=0x55589c233c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 -- 172.21.15.100:0/1560283391 shutdown_connections 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.064+0000 7f8d891d4740 1 -- 172.21.15.100:0/1560283391 wait complete. 2024-09-12T02:43:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 -- start start 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 Processor -- start 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c241d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c23efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c23f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55589c245070 con 0x55589c238b40 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55589c158060 con 0x55589c2375d0 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55589c2451f0 con 0x55589c242370 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d891d4740 10 client.0 _ll_register_callbacks cb 0x55589beab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c23efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c23efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50876/0 (socket says 172.21.15.100:50876) 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.065+0000 7f8d7ffff640 1 -- 172.21.15.100:0/81677773 learned_addr learned my addr 172.21.15.100:0/81677773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d85398640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c23f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d84b97640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c241d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d7ffff640 1 -- 172.21.15.100:0/81677773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 msgr2=0x55589c23f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c23f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d7ffff640 1 -- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 msgr2=0x55589c241d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c241d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d7ffff640 1 -- 172.21.15.100:0/81677773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589bf0e3c0 con 0x55589c238b40 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d84b97640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c241d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c23efc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c04b000 tx=0x7f8d6c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7c3e10c3afc68f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d5ffff640 1 -- 172.21.15.100:0/81677773 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c049070 con 0x55589c238b40 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d5ffff640 1 -- 172.21.15.100:0/81677773 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8d6c03bd00 con 0x55589c238b40 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d78004710 con 0x55589c238b40 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d5ffff640 1 -- 172.21.15.100:0/81677773 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d6c0bbb00 con 0x55589c238b40 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d891d4740 10 client.16152 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55589c250ac0 con 0x55589c238b40 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d5ffff640 1 -- 172.21.15.100:0/81677773 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d78004710 con 0x55589c238b40 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d5ffff640 1 -- 172.21.15.100:0/81677773 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8d6c0b8810 con 0x55589c238b40 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.066+0000 7f8d891d4740 10 client.16152 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d891d4740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d891d4740 20 client.16152 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d891d4740 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c251f00 0x55589c254330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d891d4740 4 client.16152 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55589c1aa860 con 0x55589c251f00 2024-09-12T02:43:05.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d84b97640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c251f00 0x55589c254330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d84b97640 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c251f00 0x55589c254330 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e8a8f6a1b84c23 server_cookie=da9c5d32b4e77a79 in_seq=0 out_seq=0 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.067+0000 7f8d5ffff640 10 client.16152 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d5ffff640 1 -- 172.21.15.100:0/81677773 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55589c1aa860 con 0x55589c251f00 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d5ffff640 10 client.16152 handle_command_reply: tid=0 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 client.16152 shutdown 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 msgr2=0x55589c23efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c23efc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c04b000 tx=0x7f8d6c005c90 comp rx=0 tx=0).stop 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 shutdown_connections 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c251f00 0x55589c254330 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c242370 0x55589c23f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d5ffff640 0 client.16152 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c238b40 0x55589c23efc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 --2- 172.21.15.100:0/81677773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c2375d0 0x55589c241d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 >> 172.21.15.100:0/81677773 conn(0x55589c200310 msgr2=0x55589c239930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 shutdown_connections 2024-09-12T02:43:05.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 1 -- 172.21.15.100:0/81677773 wait complete. 2024-09-12T02:43:05.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.068+0000 7f8d891d4740 20 client.16152 trim_cache size 0 max 16384 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 Processor -- start 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 -- start start 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c23d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c23a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 0x55589c23a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801afcf0 con 0x55589c2375d0 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801ad5c0 con 0x55589c242370 2024-09-12T02:43:05.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d891d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801ab410 con 0x55589c238b40 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c23d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c23d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50884/0 (socket says 172.21.15.100:50884) 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 -- 172.21.15.100:0/966809716 learned_addr learned my addr 172.21.15.100:0/966809716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c23a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 -- 172.21.15.100:0/966809716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 msgr2=0x55589c23a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c23a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 -- 172.21.15.100:0/966809716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 msgr2=0x55589c23a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 0x55589c23a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d84b97640 1 -- 172.21.15.100:0/966809716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589c23df70 con 0x55589c2375d0 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.081+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c23a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d84b97640 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c23d890 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8d74006f10 tx=0x7f8d74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49716b9e44dc479a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d6a7fc640 1 -- 172.21.15.100:0/966809716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74020070 con 0x55589c2375d0 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d6a7fc640 1 -- 172.21.15.100:0/966809716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d7401c730 con 0x55589c2375d0 2024-09-12T02:43:05.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d6a7fc640 1 -- 172.21.15.100:0/966809716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740147d0 con 0x55589c2375d0 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 -- 172.21.15.100:0/966809716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 msgr2=0x55589c23d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c23d890 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8d74006f10 tx=0x7f8d74008040 comp rx=0 tx=0).stop 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 -- 172.21.15.100:0/966809716 shutdown_connections 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 0x55589c23a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c23a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 --2- 172.21.15.100:0/966809716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c23d890 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 -- 172.21.15.100:0/966809716 >> 172.21.15.100:0/966809716 conn(0x55589c200310 msgr2=0x55589c241040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 -- 172.21.15.100:0/966809716 shutdown_connections 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.082+0000 7f8d891d4740 1 -- 172.21.15.100:0/966809716 wait complete. 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 -- start start 2024-09-12T02:43:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 Processor -- start 2024-09-12T02:43:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c24a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c24aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 0x55589c247450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801aba80 con 0x55589c2375d0 2024-09-12T02:43:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801acef0 con 0x55589c242370 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801ac150 con 0x55589c238b40 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d891d4740 10 client.0 _ll_register_callbacks cb 0x7f8d6c0044e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d84b97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c24a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d84b97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c24a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50894/0 (socket says 172.21.15.100:50894) 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d84b97640 1 -- 172.21.15.100:0/3013811523 learned_addr learned my addr 172.21.15.100:0/3013811523 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.083+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c24aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d84b97640 1 -- 172.21.15.100:0/3013811523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 msgr2=0x55589c24aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d84b97640 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c24aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d84b97640 1 -- 172.21.15.100:0/3013811523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 msgr2=0x55589c247450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d84b97640 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 0x55589c247450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d84b97640 1 -- 172.21.15.100:0/3013811523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589c247c50 con 0x55589c2375d0 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d84b97640 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c24a660 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d740143f0 tx=0x7f8d7401c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c17135fcd97d358 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d5ffff640 1 -- 172.21.15.100:0/3013811523 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74020040 con 0x55589c2375d0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d5ffff640 1 -- 172.21.15.100:0/3013811523 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8d740059c0 con 0x55589c2375d0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d7401c730 con 0x55589c2375d0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d5ffff640 1 -- 172.21.15.100:0/3013811523 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d74005bc0 con 0x55589c2375d0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 10 client.16158 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55589c2bd610 con 0x55589c2375d0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d5ffff640 1 -- 172.21.15.100:0/3013811523 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d7401c730 con 0x55589c2375d0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d5ffff640 1 -- 172.21.15.100:0/3013811523 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8d740146f0 con 0x55589c2375d0 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 10 client.16158 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 20 client.16158 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c2bdbd0 0x55589c2bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 4 client.16158 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:43:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.084+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55589c1a4d70 con 0x55589c2bdbd0 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c2bdbd0 0x55589c2bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d7ffff640 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c2bdbd0 0x55589c2bffc0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e6b0d3bf2b9e4f9 server_cookie=25639d244835820e in_seq=0 out_seq=0 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d5ffff640 10 client.16158 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d5ffff640 1 -- 172.21.15.100:0/3013811523 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55589c1a4d70 con 0x55589c2bdbd0 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d5ffff640 10 client.16158 handle_command_reply: tid=0 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 client.16158 shutdown 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 msgr2=0x55589c24a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c24a660 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d740143f0 tx=0x7f8d7401c550 comp rx=0 tx=0).stop 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 shutdown_connections 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55589c2bdbd0 0x55589c2bffc0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55589c242370 0x55589c247450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55589c238b40 0x55589c24aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 --2- 172.21.15.100:0/3013811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55589c2375d0 0x55589c24a660 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 >> 172.21.15.100:0/3013811523 conn(0x55589c200310 msgr2=0x55589c241040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.085+0000 7f8d5ffff640 0 client.16158 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 shutdown_connections 2024-09-12T02:43:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d891d4740 1 -- 172.21.15.100:0/3013811523 wait complete. 2024-09-12T02:43:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d891d4740 20 client.16158 trim_cache size 0 max 16384 2024-09-12T02:43:05.092 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8d700a2c00 msgr2=0x7f8d700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8d700a2c00 0x7f8d700a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8d7801d000 tx=0x7f8d7801e000 comp rx=0 tx=0).stop 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 msgr2=0x7f8d801989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d801989b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005ab0 tx=0x7f8d6c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 shutdown_connections 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8d700a2c00 0x7f8d700a50c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d80106f30 0x7f8d8019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d80100cc0 0x7f8d801989b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 --2- 172.21.15.100:0/290440538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d80100310 0x7f8d80198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 >> 172.21.15.100:0/290440538 conn(0x7f8d80077210 msgr2=0x7f8d80105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 shutdown_connections 2024-09-12T02:43:05.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:05.086+0000 7f8d86dfb640 1 -- 172.21.15.100:0/290440538 wait complete. 2024-09-12T02:43:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:04 smithi117 ceph-mon[34898]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.3 MiB/s wr, 278 op/s 2024-09-12T02:43:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:43:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:06 smithi189 ceph-mon[35196]: pgmap v469: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 MiB/s wr, 276 op/s 2024-09-12T02:43:07.071 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:43:07.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:43:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:06 smithi117 ceph-mon[34898]: pgmap v469: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 MiB/s wr, 276 op/s 2024-09-12T02:43:07.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:06 smithi100 ceph-mon[31390]: pgmap v469: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 MiB/s wr, 276 op/s 2024-09-12T02:43:07.331 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 -- 172.21.15.100:0/3329898934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8010c180 msgr2=0x7f1e8010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 --2- 172.21.15.100:0/3329898934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8010c180 0x7f1e8010e610 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009900 tx=0x7f1e7802a480 comp rx=0 tx=0).stop 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 -- 172.21.15.100:0/3329898934 shutdown_connections 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 --2- 172.21.15.100:0/3329898934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8010c180 0x7f1e8010e610 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 --2- 172.21.15.100:0/3329898934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e80103700 0x7f1e8010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 --2- 172.21.15.100:0/3329898934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e80102de0 0x7f1e801031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 -- 172.21.15.100:0/3329898934 >> 172.21.15.100:0/3329898934 conn(0x7f1e800fc7a0 msgr2=0x7f1e800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 -- 172.21.15.100:0/3329898934 shutdown_connections 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.840+0000 7f1e85da7640 1 -- 172.21.15.100:0/3329898934 wait complete. 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 Processor -- start 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 -- start start 2024-09-12T02:43:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e80102de0 0x7f1e80198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e80103700 0x7f1e80198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e8010c180 0x7f1e8019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80111fd0 con 0x7f1e80103700 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80111e50 con 0x7f1e80102de0 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e85da7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80112150 con 0x7f1e8010c180 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e80103700 0x7f1e80198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e80103700 0x7f1e80198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50908/0 (socket says 172.21.15.100:50908) 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.841+0000 7f1e7effd640 1 -- 172.21.15.100:0/1315828576 learned_addr learned my addr 172.21.15.100:0/1315828576 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e8010c180 0x7f1e8019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e80102de0 0x7f1e80198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7effd640 1 -- 172.21.15.100:0/1315828576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e8010c180 msgr2=0x7f1e8019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7effd640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e8010c180 0x7f1e8019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7effd640 1 -- 172.21.15.100:0/1315828576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e80102de0 msgr2=0x7f1e80198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7effd640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e80102de0 0x7f1e80198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7effd640 1 -- 172.21.15.100:0/1315828576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8019d3e0 con 0x7f1e80103700 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7effd640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e80103700 0x7f1e80198970 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400d770 tx=0x7f1e7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7cff9640 1 -- 172.21.15.100:0/1315828576 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74017070 con 0x7f1e80103700 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8019d6d0 con 0x7f1e80103700 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7cff9640 1 -- 172.21.15.100:0/1315828576 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e74005500 con 0x7f1e80103700 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e7cff9640 1 -- 172.21.15.100:0/1315828576 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74004e00 con 0x7f1e80103700 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.842+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e801a4fb0 con 0x7f1e80103700 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.844+0000 7f1e7cff9640 1 -- 172.21.15.100:0/1315828576 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1e74004fa0 con 0x7f1e80103700 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 Processor -- start 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 -- start start 2024-09-12T02:43:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e59f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e64800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e67130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558307dbf280 con 0x558307e5a480 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558307d66b10 con 0x558307e59b60 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e88180740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558307dbb240 con 0x558307e64d40 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e64800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e64800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50922/0 (socket says 172.21.15.100:50922) 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/1503994577 learned_addr learned my addr 172.21.15.100:0/1503994577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7cff9640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1e680a2b80 0x7f1e680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e59f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7effd640 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e67130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1e680a2b80 0x7f1e680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7cff9640 1 -- 172.21.15.100:0/1315828576 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1e740cea30 con 0x7f1e80103700 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/1503994577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 msgr2=0x558307e67130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e67130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/1503994577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 msgr2=0x558307e59f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e59f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.845+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/1503994577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558307d731f0 con 0x558307e5a480 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.846+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e64800 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000a4b0 tx=0x7f1e700096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c62b82178c42604 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.846+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1e680a2b80 0x7f1e680a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e780096c0 tx=0x7f1e78009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.846+0000 7f1e65ffb640 1 -- 172.21.15.100:0/1503994577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70018020 con 0x558307e5a480 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.846+0000 7f1e65ffb640 1 -- 172.21.15.100:0/1503994577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e70014cf0 con 0x558307e5a480 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.846+0000 7f1e65ffb640 1 -- 172.21.15.100:0/1503994577 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70013de0 con 0x558307e5a480 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 -- 172.21.15.100:0/1503994577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 msgr2=0x558307e64800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e64800 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000a4b0 tx=0x7f1e700096d0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 -- 172.21.15.100:0/1503994577 shutdown_connections 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e67130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e64800 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 --2- 172.21.15.100:0/1503994577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e59f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 -- 172.21.15.100:0/1503994577 >> 172.21.15.100:0/1503994577 conn(0x558307e560f0 msgr2=0x558307e564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 -- 172.21.15.100:0/1503994577 shutdown_connections 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 -- 172.21.15.100:0/1503994577 wait complete. 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 -- start start 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.847+0000 7f1e88180740 1 Processor -- start 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e61b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e62610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558307e67910 con 0x558307e5a480 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558307d79f10 con 0x558307e59b60 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558307e67a90 con 0x558307e64d40 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 10 client.0 _ll_register_callbacks cb 0x558307d42a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e620d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50924/0 (socket says 172.21.15.100:50924) 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 -- 172.21.15.100:0/23051979 learned_addr learned my addr 172.21.15.100:0/23051979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e61b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 -- 172.21.15.100:0/23051979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 msgr2=0x558307e62610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e62610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e62610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 -- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 msgr2=0x558307e61b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e61b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 -- 172.21.15.100:0/23051979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558307b306a0 con 0x558307e5a480 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e61b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e7effd640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e620d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1e74097730 tx=0x7f1e74018cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4fe100cd3be53e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e5effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e5effd640 1 -- 172.21.15.100:0/23051979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74020050 con 0x558307e5a480 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e5effd640 1 -- 172.21.15.100:0/23051979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1e74009cc0 con 0x558307e5a480 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e70014cf0 con 0x558307e5a480 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.848+0000 7f1e5effd640 1 -- 172.21.15.100:0/23051979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1e740b9e60 con 0x558307e5a480 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 10 client.16170 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558307e734a0 con 0x558307e5a480 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e5effd640 1 -- 172.21.15.100:0/23051979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e70014cf0 con 0x558307e5a480 2024-09-12T02:43:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e5effd640 1 -- 172.21.15.100:0/23051979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1e74097940 con 0x558307e5a480 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 10 client.16170 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 20 client.16170 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307e748b0 0x558307e76d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 4 client.16170 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558307dcc7f0 con 0x558307e748b0 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.849+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307e748b0 0x558307e76d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.850+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307e748b0 0x558307e76d20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cec003500558a6a server_cookie=adebb0fce1b55fb9 in_seq=0 out_seq=0 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.850+0000 7f1e5effd640 10 client.16170 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.850+0000 7f1e5effd640 1 -- 172.21.15.100:0/23051979 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558307dcc7f0 con 0x558307e748b0 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.850+0000 7f1e5effd640 10 client.16170 handle_command_reply: tid=0 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.850+0000 7f1e88180740 1 client.16170 shutdown 2024-09-12T02:43:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 msgr2=0x558307e620d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e620d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1e74097730 tx=0x7f1e74018cf0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 shutdown_connections 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307e748b0 0x558307e76d20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e64d40 0x558307e62610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e5a480 0x558307e620d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e5effd640 0 client.16170 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 --2- 172.21.15.100:0/23051979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e59b60 0x558307e61b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 >> 172.21.15.100:0/23051979 conn(0x558307e560f0 msgr2=0x558307e5be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 shutdown_connections 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 1 -- 172.21.15.100:0/23051979 wait complete. 2024-09-12T02:43:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.851+0000 7f1e88180740 20 client.16170 trim_cache size 0 max 16384 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 Processor -- start 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 -- start start 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e59b60 0x558307e5bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e5a480 0x558307e7c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e64d40 0x558307e7cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801afe60 con 0x558307e64d40 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801ad730 con 0x558307e5a480 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e88180740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801ab580 con 0x558307e59b60 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e64d40 0x558307e7cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e64d40 0x558307e7cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50930/0 (socket says 172.21.15.100:50930) 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.868+0000 7f1e7ffff640 1 -- 172.21.15.100:0/2617954890 learned_addr learned my addr 172.21.15.100:0/2617954890 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e7ffff640 1 -- 172.21.15.100:0/2617954890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e59b60 msgr2=0x558307e5bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e59b60 0x558307e5bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e7ffff640 1 -- 172.21.15.100:0/2617954890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e5a480 msgr2=0x558307e7c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e7effd640 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e5a480 0x558307e7c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e5a480 0x558307e7c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e7ffff640 1 -- 172.21.15.100:0/2617954890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558307e55f20 con 0x558307e64d40 2024-09-12T02:43:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e64d40 0x558307e7cb30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1e78033000 tx=0x7f1e7803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205b418e8ced832e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e657fa640 1 -- 172.21.15.100:0/2617954890 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78035070 con 0x558307e64d40 2024-09-12T02:43:07.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e657fa640 1 -- 172.21.15.100:0/2617954890 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e780047a0 con 0x558307e64d40 2024-09-12T02:43:07.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.869+0000 7f1e657fa640 1 -- 172.21.15.100:0/2617954890 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78003810 con 0x558307e64d40 2024-09-12T02:43:07.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 -- 172.21.15.100:0/2617954890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e64d40 msgr2=0x558307e7cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e64d40 0x558307e7cb30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1e78033000 tx=0x7f1e7803a000 comp rx=0 tx=0).stop 2024-09-12T02:43:07.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 -- 172.21.15.100:0/2617954890 shutdown_connections 2024-09-12T02:43:07.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e64d40 0x558307e7cb30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e5a480 0x558307e7c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 --2- 172.21.15.100:0/2617954890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e59b60 0x558307e5bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 -- 172.21.15.100:0/2617954890 >> 172.21.15.100:0/2617954890 conn(0x558307e560f0 msgr2=0x558307e5b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 -- 172.21.15.100:0/2617954890 shutdown_connections 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 -- 172.21.15.100:0/2617954890 wait complete. 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 -- start start 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.870+0000 7f1e88180740 1 Processor -- start 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e59b60 0x558307e6cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e5a480 0x558307e6d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e64d40 0x558307e69cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801abbf0 con 0x558307e59b60 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801ad060 con 0x558307e64d40 2024-09-12T02:43:07.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801ac2c0 con 0x558307e5a480 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 10 client.0 _ll_register_callbacks cb 0x7f1e7400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e59b60 0x558307e6cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e59b60 0x558307e6cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50946/0 (socket says 172.21.15.100:50946) 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/3424075815 learned_addr learned my addr 172.21.15.100:0/3424075815 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e64d40 0x558307e69cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7effd640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e5a480 0x558307e6d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/3424075815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e5a480 msgr2=0x558307e6d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e5a480 0x558307e6d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e64d40 msgr2=0x558307e69cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e64d40 0x558307e69cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 -- 172.21.15.100:0/3424075815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558307e6a4b0 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7effd640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e5a480 0x558307e6d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7ffff640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e64d40 0x558307e69cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e7f7fe640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e59b60 0x558307e6cec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009fd0 tx=0x7f1e700135c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebe7519d8fc95e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e5effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e5effd640 1 -- 172.21.15.100:0/3424075815 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70018040 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e5effd640 1 -- 172.21.15.100:0/3424075815 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1e70013b90 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.871+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e780047a0 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e5effd640 1 -- 172.21.15.100:0/3424075815 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1e70013dd0 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 10 client.16176 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558307ee44c0 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e5effd640 1 -- 172.21.15.100:0/3424075815 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e7002e030 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e5effd640 1 -- 172.21.15.100:0/3424075815 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1e7001d620 con 0x558307e59b60 2024-09-12T02:43:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 10 client.16176 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 20 client.16176 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307ee4b00 0x558307ee6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 4 client.16176 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558307dc6d00 con 0x558307ee4b00 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.872+0000 7f1e7effd640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307ee4b00 0x558307ee6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.873+0000 7f1e7effd640 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307ee4b00 0x558307ee6f20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af677986a72ff7c server_cookie=f115d1c3daa8f33 in_seq=0 out_seq=0 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.873+0000 7f1e5effd640 10 client.16176 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e5effd640 1 -- 172.21.15.100:0/3424075815 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558307dc6d00 con 0x558307ee4b00 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e5effd640 10 client.16176 handle_command_reply: tid=0 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 client.16176 shutdown 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e59b60 msgr2=0x558307e6cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e59b60 0x558307e6cec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009fd0 tx=0x7f1e700135c0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 shutdown_connections 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558307ee4b00 0x558307ee6f20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558307e64d40 0x558307e69cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558307e5a480 0x558307e6d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e5effd640 0 client.16176 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 --2- 172.21.15.100:0/3424075815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558307e59b60 0x558307e6cec0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 >> 172.21.15.100:0/3424075815 conn(0x558307e560f0 msgr2=0x558307e62370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 shutdown_connections 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 1 -- 172.21.15.100:0/3424075815 wait complete. 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.874+0000 7f1e88180740 20 client.16176 trim_cache size 0 max 16384 2024-09-12T02:43:07.881 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:43:07.882 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:43:07.882 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "9ae67eb7-4d28-4491-97ee-0ee25c93ee35", 2024-09-12T02:43:07.882 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:43:07.882 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1e680a2b80 msgr2=0x7f1e680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1e680a2b80 0x7f1e680a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e780096c0 tx=0x7f1e78009260 comp rx=0 tx=0).stop 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e80103700 msgr2=0x7f1e80198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e80103700 0x7f1e80198970 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400d770 tx=0x7f1e7400dc30 comp rx=0 tx=0).stop 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 shutdown_connections 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1e680a2b80 0x7f1e680a5040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e8010c180 0x7f1e8019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e80103700 0x7f1e80198970 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 --2- 172.21.15.100:0/1315828576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e80102de0 0x7f1e80198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 >> 172.21.15.100:0/1315828576 conn(0x7f1e800fc7a0 msgr2=0x7f1e800fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 shutdown_connections 2024-09-12T02:43:07.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:07.875+0000 7f1e85da7640 1 -- 172.21.15.100:0/1315828576 wait complete. 2024-09-12T02:43:08.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:43:08.754 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:08 smithi100 ceph-mon[31390]: pgmap v470: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-09-12T02:43:08.754 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:08 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:43:08.754 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:08 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:08.754 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:08 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:43:08.754 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:08 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:43:08.754 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:08 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:08.754 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:08 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:08.978 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:08 smithi189 ceph-mon[35196]: pgmap v470: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-09-12T02:43:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:08 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:43:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:08 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:08 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:43:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:08 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:43:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:08 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:08 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:08 smithi117 ceph-mon[34898]: pgmap v470: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-09-12T02:43:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:08 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:43:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:08 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:08 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:43:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:08 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:43:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:08 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:08 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 -- 172.21.15.100:0/930657720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0101430 msgr2=0x7f8be010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 --2- 172.21.15.100:0/930657720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0101430 0x7f8be010d960 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009cd0 tx=0x7f8bd802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 -- 172.21.15.100:0/930657720 shutdown_connections 2024-09-12T02:43:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 --2- 172.21.15.100:0/930657720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0101430 0x7f8be010d960 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 --2- 172.21.15.100:0/930657720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8be0100a90 0x7f8be0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 --2- 172.21.15.100:0/930657720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be0106a90 0x7f8be0106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 -- 172.21.15.100:0/930657720 >> 172.21.15.100:0/930657720 conn(0x7f8be00fc7d0 msgr2=0x7f8be00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 -- 172.21.15.100:0/930657720 shutdown_connections 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 -- 172.21.15.100:0/930657720 wait complete. 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 Processor -- start 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.447+0000 7f8be876a640 1 -- start start 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be876a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8be0100a90 0x7f8be01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be876a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be0101430 0x7f8be0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be876a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0106a90 0x7f8be019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be876a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0110e90 con 0x7f8be0106a90 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be876a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0110d10 con 0x7f8be0100a90 2024-09-12T02:43:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be876a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0111010 con 0x7f8be0101430 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0106a90 0x7f8be019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0106a90 0x7f8be019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50966/0 (socket says 172.21.15.100:50966) 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 -- 172.21.15.100:0/1756301899 learned_addr learned my addr 172.21.15.100:0/1756301899 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be5d05640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be0101430 0x7f8be0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6506640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8be0100a90 0x7f8be01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 -- 172.21.15.100:0/1756301899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be0101430 msgr2=0x7f8be0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be0101430 0x7f8be0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 -- 172.21.15.100:0/1756301899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8be0100a90 msgr2=0x7f8be01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8be0100a90 0x7f8be01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 -- 172.21.15.100:0/1756301899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be019d3a0 con 0x7f8be0106a90 2024-09-12T02:43:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.448+0000 7f8be6d07640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0106a90 0x7f8be019ccc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8005cc0 tx=0x7f8bd8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.449+0000 7f8bd77fe640 1 -- 172.21.15.100:0/1756301899 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8004040 con 0x7f8be0106a90 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.449+0000 7f8bd77fe640 1 -- 172.21.15.100:0/1756301899 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd80046c0 con 0x7f8be0106a90 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.449+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be019d630 con 0x7f8be0106a90 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.449+0000 7f8bd77fe640 1 -- 172.21.15.100:0/1756301899 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8046480 con 0x7f8be0106a90 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.449+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be01a4f70 con 0x7f8be0106a90 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8bd77fe640 1 -- 172.21.15.100:0/1756301899 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8bd80305a0 con 0x7f8be0106a90 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 Processor -- start 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 -- start start 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6380 0x559f688e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6ca0 0x559f688f5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688f5a90 0x559f688f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559f6884c2e0 con 0x559f688e6ca0 2024-09-12T02:43:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559f687f3ce0 con 0x559f688f5a90 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8beab43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559f688482a0 con 0x559f688e6380 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8be6506640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6ca0 0x559f688f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8be6506640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6ca0 0x559f688f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50970/0 (socket says 172.21.15.100:50970) 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.452+0000 7f8be6506640 1 -- 172.21.15.100:0/1486533435 learned_addr learned my addr 172.21.15.100:0/1486533435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be5d05640 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6380 0x559f688e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be5d05640 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688f5a90 0x559f688f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be6506640 1 -- 172.21.15.100:0/1486533435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6380 msgr2=0x559f688e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be6506640 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6380 0x559f688e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be6506640 1 -- 172.21.15.100:0/1486533435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688f5a90 msgr2=0x559f688f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be6506640 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688f5a90 0x559f688f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be6506640 1 -- 172.21.15.100:0/1486533435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f687d8440 con 0x559f688e6ca0 2024-09-12T02:43:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be5d05640 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688f5a90 0x559f688f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8bd77fe640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8bcc0a2b80 0x7f8bcc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be5d05640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8bcc0a2b80 0x7f8bcc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8be6506640 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6ca0 0x559f688f5550 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00bc50 tx=0x7f8bdc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305deace0a4dfe75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8bd77fe640 1 -- 172.21.15.100:0/1756301899 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8bd802e030 con 0x7f8be0106a90 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8bd4ff9640 1 -- 172.21.15.100:0/1486533435 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc01c480 con 0x559f688e6ca0 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8bd4ff9640 1 -- 172.21.15.100:0/1486533435 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bdc01cb00 con 0x559f688e6ca0 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.453+0000 7f8bd4ff9640 1 -- 172.21.15.100:0/1486533435 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc011b90 con 0x559f688e6ca0 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8be5d05640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8bcc0a2b80 0x7f8bcc0a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x559f688e3db0 tx=0x7f8bd000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 -- 172.21.15.100:0/1486533435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6ca0 msgr2=0x559f688f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6ca0 0x559f688f5550 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00bc50 tx=0x7f8bdc0107a0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 -- 172.21.15.100:0/1486533435 shutdown_connections 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688f5a90 0x559f688f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6ca0 0x559f688f5550 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 --2- 172.21.15.100:0/1486533435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6380 0x559f688e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 -- 172.21.15.100:0/1486533435 >> 172.21.15.100:0/1486533435 conn(0x559f688e2a30 msgr2=0x559f688e2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 -- 172.21.15.100:0/1486533435 shutdown_connections 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 -- 172.21.15.100:0/1486533435 wait complete. 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 -- start start 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.454+0000 7f8beab43740 1 Processor -- start 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559f688f8660 con 0x559f688f5a90 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559f68807050 con 0x559f688e6380 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559f688f87e0 con 0x559f688e6ca0 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 10 client.0 _ll_register_callbacks cb 0x559f68847160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:09.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50982/0 (socket says 172.21.15.100:50982) 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 -- 172.21.15.100:0/2805508259 learned_addr learned my addr 172.21.15.100:0/2805508259 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be5d05640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6506640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 -- 172.21.15.100:0/2805508259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 msgr2=0x559f688f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 -- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 msgr2=0x559f688f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 -- 172.21.15.100:0/2805508259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f685bd3c0 con 0x559f688f5a90 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be5d05640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8be6d07640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688f2c80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80bcd60 tx=0x7f8bd80bc730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e3513d7c489d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8bc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/2805508259 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8031e60 con 0x559f688f5a90 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/2805508259 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8bd80f02f0 con 0x559f688f5a90 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.455+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bdc01cb00 con 0x559f688f5a90 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/2805508259 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bd80bcdd0 con 0x559f688f5a90 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 10 client.16188 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559f68904020 con 0x559f688f5a90 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/2805508259 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bdc01cb00 con 0x559f688f5a90 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/2805508259 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8bd80d2070 con 0x559f688f5a90 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 10 client.16188 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 20 client.16188 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f68905430 0x559f689078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 4 client.16188 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f68859850 con 0x559f68905430 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8be6506640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f68905430 0x559f689078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8be6506640 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f68905430 0x559f689078a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77e3f524ce588eeb server_cookie=bcdc3baa4a344db3 in_seq=0 out_seq=0 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.456+0000 7f8bc9ffb640 10 client.16188 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/2805508259 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f68859850 con 0x559f68905430 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8bc9ffb640 10 client.16188 handle_command_reply: tid=0 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 client.16188 shutdown 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 msgr2=0x559f688f2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688f2c80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80bcd60 tx=0x7f8bd80bc730 comp rx=0 tx=0).stop 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 shutdown_connections 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f68905430 0x559f689078a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688f2c80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8bc9ffb640 0 client.16188 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 --2- 172.21.15.100:0/2805508259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 >> 172.21.15.100:0/2805508259 conn(0x559f688e2a30 msgr2=0x559f688e8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 shutdown_connections 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.457+0000 7f8beab43740 1 -- 172.21.15.100:0/2805508259 wait complete. 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.458+0000 7f8beab43740 20 client.16188 trim_cache size 0 max 16384 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.474+0000 7f8beab43740 1 Processor -- start 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.474+0000 7f8beab43740 1 -- start start 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8beab43740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6380 0x559f68901900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8beab43740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6ca0 0x559f688f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8beab43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688f5a90 0x559f6890d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8beab43740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8be01adb20 con 0x559f688e6380 2024-09-12T02:43:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8beab43740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8be01ab3f0 con 0x559f688e6ca0 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8beab43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8be01a9240 con 0x559f688f5a90 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6380 0x559f68901900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6380 0x559f68901900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50988/0 (socket says 172.21.15.100:50988) 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 -- 172.21.15.100:0/3020368130 learned_addr learned my addr 172.21.15.100:0/3020368130 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be5d05640 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6ca0 0x559f688f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6d07640 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688f5a90 0x559f6890d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 -- 172.21.15.100:0/3020368130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688f5a90 msgr2=0x559f6890d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688f5a90 0x559f6890d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 -- 172.21.15.100:0/3020368130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6ca0 msgr2=0x559f688f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6ca0 0x559f688f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 -- 172.21.15.100:0/3020368130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f688f1690 con 0x559f688e6380 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6d07640 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688f5a90 0x559f6890d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be5d05640 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6ca0 0x559f688f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8be6506640 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6380 0x559f68901900 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc01e010 tx=0x7f8bdc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a84d095a12270cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8bcbfff640 1 -- 172.21.15.100:0/3020368130 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc005240 con 0x559f688e6380 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8bcbfff640 1 -- 172.21.15.100:0/3020368130 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bdc00b850 con 0x559f688e6380 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.475+0000 7f8bcbfff640 1 -- 172.21.15.100:0/3020368130 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc01c710 con 0x559f688e6380 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 -- 172.21.15.100:0/3020368130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6380 msgr2=0x559f68901900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6380 0x559f68901900 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc01e010 tx=0x7f8bdc005850 comp rx=0 tx=0).stop 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 -- 172.21.15.100:0/3020368130 shutdown_connections 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688f5a90 0x559f6890d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6ca0 0x559f688f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 --2- 172.21.15.100:0/3020368130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688e6380 0x559f68901900 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 -- 172.21.15.100:0/3020368130 >> 172.21.15.100:0/3020368130 conn(0x559f688e2a30 msgr2=0x559f688edd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 -- 172.21.15.100:0/3020368130 shutdown_connections 2024-09-12T02:43:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 -- 172.21.15.100:0/3020368130 wait complete. 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 -- start start 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.476+0000 7f8beab43740 1 Processor -- start 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8beab43740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8beab43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8beab43740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688fa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8beab43740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8be01a98b0 con 0x559f688f5a90 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8beab43740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8be01aad20 con 0x559f688e6380 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8beab43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8be01a9f80 con 0x559f688e6ca0 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8beab43740 10 client.0 _ll_register_callbacks cb 0x7f8bd8030890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6d07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6506640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6d07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688fa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51000/0 (socket says 172.21.15.100:51000) 2024-09-12T02:43:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be5d05640 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6d07640 1 -- 172.21.15.100:0/940137194 learned_addr learned my addr 172.21.15.100:0/940137194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6506640 1 -- 172.21.15.100:0/940137194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 msgr2=0x559f688f9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6506640 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6506640 1 -- 172.21.15.100:0/940137194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 msgr2=0x559f688fa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6506640 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688fa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6506640 1 -- 172.21.15.100:0/940137194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f688f57a0 con 0x559f688e6380 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6d07640 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8be6506640 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f98e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc000c00 tx=0x7f8bdc010fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e087839dbf895c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.477+0000 7f8bc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/940137194 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc011ae0 con 0x559f688e6380 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f68853d60 con 0x559f688e6380 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/940137194 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8bdc005040 con 0x559f688e6380 2024-09-12T02:43:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/940137194 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bdc005240 con 0x559f688e6380 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 10 client.25589 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559f68970310 con 0x559f688e6380 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/940137194 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559f68853d60 con 0x559f688e6380 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/940137194 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8bdc004710 con 0x559f688e6380 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 10 client.25589 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 10 client.25589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 20 client.25589 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f689707e0 0x559f68972bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 4 client.25589 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.478+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559f687d0210 con 0x559f689707e0 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8be5d05640 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f689707e0 0x559f68972bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8bc9ffb640 10 client.25589 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8be5d05640 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f689707e0 0x559f68972bd0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40f0effb107418c4 server_cookie=7739839064f4bbcf in_seq=0 out_seq=0 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8bc9ffb640 1 -- 172.21.15.100:0/940137194 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559f687d0210 con 0x559f689707e0 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8bc9ffb640 10 client.25589 handle_command_reply: tid=0 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 client.25589 shutdown 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 msgr2=0x559f688f98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f98e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc000c00 tx=0x7f8bdc010fd0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 shutdown_connections 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f689707e0 0x559f68972bd0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f688f5a90 0x559f688fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f688e6ca0 0x559f688f9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8beab43740 1 --2- 172.21.15.100:0/940137194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f688e6380 0x559f688f98e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.479+0000 7f8bc9ffb640 0 client.25589 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 >> 172.21.15.100:0/940137194 conn(0x559f688e2a30 msgr2=0x559f688edd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 shutdown_connections 2024-09-12T02:43:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8beab43740 1 -- 172.21.15.100:0/940137194 wait complete. 2024-09-12T02:43:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8beab43740 20 client.25589 trim_cache size 0 max 16384 2024-09-12T02:43:09.497 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:43:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "9ae67eb7-4d28-4491-97ee-0ee25c93ee35": { 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "9ae67eb7-4d28-4491-97ee-0ee25c93ee35", 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:09.498 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:43:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8bcc0a2b80 msgr2=0x7f8bcc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8bcc0a2b80 0x7f8bcc0a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x559f688e3db0 tx=0x7f8bd000b390 comp rx=0 tx=0).stop 2024-09-12T02:43:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0106a90 msgr2=0x7f8be019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0106a90 0x7f8be019ccc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8005cc0 tx=0x7f8bd8003970 comp rx=0 tx=0).stop 2024-09-12T02:43:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 shutdown_connections 2024-09-12T02:43:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8bcc0a2b80 0x7f8bcc0a5040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8be0106a90 0x7f8be019ccc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be0101430 0x7f8be0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 --2- 172.21.15.100:0/1756301899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8be0100a90 0x7f8be01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 >> 172.21.15.100:0/1756301899 conn(0x7f8be00fc7d0 msgr2=0x7f8be006a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 shutdown_connections 2024-09-12T02:43:09.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:09.480+0000 7f8be876a640 1 -- 172.21.15.100:0/1756301899 wait complete. 2024-09-12T02:43:10.290 INFO:tasks.cephfs.filesystem:scrub status for tag:9ae67eb7-4d28-4491-97ee-0ee25c93ee35 - {'path': '/', 'tag': '9ae67eb7-4d28-4491-97ee-0ee25c93ee35', 'options': 'recursive,force'} 2024-09-12T02:43:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:10 smithi189 ceph-mon[35196]: pgmap v471: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.9 MiB/s wr, 129 op/s 2024-09-12T02:43:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:10 smithi117 ceph-mon[34898]: pgmap v471: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.9 MiB/s wr, 129 op/s 2024-09-12T02:43:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:10 smithi100 ceph-mon[31390]: pgmap v471: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.9 MiB/s wr, 129 op/s 2024-09-12T02:43:11.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:43:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:12 smithi189 ceph-mon[35196]: pgmap v472: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 752 KiB/s wr, 53 op/s 2024-09-12T02:43:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:12 smithi117 ceph-mon[34898]: pgmap v472: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 752 KiB/s wr, 53 op/s 2024-09-12T02:43:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:12 smithi100 ceph-mon[31390]: pgmap v472: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 752 KiB/s wr, 53 op/s 2024-09-12T02:43:13.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:43:13.709 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:14.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 -- 172.21.15.100:0/1720976205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1036e0 msgr2=0x7f9ccc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/1720976205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1036e0 0x7f9ccc107b90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009930 tx=0x7f9cc002a420 comp rx=0 tx=0).stop 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 -- 172.21.15.100:0/1720976205 shutdown_connections 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/1720976205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc1082a0 0x7f9ccc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/1720976205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1036e0 0x7f9ccc107b90 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/1720976205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc102d30 0x7f9ccc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 -- 172.21.15.100:0/1720976205 >> 172.21.15.100:0/1720976205 conn(0x7f9ccc0fc7d0 msgr2=0x7f9ccc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.220+0000 7f9cd16cf640 1 -- 172.21.15.100:0/1720976205 shutdown_connections 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.221+0000 7f9cd16cf640 1 -- 172.21.15.100:0/1720976205 wait complete. 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.221+0000 7f9cd16cf640 1 Processor -- start 2024-09-12T02:43:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.221+0000 7f9cd16cf640 1 -- start start 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.221+0000 7f9cd16cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc102d30 0x7f9ccc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.221+0000 7f9cd16cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc1036e0 0x7f9ccc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.221+0000 7f9cd16cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1082a0 0x7f9ccc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.221+0000 7f9cd16cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc1120a0 con 0x7f9ccc1082a0 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cd16cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc111f20 con 0x7f9ccc102d30 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cd16cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc112220 con 0x7f9ccc1036e0 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1082a0 0x7f9ccc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1082a0 0x7f9ccc101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51016/0 (socket says 172.21.15.100:51016) 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 -- 172.21.15.100:0/3392537327 learned_addr learned my addr 172.21.15.100:0/3392537327 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccaffd640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc102d30 0x7f9ccc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cca7fc640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc1036e0 0x7f9ccc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 -- 172.21.15.100:0/3392537327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc1036e0 msgr2=0x7f9ccc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc1036e0 0x7f9ccc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 -- 172.21.15.100:0/3392537327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc102d30 msgr2=0x7f9ccc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc102d30 0x7f9ccc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 -- 172.21.15.100:0/3392537327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc1a6a80 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9ccb7fe640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1082a0 0x7f9ccc101410 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400eaa0 tx=0x7f9cc400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cb3fff640 1 -- 172.21.15.100:0/3392537327 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400cdb0 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cb3fff640 1 -- 172.21.15.100:0/3392537327 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cc4005020 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc1a6d70 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cb3fff640 1 -- 172.21.15.100:0/3392537327 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40116b0 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.222+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc1a7230 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.223+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc103110 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.224+0000 7f9cb3fff640 1 -- 172.21.15.100:0/3392537327 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9cc4005560 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.225+0000 7f9cb3fff640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9cb40a2b80 0x7f9cb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.225+0000 7f9cb3fff640 1 -- 172.21.15.100:0/3392537327 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9cc40cf260 con 0x7f9ccc1082a0 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.225+0000 7f9ccaffd640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9cb40a2b80 0x7f9cb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.226+0000 7f9ccaffd640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9cb40a2b80 0x7f9cb40a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00bbe0 tx=0x7f9cbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:14.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.229+0000 7f9cb3fff640 1 -- 172.21.15.100:0/3392537327 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cc4016030 con 0x7f9ccc1082a0 2024-09-12T02:43:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.435+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ccc10a2b0 con 0x7f9ccc1082a0 2024-09-12T02:43:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.436+0000 7f9cb3fff640 1 -- 172.21.15.100:0/3392537327 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f9cc409c1b0 con 0x7f9ccc1082a0 2024-09-12T02:43:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:43:14.438 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:43:14.438 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:43:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9cb40a2b80 msgr2=0x7f9cb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9cb40a2b80 0x7f9cb40a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00bbe0 tx=0x7f9cbc00b390 comp rx=0 tx=0).stop 2024-09-12T02:43:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1082a0 msgr2=0x7f9ccc101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1082a0 0x7f9ccc101410 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400eaa0 tx=0x7f9cc400ef60 comp rx=0 tx=0).stop 2024-09-12T02:43:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 shutdown_connections 2024-09-12T02:43:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9cb40a2b80 0x7f9cb40a5040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1082a0 0x7f9ccc101410 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc1036e0 0x7f9ccc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 --2- 172.21.15.100:0/3392537327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ccc102d30 0x7f9ccc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.438+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 >> 172.21.15.100:0/3392537327 conn(0x7f9ccc0fc7d0 msgr2=0x7f9ccc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.439+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 shutdown_connections 2024-09-12T02:43:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:14.439+0000 7f9cd16cf640 1 -- 172.21.15.100:0/3392537327 wait complete. 2024-09-12T02:43:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:14 smithi189 ceph-mon[35196]: pgmap v473: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 815 KiB/s wr, 32 op/s 2024-09-12T02:43:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:14 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3392537327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:14 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:43:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:14 smithi117 ceph-mon[34898]: pgmap v473: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 815 KiB/s wr, 32 op/s 2024-09-12T02:43:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:14 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3392537327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:15.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:14 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:43:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:14 smithi100 ceph-mon[31390]: pgmap v473: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 815 KiB/s wr, 32 op/s 2024-09-12T02:43:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:14 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3392537327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:14 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:43:15.206 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id ee7df9b4 --release --await' 2024-09-12T02:43:15.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id ee7df9b4 --release --await 2024-09-12T02:43:15.457 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:15.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:15 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:43:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 -- 172.21.15.100:0/274342048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 msgr2=0x7fcdc01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 --2- 172.21.15.100:0/274342048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01067e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009900 tx=0x7fcdb002a410 comp rx=0 tx=0).stop 2024-09-12T02:43:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 -- 172.21.15.100:0/274342048 shutdown_connections 2024-09-12T02:43:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 --2- 172.21.15.100:0/274342048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc0106f10 0x7fcdc010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 --2- 172.21.15.100:0/274342048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01067e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 --2- 172.21.15.100:0/274342048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc0101de0 0x7fcdc01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 -- 172.21.15.100:0/274342048 >> 172.21.15.100:0/274342048 conn(0x7fcdc00fd8c0 msgr2=0x7fcdc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 -- 172.21.15.100:0/274342048 shutdown_connections 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.971+0000 7fcdc7859640 1 -- 172.21.15.100:0/274342048 wait complete. 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 Processor -- start 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 -- start start 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc0101de0 0x7fcdc0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc0106f10 0x7fcdc019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc0111f30 con 0x7fcdc0102790 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc0111db0 con 0x7fcdc0101de0 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.972+0000 7fcdc7859640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01120b0 con 0x7fcdc0106f10 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59832/0 (socket says 172.21.15.100:59832) 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 -- 172.21.15.100:0/31422087 learned_addr learned my addr 172.21.15.100:0/31422087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc0101de0 0x7fcdc0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc0106f10 0x7fcdc019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 -- 172.21.15.100:0/31422087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc0106f10 msgr2=0x7fcdc019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc0106f10 0x7fcdc019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 -- 172.21.15.100:0/31422087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc0101de0 msgr2=0x7fcdc0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc0101de0 0x7fcdc0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 -- 172.21.15.100:0/31422087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc019d440 con 0x7fcdc0102790 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc0101de0 0x7fcdc0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01989d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0006010 tx=0x7fcdb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdb67fc640 1 -- 172.21.15.100:0/31422087 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb003f030 con 0x7fcdc0102790 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdb67fc640 1 -- 172.21.15.100:0/31422087 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb0003ce0 con 0x7fcdc0102790 2024-09-12T02:43:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc019d6d0 con 0x7fcdc0102790 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdb67fc640 1 -- 172.21.15.100:0/31422087 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0035070 con 0x7fcdc0102790 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.973+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc01a5010 con 0x7fcdc0102790 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.975+0000 7fcdb67fc640 1 -- 172.21.15.100:0/31422087 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fcdb0042030 con 0x7fcdc0102790 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 Processor -- start 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 -- start start 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdb67fc640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdac0a2b80 0x7fcdac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd92e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd938d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd93b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5599dd893620 con 0x5599dd92e980 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599dd83ae50 con 0x5599dd939240 2024-09-12T02:43:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5599dd88f5e0 con 0x5599dd92e060 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.976+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdac0a2b80 0x7fcdac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdb67fc640 1 -- 172.21.15.100:0/31422087 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcdb00ef7c0 con 0x7fcdc0102790 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd92e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc5df6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd93b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd92e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:49036/0 (socket says 172.21.15.100:49036) 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2653393471 learned_addr learned my addr 172.21.15.100:0/2653393471 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd938d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2653393471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 msgr2=0x5599dd93b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd93b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2653393471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 msgr2=0x5599dd938d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd938d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2653393471 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd82bd40 con 0x5599dd92e060 2024-09-12T02:43:15.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdac0a2b80 0x7fcdac0a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80092f0 tx=0x7fcdb80099b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:15.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd92e440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00cca0 tx=0x7fcdbc00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8e80cf231f3ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:15.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdab7fe640 1 -- 172.21.15.100:0/2653393471 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc005220 con 0x5599dd92e060 2024-09-12T02:43:15.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdab7fe640 1 -- 172.21.15.100:0/2653393471 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdbc004c80 con 0x5599dd92e060 2024-09-12T02:43:15.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.977+0000 7fcdab7fe640 1 -- 172.21.15.100:0/2653393471 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0107c0 con 0x5599dd92e060 2024-09-12T02:43:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2653393471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 msgr2=0x5599dd92e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd92e440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00cca0 tx=0x7fcdbc00e720 comp rx=0 tx=0).stop 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2653393471 shutdown_connections 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd93b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd938d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2653393471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd92e440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2653393471 >> 172.21.15.100:0/2653393471 conn(0x5599dd92a5f0 msgr2=0x5599dd92a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.978+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2653393471 shutdown_connections 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2653393471 wait complete. 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 -- start start 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 Processor -- start 2024-09-12T02:43:15.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e060 0x5599dd936090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd9365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd939240 0x5599dd936b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5599dd93be10 con 0x5599dd92e060 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599dd81bf10 con 0x5599dd92e980 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5599dd93bf90 con 0x5599dd939240 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc9c32740 10 client.0 _ll_register_callbacks cb 0x5599dd83fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc55f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e060 0x5599dd936090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc55f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e060 0x5599dd936090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59860/0 (socket says 172.21.15.100:59860) 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.979+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2118874965 learned_addr learned my addr 172.21.15.100:0/2118874965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd939240 0x5599dd936b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd9365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2118874965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd939240 msgr2=0x5599dd936b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd939240 0x5599dd936b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 msgr2=0x5599dd9365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd9365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc55f5640 1 -- 172.21.15.100:0/2118874965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dd5a2580 con 0x5599dd92e060 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e060 0x5599dd936090 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c9e0 tx=0x7fcdbc010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a74e6e0f7f03cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcda8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcda8ff9640 1 -- 172.21.15.100:0/2118874965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc029060 con 0x5599dd92e060 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcda8ff9640 1 -- 172.21.15.100:0/2118874965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcdbc0048d0 con 0x5599dd92e060 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdbc004c80 con 0x5599dd92e060 2024-09-12T02:43:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcda8ff9640 1 -- 172.21.15.100:0/2118874965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcdbc004ad0 con 0x5599dd92e060 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc9c32740 10 client.16212 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599dd66c960 con 0x5599dd92e060 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.980+0000 7fcda8ff9640 1 -- 172.21.15.100:0/2118874965 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdbc004c80 con 0x5599dd92e060 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcda8ff9640 1 -- 172.21.15.100:0/2118874965 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcdbc024530 con 0x5599dd92e060 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc9c32740 10 client.16212 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc9c32740 10 client.16212 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc9c32740 20 client.16212 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd948c00 0x5599dd94aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc9c32740 4 client.16212 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599dd8a0b90 con 0x5599dd948c00 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd948c00 0x5599dd94aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcda8ff9640 10 client.16212 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.981+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd948c00 0x5599dd94aff0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ac93e63391a56fc server_cookie=3c528381a9264ac1 in_seq=0 out_seq=0 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcda8ff9640 1 -- 172.21.15.100:0/2118874965 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599dd8a0b90 con 0x5599dd948c00 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcda8ff9640 10 client.16212 handle_command_reply: tid=0 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 client.16212 shutdown 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e060 msgr2=0x5599dd936090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e060 0x5599dd936090 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c9e0 tx=0x7fcdbc010490 comp rx=0 tx=0).stop 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 shutdown_connections 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd948c00 0x5599dd94aff0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd939240 0x5599dd936b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd9365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/2118874965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e060 0x5599dd936090 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcda8ff9640 0 client.16212 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 >> 172.21.15.100:0/2118874965 conn(0x5599dd92a5f0 msgr2=0x5599dd930320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 shutdown_connections 2024-09-12T02:43:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.982+0000 7fcdc9c32740 1 -- 172.21.15.100:0/2118874965 wait complete. 2024-09-12T02:43:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.983+0000 7fcdc9c32740 20 client.16212 trim_cache size 0 max 16384 2024-09-12T02:43:16.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.999+0000 7fcdc9c32740 1 Processor -- start 2024-09-12T02:43:16.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.999+0000 7fcdc9c32740 1 -- start start 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.999+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd950620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.999+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd950b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:15.999+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd939240 0x5599dd933310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01afe80 con 0x5599dd939240 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01ad750 con 0x5599dd92e980 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01ab5a0 con 0x5599dd92e060 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd939240 0x5599dd933310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd939240 0x5599dd933310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59866/0 (socket says 172.21.15.100:59866) 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 -- 172.21.15.100:0/758059133 learned_addr learned my addr 172.21.15.100:0/758059133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd950b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd950620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 -- 172.21.15.100:0/758059133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 msgr2=0x5599dd950620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd950620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 -- 172.21.15.100:0/758059133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 msgr2=0x5599dd950b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd950b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 -- 172.21.15.100:0/758059133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd92e7b0 con 0x5599dd939240 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd950b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd939240 0x5599dd933310 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8012d10 tx=0x7fcdb801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321cd00a3aca393d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdaaffd640 1 -- 172.21.15.100:0/758059133 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8010e20 con 0x5599dd939240 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdaaffd640 1 -- 172.21.15.100:0/758059133 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb8005020 con 0x5599dd939240 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.000+0000 7fcdaaffd640 1 -- 172.21.15.100:0/758059133 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8022690 con 0x5599dd939240 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 -- 172.21.15.100:0/758059133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd939240 msgr2=0x5599dd933310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd939240 0x5599dd933310 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8012d10 tx=0x7fcdb801e000 comp rx=0 tx=0).stop 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 -- 172.21.15.100:0/758059133 shutdown_connections 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd939240 0x5599dd933310 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd92e980 0x5599dd950b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/758059133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd950620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 -- 172.21.15.100:0/758059133 >> 172.21.15.100:0/758059133 conn(0x5599dd92a5f0 msgr2=0x5599dd9378f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 -- 172.21.15.100:0/758059133 shutdown_connections 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 -- 172.21.15.100:0/758059133 wait complete. 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.001+0000 7fcdc9c32740 1 -- start start 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 1 Processor -- start 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd9330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd9335e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd933b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01abc10 con 0x5599dd92e980 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01ad080 con 0x5599dd939240 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01ac2e0 con 0x5599dd92e060 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc9c32740 10 client.0 _ll_register_callbacks cb 0x7fcdb80145f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd9335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd9335e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59868/0 (socket says 172.21.15.100:59868) 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 -- 172.21.15.100:0/3458486687 learned_addr learned my addr 172.21.15.100:0/3458486687 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc5df6640 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd933b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd9330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 -- 172.21.15.100:0/3458486687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 msgr2=0x5599dd9330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd9330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 -- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 msgr2=0x5599dd933b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd933b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.002+0000 7fcdc4df4640 1 -- 172.21.15.100:0/3458486687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dd9b25f0 con 0x5599dd92e980 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc4df4640 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd9335e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcdb002a410 tx=0x7fcdb0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709d108a6cdf634b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcda8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcda8ff9640 1 -- 172.21.15.100:0/3458486687 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0049040 con 0x5599dd92e980 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcda8ff9640 1 -- 172.21.15.100:0/3458486687 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcdb00ba3d0 con 0x5599dd92e980 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdb8005020 con 0x5599dd92e980 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcda8ff9640 1 -- 172.21.15.100:0/3458486687 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcdb00b8370 con 0x5599dd92e980 2024-09-12T02:43:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 10 client.16218 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599dd9b38c0 con 0x5599dd92e980 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcda8ff9640 1 -- 172.21.15.100:0/3458486687 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb8005020 con 0x5599dd92e980 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcda8ff9640 1 -- 172.21.15.100:0/3458486687 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcdb00b8740 con 0x5599dd92e980 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 10 client.16218 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 10 client.16218 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 20 client.16218 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd9b4090 0x5599dd9b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 4 client.16218 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ee7df9b4", "release": true, "await": true}] 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.003+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ee7df9b4", "release": true, "await": true}) -- 0x5599dd925950 con 0x5599dd9b4090 2024-09-12T02:43:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.004+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd9b4090 0x5599dd9b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.004+0000 7fcdc55f5640 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd9b4090 0x5599dd9b64b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9104645c2aa276e3 server_cookie=a286f01587df1a9e in_seq=0 out_seq=0 2024-09-12T02:43:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.004+0000 7fcda8ff9640 10 client.16218 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:16.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:15 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:43:16.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.087+0000 7fcda8ff9640 1 -- 172.21.15.100:0/3458486687 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5599dd925950 con 0x5599dd9b4090 2024-09-12T02:43:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcda8ff9640 10 client.16218 handle_command_reply: tid=0 2024-09-12T02:43:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 client.16218 shutdown 2024-09-12T02:43:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 msgr2=0x5599dd9335e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd9335e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcdb002a410 tx=0x7fcdb0009880 comp rx=0 tx=0).stop 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 shutdown_connections 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5599dd9b4090 0x5599dd9b64b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd939240 0x5599dd933b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5599dd92e980 0x5599dd9335e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 --2- 172.21.15.100:0/3458486687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5599dd92e060 0x5599dd9330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcda8ff9640 0 client.16218 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 >> 172.21.15.100:0/3458486687 conn(0x5599dd92a5f0 msgr2=0x5599dd936030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 shutdown_connections 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.088+0000 7fcdc9c32740 1 -- 172.21.15.100:0/3458486687 wait complete. 2024-09-12T02:43:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.089+0000 7fcdc9c32740 20 client.16218 trim_cache size 0 max 16384 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 20, 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "ee7df9b4": { 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 20, 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:43:16.092 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 140.2, 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:43:16.093 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:43:16.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:16.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:16.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:16.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:16.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:16.094 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:43:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.089+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdac0a2b80 msgr2=0x7fcdac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.089+0000 7fcdc7859640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdac0a2b80 0x7fcdac0a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80092f0 tx=0x7fcdb80099b0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 msgr2=0x7fcdc01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01989d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0006010 tx=0x7fcdb00042f0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 shutdown_connections 2024-09-12T02:43:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdac0a2b80 0x7fcdac0a5040 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc0106f10 0x7fcdc019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc0102790 0x7fcdc01989d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 --2- 172.21.15.100:0/31422087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc0101de0 0x7fcdc0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 >> 172.21.15.100:0/31422087 conn(0x7fcdc00fd8c0 msgr2=0x7fcdc00fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 shutdown_connections 2024-09-12T02:43:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:16.090+0000 7fcdc7859640 1 -- 172.21.15.100:0/31422087 wait complete. 2024-09-12T02:43:16.097 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:15 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:43:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 245.0 s, 133.9 tps, lat 2914.514 ms stddev 6980.027 2024-09-12T02:43:16.961 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ee7df9b4', total seconds elapsed: 23.7 2024-09-12T02:43:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:16 smithi189 ceph-mon[35196]: pgmap v474: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 MiB/s wr, 46 op/s 2024-09-12T02:43:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:16 smithi117 ceph-mon[34898]: pgmap v474: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 MiB/s wr, 46 op/s 2024-09-12T02:43:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:16 smithi100 ceph-mon[31390]: pgmap v474: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 MiB/s wr, 46 op/s 2024-09-12T02:43:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:18 smithi189 ceph-mon[35196]: pgmap v475: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 56 op/s 2024-09-12T02:43:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:18 smithi117 ceph-mon[34898]: pgmap v475: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 56 op/s 2024-09-12T02:43:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:18 smithi100 ceph-mon[31390]: pgmap v475: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 56 op/s 2024-09-12T02:43:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:20 smithi189 ceph-mon[35196]: pgmap v476: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 120 op/s 2024-09-12T02:43:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:20 smithi117 ceph-mon[34898]: pgmap v476: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 120 op/s 2024-09-12T02:43:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:20 smithi100 ceph-mon[31390]: pgmap v476: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 120 op/s 2024-09-12T02:43:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 250.0 s, 3216.6 tps, lat 33.636 ms stddev 224.470 2024-09-12T02:43:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:22 smithi189 ceph-mon[35196]: pgmap v477: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.0 MiB/s wr, 253 op/s 2024-09-12T02:43:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:22 smithi117 ceph-mon[34898]: pgmap v477: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.0 MiB/s wr, 253 op/s 2024-09-12T02:43:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:22 smithi100 ceph-mon[31390]: pgmap v477: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.0 MiB/s wr, 253 op/s 2024-09-12T02:43:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:24 smithi100 ceph-mon[31390]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.3 MiB/s wr, 381 op/s 2024-09-12T02:43:25.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:24 smithi189 ceph-mon[35196]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.3 MiB/s wr, 381 op/s 2024-09-12T02:43:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:24 smithi117 ceph-mon[34898]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.3 MiB/s wr, 381 op/s 2024-09-12T02:43:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 255.0 s, 3084.0 tps, lat 32.316 ms stddev 33.249 2024-09-12T02:43:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:26 smithi189 ceph-mon[35196]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.7 MiB/s wr, 440 op/s 2024-09-12T02:43:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:26 smithi117 ceph-mon[34898]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.7 MiB/s wr, 440 op/s 2024-09-12T02:43:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:26 smithi100 ceph-mon[31390]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.7 MiB/s wr, 440 op/s 2024-09-12T02:43:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:28 smithi189 ceph-mon[35196]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.3 MiB/s wr, 563 op/s 2024-09-12T02:43:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:28 smithi117 ceph-mon[34898]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.3 MiB/s wr, 563 op/s 2024-09-12T02:43:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:28 smithi100 ceph-mon[31390]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.3 MiB/s wr, 563 op/s 2024-09-12T02:43:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:30 smithi189 ceph-mon[35196]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.6 MiB/s wr, 734 op/s 2024-09-12T02:43:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:30 smithi117 ceph-mon[34898]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.6 MiB/s wr, 734 op/s 2024-09-12T02:43:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:30 smithi100 ceph-mon[31390]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.6 MiB/s wr, 734 op/s 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 260.0 s, 3230.6 tps, lat 30.989 ms stddev 33.039 2024-09-12T02:43:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:32 smithi189 ceph-mon[35196]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.1 MiB/s wr, 760 op/s 2024-09-12T02:43:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:32 smithi117 ceph-mon[34898]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.1 MiB/s wr, 760 op/s 2024-09-12T02:43:33.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:32 smithi100 ceph-mon[31390]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.1 MiB/s wr, 760 op/s 2024-09-12T02:43:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:34 smithi189 ceph-mon[35196]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 761 op/s 2024-09-12T02:43:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:34 smithi117 ceph-mon[34898]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 761 op/s 2024-09-12T02:43:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:34 smithi100 ceph-mon[31390]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 761 op/s 2024-09-12T02:43:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 265.0 s, 3365.2 tps, lat 29.742 ms stddev 29.630 2024-09-12T02:43:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:36 smithi189 ceph-mon[35196]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.5 MiB/s wr, 710 op/s 2024-09-12T02:43:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:36 smithi117 ceph-mon[34898]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.5 MiB/s wr, 710 op/s 2024-09-12T02:43:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:36 smithi100 ceph-mon[31390]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.5 MiB/s wr, 710 op/s 2024-09-12T02:43:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:38 smithi189 ceph-mon[35196]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 745 op/s 2024-09-12T02:43:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:38 smithi117 ceph-mon[34898]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 745 op/s 2024-09-12T02:43:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:38 smithi100 ceph-mon[31390]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 745 op/s 2024-09-12T02:43:40.291 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:43:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:40 smithi189 ceph-mon[35196]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-12T02:43:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:40 smithi117 ceph-mon[34898]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-12T02:43:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:40 smithi100 ceph-mon[31390]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-12T02:43:41.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 270.0 s, 3478.0 tps, lat 28.713 ms stddev 32.869 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 -- 172.21.15.100:0/2330687406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102790 msgr2=0x7f89841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 --2- 172.21.15.100:0/2330687406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102790 0x7f89841067e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8978009860 tx=0x7f897802a340 comp rx=0 tx=0).stop 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 -- 172.21.15.100:0/2330687406 shutdown_connections 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 --2- 172.21.15.100:0/2330687406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984106f10 0x7f898410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 --2- 172.21.15.100:0/2330687406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102790 0x7f89841067e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 --2- 172.21.15.100:0/2330687406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984101de0 0x7f89841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 -- 172.21.15.100:0/2330687406 >> 172.21.15.100:0/2330687406 conn(0x7f89840fd8c0 msgr2=0x7f89840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 -- 172.21.15.100:0/2330687406 shutdown_connections 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.240+0000 7f898a497640 1 -- 172.21.15.100:0/2330687406 wait complete. 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.241+0000 7f898a497640 1 Processor -- start 2024-09-12T02:43:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.241+0000 7f898a497640 1 -- start start 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f898a497640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984101de0 0x7f8984198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f898a497640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984102790 0x7f89841989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f898a497640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984106f10 0x7f898419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f898a497640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8984111f70 con 0x7f8984102790 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f898a497640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8984111df0 con 0x7f8984106f10 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f898a497640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89841120f0 con 0x7f8984101de0 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f8983fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984101de0 0x7f8984198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f8983fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984101de0 0x7f8984198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35572/0 (socket says 172.21.15.100:35572) 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.242+0000 7f8983fff640 1 -- 172.21.15.100:0/171197942 learned_addr learned my addr 172.21.15.100:0/171197942 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.243+0000 7f8983fff640 1 -- 172.21.15.100:0/171197942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984106f10 msgr2=0x7f898419cd40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.243+0000 7f8983fff640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984106f10 0x7f898419cd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.243+0000 7f8983fff640 1 -- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984102790 msgr2=0x7f89841989b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:43:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.243+0000 7f8983fff640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984102790 0x7f89841989b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.243+0000 7f8983fff640 1 -- 172.21.15.100:0/171197942 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898419d420 con 0x7f8984101de0 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.244+0000 7f8983fff640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984101de0 0x7f8984198470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f897400e9f0 tx=0x7f897400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.245+0000 7f89817fa640 1 -- 172.21.15.100:0/171197942 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400cd80 con 0x7f8984101de0 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.245+0000 7f89817fa640 1 -- 172.21.15.100:0/171197942 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8974010910 con 0x7f8984101de0 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.246+0000 7f89817fa640 1 -- 172.21.15.100:0/171197942 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740188f0 con 0x7f8984101de0 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.247+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898419d710 con 0x7f8984101de0 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.247+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8984074420 con 0x7f8984101de0 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.250+0000 7f898c870740 1 Processor -- start 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.251+0000 7f898c870740 1 -- start start 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f898c870740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8c4c0 0x559b21d8c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f898c870740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d97160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f898c870740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d976a0 0x559b21d99a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f898c870740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559b21cf22e0 con 0x559b21d8c4c0 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f898c870740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b21c99ce0 con 0x559b21d976a0 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f898c870740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559b21cee2a0 con 0x559b21d8cde0 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f8988a34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8c4c0 0x559b21d8c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f8988a34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8c4c0 0x559b21d8c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56768/0 (socket says 172.21.15.100:56768) 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.252+0000 7f8988a34640 1 -- 172.21.15.100:0/1304087904 learned_addr learned my addr 172.21.15.100:0/1304087904 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f8983fff640 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d97160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f89817fa640 1 -- 172.21.15.100:0/171197942 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8974010430 con 0x7f8984101de0 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f8983fff640 1 -- 172.21.15.100:0/1304087904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d976a0 msgr2=0x559b21d99a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f8983fff640 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d976a0 0x559b21d99a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f8983fff640 1 -- 172.21.15.100:0/1304087904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8c4c0 msgr2=0x559b21d8c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f8983fff640 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8c4c0 0x559b21d8c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f8983fff640 1 -- 172.21.15.100:0/1304087904 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b21c7e440 con 0x559b21d8cde0 2024-09-12T02:43:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f8983fff640 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d97160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89740cce20 tx=0x7f89740d7580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566ddcab33b033a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f896a7fc640 1 -- 172.21.15.100:0/1304087904 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740e2070 con 0x559b21d8cde0 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f896a7fc640 1 -- 172.21.15.100:0/1304087904 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89740cf820 con 0x559b21d8cde0 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.253+0000 7f896a7fc640 1 -- 172.21.15.100:0/1304087904 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740dd940 con 0x559b21d8cde0 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.254+0000 7f89817fa640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f896c0a2c20 0x7f896c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.255+0000 7f89817fa640 1 -- 172.21.15.100:0/171197942 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f89740cf3f0 con 0x7f8984101de0 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.255+0000 7f898c870740 1 -- 172.21.15.100:0/1304087904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 msgr2=0x559b21d97160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.255+0000 7f898c870740 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d97160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89740cce20 tx=0x7f89740d7580 comp rx=0 tx=0).stop 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.255+0000 7f8988a34640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f896c0a2c20 0x7f896c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.256+0000 7f898c870740 1 -- 172.21.15.100:0/1304087904 shutdown_connections 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.256+0000 7f898c870740 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d976a0 0x559b21d99a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.256+0000 7f898c870740 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d97160 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.256+0000 7f898c870740 1 --2- 172.21.15.100:0/1304087904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8c4c0 0x559b21d8c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.256+0000 7f898c870740 1 -- 172.21.15.100:0/1304087904 >> 172.21.15.100:0/1304087904 conn(0x559b21d88a50 msgr2=0x559b21d88e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.257+0000 7f8988a34640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f896c0a2c20 0x7f896c0a50e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f897c00f400 tx=0x7f897c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.258+0000 7f898c870740 1 -- 172.21.15.100:0/1304087904 shutdown_connections 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.258+0000 7f898c870740 1 -- 172.21.15.100:0/1304087904 wait complete. 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.259+0000 7f898c870740 1 -- start start 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.259+0000 7f898c870740 1 Processor -- start 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f898c870740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f898c870740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 0x559b21d94270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f898c870740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21d947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f898c870740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559b21da2a80 con 0x559b21d8cde0 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f898c870740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b21cad050 con 0x559b21d8c4c0 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f898c870740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559b21da2c00 con 0x559b21d976a0 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f8983fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f898c870740 10 client.0 _ll_register_callbacks cb 0x559b21ced160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f8983fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d96fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59566/0 (socket says 172.21.15.100:59566) 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.260+0000 7f8983fff640 1 -- 172.21.15.100:0/1300837358 learned_addr learned my addr 172.21.15.100:0/1300837358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f8988a34640 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21d947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f8983fff640 1 -- 172.21.15.100:0/1300837358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 msgr2=0x559b21d947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f8983fff640 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21d947b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f8983fff640 1 -- 172.21.15.100:0/1300837358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 msgr2=0x559b21d94270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f8983fff640 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 0x559b21d94270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f8983fff640 1 -- 172.21.15.100:0/1300837358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b21a633c0 con 0x559b21d8c4c0 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f8983fff640 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d96fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89740985b0 tx=0x7f897400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3380703b1c8f5a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f89637fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.261+0000 7f89637fe640 1 -- 172.21.15.100:0/1300837358 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974097e80 con 0x559b21d8c4c0 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.262+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89740cf820 con 0x559b21d8c4c0 2024-09-12T02:43:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.262+0000 7f89637fe640 1 -- 172.21.15.100:0/1300837358 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8974016330 con 0x559b21d8c4c0 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.262+0000 7f89637fe640 1 -- 172.21.15.100:0/1300837358 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f89740b9050 con 0x559b21d8c4c0 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.262+0000 7f898c870740 10 client.25613 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.262+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b21da2a80 con 0x559b21d8c4c0 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f89637fe640 1 -- 172.21.15.100:0/1300837358 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8974016530 con 0x559b21d8c4c0 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f89637fe640 1 -- 172.21.15.100:0/1300837358 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f897409be40 con 0x559b21d8c4c0 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f898c870740 10 client.25613 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f898c870740 10 client.25613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f898c870740 20 client.25613 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f898c870740 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21daf5b0 0x559b21db19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f898c870740 4 client.25613 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f89740cf820 con 0x559b21daf5b0 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.263+0000 7f89837fe640 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21daf5b0 0x559b21db19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.264+0000 7f89837fe640 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21daf5b0 0x559b21db19a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94492b2b4e4020b9 server_cookie=4fa077a8a19f287b in_seq=0 out_seq=0 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.264+0000 7f89637fe640 10 client.25613 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.265+0000 7f89637fe640 1 -- 172.21.15.100:0/1300837358 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f89740cf820 con 0x559b21daf5b0 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.265+0000 7f89637fe640 10 client.25613 handle_command_reply: tid=0 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.265+0000 7f898c870740 1 client.25613 shutdown 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.265+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 msgr2=0x559b21d96fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.265+0000 7f898c870740 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d96fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89740985b0 tx=0x7f897400cf20 comp rx=0 tx=0).stop 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 shutdown_connections 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21daf5b0 0x559b21db19a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21d947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 0x559b21d94270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f89637fe640 0 client.25613 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 --2- 172.21.15.100:0/1300837358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d96fc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 >> 172.21.15.100:0/1300837358 conn(0x559b21d88a50 msgr2=0x559b21d87c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 shutdown_connections 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 1 -- 172.21.15.100:0/1300837358 wait complete. 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.266+0000 7f898c870740 20 client.25613 trim_cache size 0 max 16384 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.293+0000 7f898c870740 1 Processor -- start 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.293+0000 7f898c870740 1 -- start start 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f898c870740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d931b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f898c870740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d94690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f898c870740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d976a0 0x559b21db45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f898c870740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89841adc10 con 0x559b21d976a0 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f898c870740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f89841ab4e0 con 0x559b21d8c4c0 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f898c870740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89841a9330 con 0x559b21d8cde0 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d94690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f8983fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d94690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35594/0 (socket says 172.21.15.100:35594) 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 -- 172.21.15.100:0/3615858567 learned_addr learned my addr 172.21.15.100:0/3615858567 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f8988a34640 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d976a0 0x559b21db45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 -- 172.21.15.100:0/3615858567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 msgr2=0x559b21d931b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d931b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 -- 172.21.15.100:0/3615858567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d976a0 msgr2=0x559b21db45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d976a0 0x559b21db45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f89837fe640 1 -- 172.21.15.100:0/3615858567 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b21d88880 con 0x559b21d8cde0 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.294+0000 7f8983fff640 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d931b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.295+0000 7f89837fe640 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d94690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8978035040 tx=0x7f8978005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef81b5059b23ebe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.295+0000 7f8969ffb640 1 -- 172.21.15.100:0/3615858567 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978041040 con 0x559b21d8cde0 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.295+0000 7f8969ffb640 1 -- 172.21.15.100:0/3615858567 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8978030e50 con 0x559b21d8cde0 2024-09-12T02:43:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.295+0000 7f8969ffb640 1 -- 172.21.15.100:0/3615858567 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978037040 con 0x559b21d8cde0 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.296+0000 7f898c870740 1 -- 172.21.15.100:0/3615858567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 msgr2=0x559b21d94690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.296+0000 7f898c870740 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d94690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8978035040 tx=0x7f8978005710 comp rx=0 tx=0).stop 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.296+0000 7f898c870740 1 -- 172.21.15.100:0/3615858567 shutdown_connections 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.296+0000 7f898c870740 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d976a0 0x559b21db45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.297+0000 7f898c870740 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d8cde0 0x559b21d94690 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.297+0000 7f898c870740 1 --2- 172.21.15.100:0/3615858567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21d931b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.297+0000 7f898c870740 1 -- 172.21.15.100:0/3615858567 >> 172.21.15.100:0/3615858567 conn(0x559b21d88a50 msgr2=0x559b21d8f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.297+0000 7f898c870740 1 -- 172.21.15.100:0/3615858567 shutdown_connections 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.297+0000 7f898c870740 1 -- 172.21.15.100:0/3615858567 wait complete. 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.298+0000 7f898c870740 1 -- start start 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.298+0000 7f898c870740 1 Processor -- start 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f898c870740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21db4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f898c870740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 0x559b21db1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f8983fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21db4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f8983fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21db4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59592/0 (socket says 172.21.15.100:59592) 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f898c870740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21db24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f8983fff640 1 -- 172.21.15.100:0/2712035996 learned_addr learned my addr 172.21.15.100:0/2712035996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89841a99a0 con 0x559b21d8cde0 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f89841aae10 con 0x559b21d8c4c0 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89841aa070 con 0x559b21d976a0 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.299+0000 7f898c870740 10 client.0 _ll_register_callbacks cb 0x7f89740e0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f8988a34640 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21db24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f89837fe640 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 0x559b21db1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f8983fff640 1 -- 172.21.15.100:0/2712035996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 msgr2=0x559b21db24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f8983fff640 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21db24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f8983fff640 1 -- 172.21.15.100:0/2712035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 msgr2=0x559b21db1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f8983fff640 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 0x559b21db1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f8983fff640 1 -- 172.21.15.100:0/2712035996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b21db2bb0 con 0x559b21d8c4c0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f8983fff640 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21db4c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f897409bb70 tx=0x7f89740d7b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab968845a16d086 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f89637fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f89637fe640 1 -- 172.21.15.100:0/2712035996 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897409b540 con 0x559b21d8c4c0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.300+0000 7f89637fe640 1 -- 172.21.15.100:0/2712035996 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f89740a13b0 con 0x559b21d8c4c0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.301+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8978030e50 con 0x559b21d8c4c0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.301+0000 7f89637fe640 1 -- 172.21.15.100:0/2712035996 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f897409b720 con 0x559b21d8c4c0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.301+0000 7f898c870740 10 client.25619 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.301+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b21e19de0 con 0x559b21d8c4c0 2024-09-12T02:43:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.301+0000 7f89637fe640 1 -- 172.21.15.100:0/2712035996 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8978030e50 con 0x559b21d8c4c0 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f89637fe640 1 -- 172.21.15.100:0/2712035996 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8974016330 con 0x559b21d8c4c0 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f898c870740 10 client.25619 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f898c870740 10 client.25619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f898c870740 20 client.25619 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f898c870740 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21e1a310 0x559b21e1c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f898c870740 4 client.25619 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559b21cff850 con 0x559b21e1a310 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.302+0000 7f89837fe640 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21e1a310 0x559b21e1c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f89637fe640 10 client.25619 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f89837fe640 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21e1a310 0x559b21e1c700 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f834019edbe0a5b1 server_cookie=6781a3854228479 in_seq=0 out_seq=0 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f89637fe640 1 -- 172.21.15.100:0/2712035996 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559b21cff850 con 0x559b21e1a310 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f89637fe640 10 client.25619 handle_command_reply: tid=0 2024-09-12T02:43:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 client.25619 shutdown 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 msgr2=0x559b21db4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21db4c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f897409bb70 tx=0x7f89740d7b00 comp rx=0 tx=0).stop 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 shutdown_connections 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559b21e1a310 0x559b21e1c700 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b21d976a0 0x559b21db24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559b21d8cde0 0x559b21db1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 --2- 172.21.15.100:0/2712035996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b21d8c4c0 0x559b21db4c30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f89637fe640 0 client.25619 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 >> 172.21.15.100:0/2712035996 conn(0x559b21d88a50 msgr2=0x559b21d87470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 shutdown_connections 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.303+0000 7f898c870740 1 -- 172.21.15.100:0/2712035996 wait complete. 2024-09-12T02:43:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898c870740 20 client.25619 trim_cache size 0 max 16384 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f896c0a2c20 msgr2=0x7f896c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f896c0a2c20 0x7f896c0a50e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f897c00f400 tx=0x7f897c0095c0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984101de0 msgr2=0x7f8984198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:41.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984101de0 0x7f8984198470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f897400e9f0 tx=0x7f897400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 shutdown_connections 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f896c0a2c20 0x7f896c0a50e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984106f10 0x7f898419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984102790 0x7f89841989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 --2- 172.21.15.100:0/171197942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984101de0 0x7f8984198470 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 >> 172.21.15.100:0/171197942 conn(0x7f89840fd8c0 msgr2=0x7f89840febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 shutdown_connections 2024-09-12T02:43:41.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:41.304+0000 7f898a497640 1 -- 172.21.15.100:0/171197942 wait complete. 2024-09-12T02:43:42.207 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:43:42.207 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:43:42.621 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:42 smithi189 ceph-mon[35196]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 795 op/s 2024-09-12T02:43:43.055 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:42 smithi100 ceph-mon[31390]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 795 op/s 2024-09-12T02:43:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:42 smithi117 ceph-mon[34898]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 795 op/s 2024-09-12T02:43:43.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.445+0000 7f99ad1cd640 1 -- 172.21.15.100:0/1934249684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 msgr2=0x7f99a8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:43.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.445+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/1934249684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 0x7f99a8100ee0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9990009930 tx=0x7f999002a420 comp rx=0 tx=0).stop 2024-09-12T02:43:43.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.445+0000 7f99ad1cd640 1 -- 172.21.15.100:0/1934249684 shutdown_connections 2024-09-12T02:43:43.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.445+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/1934249684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99a8101420 0x7f99a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.445+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/1934249684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 0x7f99a8100ee0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.445+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/1934249684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8106a80 0x7f99a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.445+0000 7f99ad1cd640 1 -- 172.21.15.100:0/1934249684 >> 172.21.15.100:0/1934249684 conn(0x7f99a80fc7a0 msgr2=0x7f99a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:43.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.446+0000 7f99ad1cd640 1 -- 172.21.15.100:0/1934249684 shutdown_connections 2024-09-12T02:43:43.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.446+0000 7f99ad1cd640 1 -- 172.21.15.100:0/1934249684 wait complete. 2024-09-12T02:43:43.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.446+0000 7f99ad1cd640 1 Processor -- start 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99ad1cd640 1 -- start start 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99ad1cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 0x7f99a8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99ad1cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8101420 0x7f99a8199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99ad1cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99a8106a80 0x7f99a81a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99ad1cd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99a8110e80 con 0x7f99a8100a80 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99ad1cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99a8110d00 con 0x7f99a8106a80 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99ad1cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99a8111000 con 0x7f99a8101420 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99a6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 0x7f99a8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8101420 0x7f99a8199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:43.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8101420 0x7f99a8199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35616/0 (socket says 172.21.15.100:35616) 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 -- 172.21.15.100:0/372052749 learned_addr learned my addr 172.21.15.100:0/372052749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99a759e640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99a8106a80 0x7f99a81a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 -- 172.21.15.100:0/372052749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99a8106a80 msgr2=0x7f99a81a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99a8106a80 0x7f99a81a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 -- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 msgr2=0x7f99a8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 0x7f99a8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f999ffff640 1 -- 172.21.15.100:0/372052749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a81a48f0 con 0x7f99a8101420 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.447+0000 7f99a6d9d640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 0x7f99a8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.448+0000 7f999ffff640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8101420 0x7f99a8199870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9990009230 tx=0x7f9990004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.448+0000 7f99a4d99640 1 -- 172.21.15.100:0/372052749 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999003f030 con 0x7f99a8101420 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.448+0000 7f99a4d99640 1 -- 172.21.15.100:0/372052749 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9990003ad0 con 0x7f99a8101420 2024-09-12T02:43:43.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.448+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a81a4ac0 con 0x7f99a8101420 2024-09-12T02:43:43.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.448+0000 7f99a4d99640 1 -- 172.21.15.100:0/372052749 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990035070 con 0x7f99a8101420 2024-09-12T02:43:43.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.448+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a81a4f10 con 0x7f99a8101420 2024-09-12T02:43:43.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.450+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a8100ee0 con 0x7f99a8101420 2024-09-12T02:43:43.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.450+0000 7f99a4d99640 1 -- 172.21.15.100:0/372052749 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9990042030 con 0x7f99a8101420 2024-09-12T02:43:43.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.451+0000 7f99a4d99640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99940a2b80 0x7f99940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:43.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.451+0000 7f99a6d9d640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99940a2b80 0x7f99940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:43.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.451+0000 7f99a4d99640 1 -- 172.21.15.100:0/372052749 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f99900ef680 con 0x7f99a8101420 2024-09-12T02:43:43.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.451+0000 7f99a6d9d640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99940a2b80 0x7f99940a5040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9998009f40 tx=0x7f9998005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:43.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.455+0000 7f99a4d99640 1 -- 172.21.15.100:0/372052749 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99900bbf20 con 0x7f99a8101420 2024-09-12T02:43:43.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.840+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99a8108ff0 con 0x7f99a8101420 2024-09-12T02:43:43.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.841+0000 7f99a4d99640 1 -- 172.21.15.100:0/372052749 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f99900c0220 con 0x7f99a8101420 2024-09-12T02:43:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:43:43.842 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:43:43.842 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:43:43.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99940a2b80 msgr2=0x7f99940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:43.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99940a2b80 0x7f99940a5040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9998009f40 tx=0x7f9998005f90 comp rx=0 tx=0).stop 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8101420 msgr2=0x7f99a8199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8101420 0x7f99a8199870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9990009230 tx=0x7f9990004270 comp rx=0 tx=0).stop 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 shutdown_connections 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f99940a2b80 0x7f99940a5040 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99a8106a80 0x7f99a81a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a8101420 0x7f99a8199870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 --2- 172.21.15.100:0/372052749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a8100a80 0x7f99a8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 >> 172.21.15.100:0/372052749 conn(0x7f99a80fc7a0 msgr2=0x7f99a80fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 shutdown_connections 2024-09-12T02:43:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:43.844+0000 7f99ad1cd640 1 -- 172.21.15.100:0/372052749 wait complete. 2024-09-12T02:43:44.639 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:43:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:44 smithi100 ceph-mon[31390]: pgmap v488: 97 pgs: 97 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 811 op/s 2024-09-12T02:43:44.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:44 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/372052749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:44 smithi189 ceph-mon[35196]: pgmap v488: 97 pgs: 97 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 811 op/s 2024-09-12T02:43:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:44 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/372052749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:44 smithi117 ceph-mon[34898]: pgmap v488: 97 pgs: 97 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 811 op/s 2024-09-12T02:43:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:44 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/372052749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 -- 172.21.15.100:0/1141682317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff564102d30 msgr2=0x7ff564103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 --2- 172.21.15.100:0/1141682317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff564102d30 0x7ff564103110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff560009930 tx=0x7ff56002a460 comp rx=0 tx=0).stop 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 -- 172.21.15.100:0/1141682317 shutdown_connections 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 --2- 172.21.15.100:0/1141682317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5641082a0 0x7ff56410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 --2- 172.21.15.100:0/1141682317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5641036e0 0x7ff564107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 --2- 172.21.15.100:0/1141682317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff564102d30 0x7ff564103110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 -- 172.21.15.100:0/1141682317 >> 172.21.15.100:0/1141682317 conn(0x7ff5640fc7d0 msgr2=0x7ff5640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 -- 172.21.15.100:0/1141682317 shutdown_connections 2024-09-12T02:43:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.643+0000 7ff56b994640 1 -- 172.21.15.100:0/1141682317 wait complete. 2024-09-12T02:43:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.644+0000 7ff56b994640 1 Processor -- start 2024-09-12T02:43:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.644+0000 7ff56b994640 1 -- start start 2024-09-12T02:43:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff56b994640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff564102d30 0x7ff56419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff56b994640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5641036e0 0x7ff56419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff56b994640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5641082a0 0x7ff56410e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff56b994640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641120e0 con 0x7ff5641082a0 2024-09-12T02:43:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff56b994640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff564111f60 con 0x7ff5641036e0 2024-09-12T02:43:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff56b994640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff564112260 con 0x7ff564102d30 2024-09-12T02:43:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff569f31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5641082a0 0x7ff56410e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff569f31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5641082a0 0x7ff56410e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50336/0 (socket says 172.21.15.100:50336) 2024-09-12T02:43:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff569f31640 1 -- 172.21.15.100:0/2583702981 learned_addr learned my addr 172.21.15.100:0/2583702981 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.645+0000 7ff569730640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff564102d30 0x7ff56419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.646+0000 7ff568f2f640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5641036e0 0x7ff56419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.646+0000 7ff569730640 1 -- 172.21.15.100:0/2583702981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5641036e0 msgr2=0x7ff56419f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.646+0000 7ff569730640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5641036e0 0x7ff56419f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.646+0000 7ff569730640 1 -- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5641082a0 msgr2=0x7ff56410e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.646+0000 7ff569730640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5641082a0 0x7ff56410e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.646+0000 7ff569730640 1 -- 172.21.15.100:0/2583702981 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56410e8c0 con 0x7ff564102d30 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.646+0000 7ff569730640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff564102d30 0x7ff56419f330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff560005940 tx=0x7ff5600042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.647+0000 7ff55a7fc640 1 -- 172.21.15.100:0/2583702981 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56003f070 con 0x7ff564102d30 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.647+0000 7ff55a7fc640 1 -- 172.21.15.100:0/2583702981 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff56003b460 con 0x7ff564102d30 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.647+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56410eb50 con 0x7ff564102d30 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.647+0000 7ff55a7fc640 1 -- 172.21.15.100:0/2583702981 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560035070 con 0x7ff564102d30 2024-09-12T02:43:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.647+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56419aee0 con 0x7ff564102d30 2024-09-12T02:43:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.651+0000 7ff55a7fc640 1 -- 172.21.15.100:0/2583702981 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff56003b610 con 0x7ff564102d30 2024-09-12T02:43:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.651+0000 7ff56dd6d740 1 Processor -- start 2024-09-12T02:43:45.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff56dd6d740 1 -- start start 2024-09-12T02:43:45.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca35d0 0x55e58dca3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcb0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e58dc092f0 con 0x55e58dcae370 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e58dbb0cf0 con 0x55e58dca4b40 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e58dc052b0 con 0x55e58dca35d0 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff569f31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff569f31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48126/0 (socket says 172.21.15.100:48126) 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff569f31640 1 -- 172.21.15.100:0/348953635 learned_addr learned my addr 172.21.15.100:0/348953635 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff568f2f640 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcb0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.654+0000 7ff569730640 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca35d0 0x55e58dca3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.655+0000 7ff569f31640 1 -- 172.21.15.100:0/348953635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca35d0 msgr2=0x55e58dca3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.655+0000 7ff569f31640 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca35d0 0x55e58dca3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.655+0000 7ff569f31640 1 -- 172.21.15.100:0/348953635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 msgr2=0x55e58dcb0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.655+0000 7ff569f31640 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcb0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.655+0000 7ff569f31640 1 -- 172.21.15.100:0/348953635 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e58db953a0 con 0x55e58dca4b40 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.655+0000 7ff55a7fc640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff5500a2cd0 0x7ff5500a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.655+0000 7ff55a7fc640 1 -- 172.21.15.100:0/2583702981 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff5600ef3b0 con 0x7ff564102d30 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.656+0000 7ff569f31640 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca3090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff55c033470 tx=0x7ff55c033930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953418b949b876b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.656+0000 7ff569730640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff5500a2cd0 0x7ff5500a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.656+0000 7ff54f7fe640 1 -- 172.21.15.100:0/348953635 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c040070 con 0x55e58dca4b40 2024-09-12T02:43:45.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.656+0000 7ff54f7fe640 1 -- 172.21.15.100:0/348953635 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55c0319d0 con 0x55e58dca4b40 2024-09-12T02:43:45.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff54f7fe640 1 -- 172.21.15.100:0/348953635 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03bbc0 con 0x55e58dca4b40 2024-09-12T02:43:45.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff56dd6d740 1 -- 172.21.15.100:0/348953635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 msgr2=0x55e58dca3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff569730640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff5500a2cd0 0x7ff5500a5190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5600ed210 tx=0x7ff5600f2e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:45.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca3090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff55c033470 tx=0x7ff55c033930 comp rx=0 tx=0).stop 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff56dd6d740 1 -- 172.21.15.100:0/348953635 shutdown_connections 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcb0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca35d0 0x55e58dca3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/348953635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca3090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.657+0000 7ff56dd6d740 1 -- 172.21.15.100:0/348953635 >> 172.21.15.100:0/348953635 conn(0x55e58dc6c310 msgr2=0x55e58dc9fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.658+0000 7ff56dd6d740 1 -- 172.21.15.100:0/348953635 shutdown_connections 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.658+0000 7ff56dd6d740 1 -- 172.21.15.100:0/348953635 wait complete. 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.658+0000 7ff56dd6d740 1 -- start start 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.658+0000 7ff56dd6d740 1 Processor -- start 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca35d0 0x55e58dcadce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca4b40 0x55e58dcaaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e58dcb1110 con 0x55e58dcae370 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e58dbc4060 con 0x55e58dca35d0 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e58dcb1290 con 0x55e58dca4b40 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff56dd6d740 10 client.0 _ll_register_callbacks cb 0x55e58d9178c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca35d0 0x55e58dcadce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca35d0 0x55e58dcadce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48134/0 (socket says 172.21.15.100:48134) 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 -- 172.21.15.100:0/2109760598 learned_addr learned my addr 172.21.15.100:0/2109760598 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff568f2f640 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca4b40 0x55e58dcaaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 -- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca4b40 msgr2=0x55e58dcaaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca4b40 0x55e58dcaaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 -- 172.21.15.100:0/2109760598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 msgr2=0x55e58dcab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.659+0000 7ff569f31640 1 -- 172.21.15.100:0/2109760598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e58d97a3c0 con 0x55e58dca35d0 2024-09-12T02:43:45.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.660+0000 7ff569f31640 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca35d0 0x55e58dcadce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff55c03e040 tx=0x7ff55c03b6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbeea50f717572f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:45.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.660+0000 7ff54cff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:45.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.660+0000 7ff54cff9640 1 -- 172.21.15.100:0/2109760598 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c04f060 con 0x55e58dca35d0 2024-09-12T02:43:45.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.660+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff55c0319d0 con 0x55e58dca35d0 2024-09-12T02:43:45.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.660+0000 7ff54cff9640 1 -- 172.21.15.100:0/2109760598 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff55c004c50 con 0x55e58dca35d0 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.660+0000 7ff54cff9640 1 -- 172.21.15.100:0/2109760598 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff55c040070 con 0x55e58dca35d0 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.661+0000 7ff56dd6d740 10 client.25634 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.661+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e58dcbcb70 con 0x55e58dca35d0 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.661+0000 7ff54cff9640 1 -- 172.21.15.100:0/2109760598 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55c0319d0 con 0x55e58dca35d0 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.661+0000 7ff54cff9640 1 -- 172.21.15.100:0/2109760598 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff55c030040 con 0x55e58dca35d0 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.661+0000 7ff56dd6d740 10 client.25634 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.661+0000 7ff56dd6d740 10 client.25634 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.661+0000 7ff56dd6d740 20 client.25634 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.662+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dcbdf80 0x55e58dcc0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.662+0000 7ff56dd6d740 4 client.25634 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.662+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e58dc16860 con 0x55e58dcbdf80 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.662+0000 7ff568f2f640 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dcbdf80 0x55e58dcc0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.663+0000 7ff568f2f640 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dcbdf80 0x55e58dcc0370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1afb421cdf7650b6 server_cookie=f90c3dbcc125613b in_seq=0 out_seq=0 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.663+0000 7ff54cff9640 10 client.25634 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.663+0000 7ff54cff9640 1 -- 172.21.15.100:0/2109760598 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e58dc16860 con 0x55e58dcbdf80 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.663+0000 7ff54cff9640 10 client.25634 handle_command_reply: tid=0 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 client.25634 shutdown 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca35d0 msgr2=0x55e58dcadce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca35d0 0x55e58dcadce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff55c03e040 tx=0x7ff55c03b6c0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 shutdown_connections 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dcbdf80 0x55e58dcc0370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dcae370 0x55e58dcab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dca4b40 0x55e58dcaaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2109760598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca35d0 0x55e58dcadce0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 >> 172.21.15.100:0/2109760598 conn(0x55e58dc6c310 msgr2=0x55e58dca5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:45.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff54cff9640 0 client.25634 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:45.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 shutdown_connections 2024-09-12T02:43:45.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2109760598 wait complete. 2024-09-12T02:43:45.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.664+0000 7ff56dd6d740 20 client.25634 trim_cache size 0 max 16384 2024-09-12T02:43:45.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.686+0000 7ff56dd6d740 1 Processor -- start 2024-09-12T02:43:45.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff56dd6d740 1 -- start start 2024-09-12T02:43:45.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dcc5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641a9d30 con 0x55e58dca35d0 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641a7600 con 0x55e58dca4b40 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641a5450 con 0x55e58dcae370 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff569f31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff568f2f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff569f31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcba400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50358/0 (socket says 172.21.15.100:50358) 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff568f2f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48136/0 (socket says 172.21.15.100:48136) 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff569f31640 1 -- 172.21.15.100:0/2446756991 learned_addr learned my addr 172.21.15.100:0/2446756991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff569f31640 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dcc5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff568f2f640 1 -- 172.21.15.100:0/2446756991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 msgr2=0x55e58dcc5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff568f2f640 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dcc5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff568f2f640 1 -- 172.21.15.100:0/2446756991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 msgr2=0x55e58dcba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff568f2f640 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff568f2f640 1 -- 172.21.15.100:0/2446756991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e58dcae050 con 0x55e58dca4b40 2024-09-12T02:43:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.687+0000 7ff569f31640 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.688+0000 7ff568f2f640 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca9f70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff564197ad0 tx=0x7ff554009110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba533acaf327abfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.688+0000 7ff54effd640 1 -- 172.21.15.100:0/2446756991 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554015950 con 0x55e58dca4b40 2024-09-12T02:43:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.688+0000 7ff54effd640 1 -- 172.21.15.100:0/2446756991 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55401e440 con 0x55e58dca4b40 2024-09-12T02:43:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.688+0000 7ff54effd640 1 -- 172.21.15.100:0/2446756991 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55401d620 con 0x55e58dca4b40 2024-09-12T02:43:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.689+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2446756991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 msgr2=0x55e58dca9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.689+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca9f70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff564197ad0 tx=0x7ff554009110 comp rx=0 tx=0).stop 2024-09-12T02:43:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.689+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2446756991 shutdown_connections 2024-09-12T02:43:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.689+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dcc5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.689+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dca9f70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.689+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/2446756991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.689+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2446756991 >> 172.21.15.100:0/2446756991 conn(0x55e58dc6c310 msgr2=0x55e58dca9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.690+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2446756991 shutdown_connections 2024-09-12T02:43:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.690+0000 7ff56dd6d740 1 -- 172.21.15.100:0/2446756991 wait complete. 2024-09-12T02:43:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.691+0000 7ff56dd6d740 1 -- start start 2024-09-12T02:43:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.691+0000 7ff56dd6d740 1 Processor -- start 2024-09-12T02:43:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.691+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcb6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.691+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dcb6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff56dd6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dca7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641a5ac0 con 0x55e58dca35d0 2024-09-12T02:43:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641a6f30 con 0x55e58dca4b40 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff56dd6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641a6190 con 0x55e58dcae370 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff56dd6d740 10 client.0 _ll_register_callbacks cb 0x7ff55c03e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff568f2f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dcb6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcb6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff568f2f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dcb6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48144/0 (socket says 172.21.15.100:48144) 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff568f2f640 1 -- 172.21.15.100:0/4261919957 learned_addr learned my addr 172.21.15.100:0/4261919957 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dca7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 -- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 msgr2=0x55e58dca7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dca7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 -- 172.21.15.100:0/4261919957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 msgr2=0x55e58dcb6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dcb6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 -- 172.21.15.100:0/4261919957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e58dca8260 con 0x55e58dca35d0 2024-09-12T02:43:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff569f31640 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcb6870 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009700 tx=0x7ff55c0092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6170bddc5bc021c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.692+0000 7ff54cff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.693+0000 7ff54cff9640 1 -- 172.21.15.100:0/4261919957 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c04f070 con 0x55e58dca35d0 2024-09-12T02:43:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.693+0000 7ff54cff9640 1 -- 172.21.15.100:0/4261919957 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff55c03bbe0 con 0x55e58dca35d0 2024-09-12T02:43:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.693+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff55401e440 con 0x55e58dca35d0 2024-09-12T02:43:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.693+0000 7ff54cff9640 1 -- 172.21.15.100:0/4261919957 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff55c03be00 con 0x55e58dca35d0 2024-09-12T02:43:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 10 client.16251 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e58dd286a0 con 0x55e58dca35d0 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff54cff9640 1 -- 172.21.15.100:0/4261919957 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55401e440 con 0x55e58dca35d0 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff54cff9640 1 -- 172.21.15.100:0/4261919957 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff55c05e020 con 0x55e58dca35d0 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 10 client.16251 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 10 client.16251 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 20 client.16251 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dd28d60 0x55e58dd2b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 4 client.16251 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.694+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e58dc10d70 con 0x55e58dd28d60 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.695+0000 7ff568f2f640 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dd28d60 0x55e58dd2b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.695+0000 7ff54cff9640 10 client.16251 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.695+0000 7ff568f2f640 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dd28d60 0x55e58dd2b180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef4df351900ed1a9 server_cookie=a71715fb9ceec5c8 in_seq=0 out_seq=0 2024-09-12T02:43:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.695+0000 7ff54cff9640 1 -- 172.21.15.100:0/4261919957 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e58dc10d70 con 0x55e58dd28d60 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.695+0000 7ff54cff9640 10 client.16251 handle_command_reply: tid=0 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 client.16251 shutdown 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 msgr2=0x55e58dcb6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcb6870 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009700 tx=0x7ff55c0092b0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 shutdown_connections 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e58dd28d60 0x55e58dd2b180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e58dcae370 0x55e58dca7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e58dca4b40 0x55e58dcb6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 --2- 172.21.15.100:0/4261919957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e58dca35d0 0x55e58dcb6870 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 >> 172.21.15.100:0/4261919957 conn(0x55e58dc6c310 msgr2=0x55e58dca5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff54cff9640 0 client.16251 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 shutdown_connections 2024-09-12T02:43:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 1 -- 172.21.15.100:0/4261919957 wait complete. 2024-09-12T02:43:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.696+0000 7ff56dd6d740 20 client.16251 trim_cache size 0 max 16384 2024-09-12T02:43:45.700 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:43:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff5500a2cd0 msgr2=0x7ff5500a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff5500a2cd0 0x7ff5500a5190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5600ed210 tx=0x7ff5600f2e90 comp rx=0 tx=0).stop 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff564102d30 msgr2=0x7ff56419f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff564102d30 0x7ff56419f330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff560005940 tx=0x7ff5600042f0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 shutdown_connections 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff5500a2cd0 0x7ff5500a5190 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5641082a0 0x7ff56410e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5641036e0 0x7ff56419f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 --2- 172.21.15.100:0/2583702981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff564102d30 0x7ff56419f330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 >> 172.21.15.100:0/2583702981 conn(0x7ff5640fc7d0 msgr2=0x7ff5641009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 shutdown_connections 2024-09-12T02:43:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:45.697+0000 7ff56b994640 1 -- 172.21.15.100:0/2583702981 wait complete. 2024-09-12T02:43:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 275.0 s, 3971.4 tps, lat 25.230 ms stddev 29.632 2024-09-12T02:43:46.794 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:43:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:46 smithi189 ceph-mon[35196]: pgmap v489: 97 pgs: 97 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 MiB/s wr, 818 op/s 2024-09-12T02:43:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:46 smithi117 ceph-mon[34898]: pgmap v489: 97 pgs: 97 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 MiB/s wr, 818 op/s 2024-09-12T02:43:47.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:46 smithi100 ceph-mon[31390]: pgmap v489: 97 pgs: 97 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 MiB/s wr, 818 op/s 2024-09-12T02:43:47.188 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.740+0000 7f3beb542640 1 -- 172.21.15.100:0/215754590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4112a10 msgr2=0x7f3be4114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.740+0000 7f3beb542640 1 --2- 172.21.15.100:0/215754590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4112a10 0x7f3be4114e00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc01acb0 tx=0x7f3bdc03b920 comp rx=0 tx=0).stop 2024-09-12T02:43:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.740+0000 7f3beb542640 1 -- 172.21.15.100:0/215754590 shutdown_connections 2024-09-12T02:43:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.740+0000 7f3beb542640 1 --2- 172.21.15.100:0/215754590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4112a10 0x7f3be4114e00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.740+0000 7f3beb542640 1 --2- 172.21.15.100:0/215754590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3be4077040 0x7f3be41124d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.740+0000 7f3beb542640 1 --2- 172.21.15.100:0/215754590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be4076720 0x7f3be4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.740+0000 7f3beb542640 1 -- 172.21.15.100:0/215754590 >> 172.21.15.100:0/215754590 conn(0x7f3be40ffa30 msgr2=0x7f3be4101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.742+0000 7f3beb542640 1 -- 172.21.15.100:0/215754590 shutdown_connections 2024-09-12T02:43:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.742+0000 7f3beb542640 1 -- 172.21.15.100:0/215754590 wait complete. 2024-09-12T02:43:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 Processor -- start 2024-09-12T02:43:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 -- start start 2024-09-12T02:43:47.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4076720 0x7f3be41120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be4077040 0x7f3be410e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3be4112a10 0x7f3be410e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3be4106670 con 0x7f3be4076720 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3be41064f0 con 0x7f3be4077040 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3beb542640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3be41067f0 con 0x7f3be4112a10 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3be92de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4076720 0x7f3be41120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3be8add640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be4077040 0x7f3be410e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3be8add640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be4077040 0x7f3be410e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48154/0 (socket says 172.21.15.100:48154) 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3be8add640 1 -- 172.21.15.100:0/2878761959 learned_addr learned my addr 172.21.15.100:0/2878761959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.743+0000 7f3be9adf640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3be4112a10 0x7f3be410e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.744+0000 7f3be92de640 1 -- 172.21.15.100:0/2878761959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3be4112a10 msgr2=0x7f3be410e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.744+0000 7f3be92de640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3be4112a10 0x7f3be410e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.744+0000 7f3be92de640 1 -- 172.21.15.100:0/2878761959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be4077040 msgr2=0x7f3be410e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.744+0000 7f3be92de640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be4077040 0x7f3be410e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.744+0000 7f3be92de640 1 -- 172.21.15.100:0/2878761959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be410edb0 con 0x7f3be4076720 2024-09-12T02:43:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.744+0000 7f3be92de640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4076720 0x7f3be41120a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c970 tx=0x7f3be000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.745+0000 7f3bda7fc640 1 -- 172.21.15.100:0/2878761959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0007b30 con 0x7f3be4076720 2024-09-12T02:43:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.745+0000 7f3bda7fc640 1 -- 172.21.15.100:0/2878761959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3be0007cd0 con 0x7f3be4076720 2024-09-12T02:43:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.745+0000 7f3bda7fc640 1 -- 172.21.15.100:0/2878761959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0018820 con 0x7f3be4076720 2024-09-12T02:43:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.745+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be41a2940 con 0x7f3be4076720 2024-09-12T02:43:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.745+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be41a2ce0 con 0x7f3be4076720 2024-09-12T02:43:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.750+0000 7f3bda7fc640 1 -- 172.21.15.100:0/2878761959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3be00189c0 con 0x7f3be4076720 2024-09-12T02:43:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 Processor -- start 2024-09-12T02:43:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 -- start start 2024-09-12T02:43:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b91808a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b91808a5d0 0x55b91808aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b918097760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b917ff02f0 con 0x55b918095370 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b917f97cf0 con 0x55b91808a5d0 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.751+0000 7f3bed91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b917fec2b0 con 0x55b91808bb40 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b91808a5d0 0x55b91808aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b91808a5d0 0x55b91808aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48168/0 (socket says 172.21.15.100:48168) 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 -- 172.21.15.100:0/4193452649 learned_addr learned my addr 172.21.15.100:0/4193452649 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be9adf640 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b91808a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be8add640 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b918097760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 -- 172.21.15.100:0/4193452649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 msgr2=0x55b91808a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b91808a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 -- 172.21.15.100:0/4193452649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 msgr2=0x55b918097760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b918097760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 -- 172.21.15.100:0/4193452649 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b917f7c3a0 con 0x55b91808a5d0 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.752+0000 7f3be92de640 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b91808a5d0 0x55b91808aa10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3be00d2e80 tx=0x7f3be00d2f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da305fd7d30d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.753+0000 7f3bcf7fe640 1 -- 172.21.15.100:0/4193452649 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be00e1470 con 0x55b91808a5d0 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.753+0000 7f3bcf7fe640 1 -- 172.21.15.100:0/4193452649 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3be00dc070 con 0x55b91808a5d0 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.753+0000 7f3bcf7fe640 1 -- 172.21.15.100:0/4193452649 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be00d88e0 con 0x55b91808a5d0 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.753+0000 7f3bda7fc640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3bd00a2cc0 0x7f3bd00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.753+0000 7f3be9adf640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3bd00a2cc0 0x7f3bd00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.753+0000 7f3bda7fc640 1 -- 172.21.15.100:0/2878761959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3be00cedd0 con 0x7f3be4076720 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 -- 172.21.15.100:0/4193452649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b91808a5d0 msgr2=0x55b91808aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b91808a5d0 0x55b91808aa10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3be00d2e80 tx=0x7f3be00d2f70 comp rx=0 tx=0).stop 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3be9adf640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3bd00a2cc0 0x7f3bd00a5180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006010 tx=0x7f3bdc04d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 -- 172.21.15.100:0/4193452649 shutdown_connections 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b918097760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b91808a5d0 0x55b91808aa10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 --2- 172.21.15.100:0/4193452649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b91808a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 -- 172.21.15.100:0/4193452649 >> 172.21.15.100:0/4193452649 conn(0x55b918053310 msgr2=0x55b918086c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 -- 172.21.15.100:0/4193452649 shutdown_connections 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.754+0000 7f3bed91b740 1 -- 172.21.15.100:0/4193452649 wait complete. 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.755+0000 7f3bed91b740 1 -- start start 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.755+0000 7f3bed91b740 1 Processor -- start 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918094d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b918091fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b918092570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3bed91b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b918098070 con 0x55b91808a5d0 2024-09-12T02:43:47.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3bed91b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b917fab060 con 0x55b918095370 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3bed91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b9180981f0 con 0x55b91808bb40 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3bed91b740 10 client.0 _ll_register_callbacks cb 0x55b917cfe8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918094d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918094d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50396/0 (socket says 172.21.15.100:50396) 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 -- 172.21.15.100:0/3066974336 learned_addr learned my addr 172.21.15.100:0/3066974336 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be8add640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b918091fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be9adf640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b918092570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 -- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 msgr2=0x55b918091fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b918091fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 -- 172.21.15.100:0/3066974336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 msgr2=0x55b918092570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b918092570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.756+0000 7f3be92de640 1 -- 172.21.15.100:0/3066974336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b917d613c0 con 0x55b91808a5d0 2024-09-12T02:43:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.757+0000 7f3be9adf640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b918092570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.757+0000 7f3be92de640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918094d20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3be0097f90 tx=0x7f3be00d5c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274a700272d653d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.757+0000 7f3be8add640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b918091fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.757+0000 7f3bccff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.761+0000 7f3bccff9640 1 -- 172.21.15.100:0/3066974336 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0097860 con 0x55b91808a5d0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.761+0000 7f3bccff9640 1 -- 172.21.15.100:0/3066974336 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3be00998c0 con 0x55b91808a5d0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.761+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3be00dc070 con 0x55b91808a5d0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.761+0000 7f3bccff9640 1 -- 172.21.15.100:0/3066974336 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3be0018cb0 con 0x55b91808a5d0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.761+0000 7f3bed91b740 10 client.16263 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.761+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b9180a3b50 con 0x55b91808a5d0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.762+0000 7f3bccff9640 1 -- 172.21.15.100:0/3066974336 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3be00dc070 con 0x55b91808a5d0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.762+0000 7f3bccff9640 1 -- 172.21.15.100:0/3066974336 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3be009b820 con 0x55b91808a5d0 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3bed91b740 10 client.16263 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3bed91b740 10 client.16263 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:43:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3bed91b740 20 client.16263 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b9180a4ea0 0x55b9180a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3bed91b740 4 client.16263 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b917ffd860 con 0x55b9180a4ea0 2024-09-12T02:43:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3be8add640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b9180a4ea0 0x55b9180a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3bccff9640 10 client.16263 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.763+0000 7f3be8add640 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b9180a4ea0 0x55b9180a7290 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b42918e11b9f1a07 server_cookie=151f129c8181ce0e in_seq=0 out_seq=0 2024-09-12T02:43:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bccff9640 1 -- 172.21.15.100:0/3066974336 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b917ffd860 con 0x55b9180a4ea0 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bccff9640 10 client.16263 handle_command_reply: tid=0 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 client.16263 shutdown 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 msgr2=0x55b918094d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918094d20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3be0097f90 tx=0x7f3be00d5c60 comp rx=0 tx=0).stop 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 shutdown_connections 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b9180a4ea0 0x55b9180a7290 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b918092570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b918091fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3066974336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918094d20 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.764+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 >> 172.21.15.100:0/3066974336 conn(0x55b918053310 msgr2=0x55b91808c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.765+0000 7f3bccff9640 0 client.16263 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.765+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 shutdown_connections 2024-09-12T02:43:47.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.765+0000 7f3bed91b740 1 -- 172.21.15.100:0/3066974336 wait complete. 2024-09-12T02:43:47.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.765+0000 7f3bed91b740 20 client.16263 trim_cache size 0 max 16384 2024-09-12T02:43:47.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 Processor -- start 2024-09-12T02:43:47.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 -- start start 2024-09-12T02:43:47.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918091fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b9180aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc8010d40 con 0x55b91808a5d0 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc800e610 con 0x55b918095370 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.787+0000 7f3bed91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc800c460 con 0x55b91808bb40 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918091fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be9adf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b9180aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be9adf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b9180aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48174/0 (socket says 172.21.15.100:48174) 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be9adf640 1 -- 172.21.15.100:0/2636021022 learned_addr learned my addr 172.21.15.100:0/2636021022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918091fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50410/0 (socket says 172.21.15.100:50410) 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be8add640 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 -- 172.21.15.100:0/2636021022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 msgr2=0x55b9180a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 -- 172.21.15.100:0/2636021022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 msgr2=0x55b9180aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b9180aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 -- 172.21.15.100:0/2636021022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b918095090 con 0x55b91808a5d0 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be9adf640 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b9180aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.788+0000 7f3be92de640 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918091fa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3be0097f40 tx=0x7f3be00d2f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429b4be038b8d9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.789+0000 7f3bceffd640 1 -- 172.21.15.100:0/2636021022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be009af20 con 0x55b91808a5d0 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.789+0000 7f3bceffd640 1 -- 172.21.15.100:0/2636021022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3be00dc030 con 0x55b91808a5d0 2024-09-12T02:43:47.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.789+0000 7f3bceffd640 1 -- 172.21.15.100:0/2636021022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be009b100 con 0x55b91808a5d0 2024-09-12T02:43:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.790+0000 7f3bed91b740 1 -- 172.21.15.100:0/2636021022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 msgr2=0x55b918091fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.790+0000 7f3bed91b740 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918091fa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3be0097f40 tx=0x7f3be00d2f70 comp rx=0 tx=0).stop 2024-09-12T02:43:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.790+0000 7f3bed91b740 1 -- 172.21.15.100:0/2636021022 shutdown_connections 2024-09-12T02:43:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.790+0000 7f3bed91b740 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b918095370 0x55b9180aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.790+0000 7f3bed91b740 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.790+0000 7f3bed91b740 1 --2- 172.21.15.100:0/2636021022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b91808a5d0 0x55b918091fa0 secure :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3be0097f40 tx=0x7f3be00d2f70 comp rx=0 tx=0).stop 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.790+0000 7f3bed91b740 1 -- 172.21.15.100:0/2636021022 >> 172.21.15.100:0/2636021022 conn(0x55b918053310 msgr2=0x55b918091890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.791+0000 7f3bed91b740 1 -- 172.21.15.100:0/2636021022 shutdown_connections 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.791+0000 7f3bed91b740 1 -- 172.21.15.100:0/2636021022 wait complete. 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.791+0000 7f3bed91b740 1 -- start start 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 1 Processor -- start 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b9180a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9180a9d20 0x55b9180aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3be92de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc800cad0 con 0x55b918095370 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc800df40 con 0x55b9180a9d20 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc800d1a0 con 0x55b91808bb40 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3bed91b740 10 client.0 _ll_register_callbacks cb 0x7f3bd4009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.792+0000 7f3be8add640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b9180a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be8add640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b9180a7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50414/0 (socket says 172.21.15.100:50414) 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be9adf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9180a9d20 0x55b9180aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be8add640 1 -- 172.21.15.100:0/3428131655 learned_addr learned my addr 172.21.15.100:0/3428131655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be9adf640 1 -- 172.21.15.100:0/3428131655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 msgr2=0x55b9180a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be9adf640 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be9adf640 1 -- 172.21.15.100:0/3428131655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 msgr2=0x55b9180a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:47.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be9adf640 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b9180a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.793+0000 7f3be9adf640 1 -- 172.21.15.100:0/3428131655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9180aa790 con 0x55b9180a9d20 2024-09-12T02:43:47.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.794+0000 7f3be9adf640 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9180a9d20 0x55b9180aa1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc01aa70 tx=0x7f3bdc03b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e04a577ee059350 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.794+0000 7f3bccff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.795+0000 7f3bccff9640 1 -- 172.21.15.100:0/3428131655 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc067030 con 0x55b9180a9d20 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.795+0000 7f3bccff9640 1 -- 172.21.15.100:0/3428131655 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3bdc019040 con 0x55b9180a9d20 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.795+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3be00dc030 con 0x55b9180a9d20 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.795+0000 7f3bccff9640 1 -- 172.21.15.100:0/3428131655 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3bdc045040 con 0x55b9180a9d20 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.795+0000 7f3bed91b740 10 client.25655 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.795+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b91810f700 con 0x55b9180a9d20 2024-09-12T02:43:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.795+0000 7f3bccff9640 1 -- 172.21.15.100:0/3428131655 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bdc004730 con 0x55b9180a9d20 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.796+0000 7f3bccff9640 1 -- 172.21.15.100:0/3428131655 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3bdc04bc20 con 0x55b9180a9d20 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.796+0000 7f3bed91b740 10 client.25655 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.796+0000 7f3bed91b740 10 client.25655 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.796+0000 7f3bed91b740 20 client.25655 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.796+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b91810fe70 0x55b918112290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.796+0000 7f3bed91b740 4 client.25655 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.796+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3be00dc030 con 0x55b91810fe70 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.797+0000 7f3be92de640 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b91810fe70 0x55b918112290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:47.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.797+0000 7f3bccff9640 10 client.25655 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.797+0000 7f3be92de640 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b91810fe70 0x55b918112290 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7d975fe8c40b48d server_cookie=4608dffac92f3c58 in_seq=0 out_seq=0 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.797+0000 7f3bccff9640 1 -- 172.21.15.100:0/3428131655 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3be00dc030 con 0x55b91810fe70 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.797+0000 7f3bccff9640 10 client.25655 handle_command_reply: tid=0 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.797+0000 7f3bed91b740 1 client.25655 shutdown 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9180a9d20 msgr2=0x55b9180aa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9180a9d20 0x55b9180aa1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc01aa70 tx=0x7f3bdc03b920 comp rx=0 tx=0).stop 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 shutdown_connections 2024-09-12T02:43:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b91810fe70 0x55b918112290 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9180a9d20 0x55b9180aa1a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bccff9640 0 client.25655 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:43:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b918095370 0x55b9180a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 --2- 172.21.15.100:0/3428131655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b91808bb40 0x55b9180a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 >> 172.21.15.100:0/3428131655 conn(0x55b918053310 msgr2=0x55b91808c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.798+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 shutdown_connections 2024-09-12T02:43:47.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.799+0000 7f3bed91b740 1 -- 172.21.15.100:0/3428131655 wait complete. 2024-09-12T02:43:47.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.799+0000 7f3bed91b740 20 client.25655 trim_cache size 0 max 16384 2024-09-12T02:43:47.803 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3bd00a2cc0 msgr2=0x7f3bd00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3bd00a2cc0 0x7f3bd00a5180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006010 tx=0x7f3bdc04d040 comp rx=0 tx=0).stop 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4076720 msgr2=0x7f3be41120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4076720 0x7f3be41120a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c970 tx=0x7f3be000ce30 comp rx=0 tx=0).stop 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 shutdown_connections 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3bd00a2cc0 0x7f3bd00a5180 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3be4112a10 0x7f3be410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be4077040 0x7f3be410e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 --2- 172.21.15.100:0/2878761959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3be4076720 0x7f3be41120a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:47.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 >> 172.21.15.100:0/2878761959 conn(0x7f3be40ffa30 msgr2=0x7f3be4101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:47.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 shutdown_connections 2024-09-12T02:43:47.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:47.800+0000 7f3beb542640 1 -- 172.21.15.100:0/2878761959 wait complete. 2024-09-12T02:43:49.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:48 smithi189 ceph-mon[35196]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 MiB/s wr, 908 op/s 2024-09-12T02:43:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:48 smithi117 ceph-mon[34898]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 MiB/s wr, 908 op/s 2024-09-12T02:43:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:48 smithi100 ceph-mon[31390]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 40 MiB/s wr, 908 op/s 2024-09-12T02:43:49.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:43:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:50.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.912+0000 7f8e03c42640 1 -- 172.21.15.100:0/4194961735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 msgr2=0x7f8dfc115070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.912+0000 7f8e03c42640 1 --2- 172.21.15.100:0/4194961735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 0x7f8dfc115070 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009be0 tx=0x7f8df402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.913+0000 7f8e03c42640 1 -- 172.21.15.100:0/4194961735 shutdown_connections 2024-09-12T02:43:50.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.913+0000 7f8e03c42640 1 --2- 172.21.15.100:0/4194961735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 0x7f8dfc115070 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.913+0000 7f8e03c42640 1 --2- 172.21.15.100:0/4194961735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc1081f0 0x7f8dfc108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.913+0000 7f8e03c42640 1 --2- 172.21.15.100:0/4194961735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc10e230 0x7f8dfc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.913+0000 7f8e03c42640 1 -- 172.21.15.100:0/4194961735 >> 172.21.15.100:0/4194961735 conn(0x7f8dfc077bb0 msgr2=0x7f8dfc079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.913+0000 7f8e03c42640 1 -- 172.21.15.100:0/4194961735 shutdown_connections 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.913+0000 7f8e03c42640 1 -- 172.21.15.100:0/4194961735 wait complete. 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.914+0000 7f8e03c42640 1 Processor -- start 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.914+0000 7f8e03c42640 1 -- start start 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.915+0000 7f8e03c42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc1081f0 0x7f8dfc1a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.915+0000 7f8e03c42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 0x7f8dfc1a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.915+0000 7f8e03c42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc10e230 0x7f8dfc19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.915+0000 7f8e019de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc1081f0 0x7f8dfc1a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.915+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 0x7f8dfc1a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.915+0000 7f8e019de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc1081f0 0x7f8dfc1a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35954/0 (socket says 172.21.15.100:35954) 2024-09-12T02:43:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 0x7f8dfc1a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48210/0 (socket says 172.21.15.100:48210) 2024-09-12T02:43:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e019de640 1 -- 172.21.15.100:0/603068045 learned_addr learned my addr 172.21.15.100:0/603068045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e021df640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc10e230 0x7f8dfc19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc118540 con 0x7f8dfc10e230 2024-09-12T02:43:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc1183c0 con 0x7f8dfc108b50 2024-09-12T02:43:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc1186c0 con 0x7f8dfc1081f0 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e019de640 1 -- 172.21.15.100:0/603068045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 msgr2=0x7f8dfc1a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e019de640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 0x7f8dfc1a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e019de640 1 -- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc10e230 msgr2=0x7f8dfc19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e019de640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc10e230 0x7f8dfc19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.916+0000 7f8e019de640 1 -- 172.21.15.100:0/603068045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc19efb0 con 0x7f8dfc1081f0 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.917+0000 7f8e019de640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc1081f0 0x7f8dfc1a4690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8df800e9c0 tx=0x7f8df800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.917+0000 7f8df2ffd640 1 -- 172.21.15.100:0/603068045 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df800ccc0 con 0x7f8dfc1081f0 2024-09-12T02:43:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.917+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc19f2a0 con 0x7f8dfc1081f0 2024-09-12T02:43:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.917+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc1ab4f0 con 0x7f8dfc1081f0 2024-09-12T02:43:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.917+0000 7f8df2ffd640 1 -- 172.21.15.100:0/603068045 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df8005500 con 0x7f8dfc1081f0 2024-09-12T02:43:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.917+0000 7f8df2ffd640 1 -- 172.21.15.100:0/603068045 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8010430 con 0x7f8dfc1081f0 2024-09-12T02:43:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.920+0000 7f8df2ffd640 1 -- 172.21.15.100:0/603068045 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8df8004f20 con 0x7f8dfc1081f0 2024-09-12T02:43:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.920+0000 7f8df2ffd640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8de80a2d80 0x7f8de80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8df2ffd640 1 -- 172.21.15.100:0/603068045 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8df8004cc0 con 0x7f8dfc1081f0 2024-09-12T02:43:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 Processor -- start 2024-09-12T02:43:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e011dd640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8de80a2d80 0x7f8de80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 -- start start 2024-09-12T02:43:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384566090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5563845665d0 0x556384566a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x556384573760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563844cc2f0 con 0x556384567b40 2024-09-12T02:43:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556384473cf0 con 0x5563845665d0 2024-09-12T02:43:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e0601b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5563844c82b0 con 0x556384571370 2024-09-12T02:43:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.921+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5563845665d0 0x556384566a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.922+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5563845665d0 0x556384566a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48222/0 (socket says 172.21.15.100:48222) 2024-09-12T02:43:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.922+0000 7f8e021df640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x556384573760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.922+0000 7f8e011dd640 1 -- 172.21.15.100:0/3842701706 learned_addr learned my addr 172.21.15.100:0/3842701706 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.922+0000 7f8e019de640 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384566090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.922+0000 7f8e011dd640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8de80a2d80 0x7f8de80a5240 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc10d8c0 tx=0x7f8dec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.923+0000 7f8e011dd640 1 -- 172.21.15.100:0/3842701706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 msgr2=0x556384573760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.923+0000 7f8e011dd640 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x556384573760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.923+0000 7f8e011dd640 1 -- 172.21.15.100:0/3842701706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 msgr2=0x556384566090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.923+0000 7f8e011dd640 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384566090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.923+0000 7f8e011dd640 1 -- 172.21.15.100:0/3842701706 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563844583a0 con 0x5563845665d0 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.923+0000 7f8e011dd640 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5563845665d0 0x556384566a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00e600 tx=0x7f8dec014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a264d6d28b1c6a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.924+0000 7f8de7fff640 1 -- 172.21.15.100:0/3842701706 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec004020 con 0x5563845665d0 2024-09-12T02:43:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.924+0000 7f8de7fff640 1 -- 172.21.15.100:0/3842701706 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dec0041c0 con 0x5563845665d0 2024-09-12T02:43:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.924+0000 7f8de7fff640 1 -- 172.21.15.100:0/3842701706 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec026840 con 0x5563845665d0 2024-09-12T02:43:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 -- 172.21.15.100:0/3842701706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5563845665d0 msgr2=0x556384566a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5563845665d0 0x556384566a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00e600 tx=0x7f8dec014000 comp rx=0 tx=0).stop 2024-09-12T02:43:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 -- 172.21.15.100:0/3842701706 shutdown_connections 2024-09-12T02:43:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x556384573760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5563845665d0 0x556384566a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 --2- 172.21.15.100:0/3842701706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384566090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 -- 172.21.15.100:0/3842701706 >> 172.21.15.100:0/3842701706 conn(0x55638452f310 msgr2=0x556384562c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 -- 172.21.15.100:0/3842701706 shutdown_connections 2024-09-12T02:43:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.925+0000 7f8e0601b740 1 -- 172.21.15.100:0/3842701706 wait complete. 2024-09-12T02:43:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.926+0000 7f8e0601b740 1 -- start start 2024-09-12T02:43:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.926+0000 7f8e0601b740 1 Processor -- start 2024-09-12T02:43:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.927+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x556384570d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.927+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384567b40 0x55638456e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.927+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x55638456e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.927+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384567b40 0x55638456e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.927+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384567b40 0x55638456e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35978/0 (socket says 172.21.15.100:35978) 2024-09-12T02:43:50.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.927+0000 7f8e011dd640 1 -- 172.21.15.100:0/4238232368 learned_addr learned my addr 172.21.15.100:0/4238232368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:50.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e021df640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x55638456e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556384574070 con 0x5563845665d0 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e019de640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x556384570d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556384487060 con 0x556384571370 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5563845741f0 con 0x556384567b40 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e0601b740 10 client.0 _ll_register_callbacks cb 0x5563841da8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e011dd640 1 -- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 msgr2=0x55638456e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x55638456e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e011dd640 1 -- 172.21.15.100:0/4238232368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 msgr2=0x556384570d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x556384570d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e011dd640 1 -- 172.21.15.100:0/4238232368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638423d3c0 con 0x556384567b40 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.928+0000 7f8e021df640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x55638456e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:50.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384567b40 0x55638456e030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8dec005750 tx=0x7f8dec003d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a29f15ca6a2c8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8de57fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dec0041c0 con 0x556384567b40 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8de57fa640 1 -- 172.21.15.100:0/4238232368 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec026b40 con 0x556384567b40 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8de57fa640 1 -- 172.21.15.100:0/4238232368 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8dec026ce0 con 0x556384567b40 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8de57fa640 1 -- 172.21.15.100:0/4238232368 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8dec037050 con 0x556384567b40 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8e0601b740 10 client.25663 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55638457faa0 con 0x556384567b40 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8de57fa640 1 -- 172.21.15.100:0/4238232368 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8dec026560 con 0x556384567b40 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8e0601b740 10 client.25663 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.929+0000 7f8e0601b740 10 client.25663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.930+0000 7f8e0601b740 20 client.25663 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.930+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556384580df0 0x5563845831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.930+0000 7f8e0601b740 4 client.25663 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.930+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563844d9860 con 0x556384580df0 2024-09-12T02:43:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.930+0000 7f8e019de640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556384580df0 0x5563845831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.930+0000 7f8e019de640 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556384580df0 0x5563845831e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0dba4f7e4eb083b server_cookie=20b30bff92e5db32 in_seq=0 out_seq=0 2024-09-12T02:43:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.930+0000 7f8de57fa640 10 client.25663 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8de57fa640 1 -- 172.21.15.100:0/4238232368 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563844d9860 con 0x556384580df0 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8de57fa640 10 client.25663 handle_command_reply: tid=0 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 client.25663 shutdown 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384567b40 msgr2=0x55638456e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384567b40 0x55638456e030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8dec005750 tx=0x7f8dec003d30 comp rx=0 tx=0).stop 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 shutdown_connections 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556384580df0 0x5563845831e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x55638456e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384567b40 0x55638456e030 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.932+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4238232368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x556384570d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.933+0000 7f8de57fa640 0 client.25663 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:50.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.933+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 >> 172.21.15.100:0/4238232368 conn(0x55638452f310 msgr2=0x556384568930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.933+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 shutdown_connections 2024-09-12T02:43:50.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.933+0000 7f8e0601b740 1 -- 172.21.15.100:0/4238232368 wait complete. 2024-09-12T02:43:50.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.933+0000 7f8e0601b740 20 client.25663 trim_cache size 0 max 16384 2024-09-12T02:43:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.951+0000 7f8e0601b740 1 Processor -- start 2024-09-12T02:43:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.951+0000 7f8e0601b740 1 -- start start 2024-09-12T02:43:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x5563845692c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384567b40 0x556384569800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x5563845625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e0601b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0010cb0 con 0x5563845665d0 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e0601b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8de000e580 con 0x556384567b40 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e019de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x5563845692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384567b40 0x556384569800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e021df640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x5563845625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e019de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x5563845692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50440/0 (socket says 172.21.15.100:50440) 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384567b40 0x556384569800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48242/0 (socket says 172.21.15.100:48242) 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e019de640 1 -- 172.21.15.100:0/4161044513 learned_addr learned my addr 172.21.15.100:0/4161044513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.952+0000 7f8e0601b740 1 -- 172.21.15.100:0/4161044513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8de000c3d0 con 0x556384571370 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8e011dd640 1 -- 172.21.15.100:0/4161044513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 msgr2=0x5563845625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x5563845625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8e011dd640 1 -- 172.21.15.100:0/4161044513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 msgr2=0x5563845692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x5563845692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8e011dd640 1 -- 172.21.15.100:0/4161044513 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638456e970 con 0x556384567b40 2024-09-12T02:43:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8e019de640 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x5563845692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384567b40 0x556384569800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00eac0 tx=0x7f8dec02a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13ba9ee0333f2449 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8de77fe640 1 -- 172.21.15.100:0/4161044513 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec026aa0 con 0x556384567b40 2024-09-12T02:43:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8de77fe640 1 -- 172.21.15.100:0/4161044513 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dec0041c0 con 0x556384567b40 2024-09-12T02:43:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.953+0000 7f8de77fe640 1 -- 172.21.15.100:0/4161044513 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec003870 con 0x556384567b40 2024-09-12T02:43:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.954+0000 7f8e0601b740 1 -- 172.21.15.100:0/4161044513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384567b40 msgr2=0x556384569800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.954+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384567b40 0x556384569800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00eac0 tx=0x7f8dec02a000 comp rx=0 tx=0).stop 2024-09-12T02:43:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.955+0000 7f8e0601b740 1 -- 172.21.15.100:0/4161044513 shutdown_connections 2024-09-12T02:43:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.955+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556384571370 0x5563845625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.955+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384567b40 0x556384569800 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.955+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4161044513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563845665d0 0x5563845692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.955+0000 7f8e0601b740 1 -- 172.21.15.100:0/4161044513 >> 172.21.15.100:0/4161044513 conn(0x55638452f310 msgr2=0x55638455da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.955+0000 7f8e0601b740 1 -- 172.21.15.100:0/4161044513 shutdown_connections 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.955+0000 7f8e0601b740 1 -- 172.21.15.100:0/4161044513 wait complete. 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.956+0000 7f8e0601b740 1 -- start start 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.956+0000 7f8e0601b740 1 Processor -- start 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.956+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5563845665d0 0x5563845831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.956+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384583720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e0601b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x5563845e9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e0601b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8de000ca40 con 0x556384567b40 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e0601b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8de000deb0 con 0x556384571370 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e0601b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8de000d110 con 0x5563845665d0 2024-09-12T02:43:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e0601b740 10 client.0 _ll_register_callbacks cb 0x7f8df8097a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e021df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x5563845e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5563845665d0 0x5563845831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e011dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384583720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5563845665d0 0x5563845831e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35992/0 (socket says 172.21.15.100:35992) 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 -- 172.21.15.100:0/4060502547 learned_addr learned my addr 172.21.15.100:0/4060502547 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 -- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 msgr2=0x5563845e9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x5563845e9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 -- 172.21.15.100:0/4060502547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 msgr2=0x556384583720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384583720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 -- 172.21.15.100:0/4060502547 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563845e9c60 con 0x5563845665d0 2024-09-12T02:43:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e021df640 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x5563845e9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8e019de640 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5563845665d0 0x5563845831e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8df80ccaa0 tx=0x7f8df8086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c60988ba21998d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8de57fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.957+0000 7f8de57fa640 1 -- 172.21.15.100:0/4060502547 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df80b9070 con 0x5563845665d0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8de57fa640 1 -- 172.21.15.100:0/4060502547 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8df8005210 con 0x5563845665d0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dec0041c0 con 0x5563845665d0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8de57fa640 1 -- 172.21.15.100:0/4060502547 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8df80860b0 con 0x5563845665d0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 10 client.25669 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5563845eaec0 con 0x5563845665d0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8de57fa640 1 -- 172.21.15.100:0/4060502547 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dec0041c0 con 0x5563845665d0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8de57fa640 1 -- 172.21.15.100:0/4060502547 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8df80046c0 con 0x5563845665d0 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 10 client.25669 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 10 client.25669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 20 client.25669 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5563845eb590 0x5563845ed980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 4 client.25669 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563844d3d70 con 0x5563845eb590 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.958+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5563845eb590 0x5563845ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.959+0000 7f8e011dd640 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5563845eb590 0x5563845ed980 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25693c66aa5492cd server_cookie=e0e6378950fae16d in_seq=0 out_seq=0 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.959+0000 7f8de57fa640 10 client.25669 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.959+0000 7f8de57fa640 1 -- 172.21.15.100:0/4060502547 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563844d3d70 con 0x5563845eb590 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.959+0000 7f8de57fa640 10 client.25669 handle_command_reply: tid=0 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.959+0000 7f8e0601b740 1 client.25669 shutdown 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5563845665d0 msgr2=0x5563845831e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5563845665d0 0x5563845831e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8df80ccaa0 tx=0x7f8df8086040 comp rx=0 tx=0).stop 2024-09-12T02:43:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 shutdown_connections 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5563845eb590 0x5563845ed980 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8de57fa640 0 client.25669 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556384571370 0x5563845e9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556384567b40 0x556384583720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 --2- 172.21.15.100:0/4060502547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5563845665d0 0x5563845831e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 >> 172.21.15.100:0/4060502547 conn(0x55638452f310 msgr2=0x5563845692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 shutdown_connections 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 1 -- 172.21.15.100:0/4060502547 wait complete. 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.960+0000 7f8e0601b740 20 client.25669 trim_cache size 0 max 16384 2024-09-12T02:43:50.967 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:43:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8de80a2d80 msgr2=0x7f8de80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8de80a2d80 0x7f8de80a5240 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc10d8c0 tx=0x7f8dec005f90 comp rx=0 tx=0).stop 2024-09-12T02:43:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc1081f0 msgr2=0x7f8dfc1a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc1081f0 0x7f8dfc1a4690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8df800e9c0 tx=0x7f8df800ee80 comp rx=0 tx=0).stop 2024-09-12T02:43:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 shutdown_connections 2024-09-12T02:43:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8de80a2d80 0x7f8de80a5240 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc10e230 0x7f8dfc19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc108b50 0x7f8dfc1a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 --2- 172.21.15.100:0/603068045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8dfc1081f0 0x7f8dfc1a4690 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.961+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 >> 172.21.15.100:0/603068045 conn(0x7f8dfc077bb0 msgr2=0x7f8dfc0793a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.963+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 shutdown_connections 2024-09-12T02:43:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:50.963+0000 7f8e03c42640 1 -- 172.21.15.100:0/603068045 wait complete. 2024-09-12T02:43:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:50 smithi189 ceph-mon[35196]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 49 MiB/s wr, 971 op/s 2024-09-12T02:43:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:50 smithi117 ceph-mon[34898]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 49 MiB/s wr, 971 op/s 2024-09-12T02:43:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:50 smithi100 ceph-mon[31390]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 49 MiB/s wr, 971 op/s 2024-09-12T02:43:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 280.0 s, 4006.6 tps, lat 24.654 ms stddev 30.232 2024-09-12T02:43:52.768 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:43:52.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:43:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:52 smithi117 ceph-mon[34898]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 MiB/s wr, 918 op/s 2024-09-12T02:43:53.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:52 smithi100 ceph-mon[31390]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 MiB/s wr, 918 op/s 2024-09-12T02:43:53.219 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:52 smithi189 ceph-mon[35196]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 MiB/s wr, 918 op/s 2024-09-12T02:43:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.797+0000 7f9b8e99d640 1 -- 172.21.15.100:0/3622508456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b881008b0 msgr2=0x7f9b88100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.797+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/3622508456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b881008b0 0x7f9b88100d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009cd0 tx=0x7f9b8002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.797+0000 7f9b8e99d640 1 -- 172.21.15.100:0/3622508456 shutdown_connections 2024-09-12T02:43:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.797+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/3622508456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b88101250 0x7f9b8810d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.797+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/3622508456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b881008b0 0x7f9b88100d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.797+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/3622508456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b881068b0 0x7f9b88106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.797+0000 7f9b8e99d640 1 -- 172.21.15.100:0/3622508456 >> 172.21.15.100:0/3622508456 conn(0x7f9b880fc5d0 msgr2=0x7f9b880fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.805+0000 7f9b8e99d640 1 -- 172.21.15.100:0/3622508456 shutdown_connections 2024-09-12T02:43:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.805+0000 7f9b8e99d640 1 -- 172.21.15.100:0/3622508456 wait complete. 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 Processor -- start 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 -- start start 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b881008b0 0x7f9b8819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b88101250 0x7f9b88195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b881068b0 0x7f9b88196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8810fc00 con 0x7f9b881008b0 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8810fa80 con 0x7f9b881068b0 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8e99d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8810fd80 con 0x7f9b88101250 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8d99b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b881008b0 0x7f9b8819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8d99b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b881008b0 0x7f9b8819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50478/0 (socket says 172.21.15.100:50478) 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.806+0000 7f9b8d99b640 1 -- 172.21.15.100:0/2206949748 learned_addr learned my addr 172.21.15.100:0/2206949748 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:53.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.807+0000 7f9b8d99b640 1 -- 172.21.15.100:0/2206949748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b88101250 msgr2=0x7f9b88195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.807+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b88101250 0x7f9b88195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.807+0000 7f9b8d99b640 1 -- 172.21.15.100:0/2206949748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b881068b0 msgr2=0x7f9b88196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.807+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b881068b0 0x7f9b88196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.807+0000 7f9b8d99b640 1 -- 172.21.15.100:0/2206949748 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b881969d0 con 0x7f9b881008b0 2024-09-12T02:43:53.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.811+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b881008b0 0x7f9b8819ce40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9b840099f0 tx=0x7f9b84009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.813+0000 7f9b7effd640 1 -- 172.21.15.100:0/2206949748 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8401c070 con 0x7f9b881008b0 2024-09-12T02:43:53.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.813+0000 7f9b7effd640 1 -- 172.21.15.100:0/2206949748 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b8400cc60 con 0x7f9b881008b0 2024-09-12T02:43:53.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.813+0000 7f9b7effd640 1 -- 172.21.15.100:0/2206949748 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b84016690 con 0x7f9b881008b0 2024-09-12T02:43:53.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.814+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b88196cc0 con 0x7f9b881008b0 2024-09-12T02:43:53.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.814+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b8819ac60 con 0x7f9b881008b0 2024-09-12T02:43:53.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.818+0000 7f9b91fd8740 1 Processor -- start 2024-09-12T02:43:53.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.818+0000 7f9b91fd8740 1 -- start start 2024-09-12T02:43:53.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f046150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f050a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f050f50 0x56202f053340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56202efab280 con 0x56202f050f50 2024-09-12T02:43:53.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56202ef52b10 con 0x56202f045d70 2024-09-12T02:43:53.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56202efa7240 con 0x56202f046690 2024-09-12T02:43:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b8e19c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f046150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b8e19c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f046150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48294/0 (socket says 172.21.15.100:48294) 2024-09-12T02:43:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.819+0000 7f9b8e19c640 1 -- 172.21.15.100:0/1967461534 learned_addr learned my addr 172.21.15.100:0/1967461534 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b8e19c640 1 -- 172.21.15.100:0/1967461534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 msgr2=0x56202f050a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/1967461534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f050a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b8e19c640 1 -- 172.21.15.100:0/1967461534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f050f50 msgr2=0x56202f053340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/1967461534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f050f50 0x56202f053340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b8e19c640 1 -- 172.21.15.100:0/1967461534 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56202ef5f1f0 con 0x56202f045d70 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/1967461534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f046150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800ba90 tx=0x7f9b7800bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e35f3b55f4e7e439 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b73fff640 1 -- 172.21.15.100:0/1967461534 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78016070 con 0x56202f045d70 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.820+0000 7f9b73fff640 1 -- 172.21.15.100:0/1967461534 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b78005500 con 0x56202f045d70 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.821+0000 7f9b73fff640 1 -- 172.21.15.100:0/1967461534 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78010460 con 0x56202f045d70 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.821+0000 7f9b91fd8740 1 -- 172.21.15.100:0/1967461534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 msgr2=0x56202f046150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.822+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/1967461534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f046150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800ba90 tx=0x7f9b7800bf50 comp rx=0 tx=0).stop 2024-09-12T02:43:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.822+0000 7f9b91fd8740 1 -- 172.21.15.100:0/1967461534 shutdown_connections 2024-09-12T02:43:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.822+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/1967461534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f050f50 0x56202f053340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.822+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/1967461534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f050a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.822+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/1967461534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f046150 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.822+0000 7f9b91fd8740 1 -- 172.21.15.100:0/1967461534 >> 172.21.15.100:0/1967461534 conn(0x56202f042300 msgr2=0x56202f0426e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.823+0000 7f9b91fd8740 1 -- 172.21.15.100:0/1967461534 shutdown_connections 2024-09-12T02:43:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.824+0000 7f9b7effd640 1 -- 172.21.15.100:0/2206949748 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9b84017400 con 0x7f9b881008b0 2024-09-12T02:43:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.825+0000 7f9b91fd8740 1 -- 172.21.15.100:0/1967461534 wait complete. 2024-09-12T02:43:53.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.825+0000 7f9b7effd640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b740a2b10 0x7f9b740a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.826+0000 7f9b7effd640 1 -- 172.21.15.100:0/2206949748 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9b840cefb0 con 0x7f9b881008b0 2024-09-12T02:43:53.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.826+0000 7f9b8d19a640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b740a2b10 0x7f9b740a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.826+0000 7f9b91fd8740 1 -- start start 2024-09-12T02:43:53.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.826+0000 7f9b91fd8740 1 Processor -- start 2024-09-12T02:43:53.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.827+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f050900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.827+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f04dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.827+0000 7f9b8d19a640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b740a2b10 0x7f9b740a4fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9b8002aaf0 tx=0x7f9b80009c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f050f50 0x56202f04e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b8d19a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f04dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b8d19a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f04dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:36028/0 (socket says 172.21.15.100:36028) 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b8d99b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f050900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b8d99b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f050900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50494/0 (socket says 172.21.15.100:50494) 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b8e19c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f050f50 0x56202f04e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b8e19c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f050f50 0x56202f04e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48306/0 (socket says 172.21.15.100:48306) 2024-09-12T02:43:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56202f053bc0 con 0x56202f045d70 2024-09-12T02:43:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56202ef65f10 con 0x56202f050f50 2024-09-12T02:43:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56202f053d40 con 0x56202f046690 2024-09-12T02:43:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b8d19a640 1 -- 172.21.15.100:0/2180054686 learned_addr learned my addr 172.21.15.100:0/2180054686 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.828+0000 7f9b91fd8740 10 client.0 _ll_register_callbacks cb 0x56202ef2ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.829+0000 7f9b8e19c640 1 -- 172.21.15.100:0/2180054686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 msgr2=0x56202f04dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.829+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f04dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.829+0000 7f9b8e19c640 1 -- 172.21.15.100:0/2180054686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 msgr2=0x56202f050900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.829+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f050900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.829+0000 7f9b8e19c640 1 -- 172.21.15.100:0/2180054686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56202ed1c6a0 con 0x56202f050f50 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.829+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f050f50 0x56202f04e210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800ba90 tx=0x7f9b78005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e04c89bc0426b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b717fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b717fa640 1 -- 172.21.15.100:0/2180054686 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78016070 con 0x56202f050f50 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b717fa640 1 -- 172.21.15.100:0/2180054686 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9b78005200 con 0x56202f050f50 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b78005500 con 0x56202f050f50 2024-09-12T02:43:53.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b717fa640 1 -- 172.21.15.100:0/2180054686 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b78004960 con 0x56202f050f50 2024-09-12T02:43:53.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 10 client.25682 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:53.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56202f05f630 con 0x56202f050f50 2024-09-12T02:43:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b717fa640 1 -- 172.21.15.100:0/2180054686 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b78010460 con 0x56202f050f50 2024-09-12T02:43:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b717fa640 1 -- 172.21.15.100:0/2180054686 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9b7802d050 con 0x56202f050f50 2024-09-12T02:43:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 10 client.25682 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 10 client.25682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 20 client.25682 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f060ea0 0x56202f0632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 4 client.25682 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:53.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.830+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9b78005500 con 0x56202f060ea0 2024-09-12T02:43:53.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.836+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f060ea0 0x56202f0632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.837+0000 7f9b717fa640 10 client.25682 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:53.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.837+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f060ea0 0x56202f0632c0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1088a7dab565a745 server_cookie=6145b849cb768dc4 in_seq=0 out_seq=0 2024-09-12T02:43:53.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.838+0000 7f9b717fa640 1 -- 172.21.15.100:0/2180054686 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9b78005500 con 0x56202f060ea0 2024-09-12T02:43:53.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.838+0000 7f9b717fa640 10 client.25682 handle_command_reply: tid=0 2024-09-12T02:43:53.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.838+0000 7f9b91fd8740 1 client.25682 shutdown 2024-09-12T02:43:53.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.838+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f050f50 msgr2=0x56202f04e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f050f50 0x56202f04e210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800ba90 tx=0x7f9b78005780 comp rx=0 tx=0).stop 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 shutdown_connections 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f060ea0 0x56202f0632c0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f050f50 0x56202f04e210 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f046690 0x56202f04dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/2180054686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f050900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 >> 172.21.15.100:0/2180054686 conn(0x56202f042300 msgr2=0x56202f047fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b717fa640 0 client.25682 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 shutdown_connections 2024-09-12T02:43:53.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.839+0000 7f9b91fd8740 1 -- 172.21.15.100:0/2180054686 wait complete. 2024-09-12T02:43:53.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.840+0000 7f9b91fd8740 20 client.25682 trim_cache size 0 max 16384 2024-09-12T02:43:53.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.871+0000 7f9b91fd8740 1 Processor -- start 2024-09-12T02:43:53.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.871+0000 7f9b91fd8740 1 -- start start 2024-09-12T02:43:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.871+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f05cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f046690 0x56202f04fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b881c7540 con 0x56202f046690 2024-09-12T02:43:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88073960 con 0x56202f045d70 2024-09-12T02:43:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b91fd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b880717b0 con 0x56202f050f50 2024-09-12T02:43:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8d19a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f046690 0x56202f04fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f068bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:36044/0 (socket says 172.21.15.100:36044) 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 -- 172.21.15.100:0/179834928 learned_addr learned my addr 172.21.15.100:0/179834928 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f05cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 -- 172.21.15.100:0/179834928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 msgr2=0x56202f05cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f05cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 -- 172.21.15.100:0/179834928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f046690 msgr2=0x56202f04fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f046690 0x56202f04fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.872+0000 7f9b8e19c640 1 -- 172.21.15.100:0/179834928 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56202f04cc20 con 0x56202f050f50 2024-09-12T02:43:53.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.873+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f068bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800b3e0 tx=0x7f9b7801a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df3f169fd0d6704 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.873+0000 7f9b737fe640 1 -- 172.21.15.100:0/179834928 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78033030 con 0x56202f050f50 2024-09-12T02:43:53.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.874+0000 7f9b737fe640 1 -- 172.21.15.100:0/179834928 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b78004fd0 con 0x56202f050f50 2024-09-12T02:43:53.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.874+0000 7f9b737fe640 1 -- 172.21.15.100:0/179834928 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78016070 con 0x56202f050f50 2024-09-12T02:43:53.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.874+0000 7f9b91fd8740 1 -- 172.21.15.100:0/179834928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 msgr2=0x56202f068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.874+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f068bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800b3e0 tx=0x7f9b7801a630 comp rx=0 tx=0).stop 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.875+0000 7f9b91fd8740 1 -- 172.21.15.100:0/179834928 shutdown_connections 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.875+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f068bd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.875+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f046690 0x56202f04fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.875+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/179834928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f045d70 0x56202f05cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.875+0000 7f9b91fd8740 1 -- 172.21.15.100:0/179834928 >> 172.21.15.100:0/179834928 conn(0x56202f042300 msgr2=0x56202f04f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.875+0000 7f9b91fd8740 1 -- 172.21.15.100:0/179834928 shutdown_connections 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.875+0000 7f9b91fd8740 1 -- 172.21.15.100:0/179834928 wait complete. 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.876+0000 7f9b91fd8740 1 -- start start 2024-09-12T02:43:53.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.876+0000 7f9b91fd8740 1 Processor -- start 2024-09-12T02:43:53.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.877+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f059890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b8d99b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f059890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b8d99b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f059890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50512/0 (socket says 172.21.15.100:50512) 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b91fd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f046690 0x56202f051e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b8d99b640 1 -- 172.21.15.100:0/4107948761 learned_addr learned my addr 172.21.15.100:0/4107948761 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f0524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88071e20 con 0x56202f045d70 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b8d19a640 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f046690 0x56202f051e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88073290 con 0x56202f046690 2024-09-12T02:43:53.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b8e19c640 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f0524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.878+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b880724f0 con 0x56202f050f50 2024-09-12T02:43:53.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.879+0000 7f9b91fd8740 10 client.0 _ll_register_callbacks cb 0x7f9b7800b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.879+0000 7f9b8d99b640 1 -- 172.21.15.100:0/4107948761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 msgr2=0x56202f0524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.879+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f0524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.879+0000 7f9b8d99b640 1 -- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f046690 msgr2=0x56202f051e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.879+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f046690 0x56202f051e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.879+0000 7f9b8d99b640 1 -- 172.21.15.100:0/4107948761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56202f050c70 con 0x56202f045d70 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.879+0000 7f9b8d99b640 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f059890 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9b840cce10 tx=0x7f9b840ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0746873131cd306 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.880+0000 7f9b717fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.880+0000 7f9b717fa640 1 -- 172.21.15.100:0/4107948761 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8400ce10 con 0x56202f045d70 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.880+0000 7f9b717fa640 1 -- 172.21.15.100:0/4107948761 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9b84099b00 con 0x56202f045d70 2024-09-12T02:43:53.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.880+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b78004fd0 con 0x56202f045d70 2024-09-12T02:43:53.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.880+0000 7f9b717fa640 1 -- 172.21.15.100:0/4107948761 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b84017970 con 0x56202f045d70 2024-09-12T02:43:53.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.880+0000 7f9b91fd8740 10 client.16302 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:53.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.880+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56202f053d70 con 0x56202f045d70 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b717fa640 1 -- 172.21.15.100:0/4107948761 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b78004fd0 con 0x56202f045d70 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b717fa640 1 -- 172.21.15.100:0/4107948761 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9b8409ac50 con 0x56202f045d70 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b91fd8740 10 client.16302 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b91fd8740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b91fd8740 20 client.16302 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f0cc0f0 0x56202f0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b91fd8740 4 client.16302 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56202efb87f0 con 0x56202f0cc0f0 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.881+0000 7f9b8d19a640 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f0cc0f0 0x56202f0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.882+0000 7f9b8d19a640 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f0cc0f0 0x56202f0ce4e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43306246ae47c765 server_cookie=e684bc9e8ee75fe8 in_seq=0 out_seq=0 2024-09-12T02:43:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.882+0000 7f9b717fa640 10 client.16302 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.883+0000 7f9b717fa640 1 -- 172.21.15.100:0/4107948761 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56202efb87f0 con 0x56202f0cc0f0 2024-09-12T02:43:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.883+0000 7f9b717fa640 10 client.16302 handle_command_reply: tid=0 2024-09-12T02:43:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.883+0000 7f9b91fd8740 1 client.16302 shutdown 2024-09-12T02:43:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.885+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 msgr2=0x56202f059890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.885+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f059890 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9b840cce10 tx=0x7f9b840ce040 comp rx=0 tx=0).stop 2024-09-12T02:43:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.886+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 shutdown_connections 2024-09-12T02:43:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.886+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56202f0cc0f0 0x56202f0ce4e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.886+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56202f050f50 0x56202f0524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.886+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56202f046690 0x56202f051e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.886+0000 7f9b91fd8740 1 --2- 172.21.15.100:0/4107948761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56202f045d70 0x56202f059890 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.886+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 >> 172.21.15.100:0/4107948761 conn(0x56202f042300 msgr2=0x56202f047fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.886+0000 7f9b717fa640 0 client.16302 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.887+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 shutdown_connections 2024-09-12T02:43:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.887+0000 7f9b91fd8740 1 -- 172.21.15.100:0/4107948761 wait complete. 2024-09-12T02:43:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.887+0000 7f9b91fd8740 20 client.16302 trim_cache size 0 max 16384 2024-09-12T02:43:53.890 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:43:53.890 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:43:53.890 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "133d5777-c8d3-4b3c-ac9f-03822df4185f", 2024-09-12T02:43:53.890 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:43:53.890 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:43:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b740a2b10 msgr2=0x7f9b740a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b740a2b10 0x7f9b740a4fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9b8002aaf0 tx=0x7f9b80009c20 comp rx=0 tx=0).stop 2024-09-12T02:43:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b881008b0 msgr2=0x7f9b8819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b881008b0 0x7f9b8819ce40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9b840099f0 tx=0x7f9b84009eb0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 shutdown_connections 2024-09-12T02:43:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b740a2b10 0x7f9b740a4fd0 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9b8002aaf0 tx=0x7f9b80009c20 comp rx=0 tx=0).stop 2024-09-12T02:43:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b881068b0 0x7f9b88196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b88101250 0x7f9b88195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 --2- 172.21.15.100:0/2206949748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b881008b0 0x7f9b8819ce40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.889+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 >> 172.21.15.100:0/2206949748 conn(0x7f9b880fc5d0 msgr2=0x7f9b880fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.890+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 shutdown_connections 2024-09-12T02:43:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:53.890+0000 7f9b8e99d640 1 -- 172.21.15.100:0/2206949748 wait complete. 2024-09-12T02:43:55.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:54 smithi100 ceph-mon[31390]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 MiB/s wr, 857 op/s 2024-09-12T02:43:55.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:54 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:43:55.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:54 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:54 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:43:55.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:54 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:43:55.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:54 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:54 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:43:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:54 smithi117 ceph-mon[34898]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 MiB/s wr, 857 op/s 2024-09-12T02:43:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:54 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:43:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:54 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:54 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:43:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:54 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:43:55.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:54 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:54 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:54 smithi189 ceph-mon[35196]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 MiB/s wr, 857 op/s 2024-09-12T02:43:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:54 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:43:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:54 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:54 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:43:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:54 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:43:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:54 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:54 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:43:55.533 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.209+0000 7f8656120640 1 -- 172.21.15.100:0/2459750887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8650102570 msgr2=0x7f86501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.209+0000 7f8656120640 1 --2- 172.21.15.100:0/2459750887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8650102570 0x7f86501029b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8640009900 tx=0x7f864002a480 comp rx=0 tx=0).stop 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.210+0000 7f8656120640 1 -- 172.21.15.100:0/2459750887 shutdown_connections 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.210+0000 7f8656120640 1 --2- 172.21.15.100:0/2459750887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8650102ef0 0x7f865010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.210+0000 7f8656120640 1 --2- 172.21.15.100:0/2459750887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8650102570 0x7f86501029b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.210+0000 7f8656120640 1 --2- 172.21.15.100:0/2459750887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 0x7f8650101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.210+0000 7f8656120640 1 -- 172.21.15.100:0/2459750887 >> 172.21.15.100:0/2459750887 conn(0x7f86500fc7d0 msgr2=0x7f86500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.210+0000 7f8656120640 1 -- 172.21.15.100:0/2459750887 shutdown_connections 2024-09-12T02:43:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.210+0000 7f8656120640 1 -- 172.21.15.100:0/2459750887 wait complete. 2024-09-12T02:43:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.211+0000 7f8656120640 1 Processor -- start 2024-09-12T02:43:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.211+0000 7f8656120640 1 -- start start 2024-09-12T02:43:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f8656120640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 0x7f8650197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f8656120640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8650102570 0x7f8650197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f8656120640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8650102ef0 0x7f865019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f8656120640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8650110f80 con 0x7f8650102570 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f8656120640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8650110e00 con 0x7f8650102ef0 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f8656120640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8650111100 con 0x7f8650100e20 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 0x7f8650197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 0x7f8650197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:58348/0 (socket says 172.21.15.100:58348) 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 -- 172.21.15.100:0/4155596784 learned_addr learned my addr 172.21.15.100:0/4155596784 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 -- 172.21.15.100:0/4155596784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8650102ef0 msgr2=0x7f865019c190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8650102ef0 0x7f865019c190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 -- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8650102570 msgr2=0x7f8650197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8650102570 0x7f8650197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.212+0000 7f864f7fe640 1 -- 172.21.15.100:0/4155596784 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865019c6d0 con 0x7f8650100e20 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.213+0000 7f864f7fe640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 0x7f8650197140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f864400e9f0 tx=0x7f864400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.213+0000 7f864cff9640 1 -- 172.21.15.100:0/4155596784 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864400cd80 con 0x7f8650100e20 2024-09-12T02:43:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.213+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865019c9c0 con 0x7f8650100e20 2024-09-12T02:43:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.213+0000 7f864cff9640 1 -- 172.21.15.100:0/4155596784 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8644005500 con 0x7f8650100e20 2024-09-12T02:43:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.214+0000 7f864cff9640 1 -- 172.21.15.100:0/4155596784 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644010690 con 0x7f8650100e20 2024-09-12T02:43:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.214+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865019cf00 con 0x7f8650100e20 2024-09-12T02:43:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.215+0000 7f864cff9640 1 -- 172.21.15.100:0/4155596784 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8644004f70 con 0x7f8650100e20 2024-09-12T02:43:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.216+0000 7f864cff9640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f86380a2c00 0x7f86380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.217+0000 7f864cff9640 1 -- 172.21.15.100:0/4155596784 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f86440cf520 con 0x7f8650100e20 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.217+0000 7f86584f9740 1 Processor -- start 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.217+0000 7f864effd640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f86380a2c00 0x7f86380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f86584f9740 1 -- start start 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f86584f9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f50d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f86584f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 0x55f42f529150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f86584f9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f529690 0x55f42f52ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f86584f9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f42f4732e0 con 0x55f42f50dba0 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f86584f9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f42f41ace0 con 0x55f42f529690 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f86584f9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f42f46f2a0 con 0x55f42f50d280 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f50d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f50d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:58354/0 (socket says 172.21.15.100:58354) 2024-09-12T02:43:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f864f7fe640 1 -- 172.21.15.100:0/597665570 learned_addr learned my addr 172.21.15.100:0/597665570 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.218+0000 7f864ffff640 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f529690 0x55f42f52ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.219+0000 7f864f7fe640 1 -- 172.21.15.100:0/597665570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f529690 msgr2=0x55f42f52ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.219+0000 7f864f7fe640 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f529690 0x55f42f52ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.219+0000 7f864f7fe640 1 -- 172.21.15.100:0/597665570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 msgr2=0x55f42f529150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.219+0000 7f864f7fe640 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 0x55f42f529150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.219+0000 7f864f7fe640 1 -- 172.21.15.100:0/597665570 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42f3ff440 con 0x55f42f50d280 2024-09-12T02:43:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.219+0000 7f864f7fe640 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f50d660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f864409bca0 tx=0x7f864409bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795ea007013f9bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.219+0000 7f864effd640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f86380a2c00 0x7f86380a50c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f86400096c0 tx=0x7f8640005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.220+0000 7f8635ffb640 1 -- 172.21.15.100:0/597665570 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86440a00c0 con 0x55f42f50d280 2024-09-12T02:43:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.221+0000 7f8635ffb640 1 -- 172.21.15.100:0/597665570 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86440a4980 con 0x55f42f50d280 2024-09-12T02:43:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.221+0000 7f8635ffb640 1 -- 172.21.15.100:0/597665570 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86440046c0 con 0x55f42f50d280 2024-09-12T02:43:56.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.222+0000 7f86584f9740 1 -- 172.21.15.100:0/597665570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 msgr2=0x55f42f50d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.222+0000 7f86584f9740 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f50d660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f864409bca0 tx=0x7f864409bc10 comp rx=0 tx=0).stop 2024-09-12T02:43:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.222+0000 7f86584f9740 1 -- 172.21.15.100:0/597665570 shutdown_connections 2024-09-12T02:43:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.222+0000 7f86584f9740 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f529690 0x55f42f52ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.222+0000 7f86584f9740 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 0x55f42f529150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.222+0000 7f86584f9740 1 --2- 172.21.15.100:0/597665570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f50d660 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.222+0000 7f86584f9740 1 -- 172.21.15.100:0/597665570 >> 172.21.15.100:0/597665570 conn(0x55f42f509a30 msgr2=0x55f42f509e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.223+0000 7f86584f9740 1 -- 172.21.15.100:0/597665570 shutdown_connections 2024-09-12T02:43:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.223+0000 7f86584f9740 1 -- 172.21.15.100:0/597665570 wait complete. 2024-09-12T02:43:56.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.223+0000 7f86584f9740 1 -- start start 2024-09-12T02:43:56.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.223+0000 7f86584f9740 1 Processor -- start 2024-09-12T02:43:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f86584f9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f528fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f86584f9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f526260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f86584f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f529690 0x55f42f5267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f86584f9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f42f52c360 con 0x55f42f529690 2024-09-12T02:43:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f86584f9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f42f42e050 con 0x55f42f50dba0 2024-09-12T02:43:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f86584f9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f42f52c4e0 con 0x55f42f50d280 2024-09-12T02:43:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f864effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f526260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f86584f9740 10 client.0 _ll_register_callbacks cb 0x55f42f46e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f864effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f526260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49760/0 (socket says 172.21.15.100:49760) 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.224+0000 7f864effd640 1 -- 172.21.15.100:0/2257212014 learned_addr learned my addr 172.21.15.100:0/2257212014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864f7fe640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f528fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864f7fe640 1 -- 172.21.15.100:0/2257212014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 msgr2=0x55f42f526260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864ffff640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f529690 0x55f42f5267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864f7fe640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f526260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864f7fe640 1 -- 172.21.15.100:0/2257212014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f529690 msgr2=0x55f42f5267a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864f7fe640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f529690 0x55f42f5267a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864f7fe640 1 -- 172.21.15.100:0/2257212014 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42f1e43c0 con 0x55f42f50d280 2024-09-12T02:43:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f864ffff640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f529690 0x55f42f5267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.225+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86440a4980 con 0x55f42f50d280 2024-09-12T02:43:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f864f7fe640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f528fb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8644098120 tx=0x7f8644004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb015149dafdbe1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f862effd640 10 client.25693 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:43:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f862effd640 1 -- 172.21.15.100:0/2257212014 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644098380 con 0x55f42f50d280 2024-09-12T02:43:56.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f862effd640 1 -- 172.21.15.100:0/2257212014 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f86440cf110 con 0x55f42f50d280 2024-09-12T02:43:56.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f862effd640 1 -- 172.21.15.100:0/2257212014 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f86440a00c0 con 0x55f42f50d280 2024-09-12T02:43:56.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f86584f9740 10 client.25693 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:56.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55f42f52c360 con 0x55f42f50d280 2024-09-12T02:43:56.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.226+0000 7f862effd640 1 -- 172.21.15.100:0/2257212014 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f864409bf70 con 0x55f42f50d280 2024-09-12T02:43:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.227+0000 7f86584f9740 10 client.25693 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.227+0000 7f86584f9740 10 client.25693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.227+0000 7f86584f9740 20 client.25693 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:56.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.227+0000 7f86584f9740 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f538de0 0x55f42f53b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.227+0000 7f86584f9740 4 client.25693 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.227+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f42f480850 con 0x55f42f538de0 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.227+0000 7f864effd640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f538de0 0x55f42f53b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.228+0000 7f864effd640 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f538de0 0x55f42f53b1d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7923f39d6a0fc888 server_cookie=9cac6d8a85e7f5c9 in_seq=0 out_seq=0 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.228+0000 7f862effd640 10 client.25693 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.228+0000 7f862effd640 1 -- 172.21.15.100:0/2257212014 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f42f480850 con 0x55f42f538de0 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.228+0000 7f862effd640 10 client.25693 handle_command_reply: tid=0 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.228+0000 7f86584f9740 1 client.25693 shutdown 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 msgr2=0x55f42f528fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f528fb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8644098120 tx=0x7f8644004c10 comp rx=0 tx=0).stop 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 shutdown_connections 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f538de0 0x55f42f53b1d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f529690 0x55f42f5267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f526260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 --2- 172.21.15.100:0/2257212014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f50d280 0x55f42f528fb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 >> 172.21.15.100:0/2257212014 conn(0x55f42f509a30 msgr2=0x55f42f50f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f862effd640 0 client.25693 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 shutdown_connections 2024-09-12T02:43:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 1 -- 172.21.15.100:0/2257212014 wait complete. 2024-09-12T02:43:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.229+0000 7f86584f9740 20 client.25693 trim_cache size 0 max 16384 2024-09-12T02:43:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.257+0000 7f86584f9740 1 Processor -- start 2024-09-12T02:43:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.257+0000 7f86584f9740 1 -- start start 2024-09-12T02:43:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.257+0000 7f86584f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50d280 0x55f42f5234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.257+0000 7f86584f9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f523a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.257+0000 7f86584f9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f508370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.257+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50d280 0x55f42f5234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.257+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50d280 0x55f42f5234c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52920/0 (socket says 172.21.15.100:52920) 2024-09-12T02:43:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864f7fe640 1 -- 172.21.15.100:0/1266498263 learned_addr learned my addr 172.21.15.100:0/1266498263 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86501add90 con 0x55f42f50d280 2024-09-12T02:43:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86501a5630 con 0x55f42f50dba0 2024-09-12T02:43:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f86501a3480 con 0x55f42f529690 2024-09-12T02:43:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864effd640 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f523a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864ffff640 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f508370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864effd640 1 -- 172.21.15.100:0/1266498263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 msgr2=0x55f42f508370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864effd640 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f508370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864effd640 1 -- 172.21.15.100:0/1266498263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50d280 msgr2=0x55f42f5234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864effd640 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50d280 0x55f42f5234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.258+0000 7f864effd640 1 -- 172.21.15.100:0/1266498263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42f509860 con 0x55f42f50dba0 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.259+0000 7f864effd640 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f523a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55f42f5278a0 tx=0x7f864003c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51d2ef06974ac5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.259+0000 7f86357fa640 1 -- 172.21.15.100:0/1266498263 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640044040 con 0x55f42f50dba0 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.259+0000 7f86357fa640 1 -- 172.21.15.100:0/1266498263 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8640045040 con 0x55f42f50dba0 2024-09-12T02:43:56.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.259+0000 7f86357fa640 1 -- 172.21.15.100:0/1266498263 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640035040 con 0x55f42f50dba0 2024-09-12T02:43:56.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.260+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 msgr2=0x55f42f523a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.260+0000 7f86584f9740 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f523a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55f42f5278a0 tx=0x7f864003c000 comp rx=0 tx=0).stop 2024-09-12T02:43:56.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.260+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 shutdown_connections 2024-09-12T02:43:56.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.260+0000 7f86584f9740 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f508370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.260+0000 7f86584f9740 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50dba0 0x55f42f523a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.260+0000 7f86584f9740 1 --2- 172.21.15.100:0/1266498263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50d280 0x55f42f5234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.260+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 >> 172.21.15.100:0/1266498263 conn(0x55f42f509a30 msgr2=0x55f42f521910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.261+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 shutdown_connections 2024-09-12T02:43:56.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.261+0000 7f86584f9740 1 -- 172.21.15.100:0/1266498263 wait complete. 2024-09-12T02:43:56.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.261+0000 7f86584f9740 1 -- start start 2024-09-12T02:43:56.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.262+0000 7f86584f9740 1 Processor -- start 2024-09-12T02:43:56.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.262+0000 7f86584f9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50d280 0x55f42f53dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.262+0000 7f86584f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 0x55f42f53e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50d280 0x55f42f53dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f86584f9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f53b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f86584f9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86501a3af0 con 0x55f42f50dba0 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f86584f9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86501a4f60 con 0x55f42f50d280 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50d280 0x55f42f53dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49774/0 (socket says 172.21.15.100:49774) 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f86584f9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f86501a41c0 con 0x55f42f529690 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 -- 172.21.15.100:0/1111347935 learned_addr learned my addr 172.21.15.100:0/1111347935 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f86584f9740 10 client.0 _ll_register_callbacks cb 0x7f864409b850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864effd640 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 0x55f42f53e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864ffff640 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f53b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 -- 172.21.15.100:0/1111347935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 msgr2=0x55f42f53b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f53b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 -- 172.21.15.100:0/1111347935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 msgr2=0x55f42f53e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 0x55f42f53e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 -- 172.21.15.100:0/1111347935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42f53bb50 con 0x55f42f50d280 2024-09-12T02:43:56.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f864f7fe640 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50d280 0x55f42f53dee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8644098120 tx=0x7f86440097e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21295ac33f66aaae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.263+0000 7f862effd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.264+0000 7f862effd640 1 -- 172.21.15.100:0/1111347935 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864408b060 con 0x55f42f50d280 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.264+0000 7f862effd640 1 -- 172.21.15.100:0/1111347935 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f86440a4bd0 con 0x55f42f50d280 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.264+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8640045040 con 0x55f42f50d280 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.264+0000 7f862effd640 1 -- 172.21.15.100:0/1111347935 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f86440a4dd0 con 0x55f42f50d280 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.264+0000 7f86584f9740 10 client.25700 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.264+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f42f5a3210 con 0x55f42f50d280 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f862effd640 1 -- 172.21.15.100:0/1111347935 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8640045040 con 0x55f42f50d280 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f862effd640 1 -- 172.21.15.100:0/1111347935 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8644086580 con 0x55f42f50d280 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f86584f9740 10 client.25700 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f86584f9740 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:43:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f86584f9740 20 client.25700 populate_metadata read hostname 'smithi100' 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f86584f9740 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f5a3640 0x55f42f5a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f86584f9740 4 client.25700 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f42f47ad60 con 0x55f42f5a3640 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.265+0000 7f864effd640 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f5a3640 0x55f42f5a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.266+0000 7f864effd640 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f5a3640 0x55f42f5a5a30 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed719443c1f32d7 server_cookie=6ea8699c2abb14d8 in_seq=0 out_seq=0 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.266+0000 7f862effd640 10 client.25700 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.266+0000 7f862effd640 1 -- 172.21.15.100:0/1111347935 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f42f47ad60 con 0x55f42f5a3640 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.266+0000 7f862effd640 10 client.25700 handle_command_reply: tid=0 2024-09-12T02:43:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.266+0000 7f86584f9740 1 client.25700 shutdown 2024-09-12T02:43:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50d280 msgr2=0x55f42f53dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50d280 0x55f42f53dee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8644098120 tx=0x7f86440097e0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 shutdown_connections 2024-09-12T02:43:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f42f5a3640 0x55f42f5a5a30 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f42f529690 0x55f42f53b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f42f50dba0 0x55f42f53e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 --2- 172.21.15.100:0/1111347935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f42f50d280 0x55f42f53dee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 >> 172.21.15.100:0/1111347935 conn(0x55f42f509a30 msgr2=0x55f42f50edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f862effd640 0 client.25700 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 shutdown_connections 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.267+0000 7f86584f9740 1 -- 172.21.15.100:0/1111347935 wait complete. 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f86584f9740 20 client.25700 trim_cache size 0 max 16384 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:43:56.271 INFO:teuthology.orchestra.run.smithi100.stdout: "133d5777-c8d3-4b3c-ac9f-03822df4185f": { 2024-09-12T02:43:56.272 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:43:56.272 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "133d5777-c8d3-4b3c-ac9f-03822df4185f", 2024-09-12T02:43:56.272 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:43:56.272 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:56.272 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:43:56.272 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f86380a2c00 msgr2=0x7f86380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f86380a2c00 0x7f86380a50c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f86400096c0 tx=0x7f8640005d90 comp rx=0 tx=0).stop 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 msgr2=0x7f8650197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 0x7f8650197140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f864400e9f0 tx=0x7f864400edf0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 shutdown_connections 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f86380a2c00 0x7f86380a50c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8650102ef0 0x7f865019c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8650102570 0x7f8650197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 --2- 172.21.15.100:0/4155596784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8650100e20 0x7f8650197140 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 >> 172.21.15.100:0/4155596784 conn(0x7f86500fc7d0 msgr2=0x7f86500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.268+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 shutdown_connections 2024-09-12T02:43:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:43:56.270+0000 7f8656120640 1 -- 172.21.15.100:0/4155596784 wait complete. 2024-09-12T02:43:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 285.0 s, 3792.6 tps, lat 26.677 ms stddev 47.037 2024-09-12T02:43:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:56 smithi117 ceph-mon[34898]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 MiB/s wr, 963 op/s 2024-09-12T02:43:57.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:56 smithi100 ceph-mon[31390]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 MiB/s wr, 963 op/s 2024-09-12T02:43:57.159 INFO:tasks.cephfs.filesystem:scrub status for tag:133d5777-c8d3-4b3c-ac9f-03822df4185f - {'path': '/', 'tag': '133d5777-c8d3-4b3c-ac9f-03822df4185f', 'options': 'recursive,force'} 2024-09-12T02:43:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:56 smithi189 ceph-mon[35196]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 MiB/s wr, 963 op/s 2024-09-12T02:43:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:58 smithi117 ceph-mon[34898]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 61 MiB/s wr, 1.36k op/s 2024-09-12T02:43:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:58 smithi100 ceph-mon[31390]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 61 MiB/s wr, 1.36k op/s 2024-09-12T02:43:59.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:58 smithi189 ceph-mon[35196]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 61 MiB/s wr, 1.36k op/s 2024-09-12T02:44:00.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:43:59 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:44:00.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:43:59 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:44:00.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:43:59 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:44:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:00 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:44:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:00 smithi117 ceph-mon[34898]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 67 MiB/s wr, 1.65k op/s 2024-09-12T02:44:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:00 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:44:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:00 smithi100 ceph-mon[31390]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 67 MiB/s wr, 1.65k op/s 2024-09-12T02:44:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:00 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:44:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:00 smithi189 ceph-mon[35196]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 67 MiB/s wr, 1.65k op/s 2024-09-12T02:44:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 290.0 s, 4302.8 tps, lat 23.216 ms stddev 24.710 2024-09-12T02:44:02.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:01 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:02.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:01 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:01 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:02 smithi117 ceph-mon[34898]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 60 MiB/s wr, 1.65k op/s 2024-09-12T02:44:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:03.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:03.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:44:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:02 smithi100 ceph-mon[31390]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 60 MiB/s wr, 1.65k op/s 2024-09-12T02:44:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:03.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:03.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:44:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:02 smithi189 ceph-mon[35196]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 60 MiB/s wr, 1.65k op/s 2024-09-12T02:44:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:03.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:03.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:44:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:03 smithi117 ceph-mon[34898]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 58 MiB/s wr, 1.64k op/s 2024-09-12T02:44:04.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:03 smithi100 ceph-mon[31390]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 58 MiB/s wr, 1.64k op/s 2024-09-12T02:44:04.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:03 smithi189 ceph-mon[35196]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 58 MiB/s wr, 1.64k op/s 2024-09-12T02:44:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 295.0 s, 3677.8 tps, lat 27.179 ms stddev 29.299 2024-09-12T02:44:06.965 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:06 smithi189 ceph-mon[35196]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 54 MiB/s wr, 1.60k op/s 2024-09-12T02:44:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:06 smithi117 ceph-mon[34898]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 54 MiB/s wr, 1.60k op/s 2024-09-12T02:44:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:06 smithi100 ceph-mon[31390]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 54 MiB/s wr, 1.60k op/s 2024-09-12T02:44:09.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:08 smithi189 ceph-mon[35196]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 47 MiB/s wr, 1.56k op/s 2024-09-12T02:44:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:08 smithi117 ceph-mon[34898]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 47 MiB/s wr, 1.56k op/s 2024-09-12T02:44:09.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:08 smithi100 ceph-mon[31390]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 47 MiB/s wr, 1.56k op/s 2024-09-12T02:44:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:10 smithi189 ceph-mon[35196]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 29 MiB/s wr, 1.16k op/s 2024-09-12T02:44:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:10 smithi117 ceph-mon[34898]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 29 MiB/s wr, 1.16k op/s 2024-09-12T02:44:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:10 smithi100 ceph-mon[31390]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 29 MiB/s wr, 1.16k op/s 2024-09-12T02:44:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 300.0 s, 3850.2 tps, lat 26.003 ms stddev 29.192 2024-09-12T02:44:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:12 smithi189 ceph-mon[35196]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 811 op/s 2024-09-12T02:44:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:12 smithi117 ceph-mon[34898]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 811 op/s 2024-09-12T02:44:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:12 smithi100 ceph-mon[31390]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 811 op/s 2024-09-12T02:44:15.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:14 smithi189 ceph-mon[35196]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-12T02:44:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:14 smithi117 ceph-mon[34898]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-12T02:44:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:14 smithi100 ceph-mon[31390]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-12T02:44:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 305.0 s, 3936.2 tps, lat 25.394 ms stddev 28.341 2024-09-12T02:44:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:16 smithi189 ceph-mon[35196]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.9 MiB/s wr, 707 op/s 2024-09-12T02:44:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:16 smithi117 ceph-mon[34898]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.9 MiB/s wr, 707 op/s 2024-09-12T02:44:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:16 smithi100 ceph-mon[31390]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.9 MiB/s wr, 707 op/s 2024-09-12T02:44:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:18 smithi189 ceph-mon[35196]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 849 op/s 2024-09-12T02:44:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:18 smithi117 ceph-mon[34898]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 849 op/s 2024-09-12T02:44:19.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:18 smithi100 ceph-mon[31390]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 849 op/s 2024-09-12T02:44:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:20 smithi189 ceph-mon[35196]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 857 op/s 2024-09-12T02:44:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:20 smithi117 ceph-mon[34898]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 857 op/s 2024-09-12T02:44:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:20 smithi100 ceph-mon[31390]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 857 op/s 2024-09-12T02:44:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 310.0 s, 4281.6 tps, lat 23.307 ms stddev 25.655 2024-09-12T02:44:23.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:22 smithi189 ceph-mon[35196]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-12T02:44:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:22 smithi117 ceph-mon[34898]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-12T02:44:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:22 smithi100 ceph-mon[31390]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-12T02:44:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:24 smithi100 ceph-mon[31390]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 815 op/s 2024-09-12T02:44:25.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:24 smithi189 ceph-mon[35196]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 815 op/s 2024-09-12T02:44:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:24 smithi117 ceph-mon[34898]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 815 op/s 2024-09-12T02:44:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 315.0 s, 3100.4 tps, lat 32.276 ms stddev 33.795 2024-09-12T02:44:27.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:26 smithi189 ceph-mon[35196]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-09-12T02:44:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:26 smithi117 ceph-mon[34898]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-09-12T02:44:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:26 smithi100 ceph-mon[31390]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-09-12T02:44:27.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:44:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.058+0000 7f1c87697640 1 -- 172.21.15.100:0/3000724818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 msgr2=0x7f1c80100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.058+0000 7f1c87697640 1 --2- 172.21.15.100:0/3000724818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80100ef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009900 tx=0x7f1c7002a440 comp rx=0 tx=0).stop 2024-09-12T02:44:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.061+0000 7f1c87697640 1 -- 172.21.15.100:0/3000724818 shutdown_connections 2024-09-12T02:44:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.061+0000 7f1c87697640 1 --2- 172.21.15.100:0/3000724818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c80101430 0x7f1c8010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.061+0000 7f1c87697640 1 --2- 172.21.15.100:0/3000724818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80100ef0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.061+0000 7f1c87697640 1 --2- 172.21.15.100:0/3000724818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c80106a90 0x7f1c80106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.061+0000 7f1c87697640 1 -- 172.21.15.100:0/3000724818 >> 172.21.15.100:0/3000724818 conn(0x7f1c800fc7d0 msgr2=0x7f1c800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.061+0000 7f1c87697640 1 -- 172.21.15.100:0/3000724818 shutdown_connections 2024-09-12T02:44:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.061+0000 7f1c87697640 1 -- 172.21.15.100:0/3000724818 wait complete. 2024-09-12T02:44:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.062+0000 7f1c87697640 1 Processor -- start 2024-09-12T02:44:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.062+0000 7f1c87697640 1 -- start start 2024-09-12T02:44:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c87697640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c87697640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c80101430 0x7f1c80196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c87697640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c80106a90 0x7f1c80196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c87697640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8010fd80 con 0x7f1c80106a90 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c87697640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8010fc00 con 0x7f1c80100a90 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c87697640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8010ff00 con 0x7f1c80101430 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45146/0 (socket says 172.21.15.100:45146) 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.063+0000 7f1c85433640 1 -- 172.21.15.100:0/1697851296 learned_addr learned my addr 172.21.15.100:0/1697851296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.064+0000 7f1c85433640 1 -- 172.21.15.100:0/1697851296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c80101430 msgr2=0x7f1c80196510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.064+0000 7f1c85433640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c80101430 0x7f1c80196510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.064+0000 7f1c85433640 1 -- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c80106a90 msgr2=0x7f1c80196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.064+0000 7f1c85433640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c80106a90 0x7f1c80196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.064+0000 7f1c85433640 1 -- 172.21.15.100:0/1697851296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8019a400 con 0x7f1c80100a90 2024-09-12T02:44:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.065+0000 7f1c85433640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80195fd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00bfd0 tx=0x7f1c7c00ae10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.066+0000 7f1c767fc640 1 -- 172.21.15.100:0/1697851296 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c019070 con 0x7f1c80100a90 2024-09-12T02:44:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.066+0000 7f1c767fc640 1 -- 172.21.15.100:0/1697851296 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c7c014410 con 0x7f1c80100a90 2024-09-12T02:44:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.066+0000 7f1c767fc640 1 -- 172.21.15.100:0/1697851296 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c013610 con 0x7f1c80100a90 2024-09-12T02:44:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.067+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8019a6f0 con 0x7f1c80100a90 2024-09-12T02:44:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.067+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8019abe0 con 0x7f1c80100a90 2024-09-12T02:44:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.071+0000 7f1c89a70740 1 Processor -- start 2024-09-12T02:44:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.071+0000 7f1c767fc640 1 -- 172.21.15.100:0/1697851296 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1c7c01c070 con 0x7f1c80100a90 2024-09-12T02:44:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.071+0000 7f1c89a70740 1 -- start start 2024-09-12T02:44:28.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.072+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 0x55e05babe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.072+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.072+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05bac9680 0x55e05bacba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.072+0000 7f1c89a70740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e05ba242e0 con 0x55e05babe4a0 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.072+0000 7f1c89a70740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e05b9cbce0 con 0x55e05babedc0 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.072+0000 7f1c89a70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e05ba202a0 con 0x55e05bac9680 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.072+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.073+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45152/0 (socket says 172.21.15.100:45152) 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.073+0000 7f1c85433640 1 -- 172.21.15.100:0/3627631160 learned_addr learned my addr 172.21.15.100:0/3627631160 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.073+0000 7f1c84c32640 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05bac9680 0x55e05bacba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.073+0000 7f1c767fc640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1c6c0a2cd0 0x7f1c6c0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.074+0000 7f1c85c34640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1c6c0a2cd0 0x7f1c6c0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.074+0000 7f1c767fc640 1 -- 172.21.15.100:0/1697851296 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1c7c0ce1b0 con 0x7f1c80100a90 2024-09-12T02:44:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.074+0000 7f1c84c32640 1 -- 172.21.15.100:0/3627631160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 msgr2=0x55e05bac9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.074+0000 7f1c84c32640 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.075+0000 7f1c84c32640 1 -- 172.21.15.100:0/3627631160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 msgr2=0x55e05babe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.075+0000 7f1c84c32640 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 0x55e05babe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.075+0000 7f1c84c32640 1 -- 172.21.15.100:0/3627631160 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05b9b0440 con 0x55e05bac9680 2024-09-12T02:44:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.075+0000 7f1c85c34640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1c6c0a2cd0 0x7f1c6c0a5190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009810 tx=0x7f1c78009780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.075+0000 7f1c84c32640 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05bac9680 0x55e05bacba70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c7002a960 tx=0x7f1c70005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d246f5861829f2ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:28.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.076+0000 7f1c6b7fe640 1 -- 172.21.15.100:0/3627631160 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70040070 con 0x55e05bac9680 2024-09-12T02:44:28.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.076+0000 7f1c6b7fe640 1 -- 172.21.15.100:0/3627631160 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c70004040 con 0x55e05bac9680 2024-09-12T02:44:28.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.076+0000 7f1c6b7fe640 1 -- 172.21.15.100:0/3627631160 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70035020 con 0x55e05bac9680 2024-09-12T02:44:28.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 -- 172.21.15.100:0/3627631160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05bac9680 msgr2=0x55e05bacba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05bac9680 0x55e05bacba70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c7002a960 tx=0x7f1c70005e10 comp rx=0 tx=0).stop 2024-09-12T02:44:28.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 -- 172.21.15.100:0/3627631160 shutdown_connections 2024-09-12T02:44:28.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05bac9680 0x55e05bacba70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 --2- 172.21.15.100:0/3627631160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 0x55e05babe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 -- 172.21.15.100:0/3627631160 >> 172.21.15.100:0/3627631160 conn(0x55e05babaa30 msgr2=0x55e05babae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 -- 172.21.15.100:0/3627631160 shutdown_connections 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.077+0000 7f1c89a70740 1 -- 172.21.15.100:0/3627631160 wait complete. 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 -- start start 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 Processor -- start 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bac8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05bac9680 0x55e05bac67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e05bacc2a0 con 0x55e05bac9680 2024-09-12T02:44:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c85433640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bac8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e05b9df050 con 0x55e05babedc0 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.078+0000 7f1c89a70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e05bacc420 con 0x55e05babe4a0 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85433640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bac8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37892/0 (socket says 172.21.15.100:37892) 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85433640 1 -- 172.21.15.100:0/1933785212 learned_addr learned my addr 172.21.15.100:0/1933785212 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85c34640 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05bac9680 0x55e05bac67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c89a70740 10 client.0 _ll_register_callbacks cb 0x55e05ba1f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85433640 1 -- 172.21.15.100:0/1933785212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 msgr2=0x55e05bac6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85433640 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85433640 1 -- 172.21.15.100:0/1933785212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05bac9680 msgr2=0x55e05bac67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85433640 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05bac9680 0x55e05bac67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85433640 1 -- 172.21.15.100:0/1933785212 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05b7953c0 con 0x55e05babe4a0 2024-09-12T02:44:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.079+0000 7f1c85c34640 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05bac9680 0x55e05bac67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.081+0000 7f1c85433640 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bac8fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0a3140 tx=0x7f1c7c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2003f8cd49f081 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.081+0000 7f1c68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.081+0000 7f1c68ff9640 1 -- 172.21.15.100:0/1933785212 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c09edb0 con 0x55e05babe4a0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.081+0000 7f1c68ff9640 1 -- 172.21.15.100:0/1933785212 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1c7c0145c0 con 0x55e05babe4a0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.081+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c70004040 con 0x55e05babe4a0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c68ff9640 1 -- 172.21.15.100:0/1933785212 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1c7c0a3670 con 0x55e05babe4a0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 10 client.25708 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e05bad7cf0 con 0x55e05babe4a0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c68ff9640 1 -- 172.21.15.100:0/1933785212 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c70004040 con 0x55e05babe4a0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c68ff9640 1 -- 172.21.15.100:0/1933785212 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1c7c0998c0 con 0x55e05babe4a0 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 10 client.25708 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 20 client.25708 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bad91b0 0x55e05badb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 4 client.25708 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.082+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e05ba31850 con 0x55e05bad91b0 2024-09-12T02:44:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.083+0000 7f1c84c32640 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bad91b0 0x55e05badb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.083+0000 7f1c84c32640 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bad91b0 0x55e05badb640 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=705f7c5fd840cf43 server_cookie=77a29ec34c41b1f9 in_seq=0 out_seq=0 2024-09-12T02:44:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.083+0000 7f1c68ff9640 10 client.25708 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.086+0000 7f1c68ff9640 1 -- 172.21.15.100:0/1933785212 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e05ba31850 con 0x55e05bad91b0 2024-09-12T02:44:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.086+0000 7f1c68ff9640 10 client.25708 handle_command_reply: tid=0 2024-09-12T02:44:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.086+0000 7f1c89a70740 1 client.25708 shutdown 2024-09-12T02:44:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.087+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 msgr2=0x55e05bac8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.087+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bac8fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0a3140 tx=0x7f1c7c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.088+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 shutdown_connections 2024-09-12T02:44:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.088+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bad91b0 0x55e05badb640 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.088+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05bac9680 0x55e05bac67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.088+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babedc0 0x55e05bac6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.088+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1933785212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bac8fc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.088+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 >> 172.21.15.100:0/1933785212 conn(0x55e05babaa30 msgr2=0x55e05bac0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:28.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.088+0000 7f1c68ff9640 0 client.25708 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.089+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 shutdown_connections 2024-09-12T02:44:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.090+0000 7f1c89a70740 1 -- 172.21.15.100:0/1933785212 wait complete. 2024-09-12T02:44:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.090+0000 7f1c89a70740 20 client.25708 trim_cache size 0 max 16384 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.118+0000 7f1c89a70740 1 Processor -- start 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c89a70740 1 -- start start 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bab9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bae0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babedc0 0x55e05bae1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bab9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c85c34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babedc0 0x55e05bae1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bab9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45172/0 (socket says 172.21.15.100:45172) 2024-09-12T02:44:28.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c89a70740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801beba0 con 0x55e05babedc0 2024-09-12T02:44:28.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c89a70740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801bc470 con 0x55e05babaa30 2024-09-12T02:44:28.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c89a70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801021d0 con 0x55e05babe4a0 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.119+0000 7f1c85433640 1 -- 172.21.15.100:0/1937963694 learned_addr learned my addr 172.21.15.100:0/1937963694 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.120+0000 7f1c85c34640 1 -- 172.21.15.100:0/1937963694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 msgr2=0x55e05bae0f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.120+0000 7f1c85c34640 1 --2- 172.21.15.100:0/1937963694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bae0f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.120+0000 7f1c85c34640 1 -- 172.21.15.100:0/1937963694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 msgr2=0x55e05bab9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.120+0000 7f1c85c34640 1 --2- 172.21.15.100:0/1937963694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bab9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.120+0000 7f1c85c34640 1 -- 172.21.15.100:0/1937963694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05bacc130 con 0x55e05babedc0 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.120+0000 7f1c85c34640 1 --2- 172.21.15.100:0/1937963694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babedc0 0x55e05bae1450 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1c78004a80 tx=0x7f1c78013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eed11d560a81ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.121+0000 7f1c6affd640 1 -- 172.21.15.100:0/1937963694 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78023070 con 0x55e05babedc0 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.121+0000 7f1c6affd640 1 -- 172.21.15.100:0/1937963694 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c78003dc0 con 0x55e05babedc0 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.121+0000 7f1c6affd640 1 -- 172.21.15.100:0/1937963694 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7801f7c0 con 0x55e05babedc0 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 -- 172.21.15.100:0/1937963694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babedc0 msgr2=0x55e05bae1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1937963694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babedc0 0x55e05bae1450 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1c78004a80 tx=0x7f1c78013000 comp rx=0 tx=0).stop 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 -- 172.21.15.100:0/1937963694 shutdown_connections 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1937963694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babedc0 0x55e05bae1450 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1937963694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babe4a0 0x55e05bae0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 --2- 172.21.15.100:0/1937963694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bab9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 -- 172.21.15.100:0/1937963694 >> 172.21.15.100:0/1937963694 conn(0x55e05bac6910 msgr2=0x55e05bab9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 -- 172.21.15.100:0/1937963694 shutdown_connections 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 -- 172.21.15.100:0/1937963694 wait complete. 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 -- start start 2024-09-12T02:44:28.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.122+0000 7f1c89a70740 1 Processor -- start 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.123+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bad1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.123+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bad1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.123+0000 7f1c89a70740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 0x55e05bacf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.123+0000 7f1c85433640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bad1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45182/0 (socket says 172.21.15.100:45182) 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.124+0000 7f1c85433640 1 -- 172.21.15.100:0/841658957 learned_addr learned my addr 172.21.15.100:0/841658957 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.124+0000 7f1c84c32640 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 0x55e05bacf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.124+0000 7f1c89a70740 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babedc0 0x55e05bacf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.124+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801a18b0 con 0x55e05babe4a0 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.124+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801bbda0 con 0x55e05babaa30 2024-09-12T02:44:28.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.124+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801a1f30 con 0x55e05babedc0 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.124+0000 7f1c85c34640 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babedc0 0x55e05bacf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.125+0000 7f1c89a70740 10 client.0 _ll_register_callbacks cb 0x7f1c7c09a540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.125+0000 7f1c85433640 1 -- 172.21.15.100:0/841658957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babedc0 msgr2=0x55e05bacf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.125+0000 7f1c85433640 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babedc0 0x55e05bacf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.125+0000 7f1c85433640 1 -- 172.21.15.100:0/841658957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 msgr2=0x55e05bacf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.125+0000 7f1c85433640 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 0x55e05bacf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.125+0000 7f1c85433640 1 -- 172.21.15.100:0/841658957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05bacfc50 con 0x55e05babaa30 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.125+0000 7f1c85433640 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bad1cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0a3830 tx=0x7f1c7c09ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b17ae5ddb1298dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.126+0000 7f1c68ff9640 10 client.25715 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.126+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c78003dc0 con 0x55e05babaa30 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.126+0000 7f1c68ff9640 1 -- 172.21.15.100:0/841658957 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c09edb0 con 0x55e05babaa30 2024-09-12T02:44:28.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.126+0000 7f1c68ff9640 1 -- 172.21.15.100:0/841658957 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1c7c07e1f0 con 0x55e05babaa30 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.126+0000 7f1c68ff9640 1 -- 172.21.15.100:0/841658957 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1c7c0b92b0 con 0x55e05babaa30 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.126+0000 7f1c89a70740 10 client.25715 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.126+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55e05bb43ca0 con 0x55e05babaa30 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c68ff9640 1 -- 172.21.15.100:0/841658957 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1c7c099e50 con 0x55e05babaa30 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c89a70740 10 client.25715 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c89a70740 10 client.25715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c89a70740 20 client.25715 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c89a70740 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bac9680 0x55e05bb46090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c89a70740 4 client.25715 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1c78003dc0 con 0x55e05bac9680 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c84c32640 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bac9680 0x55e05bb46090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c84c32640 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bac9680 0x55e05bb46090 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=236ef5b485cf0b52 server_cookie=857540f3142373ae in_seq=0 out_seq=0 2024-09-12T02:44:28.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.127+0000 7f1c68ff9640 10 client.25715 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c68ff9640 1 -- 172.21.15.100:0/841658957 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f1c78003dc0 con 0x55e05bac9680 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c68ff9640 10 client.25715 handle_command_reply: tid=0 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 client.25715 shutdown 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 msgr2=0x55e05bad1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bad1cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0a3830 tx=0x7f1c7c09ab80 comp rx=0 tx=0).stop 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 shutdown_connections 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e05bac9680 0x55e05bb46090 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05babedc0 0x55e05bacf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05babe4a0 0x55e05bacf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c68ff9640 0 client.25715 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 --2- 172.21.15.100:0/841658957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05babaa30 0x55e05bad1cd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 >> 172.21.15.100:0/841658957 conn(0x55e05bac6910 msgr2=0x55e05bab9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:28.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 shutdown_connections 2024-09-12T02:44:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 1 -- 172.21.15.100:0/841658957 wait complete. 2024-09-12T02:44:28.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.128+0000 7f1c89a70740 20 client.25715 trim_cache size 0 max 16384 2024-09-12T02:44:28.134 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:44:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:44:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:44:28.134 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:44:28.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1c6c0a2cd0 msgr2=0x7f1c6c0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1c6c0a2cd0 0x7f1c6c0a5190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009810 tx=0x7f1c78009780 comp rx=0 tx=0).stop 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 msgr2=0x7f1c80195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80195fd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00bfd0 tx=0x7f1c7c00ae10 comp rx=0 tx=0).stop 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 shutdown_connections 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1c6c0a2cd0 0x7f1c6c0a5190 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c80106a90 0x7f1c80196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c80101430 0x7f1c80196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 --2- 172.21.15.100:0/1697851296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c80100a90 0x7f1c80195fd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 >> 172.21.15.100:0/1697851296 conn(0x7f1c800fc7d0 msgr2=0x7f1c800fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 shutdown_connections 2024-09-12T02:44:28.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:28.129+0000 7f1c87697640 1 -- 172.21.15.100:0/1697851296 wait complete. 2024-09-12T02:44:28.970 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:28 smithi100 ceph-mon[31390]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 916 op/s 2024-09-12T02:44:29.004 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:44:29.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:44:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:28 smithi189 ceph-mon[35196]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 916 op/s 2024-09-12T02:44:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:28 smithi117 ceph-mon[34898]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 916 op/s 2024-09-12T02:44:29.371 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:29.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 -- 172.21.15.100:0/3998090672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102570 msgr2=0x7f050c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:29.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 --2- 172.21.15.100:0/3998090672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102570 0x7f050c1029b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0500009900 tx=0x7f050002a480 comp rx=0 tx=0).stop 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 -- 172.21.15.100:0/3998090672 shutdown_connections 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 --2- 172.21.15.100:0/3998090672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102ef0 0x7f050c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 --2- 172.21.15.100:0/3998090672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102570 0x7f050c1029b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 --2- 172.21.15.100:0/3998090672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c100e20 0x7f050c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 -- 172.21.15.100:0/3998090672 >> 172.21.15.100:0/3998090672 conn(0x7f050c0fc7d0 msgr2=0x7f050c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 -- 172.21.15.100:0/3998090672 shutdown_connections 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.868+0000 7f0512214640 1 -- 172.21.15.100:0/3998090672 wait complete. 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.869+0000 7f0512214640 1 Processor -- start 2024-09-12T02:44:29.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.869+0000 7f0512214640 1 -- start start 2024-09-12T02:44:29.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f0512214640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c100e20 0x7f050c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:29.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f0512214640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102570 0x7f050c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:29.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f0512214640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102ef0 0x7f050c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:29.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f0512214640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f050c110fd0 con 0x7f050c102ef0 2024-09-12T02:44:29.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f0512214640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f050c110e50 con 0x7f050c102570 2024-09-12T02:44:29.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f0512214640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f050c111150 con 0x7f050c100e20 2024-09-12T02:44:29.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102570 0x7f050c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102ef0 0x7f050c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c100e20 0x7f050c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102ef0 0x7f050c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53826/0 (socket says 172.21.15.100:53826) 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050bfff640 1 -- 172.21.15.100:0/2918635625 learned_addr learned my addr 172.21.15.100:0/2918635625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050affd640 1 -- 172.21.15.100:0/2918635625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c100e20 msgr2=0x7f050c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050affd640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c100e20 0x7f050c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050affd640 1 -- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102ef0 msgr2=0x7f050c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050affd640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102ef0 0x7f050c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050affd640 1 -- 172.21.15.100:0/2918635625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c19d560 con 0x7f050c102570 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.870+0000 7f050affd640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102570 0x7f050c198af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f050002aa70 tx=0x7f0500003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.871+0000 7f0508ff9640 1 -- 172.21.15.100:0/2918635625 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050003f070 con 0x7f050c102570 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.871+0000 7f0508ff9640 1 -- 172.21.15.100:0/2918635625 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0500031c20 con 0x7f050c102570 2024-09-12T02:44:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.871+0000 7f0508ff9640 1 -- 172.21.15.100:0/2918635625 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500035030 con 0x7f050c102570 2024-09-12T02:44:29.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.871+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c19d7f0 con 0x7f050c102570 2024-09-12T02:44:29.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.871+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c19db90 con 0x7f050c102570 2024-09-12T02:44:29.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.873+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c101200 con 0x7f050c102570 2024-09-12T02:44:29.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.875+0000 7f0508ff9640 1 -- 172.21.15.100:0/2918635625 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f0500042070 con 0x7f050c102570 2024-09-12T02:44:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.876+0000 7f0508ff9640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f40a2c40 0x7f04f40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.876+0000 7f0508ff9640 1 -- 172.21.15.100:0/2918635625 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f05000ef920 con 0x7f050c102570 2024-09-12T02:44:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.876+0000 7f050b7fe640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f40a2c40 0x7f04f40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:29.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.876+0000 7f050b7fe640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f40a2c40 0x7f04f40a5100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009bd0 tx=0x7f04fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:29.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:29.881+0000 7f0508ff9640 1 -- 172.21.15.100:0/2918635625 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05000bc220 con 0x7f050c102570 2024-09-12T02:44:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.185+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f050c199910 con 0x7f050c102570 2024-09-12T02:44:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.189+0000 7f0508ff9640 1 -- 172.21.15.100:0/2918635625 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f05000c0520 con 0x7f050c102570 2024-09-12T02:44:30.191 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:44:30.191 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:44:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:44:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.192+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f40a2c40 msgr2=0x7f04f40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.192+0000 7f0512214640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f40a2c40 0x7f04f40a5100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009bd0 tx=0x7f04fc005f90 comp rx=0 tx=0).stop 2024-09-12T02:44:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.192+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102570 msgr2=0x7f050c198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.192+0000 7f0512214640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102570 0x7f050c198af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f050002aa70 tx=0x7f0500003b90 comp rx=0 tx=0).stop 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 shutdown_connections 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f40a2c40 0x7f04f40a5100 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c102ef0 0x7f050c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102570 0x7f050c198af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 --2- 172.21.15.100:0/2918635625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c100e20 0x7f050c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 >> 172.21.15.100:0/2918635625 conn(0x7f050c0fc7d0 msgr2=0x7f050c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 shutdown_connections 2024-09-12T02:44:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:30.193+0000 7f0512214640 1 -- 172.21.15.100:0/2918635625 wait complete. 2024-09-12T02:44:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:30 smithi100 ceph-mon[31390]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 825 op/s 2024-09-12T02:44:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:30 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2918635625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:30.958 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:44:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:30 smithi189 ceph-mon[35196]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 825 op/s 2024-09-12T02:44:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:30 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2918635625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:30 smithi117 ceph-mon[34898]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 825 op/s 2024-09-12T02:44:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:30 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2918635625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 320.0 s, 3824.6 tps, lat 26.203 ms stddev 28.339 2024-09-12T02:44:31.324 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:31.806 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.1 2024-09-12T02:44:31.806 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:44:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.829+0000 7f1566ffe640 1 -- 172.21.15.100:0/438288986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1560100e20 msgr2=0x7f1560101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.829+0000 7f1566ffe640 1 --2- 172.21.15.100:0/438288986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1560100e20 0x7f1560101200 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1554009860 tx=0x7f155402a3d0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.829+0000 7f1566ffe640 1 -- 172.21.15.100:0/438288986 shutdown_connections 2024-09-12T02:44:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.829+0000 7f1566ffe640 1 --2- 172.21.15.100:0/438288986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1560102ef0 0x7f156010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.829+0000 7f1566ffe640 1 --2- 172.21.15.100:0/438288986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560102570 0x7f15601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.829+0000 7f1566ffe640 1 --2- 172.21.15.100:0/438288986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1560100e20 0x7f1560101200 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.829+0000 7f1566ffe640 1 -- 172.21.15.100:0/438288986 >> 172.21.15.100:0/438288986 conn(0x7f15600fc7d0 msgr2=0x7f15600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.830+0000 7f1566ffe640 1 -- 172.21.15.100:0/438288986 shutdown_connections 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.830+0000 7f1566ffe640 1 -- 172.21.15.100:0/438288986 wait complete. 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.830+0000 7f1566ffe640 1 Processor -- start 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.830+0000 7f1566ffe640 1 -- start start 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.830+0000 7f1566ffe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560100e20 0x7f1560197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1566ffe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1560102570 0x7f1560197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1566ffe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1560102ef0 0x7f156019c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1566ffe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1560110f80 con 0x7f1560102ef0 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1566ffe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1560110e00 con 0x7f1560102570 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1566ffe640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1560111100 con 0x7f1560100e20 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560100e20 0x7f1560197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560100e20 0x7f1560197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37968/0 (socket says 172.21.15.100:37968) 2024-09-12T02:44:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 -- 172.21.15.100:0/4133930045 learned_addr learned my addr 172.21.15.100:0/4133930045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 -- 172.21.15.100:0/4133930045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1560102570 msgr2=0x7f1560197640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1560102570 0x7f1560197640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 -- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1560102ef0 msgr2=0x7f156019c150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1560102ef0 0x7f156019c150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.831+0000 7f1564d9a640 1 -- 172.21.15.100:0/4133930045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156019c690 con 0x7f1560100e20 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.832+0000 7f1564d9a640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560100e20 0x7f1560197100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f155402a8f0 tx=0x7f15540306c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.832+0000 7f155dffb640 1 -- 172.21.15.100:0/4133930045 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1554040020 con 0x7f1560100e20 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.832+0000 7f155dffb640 1 -- 172.21.15.100:0/4133930045 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1554004460 con 0x7f1560100e20 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.832+0000 7f155dffb640 1 -- 172.21.15.100:0/4133930045 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15540046c0 con 0x7f1560100e20 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.832+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156019c920 con 0x7f1560100e20 2024-09-12T02:44:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.832+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f156019cdb0 con 0x7f1560100e20 2024-09-12T02:44:31.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.836+0000 7f155dffb640 1 -- 172.21.15.100:0/4133930045 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1554043020 con 0x7f1560100e20 2024-09-12T02:44:31.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.838+0000 7f15693d7740 1 Processor -- start 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.838+0000 7f15693d7740 1 -- start start 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.839+0000 7f15693d7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8eb40 0x55f30cb8d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.839+0000 7f15693d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8d5d0 0x55f30cb8da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.839+0000 7f15693d7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb98370 0x55f30cb9a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.839+0000 7f15693d7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f30caf32f0 con 0x55f30cb8eb40 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.839+0000 7f15693d7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f30ca9acf0 con 0x55f30cb98370 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.839+0000 7f15693d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f30caef2b0 con 0x55f30cb8d5d0 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.840+0000 7f155dffb640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15500a2c80 0x7f15500a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.840+0000 7f155dffb640 1 -- 172.21.15.100:0/4133930045 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f15540f0010 con 0x7f1560100e20 2024-09-12T02:44:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.843+0000 7f156559b640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15500a2c80 0x7f15500a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.843+0000 7f156559b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8eb40 0x55f30cb8d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.843+0000 7f156559b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8eb40 0x55f30cb8d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53848/0 (socket says 172.21.15.100:53848) 2024-09-12T02:44:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.843+0000 7f156559b640 1 -- 172.21.15.100:0/409927615 learned_addr learned my addr 172.21.15.100:0/409927615 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:31.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.843+0000 7f155ffff640 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb98370 0x55f30cb9a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.843+0000 7f1564d9a640 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8d5d0 0x55f30cb8da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.844+0000 7f155ffff640 1 -- 172.21.15.100:0/409927615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8d5d0 msgr2=0x55f30cb8da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.844+0000 7f155ffff640 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8d5d0 0x55f30cb8da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.844+0000 7f155ffff640 1 -- 172.21.15.100:0/409927615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8eb40 msgr2=0x55f30cb8d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.844+0000 7f155ffff640 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8eb40 0x55f30cb8d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.844+0000 7f155ffff640 1 -- 172.21.15.100:0/409927615 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30ca7f3a0 con 0x55f30cb98370 2024-09-12T02:44:31.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.847+0000 7f155ffff640 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb98370 0x55f30cb9a760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f154c009aa0 tx=0x7f154c009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a0edba862b3770f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:31.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.848+0000 7f156559b640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15500a2c80 0x7f15500a5140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1558009fd0 tx=0x7f1558009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:31.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.848+0000 7f154affd640 1 -- 172.21.15.100:0/409927615 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c00ece0 con 0x55f30cb98370 2024-09-12T02:44:31.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.848+0000 7f154affd640 1 -- 172.21.15.100:0/409927615 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f154c00ee80 con 0x55f30cb98370 2024-09-12T02:44:31.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.848+0000 7f154affd640 1 -- 172.21.15.100:0/409927615 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c004ad0 con 0x55f30cb98370 2024-09-12T02:44:31.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.850+0000 7f15693d7740 1 -- 172.21.15.100:0/409927615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb98370 msgr2=0x55f30cb9a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.850+0000 7f15693d7740 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb98370 0x55f30cb9a760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f154c009aa0 tx=0x7f154c009f60 comp rx=0 tx=0).stop 2024-09-12T02:44:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.854+0000 7f15693d7740 1 -- 172.21.15.100:0/409927615 shutdown_connections 2024-09-12T02:44:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.854+0000 7f15693d7740 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb98370 0x55f30cb9a760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.854+0000 7f15693d7740 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8d5d0 0x55f30cb8da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.854+0000 7f15693d7740 1 --2- 172.21.15.100:0/409927615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8eb40 0x55f30cb8d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.854+0000 7f15693d7740 1 -- 172.21.15.100:0/409927615 >> 172.21.15.100:0/409927615 conn(0x55f30cb56310 msgr2=0x55f30cb89c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:31.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.862+0000 7f15693d7740 1 -- 172.21.15.100:0/409927615 shutdown_connections 2024-09-12T02:44:31.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.864+0000 7f15693d7740 1 -- 172.21.15.100:0/409927615 wait complete. 2024-09-12T02:44:31.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.864+0000 7f15693d7740 1 -- start start 2024-09-12T02:44:31.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.864+0000 7f15693d7740 1 Processor -- start 2024-09-12T02:44:31.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.865+0000 7f15693d7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb97dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.865+0000 7f15693d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb95070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.865+0000 7f15693d7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cb95800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.865+0000 7f15693d7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f30cbac080 con 0x55f30cb98370 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.865+0000 7f15693d7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f30caae060 con 0x55f30cb8d5d0 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.865+0000 7f15693d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f30cbac200 con 0x55f30cb8eb40 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.865+0000 7f15693d7740 10 client.0 _ll_register_callbacks cb 0x55f30c8018c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.866+0000 7f155ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb95070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.866+0000 7f155ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb95070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37976/0 (socket says 172.21.15.100:37976) 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.866+0000 7f155ffff640 1 -- 172.21.15.100:0/161242969 learned_addr learned my addr 172.21.15.100:0/161242969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.867+0000 7f1564d9a640 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb97dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.867+0000 7f156559b640 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cb95800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.867+0000 7f155ffff640 1 -- 172.21.15.100:0/161242969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 msgr2=0x55f30cb97dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.867+0000 7f155ffff640 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb97dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.868+0000 7f155ffff640 1 -- 172.21.15.100:0/161242969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 msgr2=0x55f30cb95800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.868+0000 7f155ffff640 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cb95800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.868+0000 7f155ffff640 1 -- 172.21.15.100:0/161242969 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30c8643c0 con 0x55f30cb8eb40 2024-09-12T02:44:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.869+0000 7f153ffff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:44:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.869+0000 7f155ffff640 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb95070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f154c005630 tx=0x7f154c005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f594f658372e9c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:31.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.871+0000 7f153ffff640 1 -- 172.21.15.100:0/161242969 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c004c20 con 0x55f30cb8eb40 2024-09-12T02:44:31.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.871+0000 7f153ffff640 1 -- 172.21.15.100:0/161242969 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f154c004dc0 con 0x55f30cb8eb40 2024-09-12T02:44:31.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.871+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f30cb00860 con 0x55f30cb8eb40 2024-09-12T02:44:31.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f153ffff640 1 -- 172.21.15.100:0/161242969 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f154c0053d0 con 0x55f30cb8eb40 2024-09-12T02:44:31.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 10 client.25729 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:31.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f30cbc8b90 con 0x55f30cb8eb40 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f153ffff640 1 -- 172.21.15.100:0/161242969 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f30cb00860 con 0x55f30cb8eb40 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f153ffff640 1 -- 172.21.15.100:0/161242969 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f154c0186b0 con 0x55f30cb8eb40 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 10 client.25729 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 10 client.25729 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 20 client.25729 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cbc9ee0 0x55f30cbcc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 4 client.25729 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.872+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f30cafad70 con 0x55f30cbc9ee0 2024-09-12T02:44:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.873+0000 7f1564d9a640 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cbc9ee0 0x55f30cbcc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.873+0000 7f1564d9a640 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cbc9ee0 0x55f30cbcc2d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2db682221b59b604 server_cookie=7c881ef6a7332062 in_seq=0 out_seq=0 2024-09-12T02:44:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.873+0000 7f153ffff640 10 client.25729 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:44:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.875+0000 7f153ffff640 1 -- 172.21.15.100:0/161242969 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f30cafad70 con 0x55f30cbc9ee0 2024-09-12T02:44:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.875+0000 7f153ffff640 10 client.25729 handle_command_reply: tid=0 2024-09-12T02:44:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.875+0000 7f15693d7740 1 client.25729 shutdown 2024-09-12T02:44:31.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.876+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 msgr2=0x55f30cb95070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:31.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.876+0000 7f15693d7740 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb95070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f154c005630 tx=0x7f154c005230 comp rx=0 tx=0).stop 2024-09-12T02:44:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 shutdown_connections 2024-09-12T02:44:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f15693d7740 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cbc9ee0 0x55f30cbcc2d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f15693d7740 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cb95800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f15693d7740 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb95070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f15693d7740 1 --2- 172.21.15.100:0/161242969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb97dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 >> 172.21.15.100:0/161242969 conn(0x55f30cb56310 msgr2=0x55f30cb8f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f153ffff640 0 client.25729 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:44:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.877+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 shutdown_connections 2024-09-12T02:44:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.878+0000 7f15693d7740 1 -- 172.21.15.100:0/161242969 wait complete. 2024-09-12T02:44:31.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.878+0000 7f15693d7740 20 client.25729 trim_cache size 0 max 16384 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.899+0000 7f15693d7740 1 Processor -- start 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.899+0000 7f15693d7740 1 -- start start 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f15693d7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb90120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f15693d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb90660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f15693d7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cbd19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f15693d7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f156019f5b0 con 0x55f30cb98370 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f15693d7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15600741c0 con 0x55f30cb8d5d0 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f15693d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1560071fd0 con 0x55f30cb8eb40 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cbd19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f155ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb90660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f1564d9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cbd19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53864/0 (socket says 172.21.15.100:53864) 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 -- 172.21.15.100:0/1546316156 learned_addr learned my addr 172.21.15.100:0/1546316156 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 -- 172.21.15.100:0/1546316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 msgr2=0x55f30cb90660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb90660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 -- 172.21.15.100:0/1546316156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 msgr2=0x55f30cb90120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb90120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 -- 172.21.15.100:0/1546316156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30cb8add0 con 0x55f30cb98370 2024-09-12T02:44:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f1564d9a640 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb90120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.900+0000 7f156559b640 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cbd19c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1558003a20 tx=0x7f15580095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c69394d2ee5eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.901+0000 7f154a7fc640 1 -- 172.21.15.100:0/1546316156 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1558004b20 con 0x55f30cb98370 2024-09-12T02:44:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.901+0000 7f154a7fc640 1 -- 172.21.15.100:0/1546316156 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1558004cc0 con 0x55f30cb98370 2024-09-12T02:44:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.901+0000 7f154a7fc640 1 -- 172.21.15.100:0/1546316156 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1558005580 con 0x55f30cb98370 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.902+0000 7f15693d7740 1 -- 172.21.15.100:0/1546316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 msgr2=0x55f30cbd19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.902+0000 7f15693d7740 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cbd19c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1558003a20 tx=0x7f15580095c0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.902+0000 7f15693d7740 1 -- 172.21.15.100:0/1546316156 shutdown_connections 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.902+0000 7f15693d7740 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb98370 0x55f30cbd19c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.902+0000 7f15693d7740 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb8eb40 0x55f30cb90660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.902+0000 7f15693d7740 1 --2- 172.21.15.100:0/1546316156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8d5d0 0x55f30cb90120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.902+0000 7f15693d7740 1 -- 172.21.15.100:0/1546316156 >> 172.21.15.100:0/1546316156 conn(0x55f30cb56310 msgr2=0x55f30cb94e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:31.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.903+0000 7f15693d7740 1 -- 172.21.15.100:0/1546316156 shutdown_connections 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.903+0000 7f15693d7740 1 -- 172.21.15.100:0/1546316156 wait complete. 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.904+0000 7f15693d7740 1 -- start start 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.904+0000 7f15693d7740 1 Processor -- start 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f15693d7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8d5d0 0x55f30cb920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f15693d7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8eb40 0x55f30cb925e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f15693d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb98370 0x55f30cb92b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f1564d9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8d5d0 0x55f30cb920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f1564d9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8d5d0 0x55f30cb920a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53878/0 (socket says 172.21.15.100:53878) 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f155ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8eb40 0x55f30cb925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f1564d9a640 1 -- 172.21.15.100:0/959702019 learned_addr learned my addr 172.21.15.100:0/959702019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1560072680 con 0x55f30cb8d5d0 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1560073af0 con 0x55f30cb8eb40 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1560072d50 con 0x55f30cb98370 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f15693d7740 10 client.0 _ll_register_callbacks cb 0x7f154c0099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f1564d9a640 1 -- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb98370 msgr2=0x55f30cb92b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f156559b640 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb98370 0x55f30cb92b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f1564d9a640 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb98370 0x55f30cb92b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.905+0000 7f1564d9a640 1 -- 172.21.15.100:0/959702019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8eb40 msgr2=0x55f30cb925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f1564d9a640 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8eb40 0x55f30cb925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f1564d9a640 1 -- 172.21.15.100:0/959702019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30cc33990 con 0x55f30cb8d5d0 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f155ffff640 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8eb40 0x55f30cb925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f1564d9a640 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8d5d0 0x55f30cb920a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f15540b8c60 tx=0x7f1554031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52bfc6f60e7d45a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f153ffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f153ffff640 1 -- 172.21.15.100:0/959702019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1554031bb0 con 0x55f30cb8d5d0 2024-09-12T02:44:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f153ffff640 1 -- 172.21.15.100:0/959702019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f15540edbb0 con 0x55f30cb8d5d0 2024-09-12T02:44:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1558004cc0 con 0x55f30cb8d5d0 2024-09-12T02:44:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f153ffff640 1 -- 172.21.15.100:0/959702019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f15540b8e70 con 0x55f30cb8d5d0 2024-09-12T02:44:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f15693d7740 10 client.16344 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.906+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f30cc34c10 con 0x55f30cb8d5d0 2024-09-12T02:44:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f153ffff640 1 -- 172.21.15.100:0/959702019 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1558004cc0 con 0x55f30cb8d5d0 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f153ffff640 1 -- 172.21.15.100:0/959702019 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f15540c4fe0 con 0x55f30cb8d5d0 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f15693d7740 10 client.16344 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f15693d7740 10 client.16344 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f15693d7740 20 client.16344 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f15693d7740 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cc35220 0x55f30cc37640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f15693d7740 4 client.16344 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f30ca77170 con 0x55f30cc35220 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.907+0000 7f155ffff640 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cc35220 0x55f30cc37640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f153ffff640 10 client.16344 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f155ffff640 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cc35220 0x55f30cc37640 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3940078250956ac server_cookie=96a52d7b12077c9f in_seq=0 out_seq=0 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f153ffff640 1 -- 172.21.15.100:0/959702019 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f30ca77170 con 0x55f30cc35220 2024-09-12T02:44:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f153ffff640 10 client.16344 handle_command_reply: tid=0 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 client.16344 shutdown 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8d5d0 msgr2=0x55f30cb920a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8d5d0 0x55f30cb920a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f15540b8c60 tx=0x7f1554031650 comp rx=0 tx=0).stop 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 shutdown_connections 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f30cc35220 0x55f30cc37640 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f153ffff640 0 client.16344 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f30cb98370 0x55f30cb92b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f30cb8eb40 0x55f30cb925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 --2- 172.21.15.100:0/959702019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f30cb8d5d0 0x55f30cb920a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.908+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 >> 172.21.15.100:0/959702019 conn(0x55f30cb56310 msgr2=0x55f30cb968d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.909+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 shutdown_connections 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.909+0000 7f15693d7740 1 -- 172.21.15.100:0/959702019 wait complete. 2024-09-12T02:44:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.909+0000 7f15693d7740 20 client.16344 trim_cache size 0 max 16384 2024-09-12T02:44:31.914 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:44:31.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.909+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15500a2c80 msgr2=0x7f15500a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.909+0000 7f1566ffe640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15500a2c80 0x7f15500a5140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1558009fd0 tx=0x7f1558009280 comp rx=0 tx=0).stop 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.909+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560100e20 msgr2=0x7f1560197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.909+0000 7f1566ffe640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560100e20 0x7f1560197100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f155402a8f0 tx=0x7f15540306c0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 shutdown_connections 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15500a2c80 0x7f15500a5140 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1560102ef0 0x7f156019c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1560102570 0x7f1560197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 --2- 172.21.15.100:0/4133930045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1560100e20 0x7f1560197100 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 >> 172.21.15.100:0/4133930045 conn(0x7f15600fc7d0 msgr2=0x7f15600fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 shutdown_connections 2024-09-12T02:44:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:31.910+0000 7f1566ffe640 1 -- 172.21.15.100:0/4133930045 wait complete. 2024-09-12T02:44:32.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:44:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:32 smithi189 ceph-mon[35196]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-12T02:44:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:32 smithi117 ceph-mon[34898]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-12T02:44:33.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:32 smithi100 ceph-mon[31390]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-12T02:44:33.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.439+0000 7f7c0c233640 1 -- 172.21.15.100:0/1116351726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c0410e4e0 msgr2=0x7f7c041108d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:33.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.439+0000 7f7c0c233640 1 --2- 172.21.15.100:0/1116351726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c0410e4e0 0x7f7c041108d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009ca0 tx=0x7f7bfc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.439+0000 7f7c0c233640 1 -- 172.21.15.100:0/1116351726 shutdown_connections 2024-09-12T02:44:33.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.439+0000 7f7c0c233640 1 --2- 172.21.15.100:0/1116351726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c0410e4e0 0x7f7c041108d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.439+0000 7f7c0c233640 1 --2- 172.21.15.100:0/1116351726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c041012e0 0x7f7c0410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.439+0000 7f7c0c233640 1 --2- 172.21.15.100:0/1116351726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c04100930 0x7f7c04100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.439+0000 7f7c0c233640 1 -- 172.21.15.100:0/1116351726 >> 172.21.15.100:0/1116351726 conn(0x7f7c040fc7a0 msgr2=0x7f7c040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.440+0000 7f7c0c233640 1 -- 172.21.15.100:0/1116351726 shutdown_connections 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.440+0000 7f7c0c233640 1 -- 172.21.15.100:0/1116351726 wait complete. 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.440+0000 7f7c0c233640 1 Processor -- start 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.440+0000 7f7c0c233640 1 -- start start 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c0c233640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04100930 0x7f7c0419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c0c233640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c041012e0 0x7f7c0419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c0c233640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c0410e4e0 0x7f7c0419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:33.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c0c233640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c041141b0 con 0x7f7c04100930 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c0c233640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c04114030 con 0x7f7c0410e4e0 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c0c233640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c04114330 con 0x7f7c041012e0 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04100930 0x7f7c0419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04100930 0x7f7c0419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53892/0 (socket says 172.21.15.100:53892) 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c097ce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c041012e0 0x7f7c0419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 -- 172.21.15.100:0/109861475 learned_addr learned my addr 172.21.15.100:0/109861475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c0a7d0640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c0410e4e0 0x7f7c0419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 -- 172.21.15.100:0/109861475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c041012e0 msgr2=0x7f7c0419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c041012e0 0x7f7c0419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 -- 172.21.15.100:0/109861475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c0410e4e0 msgr2=0x7f7c0419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c0410e4e0 0x7f7c0419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 -- 172.21.15.100:0/109861475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0419f600 con 0x7f7c04100930 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c097ce640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c041012e0 0x7f7c0419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.441+0000 7f7c09fcf640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04100930 0x7f7c0419a650 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000e9f0 tx=0x7f7c0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.442+0000 7f7bfaffd640 1 -- 172.21.15.100:0/109861475 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000ccc0 con 0x7f7c04100930 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.442+0000 7f7bfaffd640 1 -- 172.21.15.100:0/109861475 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c00010910 con 0x7f7c04100930 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.442+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0419f8f0 con 0x7f7c04100930 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.442+0000 7f7bfaffd640 1 -- 172.21.15.100:0/109861475 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c000188a0 con 0x7f7c04100930 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.442+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c041a71d0 con 0x7f7c04100930 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.443+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c04100d10 con 0x7f7c04100930 2024-09-12T02:44:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.444+0000 7f7bfaffd640 1 -- 172.21.15.100:0/109861475 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7c00010ac0 con 0x7f7c04100930 2024-09-12T02:44:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.445+0000 7f7bfaffd640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.445+0000 7f7c097ce640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.445+0000 7f7bfaffd640 1 -- 172.21.15.100:0/109861475 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7c0009a170 con 0x7f7c04100930 2024-09-12T02:44:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.446+0000 7f7c097ce640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c0410ed70 tx=0x7f7bf4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.449+0000 7f7bfaffd640 1 -- 172.21.15.100:0/109861475 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c0009c7d0 con 0x7f7c04100930 2024-09-12T02:44:33.600 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.796+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c0419b9b0 con 0x7f7c04100930 2024-09-12T02:44:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.797+0000 7f7bfaffd640 1 -- 172.21.15.100:0/109861475 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f7c0419b9b0 con 0x7f7c04100930 2024-09-12T02:44:33.799 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:44:33.799 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:44:33.799 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bf00a2c00 msgr2=0x7f7bf00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c0410ed70 tx=0x7f7bf4009110 comp rx=0 tx=0).stop 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04100930 msgr2=0x7f7c0419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04100930 0x7f7c0419a650 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000e9f0 tx=0x7f7c0000edf0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 shutdown_connections 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7bf00a2c00 0x7f7bf00a50c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c0410e4e0 0x7f7c0419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c041012e0 0x7f7c0419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 --2- 172.21.15.100:0/109861475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04100930 0x7f7c0419a650 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.800+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 >> 172.21.15.100:0/109861475 conn(0x7f7c040fc7a0 msgr2=0x7f7c040feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.801+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 shutdown_connections 2024-09-12T02:44:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:33.801+0000 7f7c0c233640 1 -- 172.21.15.100:0/109861475 wait complete. 2024-09-12T02:44:34.621 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 140.1 --await-for 45.0' 2024-09-12T02:44:34.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 140.1 --await-for 45.0 2024-09-12T02:44:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 -- 172.21.15.100:0/642561791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48100e20 msgr2=0x7fbb48101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 --2- 172.21.15.100:0/642561791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48100e20 0x7fbb48101200 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009ca0 tx=0x7fbb4002a960 comp rx=0 tx=0).stop 2024-09-12T02:44:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 -- 172.21.15.100:0/642561791 shutdown_connections 2024-09-12T02:44:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 --2- 172.21.15.100:0/642561791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb48102ef0 0x7fbb4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 --2- 172.21.15.100:0/642561791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48102570 0x7fbb481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 --2- 172.21.15.100:0/642561791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48100e20 0x7fbb48101200 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 -- 172.21.15.100:0/642561791 >> 172.21.15.100:0/642561791 conn(0x7fbb480fc7d0 msgr2=0x7fbb480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:34.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.848+0000 7fbb4e446640 1 -- 172.21.15.100:0/642561791 shutdown_connections 2024-09-12T02:44:34.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.849+0000 7fbb4e446640 1 -- 172.21.15.100:0/642561791 wait complete. 2024-09-12T02:44:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.849+0000 7fbb4e446640 1 Processor -- start 2024-09-12T02:44:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4e446640 1 -- start start 2024-09-12T02:44:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4e446640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48100e20 0x7fbb481a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4e446640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48102570 0x7fbb481a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4e446640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb48102ef0 0x7fbb4810ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4e446640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4806a9c0 con 0x7fbb48102570 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4e446640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4806a840 con 0x7fbb48102ef0 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4e446640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4806ab40 con 0x7fbb48100e20 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48100e20 0x7fbb481a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48100e20 0x7fbb481a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:42998/0 (socket says 172.21.15.100:42998) 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb47fff640 1 -- 172.21.15.100:0/3452213018 learned_addr learned my addr 172.21.15.100:0/3452213018 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb48102ef0 0x7fbb4810ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.850+0000 7fbb477fe640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48102570 0x7fbb481a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb47fff640 1 -- 172.21.15.100:0/3452213018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb48102ef0 msgr2=0x7fbb4810ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb47fff640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb48102ef0 0x7fbb4810ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb47fff640 1 -- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48102570 msgr2=0x7fbb481a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb47fff640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48102570 0x7fbb481a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb47fff640 1 -- 172.21.15.100:0/3452213018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4810d570 con 0x7fbb48100e20 2024-09-12T02:44:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb47fff640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48100e20 0x7fbb481a05a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb400098d0 tx=0x7fbb4002fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:34.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb457fa640 1 -- 172.21.15.100:0/3452213018 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40034070 con 0x7fbb48100e20 2024-09-12T02:44:34.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.851+0000 7fbb457fa640 1 -- 172.21.15.100:0/3452213018 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb40030d40 con 0x7fbb48100e20 2024-09-12T02:44:34.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.852+0000 7fbb457fa640 1 -- 172.21.15.100:0/3452213018 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb400436a0 con 0x7fbb48100e20 2024-09-12T02:44:34.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.852+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4810d800 con 0x7fbb48100e20 2024-09-12T02:44:34.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.853+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb481a7350 con 0x7fbb48100e20 2024-09-12T02:44:34.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.857+0000 7fbb457fa640 1 -- 172.21.15.100:0/3452213018 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fbb40037020 con 0x7fbb48100e20 2024-09-12T02:44:34.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 Processor -- start 2024-09-12T02:44:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 -- start start 2024-09-12T02:44:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b661e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b661ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b662b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5643b65842f0 con 0x5643b661e5d0 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5643b652bcf0 con 0x5643b661fb40 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb5081f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5643b65802b0 con 0x5643b6629370 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b662b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb4c9e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b661e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b662b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43006/0 (socket says 172.21.15.100:43006) 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb477fe640 1 -- 172.21.15.100:0/3045493682 learned_addr learned my addr 172.21.15.100:0/3045493682 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.858+0000 7fbb47fff640 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b661ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb4c9e3640 1 -- 172.21.15.100:0/3045493682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 msgr2=0x5643b662b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b662b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb4c9e3640 1 -- 172.21.15.100:0/3045493682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 msgr2=0x5643b661ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b661ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb4c9e3640 1 -- 172.21.15.100:0/3045493682 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b65103a0 con 0x5643b661fb40 2024-09-12T02:44:34.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb47fff640 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b661ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:34.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb457fa640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbb2c0a2b20 0x7fbb2c0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b661e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009900 tx=0x7fbb38009dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cc74bc0cd6007f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:34.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.859+0000 7fbb47fff640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbb2c0a2b20 0x7fbb2c0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.860+0000 7fbb3e7fc640 1 -- 172.21.15.100:0/3045493682 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38017070 con 0x5643b661fb40 2024-09-12T02:44:34.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.860+0000 7fbb3e7fc640 1 -- 172.21.15.100:0/3045493682 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb38013470 con 0x5643b661fb40 2024-09-12T02:44:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.860+0000 7fbb457fa640 1 -- 172.21.15.100:0/3452213018 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbb400efa30 con 0x7fbb48100e20 2024-09-12T02:44:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb3e7fc640 1 -- 172.21.15.100:0/3045493682 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38012630 con 0x5643b661fb40 2024-09-12T02:44:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb47fff640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbb2c0a2b20 0x7fbb2c0a4fe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbb400ed890 tx=0x7fbb400f3240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb5081f740 1 -- 172.21.15.100:0/3045493682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 msgr2=0x5643b661e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b661e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009900 tx=0x7fbb38009dc0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb5081f740 1 -- 172.21.15.100:0/3045493682 shutdown_connections 2024-09-12T02:44:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b662b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b661ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3045493682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b661e090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.861+0000 7fbb5081f740 1 -- 172.21.15.100:0/3045493682 >> 172.21.15.100:0/3045493682 conn(0x5643b65e7310 msgr2=0x5643b661ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.862+0000 7fbb5081f740 1 -- 172.21.15.100:0/3045493682 shutdown_connections 2024-09-12T02:44:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.862+0000 7fbb5081f740 1 -- 172.21.15.100:0/3045493682 wait complete. 2024-09-12T02:44:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.862+0000 7fbb5081f740 1 -- start start 2024-09-12T02:44:34.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 1 Processor -- start 2024-09-12T02:44:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6628c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b661fb40 0x5643b6625f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b6629370 0x5643b6626460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5643b662c0c0 con 0x5643b661e5d0 2024-09-12T02:44:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5643b653f060 con 0x5643b6629370 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5643b662c240 con 0x5643b661fb40 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.864+0000 7fbb5081f740 10 client.0 _ll_register_callbacks cb 0x5643b62928c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b661fb40 0x5643b6625f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb4c9e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6628c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b661fb40 0x5643b6625f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43010/0 (socket says 172.21.15.100:43010) 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 -- 172.21.15.100:0/3213641059 learned_addr learned my addr 172.21.15.100:0/3213641059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b6629370 0x5643b6626460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 -- 172.21.15.100:0/3213641059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b6629370 msgr2=0x5643b6626460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b6629370 0x5643b6626460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 -- 172.21.15.100:0/3213641059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 msgr2=0x5643b6628c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6628c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 -- 172.21.15.100:0/3213641059 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b62f53c0 con 0x5643b661fb40 2024-09-12T02:44:34.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb477fe640 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b661fb40 0x5643b6625f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb340104d0 tx=0x7fbb34010990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428f0e6671b9a65a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.865+0000 7fbb2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.866+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/3213641059 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34018070 con 0x5643b661fb40 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.866+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb38013470 con 0x5643b661fb40 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.866+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/3213641059 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbb34014640 con 0x5643b661fb40 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.866+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/3213641059 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb34024050 con 0x5643b661fb40 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.866+0000 7fbb5081f740 10 client.25747 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.866+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5643b6637c00 con 0x5643b661fb40 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/3213641059 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb38013470 con 0x5643b661fb40 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/3213641059 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbb34012a40 con 0x5643b661fb40 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb5081f740 10 client.25747 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb5081f740 10 client.25747 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb5081f740 20 client.25747 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b6639060 0x5643b663b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb5081f740 4 client.25747 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:34.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643b6591860 con 0x5643b6639060 2024-09-12T02:44:34.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.867+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b6639060 0x5643b663b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.868+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b6639060 0x5643b663b4a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc4a6dfdc3d037e0 server_cookie=bf43a87f68cac4bc in_seq=0 out_seq=0 2024-09-12T02:44:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.868+0000 7fbb2b7fe640 10 client.25747 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:44:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.868+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/3213641059 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643b6591860 con 0x5643b6639060 2024-09-12T02:44:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.868+0000 7fbb2b7fe640 10 client.25747 handle_command_reply: tid=0 2024-09-12T02:44:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.868+0000 7fbb5081f740 1 client.25747 shutdown 2024-09-12T02:44:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b661fb40 msgr2=0x5643b6625f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b661fb40 0x5643b6625f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb340104d0 tx=0x7fbb34010990 comp rx=0 tx=0).stop 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 shutdown_connections 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b6639060 0x5643b663b4a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b6629370 0x5643b6626460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b661fb40 0x5643b6625f20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 --2- 172.21.15.100:0/3213641059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6628c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 >> 172.21.15.100:0/3213641059 conn(0x5643b65e7310 msgr2=0x5643b6620930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb2b7fe640 0 client.25747 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 shutdown_connections 2024-09-12T02:44:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 1 -- 172.21.15.100:0/3213641059 wait complete. 2024-09-12T02:44:34.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.869+0000 7fbb5081f740 20 client.25747 trim_cache size 0 max 16384 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.891+0000 7fbb5081f740 1 Processor -- start 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb5081f740 1 -- start start 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661e5d0 0x5643b6635440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661fb40 0x5643b6640d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b66412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb5081f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb481b1e10 con 0x5643b661fb40 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb5081f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb481af6e0 con 0x5643b661e5d0 2024-09-12T02:44:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb5081f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb481ad530 con 0x5643b6629370 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661fb40 0x5643b6640d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb4c9e3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b66412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661fb40 0x5643b6640d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59342/0 (socket says 172.21.15.100:59342) 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb477fe640 1 -- 172.21.15.100:0/630656129 learned_addr learned my addr 172.21.15.100:0/630656129 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661e5d0 0x5643b6635440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb4c9e3640 1 -- 172.21.15.100:0/630656129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661e5d0 msgr2=0x5643b6635440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661e5d0 0x5643b6635440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb4c9e3640 1 -- 172.21.15.100:0/630656129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661fb40 msgr2=0x5643b6640d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661fb40 0x5643b6640d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.892+0000 7fbb4c9e3640 1 -- 172.21.15.100:0/630656129 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b661a510 con 0x5643b6629370 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.893+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b66412b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb380096c0 tx=0x7fbb3801e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d62ae050d931b696 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.893+0000 7fbb3dffb640 1 -- 172.21.15.100:0/630656129 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38017040 con 0x5643b6629370 2024-09-12T02:44:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.893+0000 7fbb3dffb640 1 -- 172.21.15.100:0/630656129 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb38004500 con 0x5643b6629370 2024-09-12T02:44:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.893+0000 7fbb3dffb640 1 -- 172.21.15.100:0/630656129 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38003780 con 0x5643b6629370 2024-09-12T02:44:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.894+0000 7fbb5081f740 1 -- 172.21.15.100:0/630656129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 msgr2=0x5643b66412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.894+0000 7fbb5081f740 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b66412b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb380096c0 tx=0x7fbb3801e040 comp rx=0 tx=0).stop 2024-09-12T02:44:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.894+0000 7fbb5081f740 1 -- 172.21.15.100:0/630656129 shutdown_connections 2024-09-12T02:44:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.894+0000 7fbb5081f740 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b66412b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.894+0000 7fbb5081f740 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661fb40 0x5643b6640d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.894+0000 7fbb5081f740 1 --2- 172.21.15.100:0/630656129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661e5d0 0x5643b6635440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.894+0000 7fbb5081f740 1 -- 172.21.15.100:0/630656129 >> 172.21.15.100:0/630656129 conn(0x5643b65e7310 msgr2=0x5643b6625ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.895+0000 7fbb5081f740 1 -- 172.21.15.100:0/630656129 shutdown_connections 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.895+0000 7fbb5081f740 1 -- 172.21.15.100:0/630656129 wait complete. 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.895+0000 7fbb5081f740 1 -- start start 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.895+0000 7fbb5081f740 1 Processor -- start 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6631790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb5081f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b6631cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb4c9e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6631790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb4c9e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6631790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59350/0 (socket says 172.21.15.100:59350) 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb4c9e3640 1 -- 172.21.15.100:0/594230733 learned_addr learned my addr 172.21.15.100:0/594230733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb5081f740 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b6622730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb481adba0 con 0x5643b661e5d0 2024-09-12T02:44:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.896+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb481af010 con 0x5643b661fb40 2024-09-12T02:44:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb481ae270 con 0x5643b6629370 2024-09-12T02:44:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb477fe640 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b6631cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb5081f740 10 client.0 _ll_register_callbacks cb 0x7fbb3400b580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b6622730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb477fe640 1 -- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 msgr2=0x5643b6622730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb477fe640 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b6622730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb477fe640 1 -- 172.21.15.100:0/594230733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 msgr2=0x5643b6631790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb477fe640 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6631790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb477fe640 1 -- 172.21.15.100:0/594230733 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b6621120 con 0x5643b661fb40 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.897+0000 7fbb477fe640 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b6631cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbb34004810 tx=0x7fbb34013600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79046f0b401cc034 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.898+0000 7fbb2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.898+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/594230733 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3402c070 con 0x5643b661fb40 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.898+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/594230733 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbb34013c80 con 0x5643b661fb40 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.898+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb38004500 con 0x5643b661fb40 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.899+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/594230733 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb34036050 con 0x5643b661fb40 2024-09-12T02:44:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.899+0000 7fbb5081f740 10 client.25754 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.899+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5643b66abcd0 con 0x5643b661fb40 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.900+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/594230733 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb34013e80 con 0x5643b661fb40 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.900+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/594230733 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbb340123f0 con 0x5643b661fb40 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.900+0000 7fbb5081f740 10 client.25754 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.900+0000 7fbb5081f740 10 client.25754 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.901+0000 7fbb5081f740 20 client.25754 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.901+0000 7fbb5081f740 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b66ac3a0 0x5643b66ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.901+0000 7fbb5081f740 4 client.25754 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.901+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbb38004500 con 0x5643b66ac3a0 2024-09-12T02:44:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.901+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b66ac3a0 0x5643b66ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb4c9e3640 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b66ac3a0 0x5643b66ae7c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=938633b1d1416a52 server_cookie=6c17e4d9f9056c23 in_seq=0 out_seq=0 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb2b7fe640 10 client.25754 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb2b7fe640 1 -- 172.21.15.100:0/594230733 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbb38004500 con 0x5643b66ac3a0 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb2b7fe640 10 client.25754 handle_command_reply: tid=0 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 client.25754 shutdown 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 msgr2=0x5643b6631cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b6631cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbb34004810 tx=0x7fbb34013600 comp rx=0 tx=0).stop 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 shutdown_connections 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5643b66ac3a0 0x5643b66ae7c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb2b7fe640 0 client.25754 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643b6629370 0x5643b6622730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643b661fb40 0x5643b6631cd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 --2- 172.21.15.100:0/594230733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643b661e5d0 0x5643b6631790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 >> 172.21.15.100:0/594230733 conn(0x5643b65e7310 msgr2=0x5643b66194e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.902+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 shutdown_connections 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.903+0000 7fbb5081f740 1 -- 172.21.15.100:0/594230733 wait complete. 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.903+0000 7fbb5081f740 20 client.25754 trim_cache size 0 max 16384 2024-09-12T02:44:34.907 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:44:34.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.903+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbb2c0a2b20 msgr2=0x7fbb2c0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.903+0000 7fbb4e446640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbb2c0a2b20 0x7fbb2c0a4fe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbb400ed890 tx=0x7fbb400f3240 comp rx=0 tx=0).stop 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.903+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48100e20 msgr2=0x7fbb481a05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.903+0000 7fbb4e446640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48100e20 0x7fbb481a05a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb400098d0 tx=0x7fbb4002fc60 comp rx=0 tx=0).stop 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.903+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 shutdown_connections 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.904+0000 7fbb4e446640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbb2c0a2b20 0x7fbb2c0a4fe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.904+0000 7fbb4e446640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb48102ef0 0x7fbb4810ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.904+0000 7fbb4e446640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb48102570 0x7fbb481a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.904+0000 7fbb4e446640 1 --2- 172.21.15.100:0/3452213018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb48100e20 0x7fbb481a05a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.904+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 >> 172.21.15.100:0/3452213018 conn(0x7fbb480fc7d0 msgr2=0x7fbb48106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.904+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 shutdown_connections 2024-09-12T02:44:34.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:34.904+0000 7fbb4e446640 1 -- 172.21.15.100:0/3452213018 wait complete. 2024-09-12T02:44:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:34 smithi189 ceph-mon[35196]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 803 op/s 2024-09-12T02:44:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/109861475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:34 smithi117 ceph-mon[34898]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 803 op/s 2024-09-12T02:44:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:34 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/109861475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:34 smithi100 ceph-mon[31390]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 803 op/s 2024-09-12T02:44:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/109861475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:35.570 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:44:35.645 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.194+0000 7f1298e95640 1 -- 172.21.15.100:0/101612385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 msgr2=0x7f1294105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.194+0000 7f1298e95640 1 --2- 172.21.15.100:0/101612385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 0x7f1294105910 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1288009900 tx=0x7f128802a470 comp rx=0 tx=0).stop 2024-09-12T02:44:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.195+0000 7f1298e95640 1 -- 172.21.15.100:0/101612385 shutdown_connections 2024-09-12T02:44:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.195+0000 7f1298e95640 1 --2- 172.21.15.100:0/101612385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1294105f30 0x7f12941063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.195+0000 7f1298e95640 1 --2- 172.21.15.100:0/101612385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 0x7f1294105910 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.195+0000 7f1298e95640 1 --2- 172.21.15.100:0/101612385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 0x7f1294100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.195+0000 7f1298e95640 1 -- 172.21.15.100:0/101612385 >> 172.21.15.100:0/101612385 conn(0x7f12940fc7d0 msgr2=0x7f12940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.196+0000 7f1298e95640 1 -- 172.21.15.100:0/101612385 shutdown_connections 2024-09-12T02:44:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.196+0000 7f1298e95640 1 -- 172.21.15.100:0/101612385 wait complete. 2024-09-12T02:44:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 Processor -- start 2024-09-12T02:44:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 -- start start 2024-09-12T02:44:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 0x7f12941a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 0x7f12941a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1294105f30 0x7f129419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f129259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 0x7f12941a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f129259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 0x7f12941a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43060/0 (socket says 172.21.15.100:43060) 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f129259c640 1 -- 172.21.15.100:0/2472452561 learned_addr learned my addr 172.21.15.100:0/2472452561 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1294118550 con 0x7f1294101440 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12941183d0 con 0x7f1294105f30 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12941186d0 con 0x7f1294100b20 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.197+0000 7f1291d9b640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 0x7f12941a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f1292d9d640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1294105f30 0x7f129419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f129259c640 1 -- 172.21.15.100:0/2472452561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1294105f30 msgr2=0x7f129419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f129259c640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1294105f30 0x7f129419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f129259c640 1 -- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 msgr2=0x7f12941a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f129259c640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 0x7f12941a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f129259c640 1 -- 172.21.15.100:0/2472452561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129419efc0 con 0x7f1294100b20 2024-09-12T02:44:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f129259c640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 0x7f12941a46d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f128400e9f0 tx=0x7f128400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f12837fe640 1 -- 172.21.15.100:0/2472452561 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128400cd80 con 0x7f1294100b20 2024-09-12T02:44:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f12837fe640 1 -- 172.21.15.100:0/2472452561 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1284010910 con 0x7f1294100b20 2024-09-12T02:44:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.198+0000 7f12837fe640 1 -- 172.21.15.100:0/2472452561 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284018980 con 0x7f1294100b20 2024-09-12T02:44:36.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.199+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129419f2b0 con 0x7f1294100b20 2024-09-12T02:44:36.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.199+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129419f6b0 con 0x7f1294100b20 2024-09-12T02:44:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.203+0000 7f129b26e740 1 Processor -- start 2024-09-12T02:44:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.203+0000 7f129b26e740 1 -- start start 2024-09-12T02:44:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.203+0000 7f12837fe640 1 -- 172.21.15.100:0/2472452561 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1284010ac0 con 0x7f1294100b20 2024-09-12T02:44:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129b26e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192e760 0x55c86192eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129b26e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192f080 0x55c861939400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129b26e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c861939940 0x55c86193bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129b26e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c8618942a0 con 0x55c86192e760 2024-09-12T02:44:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129b26e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c86183bb10 con 0x55c86192f080 2024-09-12T02:44:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129b26e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c861890260 con 0x55c861939940 2024-09-12T02:44:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192f080 0x55c861939400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192f080 0x55c861939400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60748/0 (socket says 172.21.15.100:60748) 2024-09-12T02:44:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f129259c640 1 -- 172.21.15.100:0/1985250205 learned_addr learned my addr 172.21.15.100:0/1985250205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f1292d9d640 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192e760 0x55c86192eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.204+0000 7f1291d9b640 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c861939940 0x55c86193bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.205+0000 7f129259c640 1 -- 172.21.15.100:0/1985250205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c861939940 msgr2=0x55c86193bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.205+0000 7f129259c640 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c861939940 0x55c86193bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.205+0000 7f129259c640 1 -- 172.21.15.100:0/1985250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192e760 msgr2=0x55c86192eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.205+0000 7f129259c640 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192e760 0x55c86192eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.205+0000 7f129259c640 1 -- 172.21.15.100:0/1985250205 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c861605b90 con 0x55c86192f080 2024-09-12T02:44:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.206+0000 7f129259c640 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192f080 0x55c861939400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12840d74f0 tx=0x7f12840d79b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55469422c4361930 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.206+0000 7f12837fe640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f127c0a2c80 0x7f127c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.206+0000 7f12837fe640 1 -- 172.21.15.100:0/2472452561 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f12840cf3e0 con 0x7f1294100b20 2024-09-12T02:44:36.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.207+0000 7f1280ff9640 1 -- 172.21.15.100:0/1985250205 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12840e2070 con 0x55c86192f080 2024-09-12T02:44:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.207+0000 7f1280ff9640 1 -- 172.21.15.100:0/1985250205 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12840d1480 con 0x55c86192f080 2024-09-12T02:44:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.207+0000 7f1280ff9640 1 -- 172.21.15.100:0/1985250205 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12840ddbb0 con 0x55c86192f080 2024-09-12T02:44:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.207+0000 7f1292d9d640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f127c0a2c80 0x7f127c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f1292d9d640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f127c0a2c80 0x7f127c0a5140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f128c005fd0 tx=0x7f128c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 -- 172.21.15.100:0/1985250205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192f080 msgr2=0x55c861939400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192f080 0x55c861939400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12840d74f0 tx=0x7f12840d79b0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 -- 172.21.15.100:0/1985250205 shutdown_connections 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c861939940 0x55c86193bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192f080 0x55c861939400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 --2- 172.21.15.100:0/1985250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192e760 0x55c86192eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 -- 172.21.15.100:0/1985250205 >> 172.21.15.100:0/1985250205 conn(0x55c86192acf0 msgr2=0x55c86192b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 -- 172.21.15.100:0/1985250205 shutdown_connections 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 -- 172.21.15.100:0/1985250205 wait complete. 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.208+0000 7f129b26e740 1 -- start start 2024-09-12T02:44:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 1 Processor -- start 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861936800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c861936d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 0x55c861937280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c86193c560 con 0x55c861939940 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c86181c6e0 con 0x55c86192e760 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c86193c6e0 con 0x55c86192f080 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861936800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129b26e740 10 client.0 _ll_register_callbacks cb 0x55c861840a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861936800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60756/0 (socket says 172.21.15.100:60756) 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 -- 172.21.15.100:0/2739265979 learned_addr learned my addr 172.21.15.100:0/2739265979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f1291d9b640 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c861936d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f1292d9d640 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 0x55c861937280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 -- 172.21.15.100:0/2739265979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 msgr2=0x55c861936d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c861936d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 -- 172.21.15.100:0/2739265979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 msgr2=0x55c861937280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 0x55c861937280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.209+0000 7f129259c640 1 -- 172.21.15.100:0/2739265979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c861945a70 con 0x55c86192e760 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.210+0000 7f129259c640 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861936800 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1284098030 tx=0x7f1284018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84394c280a8acebc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.210+0000 7f1279ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.210+0000 7f1279ffb640 1 -- 172.21.15.100:0/2739265979 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284097e70 con 0x55c86192e760 2024-09-12T02:44:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.210+0000 7f1279ffb640 1 -- 172.21.15.100:0/2739265979 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f128409be30 con 0x55c86192e760 2024-09-12T02:44:36.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.211+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12840d1480 con 0x55c86192e760 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.211+0000 7f1279ffb640 1 -- 172.21.15.100:0/2739265979 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f128409b530 con 0x55c86192e760 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 10 client.25766 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c86193c560 con 0x55c86192e760 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f1279ffb640 1 -- 172.21.15.100:0/2739265979 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f128409c2d0 con 0x55c86192e760 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f1279ffb640 1 -- 172.21.15.100:0/2739265979 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f12840a43b0 con 0x55c86192e760 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 10 client.25766 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 10 client.25766 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 20 client.25766 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c861949580 0x55c86194b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 4 client.25766 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:36.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.212+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f12840d1480 con 0x55c861949580 2024-09-12T02:44:36.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.213+0000 7f1291d9b640 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c861949580 0x55c86194b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.214+0000 7f1291d9b640 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c861949580 0x55c86194b970 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1ca2899d7394e13 server_cookie=c743d3624ec99d36 in_seq=0 out_seq=0 2024-09-12T02:44:36.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.214+0000 7f1279ffb640 10 client.25766 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.214+0000 7f1279ffb640 1 -- 172.21.15.100:0/2739265979 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f12840d1480 con 0x55c861949580 2024-09-12T02:44:36.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.214+0000 7f1279ffb640 10 client.25766 handle_command_reply: tid=0 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.214+0000 7f129b26e740 1 client.25766 shutdown 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.215+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 msgr2=0x55c861936800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.215+0000 7f129b26e740 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861936800 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1284098030 tx=0x7f1284018420 comp rx=0 tx=0).stop 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 shutdown_connections 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c861949580 0x55c86194b970 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 0x55c861937280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c861936d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 --2- 172.21.15.100:0/2739265979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861936800 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 >> 172.21.15.100:0/2739265979 conn(0x55c86192acf0 msgr2=0x55c861930a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f1279ffb640 0 client.25766 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 shutdown_connections 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 1 -- 172.21.15.100:0/2739265979 wait complete. 2024-09-12T02:44:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.216+0000 7f129b26e740 20 client.25766 trim_cache size 0 max 16384 2024-09-12T02:44:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:36.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.247+0000 7f129b26e740 1 Processor -- start 2024-09-12T02:44:36.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.247+0000 7f129b26e740 1 -- start start 2024-09-12T02:44:36.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.248+0000 7f129b26e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861931210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.248+0000 7f129b26e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c86194e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.248+0000 7f129b26e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 0x55c86194eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.248+0000 7f129b26e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12941b6660 con 0x55c861939940 2024-09-12T02:44:36.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.248+0000 7f129b26e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12941b3f30 con 0x55c86192e760 2024-09-12T02:44:36.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.248+0000 7f129b26e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12941b1d80 con 0x55c86192f080 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c86194e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c86194e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43076/0 (socket says 172.21.15.100:43076) 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 -- 172.21.15.100:0/228827675 learned_addr learned my addr 172.21.15.100:0/228827675 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f129259c640 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861931210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 -- 172.21.15.100:0/228827675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 msgr2=0x55c861931210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861931210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 -- 172.21.15.100:0/228827675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 msgr2=0x55c86194eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 0x55c86194eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.249+0000 7f1291d9b640 1 -- 172.21.15.100:0/228827675 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86192ab20 con 0x55c86192f080 2024-09-12T02:44:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.253+0000 7f1291d9b640 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c86194e5b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f128802a990 tx=0x7f12880319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2805a79c7a205e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.253+0000 7f127bfff640 1 -- 172.21.15.100:0/228827675 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288035040 con 0x55c86192f080 2024-09-12T02:44:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.253+0000 7f127bfff640 1 -- 172.21.15.100:0/228827675 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1288005500 con 0x55c86192f080 2024-09-12T02:44:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.253+0000 7f127bfff640 1 -- 172.21.15.100:0/228827675 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288004d00 con 0x55c86192f080 2024-09-12T02:44:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.254+0000 7f129b26e740 1 -- 172.21.15.100:0/228827675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 msgr2=0x55c86194e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.254+0000 7f129b26e740 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c86194e5b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f128802a990 tx=0x7f12880319f0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.256+0000 7f129b26e740 1 -- 172.21.15.100:0/228827675 shutdown_connections 2024-09-12T02:44:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.256+0000 7f129b26e740 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c861939940 0x55c86194eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.256+0000 7f129b26e740 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192f080 0x55c86194e5b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.256+0000 7f129b26e740 1 --2- 172.21.15.100:0/228827675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c86192e760 0x55c861931210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.256+0000 7f129b26e740 1 -- 172.21.15.100:0/228827675 >> 172.21.15.100:0/228827675 conn(0x55c86192acf0 msgr2=0x55c8619350d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.256+0000 7f129b26e740 1 -- 172.21.15.100:0/228827675 shutdown_connections 2024-09-12T02:44:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.257+0000 7f129b26e740 1 -- 172.21.15.100:0/228827675 wait complete. 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.257+0000 7f129b26e740 1 -- start start 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.257+0000 7f129b26e740 1 Processor -- start 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129b26e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192e760 0x55c86194c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129b26e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192f080 0x55c86194cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129b26e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c861939940 0x55c8619b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129b26e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12941b23f0 con 0x55c86192f080 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129b26e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12941b3860 con 0x55c861939940 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129b26e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12941b2ac0 con 0x55c86192e760 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129b26e740 10 client.0 _ll_register_callbacks cb 0x7f128c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192e760 0x55c86194c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f1291d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192f080 0x55c86194cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192e760 0x55c86194c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43092/0 (socket says 172.21.15.100:43092) 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f1291d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192f080 0x55c86194cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59398/0 (socket says 172.21.15.100:59398) 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 -- 172.21.15.100:0/1254784801 learned_addr learned my addr 172.21.15.100:0/1254784801 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f1292d9d640 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c861939940 0x55c8619b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 -- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c861939940 msgr2=0x55c8619b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c861939940 0x55c8619b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 -- 172.21.15.100:0/1254784801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192f080 msgr2=0x55c86194cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192f080 0x55c86194cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f129259c640 1 -- 172.21.15.100:0/1254784801 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c861926260 con 0x55c86192e760 2024-09-12T02:44:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.258+0000 7f1291d9b640 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192f080 0x55c86194cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.259+0000 7f129259c640 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192e760 0x55c86194c660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f128409bb60 tx=0x7f1284009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=641720a6446610e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.259+0000 7f1279ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:44:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.259+0000 7f1279ffb640 1 -- 172.21.15.100:0/1254784801 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128409b710 con 0x55c86192e760 2024-09-12T02:44:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.259+0000 7f1279ffb640 1 -- 172.21.15.100:0/1254784801 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f128409b070 con 0x55c86192e760 2024-09-12T02:44:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.259+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1288005500 con 0x55c86192e760 2024-09-12T02:44:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.260+0000 7f1279ffb640 1 -- 172.21.15.100:0/1254784801 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f128409b9a0 con 0x55c86192e760 2024-09-12T02:44:36.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.260+0000 7f129b26e740 10 client.25771 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:36.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.260+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c8619b42d0 con 0x55c86192e760 2024-09-12T02:44:36.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.260+0000 7f1279ffb640 1 -- 172.21.15.100:0/1254784801 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1288005500 con 0x55c86192e760 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.261+0000 7f1279ffb640 1 -- 172.21.15.100:0/1254784801 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1284097920 con 0x55c86192e760 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.261+0000 7f129b26e740 10 client.25771 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.261+0000 7f129b26e740 10 client.25771 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.261+0000 7f129b26e740 20 client.25771 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.261+0000 7f129b26e740 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c8619b47d0 0x55c8619b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.261+0000 7f129b26e740 4 client.25771 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.1, "await_for": 45.0}] 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.261+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.1, "await_for": 45.0}) -- 0x55c8618a19d0 con 0x55c8619b47d0 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.262+0000 7f1291d9b640 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c8619b47d0 0x55c8619b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.262+0000 7f1279ffb640 10 client.25771 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.262+0000 7f1291d9b640 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c8619b47d0 0x55c8619b6bc0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=801d3e0f7f37ec4a server_cookie=29706940805b1bf3 in_seq=0 out_seq=0 2024-09-12T02:44:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 325.0 s, 3147.0 tps, lat 31.529 ms stddev 33.287 2024-09-12T02:44:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f1279ffb640 1 -- 172.21.15.100:0/1254784801 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c8618a19d0 con 0x55c8619b47d0 2024-09-12T02:44:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f1279ffb640 10 client.25771 handle_command_reply: tid=0 2024-09-12T02:44:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 client.25771 shutdown 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192e760 msgr2=0x55c86194c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192e760 0x55c86194c660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f128409bb60 tx=0x7f1284009770 comp rx=0 tx=0).stop 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 shutdown_connections 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c8619b47d0 0x55c8619b6bc0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c861939940 0x55c8619b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c86192f080 0x55c86194cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 --2- 172.21.15.100:0/1254784801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c86192e760 0x55c86194c660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f1279ffb640 0 client.25771 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.618+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 >> 172.21.15.100:0/1254784801 conn(0x55c86192acf0 msgr2=0x55c861944980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 shutdown_connections 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f129b26e740 1 -- 172.21.15.100:0/1254784801 wait complete. 2024-09-12T02:44:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f129b26e740 20 client.25771 trim_cache size 0 max 16384 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 22, 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "21a85422": { 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 22, 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:44:36.622 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 140.1, 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:44:36.623 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:36.624 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:36.624 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:36.624 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:36.624 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:36.624 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f127c0a2c80 msgr2=0x7f127c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f127c0a2c80 0x7f127c0a5140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f128c005fd0 tx=0x7f128c009500 comp rx=0 tx=0).stop 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 msgr2=0x7f12941a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 0x7f12941a46d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f128400e9f0 tx=0x7f128400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 shutdown_connections 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f127c0a2c80 0x7f127c0a5140 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1294105f30 0x7f129419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1294101440 0x7f12941a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 --2- 172.21.15.100:0/2472452561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1294100b20 0x7f12941a46d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 >> 172.21.15.100:0/2472452561 conn(0x7f12940fc7d0 msgr2=0x7f129410f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.619+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 shutdown_connections 2024-09-12T02:44:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.620+0000 7f1298e95640 1 -- 172.21.15.100:0/2472452561 wait complete. 2024-09-12T02:44:36.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 -- 172.21.15.100:0/1285346314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc102570 msgr2=0x7f76fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 --2- 172.21.15.100:0/1285346314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc102570 0x7f76fc1029b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009900 tx=0x7f76f002a480 comp rx=0 tx=0).stop 2024-09-12T02:44:36.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 -- 172.21.15.100:0/1285346314 shutdown_connections 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 --2- 172.21.15.100:0/1285346314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76fc102ef0 0x7f76fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 --2- 172.21.15.100:0/1285346314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc102570 0x7f76fc1029b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 --2- 172.21.15.100:0/1285346314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76fc100e20 0x7f76fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 -- 172.21.15.100:0/1285346314 >> 172.21.15.100:0/1285346314 conn(0x7f76fc0fc7d0 msgr2=0x7f76fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 -- 172.21.15.100:0/1285346314 shutdown_connections 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.770+0000 7f7700ed8640 1 -- 172.21.15.100:0/1285346314 wait complete. 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 Processor -- start 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 -- start start 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc100e20 0x7f76fc199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76fc102570 0x7f76fc1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76fc102ef0 0x7f76fc1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc110f80 con 0x7f76fc100e20 2024-09-12T02:44:36.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc110e00 con 0x7f76fc102570 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f7700ed8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc111100 con 0x7f76fc102ef0 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc100e20 0x7f76fc199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc100e20 0x7f76fc199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59416/0 (socket says 172.21.15.100:59416) 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 -- 172.21.15.100:0/2980897401 learned_addr learned my addr 172.21.15.100:0/2980897401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fad9d640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76fc102ef0 0x7f76fc1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76fc102570 0x7f76fc1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 -- 172.21.15.100:0/2980897401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76fc102ef0 msgr2=0x7f76fc1a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76fc102ef0 0x7f76fc1a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 -- 172.21.15.100:0/2980897401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76fc102570 msgr2=0x7f76fc1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76fc102570 0x7f76fc1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 -- 172.21.15.100:0/2980897401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc1a4950 con 0x7f76fc100e20 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76fc102570 0x7f76fc1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76fa59c640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc100e20 0x7f76fc199390 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00d770 tx=0x7f76ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.771+0000 7f76eb7fe640 1 -- 172.21.15.100:0/2980897401 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec017070 con 0x7f76fc100e20 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.772+0000 7f76eb7fe640 1 -- 172.21.15.100:0/2980897401 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76ec005500 con 0x7f76fc100e20 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.772+0000 7f76eb7fe640 1 -- 172.21.15.100:0/2980897401 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec004e00 con 0x7f76fc100e20 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.772+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76fc1a4b20 con 0x7f76fc100e20 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.772+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76fc1a4fe0 con 0x7f76fc100e20 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.774+0000 7f76eb7fe640 1 -- 172.21.15.100:0/2980897401 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f76ec004fa0 con 0x7f76fc100e20 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.774+0000 7f77032b1740 1 Processor -- start 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.774+0000 7f77032b1740 1 -- start start 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76eb7fe640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76e40a2b80 0x7f76e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f77032b1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x55937533a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f77032b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533a5d0 0x55937533aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f77032b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559375345370 0x559375347760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f77032b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5593752a02f0 con 0x559375345370 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f77032b1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559375247cf0 con 0x55937533bb40 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f77032b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55937529c2b0 con 0x55937533a5d0 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76eb7fe640 1 -- 172.21.15.100:0/2980897401 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f76ec0ceb80 con 0x7f76fc100e20 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76fad9d640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76e40a2b80 0x7f76e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533a5d0 0x55937533aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559375345370 0x559375347760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533a5d0 0x55937533aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43132/0 (socket says 172.21.15.100:43132) 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 -- 172.21.15.100:0/752587776 learned_addr learned my addr 172.21.15.100:0/752587776 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76fa59c640 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x55937533a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 -- 172.21.15.100:0/752587776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 msgr2=0x55937533a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x55937533a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 -- 172.21.15.100:0/752587776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559375345370 msgr2=0x559375347760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559375345370 0x559375347760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 -- 172.21.15.100:0/752587776 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937522c3a0 con 0x55937533a5d0 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76fad9d640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76e40a2b80 0x7f76e40a5040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009fd0 tx=0x7f76f4009d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.775+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533a5d0 0x55937533aa10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f76f0000c00 tx=0x7f76f0009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74e51c4287b1f2df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f76e8ff9640 1 -- 172.21.15.100:0/752587776 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f003f070 con 0x55937533a5d0 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f76e8ff9640 1 -- 172.21.15.100:0/752587776 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76f0004470 con 0x55937533a5d0 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f76e8ff9640 1 -- 172.21.15.100:0/752587776 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0035030 con 0x55937533a5d0 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f77032b1740 1 -- 172.21.15.100:0/752587776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533a5d0 msgr2=0x55937533aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f77032b1740 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533a5d0 0x55937533aa10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f76f0000c00 tx=0x7f76f0009680 comp rx=0 tx=0).stop 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f77032b1740 1 -- 172.21.15.100:0/752587776 shutdown_connections 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f77032b1740 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559375345370 0x559375347760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f77032b1740 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533a5d0 0x55937533aa10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f77032b1740 1 --2- 172.21.15.100:0/752587776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x55937533a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.776+0000 7f77032b1740 1 -- 172.21.15.100:0/752587776 >> 172.21.15.100:0/752587776 conn(0x559375303310 msgr2=0x559375336c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 -- 172.21.15.100:0/752587776 shutdown_connections 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 -- 172.21.15.100:0/752587776 wait complete. 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 -- start start 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 Processor -- start 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x559375344cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x559375341f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x5593753424d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559375348010 con 0x55937533a5d0 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55937525b060 con 0x55937533bb40 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559375348190 con 0x559375345370 2024-09-12T02:44:36.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f77032b1740 10 client.0 _ll_register_callbacks cb 0x559374fae8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x559375344cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x559375344cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59422/0 (socket says 172.21.15.100:59422) 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f76fa59c640 1 -- 172.21.15.100:0/829033890 learned_addr learned my addr 172.21.15.100:0/829033890 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x559375341f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.777+0000 7f76fad9d640 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x5593753424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76fa59c640 1 -- 172.21.15.100:0/829033890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 msgr2=0x5593753424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76fa59c640 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x5593753424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76fa59c640 1 -- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 msgr2=0x559375341f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76fa59c640 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x559375341f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76fa59c640 1 -- 172.21.15.100:0/829033890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593750113c0 con 0x55937533a5d0 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76fa59c640 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x559375344cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f76ec097da0 tx=0x7f76ec0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91f8751855e8cba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76e1ffb640 1 -- 172.21.15.100:0/829033890 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec020040 con 0x55937533a5d0 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76e1ffb640 1 -- 172.21.15.100:0/829033890 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f76ec0cc780 con 0x55937533a5d0 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76f0004470 con 0x55937533a5d0 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76e1ffb640 1 -- 172.21.15.100:0/829033890 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f76ec0a4040 con 0x55937533a5d0 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f77032b1740 10 client.16392 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559375353a50 con 0x55937533a5d0 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76e1ffb640 1 -- 172.21.15.100:0/829033890 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76f0004470 con 0x55937533a5d0 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.778+0000 7f76e1ffb640 1 -- 172.21.15.100:0/829033890 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f76ec097a40 con 0x55937533a5d0 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f77032b1740 10 client.16392 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f77032b1740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f77032b1740 20 client.16392 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f77032b1740 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559375354e60 0x5593753572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f77032b1740 4 client.16392 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593752ad860 con 0x559375354e60 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559375354e60 0x5593753572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f76e1ffb640 10 client.16392 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.779+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559375354e60 0x5593753572d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ad62687979f7af7 server_cookie=5423801ffcd4c627 in_seq=0 out_seq=0 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f76e1ffb640 1 -- 172.21.15.100:0/829033890 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593752ad860 con 0x559375354e60 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f76e1ffb640 10 client.16392 handle_command_reply: tid=0 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 client.16392 shutdown 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 msgr2=0x559375344cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x559375344cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f76ec097da0 tx=0x7f76ec0047b0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 shutdown_connections 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559375354e60 0x5593753572d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x5593753424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533bb40 0x559375341f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 --2- 172.21.15.100:0/829033890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x559375344cc0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 >> 172.21.15.100:0/829033890 conn(0x559375303310 msgr2=0x55937533c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f76e1ffb640 0 client.16392 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 shutdown_connections 2024-09-12T02:44:36.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 1 -- 172.21.15.100:0/829033890 wait complete. 2024-09-12T02:44:36.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.780+0000 7f77032b1740 20 client.16392 trim_cache size 0 max 16384 2024-09-12T02:44:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 Processor -- start 2024-09-12T02:44:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 -- start start 2024-09-12T02:44:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533a5d0 0x5593753512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533bb40 0x55937534d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x55937534dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc1afe10 con 0x55937533bb40 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc1ad6e0 con 0x55937533a5d0 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f77032b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc1ab530 con 0x559375345370 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f76f9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533bb40 0x55937534d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f76f9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533bb40 0x55937534d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59434/0 (socket says 172.21.15.100:59434) 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f76f9d9b640 1 -- 172.21.15.100:0/2080249832 learned_addr learned my addr 172.21.15.100:0/2080249832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f76fad9d640 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x55937534dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.793+0000 7f76fa59c640 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533a5d0 0x5593753512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76f9d9b640 1 -- 172.21.15.100:0/2080249832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 msgr2=0x55937534dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x55937534dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76f9d9b640 1 -- 172.21.15.100:0/2080249832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533a5d0 msgr2=0x5593753512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533a5d0 0x5593753512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76f9d9b640 1 -- 172.21.15.100:0/2080249832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593753404e0 con 0x55937533bb40 2024-09-12T02:44:36.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533bb40 0x55937534d830 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f76f0004c90 tx=0x7f76f0004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce533684b8f6f3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76e3fff640 1 -- 172.21.15.100:0/2080249832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f003f040 con 0x55937533bb40 2024-09-12T02:44:36.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76e3fff640 1 -- 172.21.15.100:0/2080249832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76f0005210 con 0x55937533bb40 2024-09-12T02:44:36.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f76e3fff640 1 -- 172.21.15.100:0/2080249832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0035040 con 0x55937533bb40 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f77032b1740 1 -- 172.21.15.100:0/2080249832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533bb40 msgr2=0x55937534d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.794+0000 7f77032b1740 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533bb40 0x55937534d830 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f76f0004c90 tx=0x7f76f0004cc0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- 172.21.15.100:0/2080249832 shutdown_connections 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559375345370 0x55937534dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533bb40 0x55937534d830 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 --2- 172.21.15.100:0/2080249832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55937533a5d0 0x5593753512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- 172.21.15.100:0/2080249832 >> 172.21.15.100:0/2080249832 conn(0x559375303310 msgr2=0x5593753414d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- 172.21.15.100:0/2080249832 shutdown_connections 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- 172.21.15.100:0/2080249832 wait complete. 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- start start 2024-09-12T02:44:36.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 Processor -- start 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x55937535cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533bb40 0x55937535d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559375345370 0x55937533f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc1abba0 con 0x55937533a5d0 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc1ad010 con 0x559375345370 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc1ac270 con 0x55937533bb40 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f77032b1740 10 client.0 _ll_register_callbacks cb 0x7f76ec09af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x55937535cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x55937535cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59440/0 (socket says 172.21.15.100:59440) 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f76fa59c640 1 -- 172.21.15.100:0/473399695 learned_addr learned my addr 172.21.15.100:0/473399695 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533bb40 0x55937535d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.795+0000 7f76fad9d640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559375345370 0x55937533f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76fa59c640 1 -- 172.21.15.100:0/473399695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533bb40 msgr2=0x55937535d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76fa59c640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533bb40 0x55937535d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76fa59c640 1 -- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559375345370 msgr2=0x55937533f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76fa59c640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559375345370 0x55937533f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76fa59c640 1 -- 172.21.15.100:0/473399695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937533f8b0 con 0x55937533a5d0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76fad9d640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559375345370 0x55937533f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76fa59c640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x55937535cbc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f76ec09ae40 tx=0x7f76ec005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af241d169b55acd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76e1ffb640 1 -- 172.21.15.100:0/473399695 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0b3020 con 0x55937533a5d0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76e1ffb640 1 -- 172.21.15.100:0/473399695 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f76ec097a40 con 0x55937533a5d0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76f0005210 con 0x55937533a5d0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76e1ffb640 1 -- 172.21.15.100:0/473399695 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f76ec020040 con 0x55937533a5d0 2024-09-12T02:44:36.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 10 client.16398 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5593753460a0 con 0x55937533a5d0 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76e1ffb640 1 -- 172.21.15.100:0/473399695 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76f0005210 con 0x55937533a5d0 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f76e1ffb640 1 -- 172.21.15.100:0/473399695 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f76ec084b80 con 0x55937533a5d0 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 10 client.16398 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 20 client.16398 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593753c3c80 0x5593753c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 4 client.16398 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.796+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593752a7d70 con 0x5593753c3c80 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593753c3c80 0x5593753c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f76f9d9b640 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593753c3c80 0x5593753c6070 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd9f2e2744d7e90 server_cookie=40fd14b44ac267f in_seq=0 out_seq=0 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f76e1ffb640 10 client.16398 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f76e1ffb640 1 -- 172.21.15.100:0/473399695 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593752a7d70 con 0x5593753c3c80 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f76e1ffb640 10 client.16398 handle_command_reply: tid=0 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 client.16398 shutdown 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 msgr2=0x55937535cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x55937535cbc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f76ec09ae40 tx=0x7f76ec005720 comp rx=0 tx=0).stop 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 shutdown_connections 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593753c3c80 0x5593753c6070 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559375345370 0x55937533f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55937533bb40 0x55937535d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 --2- 172.21.15.100:0/473399695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55937533a5d0 0x55937535cbc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 >> 172.21.15.100:0/473399695 conn(0x559375303310 msgr2=0x5593753407b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f76e1ffb640 0 client.16398 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 shutdown_connections 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 1 -- 172.21.15.100:0/473399695 wait complete. 2024-09-12T02:44:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.797+0000 7f77032b1740 20 client.16398 trim_cache size 0 max 16384 2024-09-12T02:44:36.806 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:44:36.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76e40a2b80 msgr2=0x7f76e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76e40a2b80 0x7f76e40a5040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009fd0 tx=0x7f76f4009d40 comp rx=0 tx=0).stop 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc100e20 msgr2=0x7f76fc199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc100e20 0x7f76fc199390 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00d770 tx=0x7f76ec00dc30 comp rx=0 tx=0).stop 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 shutdown_connections 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f76e40a2b80 0x7f76e40a5040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76fc102ef0 0x7f76fc1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76fc102570 0x7f76fc1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 --2- 172.21.15.100:0/2980897401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc100e20 0x7f76fc199390 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 >> 172.21.15.100:0/2980897401 conn(0x7f76fc0fc7d0 msgr2=0x7f76fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 shutdown_connections 2024-09-12T02:44:36.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:36.798+0000 7f7700ed8640 1 -- 172.21.15.100:0/2980897401 wait complete. 2024-09-12T02:44:36.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:36 smithi100 ceph-mon[31390]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 9.7 MiB/s wr, 799 op/s 2024-09-12T02:44:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:36 smithi189 ceph-mon[35196]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 9.7 MiB/s wr, 799 op/s 2024-09-12T02:44:37.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:36 smithi117 ceph-mon[34898]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 9.7 MiB/s wr, 799 op/s 2024-09-12T02:44:38.205 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '21a85422', quiesce took 6.4 seconds. Will release after: 13.700000000000001 2024-09-12T02:44:38.769 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:44:38.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:44:39.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:38 smithi189 ceph-mon[35196]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 8.7 MiB/s wr, 777 op/s 2024-09-12T02:44:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:38 smithi117 ceph-mon[34898]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 8.7 MiB/s wr, 777 op/s 2024-09-12T02:44:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:38 smithi100 ceph-mon[31390]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 8.7 MiB/s wr, 777 op/s 2024-09-12T02:44:40.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 -- 172.21.15.100:0/4023317978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb8102d40 msgr2=0x7fbdb8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 --2- 172.21.15.100:0/4023317978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb8102d40 0x7fbdb8103120 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009900 tx=0x7fbda802a480 comp rx=0 tx=0).stop 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 -- 172.21.15.100:0/4023317978 shutdown_connections 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 --2- 172.21.15.100:0/4023317978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb810c170 0x7fbdb810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 --2- 172.21.15.100:0/4023317978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdb8103660 0x7fbdb810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 --2- 172.21.15.100:0/4023317978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb8102d40 0x7fbdb8103120 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 -- 172.21.15.100:0/4023317978 >> 172.21.15.100:0/4023317978 conn(0x7fbdb80fc7a0 msgr2=0x7fbdb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 -- 172.21.15.100:0/4023317978 shutdown_connections 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 -- 172.21.15.100:0/4023317978 wait complete. 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.298+0000 7fbdbe179640 1 Processor -- start 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdbe179640 1 -- start start 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdbe179640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdb8102d40 0x7fbdb81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdbe179640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb8103660 0x7fbdb8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdbe179640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb810c170 0x7fbdb819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdbe179640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8111f70 con 0x7fbdb810c170 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdbe179640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8111df0 con 0x7fbdb8103660 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdbe179640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb81120f0 con 0x7fbdb8102d40 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb810c170 0x7fbdb819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb810c170 0x7fbdb819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59458/0 (socket says 172.21.15.100:59458) 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 -- 172.21.15.100:0/371882318 learned_addr learned my addr 172.21.15.100:0/371882318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdb8102d40 0x7fbdb81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdaffff640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb8103660 0x7fbdb8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 -- 172.21.15.100:0/371882318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdb8102d40 msgr2=0x7fbdb81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdb8102d40 0x7fbdb81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 -- 172.21.15.100:0/371882318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb8103660 msgr2=0x7fbdb8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb8103660 0x7fbdb8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.299+0000 7fbdb7fff640 1 -- 172.21.15.100:0/371882318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb819d4a0 con 0x7fbdb810c170 2024-09-12T02:44:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.300+0000 7fbdb7fff640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb810c170 0x7fbdb819cdc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009fd0 tx=0x7fbdb000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.300+0000 7fbdb57fa640 1 -- 172.21.15.100:0/371882318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0017070 con 0x7fbdb810c170 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.300+0000 7fbdb57fa640 1 -- 172.21.15.100:0/371882318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdb0003e50 con 0x7fbdb810c170 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.300+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb819d790 con 0x7fbdb810c170 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.300+0000 7fbdb57fa640 1 -- 172.21.15.100:0/371882318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00106c0 con 0x7fbdb810c170 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.300+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb81a5070 con 0x7fbdb810c170 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdb57fa640 1 -- 172.21.15.100:0/371882318 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fbdb0003970 con 0x7fbdb810c170 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 Processor -- start 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 -- start start 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb2480 0x556e23cbc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cbf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556e23c17280 con 0x556e23cbcd40 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556e23bbeb10 con 0x556e23cb1b60 2024-09-12T02:44:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdc0552740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556e23c13240 con 0x556e23cb2480 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.302+0000 7fbdb57fa640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbda40a2c00 0x7fbda40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cbf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cbf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59464/0 (socket says 172.21.15.100:59464) 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 -- 172.21.15.100:0/1574440391 learned_addr learned my addr 172.21.15.100:0/1574440391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdb7fff640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbda40a2c00 0x7fbda40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb2480 0x556e23cbc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdb57fa640 1 -- 172.21.15.100:0/371882318 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbdb00cecf0 con 0x7fbdb810c170 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 -- 172.21.15.100:0/1574440391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb2480 msgr2=0x556e23cbc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb2480 0x556e23cbc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 -- 172.21.15.100:0/1574440391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 msgr2=0x556e23cb1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 -- 172.21.15.100:0/1574440391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e23bcb1f0 con 0x556e23cbcd40 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cbf130 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009f90 tx=0x7fbda00097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc55febf723b76d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdb7fff640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbda40a2c00 0x7fbda40a50c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0005c40 tx=0x7fbdb0086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdadffb640 1 -- 172.21.15.100:0/1574440391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0004230 con 0x556e23cbcd40 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdadffb640 1 -- 172.21.15.100:0/1574440391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda00043d0 con 0x556e23cbcd40 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.303+0000 7fbdadffb640 1 -- 172.21.15.100:0/1574440391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0010a70 con 0x556e23cbcd40 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 -- 172.21.15.100:0/1574440391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 msgr2=0x556e23cbf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cbf130 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009f90 tx=0x7fbda00097a0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 -- 172.21.15.100:0/1574440391 shutdown_connections 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cbf130 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb2480 0x556e23cbc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1574440391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 -- 172.21.15.100:0/1574440391 >> 172.21.15.100:0/1574440391 conn(0x556e23cae0f0 msgr2=0x556e23cae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 -- 172.21.15.100:0/1574440391 shutdown_connections 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 -- 172.21.15.100:0/1574440391 wait complete. 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.304+0000 7fbdc0552740 1 -- start start 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 1 Processor -- start 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cba210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 0x556e23cba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556e23cbf910 con 0x556e23cb2480 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556e23bd1f10 con 0x556e23cb1b60 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556e23cbfa90 con 0x556e23cbcd40 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdc0552740 10 client.0 _ll_register_callbacks cb 0x556e23b9aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cba210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59470/0 (socket says 172.21.15.100:59470) 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 -- 172.21.15.100:0/874494972 learned_addr learned my addr 172.21.15.100:0/874494972 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdaffff640 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 -- 172.21.15.100:0/874494972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 msgr2=0x556e23cba750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 0x556e23cba750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 -- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 msgr2=0x556e23cb9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 -- 172.21.15.100:0/874494972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e239886a0 con 0x556e23cb2480 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdaffff640 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cba210 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009900 tx=0x7fbda80317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd41b47ad45cf278 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.305+0000 7fbd96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbd96ffd640 1 -- 172.21.15.100:0/874494972 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8035040 con 0x556e23cb2480 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbd96ffd640 1 -- 172.21.15.100:0/874494972 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbda8004460 con 0x556e23cb2480 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda00043d0 con 0x556e23cb2480 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbd96ffd640 1 -- 172.21.15.100:0/874494972 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbda80035f0 con 0x556e23cb2480 2024-09-12T02:44:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 10 client.16410 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e23ccb610 con 0x556e23cb2480 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbd96ffd640 1 -- 172.21.15.100:0/874494972 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda00043d0 con 0x556e23cb2480 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbd96ffd640 1 -- 172.21.15.100:0/874494972 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbda80458c0 con 0x556e23cb2480 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 10 client.16410 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 20 client.16410 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23ccefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 4 client.16410 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e23c247f0 con 0x556e23cccb20 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.306+0000 7fbdaffff640 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23ccefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.307+0000 7fbd96ffd640 10 client.16410 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.307+0000 7fbdaffff640 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23ccefa0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e98ee7bca3e833b2 server_cookie=4211540f770743b3 in_seq=0 out_seq=0 2024-09-12T02:44:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.307+0000 7fbd96ffd640 1 -- 172.21.15.100:0/874494972 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e23c247f0 con 0x556e23cccb20 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbd96ffd640 10 client.16410 handle_command_reply: tid=0 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 client.16410 shutdown 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 msgr2=0x556e23cba210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cba210 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009900 tx=0x7fbda80317e0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 shutdown_connections 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23ccefa0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbd96ffd640 0 client.16410 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 0x556e23cba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cba210 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 --2- 172.21.15.100:0/874494972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 >> 172.21.15.100:0/874494972 conn(0x556e23cae0f0 msgr2=0x556e23cb3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 shutdown_connections 2024-09-12T02:44:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 1 -- 172.21.15.100:0/874494972 wait complete. 2024-09-12T02:44:40.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.308+0000 7fbdc0552740 20 client.16410 trim_cache size 0 max 16384 2024-09-12T02:44:40.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 Processor -- start 2024-09-12T02:44:40.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 -- start start 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb1b60 0x556e23cd4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb2480 0x556e23cd4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cb6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb81afe60 con 0x556e23cbcd40 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb81ad730 con 0x556e23cb2480 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdc0552740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb81ab580 con 0x556e23cb1b60 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.325+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cb6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cb6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59486/0 (socket says 172.21.15.100:59486) 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 -- 172.21.15.100:0/1068420471 learned_addr learned my addr 172.21.15.100:0/1068420471 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb2480 0x556e23cd4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 -- 172.21.15.100:0/1068420471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb1b60 msgr2=0x556e23cd4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb1b60 0x556e23cd4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 -- 172.21.15.100:0/1068420471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb2480 msgr2=0x556e23cd4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb2480 0x556e23cd4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 -- 172.21.15.100:0/1068420471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e23cb8220 con 0x556e23cbcd40 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cb6f50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009e40 tx=0x7fbda0010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc30dfbe68a1f6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdad7fa640 1 -- 172.21.15.100:0/1068420471 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0032070 con 0x556e23cbcd40 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdad7fa640 1 -- 172.21.15.100:0/1068420471 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda0010c60 con 0x556e23cbcd40 2024-09-12T02:44:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.326+0000 7fbdad7fa640 1 -- 172.21.15.100:0/1068420471 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0003950 con 0x556e23cbcd40 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 -- 172.21.15.100:0/1068420471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 msgr2=0x556e23cb6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cb6f50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009e40 tx=0x7fbda0010650 comp rx=0 tx=0).stop 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 -- 172.21.15.100:0/1068420471 shutdown_connections 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cbcd40 0x556e23cb6f50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb2480 0x556e23cd4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1068420471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cb1b60 0x556e23cd4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 -- 172.21.15.100:0/1068420471 >> 172.21.15.100:0/1068420471 conn(0x556e23cae0f0 msgr2=0x556e23cbbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 -- 172.21.15.100:0/1068420471 shutdown_connections 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 -- 172.21.15.100:0/1068420471 wait complete. 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.327+0000 7fbdc0552740 1 -- start start 2024-09-12T02:44:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 1 Processor -- start 2024-09-12T02:44:40.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cb7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 0x556e23cb6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb81abbf0 con 0x556e23cb2480 2024-09-12T02:44:40.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb81ad060 con 0x556e23cb1b60 2024-09-12T02:44:40.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb81ac2c0 con 0x556e23cbcd40 2024-09-12T02:44:40.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdc0552740 10 client.0 _ll_register_callbacks cb 0x7fbda8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cb7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cb7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59494/0 (socket says 172.21.15.100:59494) 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 -- 172.21.15.100:0/1672186296 learned_addr learned my addr 172.21.15.100:0/1672186296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 0x556e23cb6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 -- 172.21.15.100:0/1672186296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 msgr2=0x556e23cb6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 0x556e23cb6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 -- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 msgr2=0x556e23cb7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 -- 172.21.15.100:0/1672186296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e23cb6840 con 0x556e23cb2480 2024-09-12T02:44:40.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbdb77fe640 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cb7960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbda802a9a0 tx=0x7fbda8031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8160d42ff2cad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.328+0000 7fbd96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbd96ffd640 1 -- 172.21.15.100:0/1672186296 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8035070 con 0x556e23cb2480 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda0010c60 con 0x556e23cb2480 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbd96ffd640 1 -- 172.21.15.100:0/1672186296 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbda8045880 con 0x556e23cb2480 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbd96ffd640 1 -- 172.21.15.100:0/1672186296 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbda8009520 con 0x556e23cb2480 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 10 client.16416 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e23d3c4c0 con 0x556e23cb2480 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbd96ffd640 1 -- 172.21.15.100:0/1672186296 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda0010c60 con 0x556e23cb2480 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbd96ffd640 1 -- 172.21.15.100:0/1672186296 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbda8004ac0 con 0x556e23cb2480 2024-09-12T02:44:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 10 client.16416 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 20 client.16416 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23d3ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 4 client.16416 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:44:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556e23c1ed00 con 0x556e23cccb20 2024-09-12T02:44:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.329+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23d3ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.330+0000 7fbd96ffd640 10 client.16416 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.330+0000 7fbdaffff640 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23d3ebf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f65525fcc71140f2 server_cookie=6e58b5a1ca982043 in_seq=0 out_seq=0 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbd96ffd640 1 -- 172.21.15.100:0/1672186296 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556e23c1ed00 con 0x556e23cccb20 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbd96ffd640 10 client.16416 handle_command_reply: tid=0 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 client.16416 shutdown 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 msgr2=0x556e23cb7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cb7960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbda802a9a0 tx=0x7fbda8031960 comp rx=0 tx=0).stop 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 shutdown_connections 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556e23cccb20 0x556e23d3ebf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556e23cbcd40 0x556e23cb6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e23cb2480 0x556e23cb7960 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbd96ffd640 0 client.16416 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 --2- 172.21.15.100:0/1672186296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556e23cb1b60 0x556e23cb7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 >> 172.21.15.100:0/1672186296 conn(0x556e23cae0f0 msgr2=0x556e23cb35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 shutdown_connections 2024-09-12T02:44:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 1 -- 172.21.15.100:0/1672186296 wait complete. 2024-09-12T02:44:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.331+0000 7fbdc0552740 20 client.16416 trim_cache size 0 max 16384 2024-09-12T02:44:40.341 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:44:40.341 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:44:40.341 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "006ba17d-849c-44b4-a97b-175d16cf9d0b", 2024-09-12T02:44:40.341 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:44:40.341 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbda40a2c00 msgr2=0x7fbda40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbda40a2c00 0x7fbda40a50c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0005c40 tx=0x7fbdb0086040 comp rx=0 tx=0).stop 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb810c170 msgr2=0x7fbdb819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb810c170 0x7fbdb819cdc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009fd0 tx=0x7fbdb000b260 comp rx=0 tx=0).stop 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 shutdown_connections 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbda40a2c00 0x7fbda40a50c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdb810c170 0x7fbdb819cdc0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb8103660 0x7fbdb8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 --2- 172.21.15.100:0/371882318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdb8102d40 0x7fbdb81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 >> 172.21.15.100:0/371882318 conn(0x7fbdb80fc7a0 msgr2=0x7fbdb80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 shutdown_connections 2024-09-12T02:44:40.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:40.332+0000 7fbdbe179640 1 -- 172.21.15.100:0/371882318 wait complete. 2024-09-12T02:44:41.010 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:40 smithi100 ceph-mon[31390]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.7 MiB/s wr, 700 op/s 2024-09-12T02:44:41.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:40 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:44:41.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:40 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:44:41.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:40 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:44:41.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.011 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.012 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:44:41.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:40 smithi189 ceph-mon[35196]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.7 MiB/s wr, 700 op/s 2024-09-12T02:44:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:40 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:44:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:40 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:44:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:40 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:44:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:40 smithi117 ceph-mon[34898]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.7 MiB/s wr, 700 op/s 2024-09-12T02:44:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:40 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:44:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:40 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:44:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:40 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:44:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:44:41.254 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:41.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:44:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.777+0000 7f8ba0109640 1 -- 172.21.15.100:0/313945362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98102d30 msgr2=0x7f8b98103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.777+0000 7f8ba0109640 1 --2- 172.21.15.100:0/313945362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98102d30 0x7f8b98103110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009cd0 tx=0x7f8b8802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- 172.21.15.100:0/313945362 shutdown_connections 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 --2- 172.21.15.100:0/313945362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b981082a0 0x7f8b9810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 --2- 172.21.15.100:0/313945362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b981036e0 0x7f8b98107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 --2- 172.21.15.100:0/313945362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98102d30 0x7f8b98103110 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- 172.21.15.100:0/313945362 >> 172.21.15.100:0/313945362 conn(0x7f8b980fc7d0 msgr2=0x7f8b980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- 172.21.15.100:0/313945362 shutdown_connections 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- 172.21.15.100:0/313945362 wait complete. 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 Processor -- start 2024-09-12T02:44:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- start start 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102d30 0x7f8b98198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b981036e0 0x7f8b98198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b981082a0 0x7f8b9819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981120a0 con 0x7f8b981082a0 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b98111f20 con 0x7f8b981036e0 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.778+0000 7f8ba0109640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8b98112220 con 0x7f8b98102d30 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b981082a0 0x7f8b9819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b981082a0 0x7f8b9819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59508/0 (socket says 172.21.15.100:59508) 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 -- 172.21.15.100:0/4068269690 learned_addr learned my addr 172.21.15.100:0/4068269690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102d30 0x7f8b98198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b981036e0 0x7f8b98198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 -- 172.21.15.100:0/4068269690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102d30 msgr2=0x7f8b98198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102d30 0x7f8b98198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 -- 172.21.15.100:0/4068269690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b981036e0 msgr2=0x7f8b98198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b981036e0 0x7f8b98198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 -- 172.21.15.100:0/4068269690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9819d4d0 con 0x7f8b981082a0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b9e6a6640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b981082a0 0x7f8b9819cdf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000c970 tx=0x7f8b9000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b96ffd640 1 -- 172.21.15.100:0/4068269690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90007bb0 con 0x7f8b981082a0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b96ffd640 1 -- 172.21.15.100:0/4068269690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b90007d50 con 0x7f8b981082a0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9819d7c0 con 0x7f8b981082a0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8b96ffd640 1 -- 172.21.15.100:0/4068269690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90018800 con 0x7f8b981082a0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.779+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b981a50a0 con 0x7f8b981082a0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.781+0000 7f8b96ffd640 1 -- 172.21.15.100:0/4068269690 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8b9000fa50 con 0x7f8b981082a0 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 Processor -- start 2024-09-12T02:44:41.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 -- start start 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03380 0x55e42ef03760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03ca0 0x55e42ef12550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef14e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e42ee692e0 con 0x55e42ef03ca0 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e42ee10ce0 con 0x55e42ef12a90 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e42ee652a0 con 0x55e42ef03380 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8b96ffd640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8b800a2b80 0x7f8b800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8b9dea5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03ca0 0x55e42ef12550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8b9dea5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03ca0 0x55e42ef12550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59522/0 (socket says 172.21.15.100:59522) 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8b9dea5640 1 -- 172.21.15.100:0/3485181573 learned_addr learned my addr 172.21.15.100:0/3485181573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8b9e6a6640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8b800a2b80 0x7f8b800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef14e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.782+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03380 0x55e42ef03760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b96ffd640 1 -- 172.21.15.100:0/4068269690 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8b900cefa0 con 0x7f8b981082a0 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9dea5640 1 -- 172.21.15.100:0/3485181573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03380 msgr2=0x55e42ef03760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03380 0x55e42ef03760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9dea5640 1 -- 172.21.15.100:0/3485181573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 msgr2=0x55e42ef14e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef14e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9dea5640 1 -- 172.21.15.100:0/3485181573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42edf5440 con 0x55e42ef03ca0 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef14e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03ca0 0x55e42ef12550 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009cd0 tx=0x7f8b880314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be265efc99b5bc5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b9e6a6640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8b800a2b80 0x7f8b800a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8b9009b4f0 tx=0x7f8b90066470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b7ffff640 1 -- 172.21.15.100:0/3485181573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88048070 con 0x55e42ef03ca0 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b7ffff640 1 -- 172.21.15.100:0/3485181573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b88036070 con 0x55e42ef03ca0 2024-09-12T02:44:41.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.783+0000 7f8b7ffff640 1 -- 172.21.15.100:0/3485181573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b880045d0 con 0x55e42ef03ca0 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3485181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03ca0 msgr2=0x55e42ef12550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03ca0 0x55e42ef12550 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009cd0 tx=0x7f8b880314e0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3485181573 shutdown_connections 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef14e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03ca0 0x55e42ef12550 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3485181573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03380 0x55e42ef03760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3485181573 >> 172.21.15.100:0/3485181573 conn(0x55e42eeffa30 msgr2=0x55e42eeffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3485181573 shutdown_connections 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3485181573 wait complete. 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 -- start start 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.784+0000 7f8ba24e2740 1 Processor -- start 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef123b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 0x55e42ef0f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef0fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e42ef15660 con 0x55e42ef03380 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e42ee24050 con 0x55e42ef12a90 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e42ef157e0 con 0x55e42ef03ca0 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8ba24e2740 10 client.0 _ll_register_callbacks cb 0x55e42ee64160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef123b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59532/0 (socket says 172.21.15.100:59532) 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/3905852910 learned_addr learned my addr 172.21.15.100:0/3905852910 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef0fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 0x55e42ef0f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/3905852910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 msgr2=0x55e42ef0f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 0x55e42ef0f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 msgr2=0x55e42ef0fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef0fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/3905852910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42ebda3c0 con 0x55e42ef03380 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef123b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b980697d0 tx=0x7f8b8c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac12f5af716a1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.785+0000 7f8b7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/3905852910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c011cb0 con 0x55e42ef03380 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/3905852910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8b8c005020 con 0x55e42ef03380 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b88036070 con 0x55e42ef03380 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/3905852910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b8c011e50 con 0x55e42ef03380 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 10 client.16428 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e42ef21120 con 0x55e42ef03380 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/3905852910 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b88036070 con 0x55e42ef03380 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/3905852910 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8b8c021420 con 0x55e42ef03380 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 10 client.16428 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 20 client.16428 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef22530 0x55e42ef24940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 4 client.16428 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.786+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e42ee76850 con 0x55e42ef22530 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.787+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef22530 0x55e42ef24940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.787+0000 7f8b7d7fa640 10 client.16428 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.787+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef22530 0x55e42ef24940 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a89a65bdbecf088 server_cookie=ff34de7ad3251878 in_seq=0 out_seq=0 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/3905852910 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e42ee76850 con 0x55e42ef22530 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8b7d7fa640 10 client.16428 handle_command_reply: tid=0 2024-09-12T02:44:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 client.16428 shutdown 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 msgr2=0x55e42ef123b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef123b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b980697d0 tx=0x7f8b8c014040 comp rx=0 tx=0).stop 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 shutdown_connections 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef22530 0x55e42ef24940 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef0fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 0x55e42ef0f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/3905852910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef123b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8b7d7fa640 0 client.16428 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 >> 172.21.15.100:0/3905852910 conn(0x55e42eeffa30 msgr2=0x55e42ef05790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 shutdown_connections 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 1 -- 172.21.15.100:0/3905852910 wait complete. 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.788+0000 7f8ba24e2740 20 client.16428 trim_cache size 0 max 16384 2024-09-12T02:44:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 Processor -- start 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 -- start start 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef1e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef03ca0 0x55e42eefea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef12a90 0x55e42ef2a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981adaf0 con 0x55e42ef03380 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981ab3c0 con 0x55e42ef03ca0 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981a9230 con 0x55e42ef12a90 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef1e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef1e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59544/0 (socket says 172.21.15.100:59544) 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/2663184993 learned_addr learned my addr 172.21.15.100:0/2663184993 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/2663184993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef12a90 msgr2=0x55e42ef2a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/2663184993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef12a90 0x55e42ef2a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/2663184993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef03ca0 msgr2=0x55e42eefea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/2663184993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef03ca0 0x55e42eefea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.805+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/2663184993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42ef03ad0 con 0x55e42ef03380 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/2663184993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef1e900 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0127f0 tx=0x7f8b8c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e9e0f81bbaa62f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8b7f7fe640 1 -- 172.21.15.100:0/2663184993 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c030070 con 0x55e42ef03380 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8b7f7fe640 1 -- 172.21.15.100:0/2663184993 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b8c00bd30 con 0x55e42ef03380 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8b7f7fe640 1 -- 172.21.15.100:0/2663184993 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c005280 con 0x55e42ef03380 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8ba24e2740 1 -- 172.21.15.100:0/2663184993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 msgr2=0x55e42ef1e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/2663184993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef1e900 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0127f0 tx=0x7f8b8c005c50 comp rx=0 tx=0).stop 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8ba24e2740 1 -- 172.21.15.100:0/2663184993 shutdown_connections 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/2663184993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef12a90 0x55e42ef2a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/2663184993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef03ca0 0x55e42eefea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/2663184993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef1e900 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.806+0000 7f8ba24e2740 1 -- 172.21.15.100:0/2663184993 >> 172.21.15.100:0/2663184993 conn(0x55e42eeffa30 msgr2=0x55e42eefe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 -- 172.21.15.100:0/2663184993 shutdown_connections 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 -- 172.21.15.100:0/2663184993 wait complete. 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 -- start start 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 Processor -- start 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef16990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 0x55e42ef16ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef17410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981a9880 con 0x55e42ef03380 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981aacf0 con 0x55e42ef12a90 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.807+0000 7f8ba24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981a9f50 con 0x55e42ef03ca0 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8ba24e2740 10 client.0 _ll_register_callbacks cb 0x7f8b8c00b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef16990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef16990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59560/0 (socket says 172.21.15.100:59560) 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/931849740 learned_addr learned my addr 172.21.15.100:0/931849740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/931849740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 msgr2=0x55e42ef16ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 0x55e42ef16ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/931849740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 msgr2=0x55e42ef17410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef17410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 -- 172.21.15.100:0/931849740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42ef0ff80 con 0x55e42ef03380 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b9d6a4640 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef16990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c021770 tx=0x7f8b8c0058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750fa201d66d9ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/931849740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c038070 con 0x55e42ef03380 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e42ee70d60 con 0x55e42ef03380 2024-09-12T02:44:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/931849740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8b8c005030 con 0x55e42ef03380 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/931849740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b8c030070 con 0x55e42ef03380 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8ba24e2740 10 client.16434 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e42ef8d4c0 con 0x55e42ef03380 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.808+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/931849740 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e42ee70d60 con 0x55e42ef03380 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/931849740 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8b8c03b030 con 0x55e42ef03380 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 10 client.16434 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 20 client.16434 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef8dad0 0x55e42ef8fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 4 client.16434 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e42eded210 con 0x55e42ef8dad0 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef8dad0 0x55e42ef8fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8b9dea5640 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef8dad0 0x55e42ef8fec0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549a1723ce6379c9 server_cookie=98004dff9802b1d0 in_seq=0 out_seq=0 2024-09-12T02:44:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8b7d7fa640 10 client.16434 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8b7d7fa640 1 -- 172.21.15.100:0/931849740 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e42eded210 con 0x55e42ef8dad0 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8b7d7fa640 10 client.16434 handle_command_reply: tid=0 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 1 client.16434 shutdown 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 msgr2=0x55e42ef16990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.809+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef16990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c021770 tx=0x7f8b8c0058c0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 shutdown_connections 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e42ef8dad0 0x55e42ef8fec0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.965 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: "006ba17d-849c-44b4-a97b-175d16cf9d0b": { 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "006ba17d-849c-44b4-a97b-175d16cf9d0b", 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:41.966 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e42ef12a90 0x55e42ef17410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42ef03ca0 0x55e42ef16ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8b7d7fa640 0 client.16434 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 --2- 172.21.15.100:0/931849740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e42ef03380 0x55e42ef16990 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 >> 172.21.15.100:0/931849740 conn(0x55e42eeffa30 msgr2=0x55e42eefe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 shutdown_connections 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 1 -- 172.21.15.100:0/931849740 wait complete. 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba24e2740 20 client.16434 trim_cache size 0 max 16384 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8b800a2b80 msgr2=0x7f8b800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8b800a2b80 0x7f8b800a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8b9009b4f0 tx=0x7f8b90066470 comp rx=0 tx=0).stop 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b981082a0 msgr2=0x7f8b9819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b981082a0 0x7f8b9819cdf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000c970 tx=0x7f8b9000ce30 comp rx=0 tx=0).stop 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 shutdown_connections 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f8b800a2b80 0x7f8b800a5040 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b981082a0 0x7f8b9819cdf0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b981036e0 0x7f8b98198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 --2- 172.21.15.100:0/4068269690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102d30 0x7f8b98198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 >> 172.21.15.100:0/4068269690 conn(0x7f8b980fc7d0 msgr2=0x7f8b98105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 shutdown_connections 2024-09-12T02:44:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:41.810+0000 7f8ba0109640 1 -- 172.21.15.100:0/4068269690 wait complete. 2024-09-12T02:44:42.889 INFO:tasks.cephfs.filesystem:scrub status for tag:006ba17d-849c-44b4-a97b-175d16cf9d0b - {'path': '/', 'tag': '006ba17d-849c-44b4-a97b-175d16cf9d0b', 'options': 'recursive,force'} 2024-09-12T02:44:43.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:42 smithi189 ceph-mon[35196]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 603 op/s 2024-09-12T02:44:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:42 smithi117 ceph-mon[34898]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 603 op/s 2024-09-12T02:44:43.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:42 smithi100 ceph-mon[31390]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 603 op/s 2024-09-12T02:44:45.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:44 smithi189 ceph-mon[35196]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.6 MiB/s wr, 459 op/s 2024-09-12T02:44:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:44 smithi117 ceph-mon[34898]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.6 MiB/s wr, 459 op/s 2024-09-12T02:44:45.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:44 smithi100 ceph-mon[31390]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.6 MiB/s wr, 459 op/s 2024-09-12T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:44:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:46 smithi189 ceph-mon[35196]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.5 MiB/s wr, 546 op/s 2024-09-12T02:44:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:46 smithi117 ceph-mon[34898]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.5 MiB/s wr, 546 op/s 2024-09-12T02:44:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:46 smithi100 ceph-mon[31390]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.5 MiB/s wr, 546 op/s 2024-09-12T02:44:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:48 smithi117 ceph-mon[34898]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 612 op/s 2024-09-12T02:44:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:48 smithi100 ceph-mon[31390]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 612 op/s 2024-09-12T02:44:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:48 smithi189 ceph-mon[35196]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 612 op/s 2024-09-12T02:44:50.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:49 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:44:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:49 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:44:50.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:49 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:44:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:50 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:44:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:50 smithi117 ceph-mon[34898]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 679 op/s 2024-09-12T02:44:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:50 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:44:51.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:50 smithi100 ceph-mon[31390]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 679 op/s 2024-09-12T02:44:51.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:50 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:44:51.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:50 smithi189 ceph-mon[35196]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 679 op/s 2024-09-12T02:44:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:44:51.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:44:52.162 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 -- 172.21.15.100:0/1997967153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441036e0 msgr2=0x7f1444107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 --2- 172.21.15.100:0/1997967153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441036e0 0x7f1444107b90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1438009930 tx=0x7f143802a420 comp rx=0 tx=0).stop 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 -- 172.21.15.100:0/1997967153 shutdown_connections 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 --2- 172.21.15.100:0/1997967153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14441082a0 0x7f144410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 --2- 172.21.15.100:0/1997967153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441036e0 0x7f1444107b90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 --2- 172.21.15.100:0/1997967153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1444102d30 0x7f1444103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 -- 172.21.15.100:0/1997967153 >> 172.21.15.100:0/1997967153 conn(0x7f14440fc7d0 msgr2=0x7f14440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 -- 172.21.15.100:0/1997967153 shutdown_connections 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.667+0000 7f1449304640 1 -- 172.21.15.100:0/1997967153 wait complete. 2024-09-12T02:44:52.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 Processor -- start 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 -- start start 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1444102d30 0x7f1444198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14441036e0 0x7f1444198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441082a0 0x7f144419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1444112140 con 0x7f14441082a0 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1444111fc0 con 0x7f1444102d30 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.668+0000 7f1449304640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f14441122c0 con 0x7f14441036e0 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441082a0 0x7f144419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441082a0 0x7f144419d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45878/0 (socket says 172.21.15.100:45878) 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 -- 172.21.15.100:0/238031996 learned_addr learned my addr 172.21.15.100:0/238031996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14427fc640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14441036e0 0x7f1444198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:52.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f1442ffd640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1444102d30 0x7f1444198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 -- 172.21.15.100:0/238031996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14441036e0 msgr2=0x7f1444198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14441036e0 0x7f1444198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 -- 172.21.15.100:0/238031996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1444102d30 msgr2=0x7f1444198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1444102d30 0x7f1444198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 -- 172.21.15.100:0/238031996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144419d6f0 con 0x7f14441082a0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f14437fe640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441082a0 0x7f144419d010 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f143c00b970 tx=0x7f143c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f142bfff640 1 -- 172.21.15.100:0/238031996 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c019070 con 0x7f14441082a0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f142bfff640 1 -- 172.21.15.100:0/238031996 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f143c00cb40 con 0x7f14441082a0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144419d9e0 con 0x7f14441082a0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f142bfff640 1 -- 172.21.15.100:0/238031996 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c007650 con 0x7f14441082a0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.669+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14441a52c0 con 0x7f14441082a0 2024-09-12T02:44:52.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.670+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f144406a850 con 0x7f14441082a0 2024-09-12T02:44:52.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.672+0000 7f142bfff640 1 -- 172.21.15.100:0/238031996 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f143c01c020 con 0x7f14441082a0 2024-09-12T02:44:52.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.673+0000 7f142bfff640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f142c0a2c00 0x7f142c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:52.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.673+0000 7f1442ffd640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f142c0a2c00 0x7f142c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:52.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.673+0000 7f142bfff640 1 -- 172.21.15.100:0/238031996 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f143c0cf0c0 con 0x7f14441082a0 2024-09-12T02:44:52.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.673+0000 7f1442ffd640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f142c0a2c00 0x7f142c0a50c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1434009890 tx=0x7f1434008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:52.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.675+0000 7f142bfff640 1 -- 172.21.15.100:0/238031996 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f143c023030 con 0x7f14441082a0 2024-09-12T02:44:52.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:52 smithi100 ceph-mon[31390]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 784 op/s 2024-09-12T02:44:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.894+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1444103190 con 0x7f14441082a0 2024-09-12T02:44:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.895+0000 7f142bfff640 1 -- 172.21.15.100:0/238031996 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f1444103190 con 0x7f14441082a0 2024-09-12T02:44:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:44:52.896 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:44:52.897 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:44:52.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.902+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f142c0a2c00 msgr2=0x7f142c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:52.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.902+0000 7f1449304640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f142c0a2c00 0x7f142c0a50c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1434009890 tx=0x7f1434008040 comp rx=0 tx=0).stop 2024-09-12T02:44:52.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.902+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441082a0 msgr2=0x7f144419d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:52.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.902+0000 7f1449304640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441082a0 0x7f144419d010 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f143c00b970 tx=0x7f143c00be30 comp rx=0 tx=0).stop 2024-09-12T02:44:52.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.903+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 shutdown_connections 2024-09-12T02:44:52.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.903+0000 7f1449304640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f142c0a2c00 0x7f142c0a50c0 secure :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1434009890 tx=0x7f1434008040 comp rx=0 tx=0).stop 2024-09-12T02:44:52.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.903+0000 7f1449304640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441082a0 0x7f144419d010 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.903+0000 7f1449304640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14441036e0 0x7f1444198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.903+0000 7f1449304640 1 --2- 172.21.15.100:0/238031996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1444102d30 0x7f1444198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:52.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.903+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 >> 172.21.15.100:0/238031996 conn(0x7f14440fc7d0 msgr2=0x7f1444105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:52.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.905+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 shutdown_connections 2024-09-12T02:44:52.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:52.905+0000 7f1449304640 1 -- 172.21.15.100:0/238031996 wait complete. 2024-09-12T02:44:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:52 smithi117 ceph-mon[34898]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 784 op/s 2024-09-12T02:44:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:52 smithi189 ceph-mon[35196]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 784 op/s 2024-09-12T02:44:53.837 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 21a85422 --release --await' 2024-09-12T02:44:53.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 21a85422 --release --await 2024-09-12T02:44:54.085 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:54.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:53 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/238031996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:54.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:53 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/238031996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:54.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:53 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/238031996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:54.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 -- 172.21.15.100:0/2955638236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 msgr2=0x7f0444101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 --2- 172.21.15.100:0/2955638236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f0444101200 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0434009ca0 tx=0x7f043402a950 comp rx=0 tx=0).stop 2024-09-12T02:44:54.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 -- 172.21.15.100:0/2955638236 shutdown_connections 2024-09-12T02:44:54.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 --2- 172.21.15.100:0/2955638236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0444102ef0 0x7f044410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 --2- 172.21.15.100:0/2955638236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0444102570 0x7f04441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 --2- 172.21.15.100:0/2955638236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f0444101200 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 -- 172.21.15.100:0/2955638236 >> 172.21.15.100:0/2955638236 conn(0x7f04440fc7d0 msgr2=0x7f04440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 -- 172.21.15.100:0/2955638236 shutdown_connections 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 -- 172.21.15.100:0/2955638236 wait complete. 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 Processor -- start 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.567+0000 7f044b67b640 1 -- start start 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f044b67b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f04441992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f044b67b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0444102570 0x7f0444199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f044b67b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0444102ef0 0x7f04441a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f044b67b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0444110f80 con 0x7f0444100e20 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f044b67b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0444110e00 con 0x7f0444102570 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f044b67b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0444111100 con 0x7f0444102ef0 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f04441992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f04441992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35598/0 (socket says 172.21.15.100:35598) 2024-09-12T02:44:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 -- 172.21.15.100:0/581237557 learned_addr learned my addr 172.21.15.100:0/581237557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0448c16640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0444102570 0x7f0444199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449c18640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0444102ef0 0x7f04441a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 -- 172.21.15.100:0/581237557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0444102ef0 msgr2=0x7f04441a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0444102ef0 0x7f04441a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 -- 172.21.15.100:0/581237557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0444102570 msgr2=0x7f0444199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0444102570 0x7f0444199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 -- 172.21.15.100:0/581237557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04441a4890 con 0x7f0444100e20 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0448c16640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0444102570 0x7f0444199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f0449417640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f04441992d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0434005cc0 tx=0x7f043402f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f04427fc640 1 -- 172.21.15.100:0/581237557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434034040 con 0x7f0444100e20 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.568+0000 7f04427fc640 1 -- 172.21.15.100:0/581237557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0434003e40 con 0x7f0444100e20 2024-09-12T02:44:54.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.569+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04441a4a60 con 0x7f0444100e20 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.569+0000 7f04427fc640 1 -- 172.21.15.100:0/581237557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434045480 con 0x7f0444100e20 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.569+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04441a4f10 con 0x7f0444100e20 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.571+0000 7f04427fc640 1 -- 172.21.15.100:0/581237557 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f0434037020 con 0x7f0444100e20 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.571+0000 7f044da54740 1 Processor -- start 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.571+0000 7f044da54740 1 -- start start 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.571+0000 7f04427fc640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f042c0a2c00 0x7f042c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f044da54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1060 0x55c6f03c1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f044da54740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f044da54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03cc240 0x55c6f03ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f044da54740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0326620 con 0x55c6f03c1060 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f044da54740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c6f02cde50 con 0x55c6f03c1980 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f044da54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c6f03225e0 con 0x55c6f03cc240 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1060 0x55c6f03c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449c18640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f042c0a2c00 0x7f042c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1060 0x55c6f03c1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35614/0 (socket says 172.21.15.100:35614) 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 -- 172.21.15.100:0/4197706491 learned_addr learned my addr 172.21.15.100:0/4197706491 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0448c16640 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f04427fc640 1 -- 172.21.15.100:0/581237557 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f04340f0300 con 0x7f0444100e20 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449c18640 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03cc240 0x55c6f03ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 -- 172.21.15.100:0/4197706491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03cc240 msgr2=0x55c6f03ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03cc240 0x55c6f03ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 -- 172.21.15.100:0/4197706491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 msgr2=0x55c6f03cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 -- 172.21.15.100:0/4197706491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f02bed40 con 0x55c6f03c1060 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0448c16640 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449c18640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f042c0a2c00 0x7f042c0a50c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f043c005fd0 tx=0x7f043c0127c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f0449417640 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1060 0x55c6f03c1440 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f04340edd90 tx=0x7f043402cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e06e249f3e996 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f042b7fe640 1 -- 172.21.15.100:0/4197706491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043407c0d0 con 0x55c6f03c1060 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f042b7fe640 1 -- 172.21.15.100:0/4197706491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04340bd1f0 con 0x55c6f03c1060 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.572+0000 7f042b7fe640 1 -- 172.21.15.100:0/4197706491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434043e40 con 0x55c6f03c1060 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 -- 172.21.15.100:0/4197706491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1060 msgr2=0x55c6f03c1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1060 0x55c6f03c1440 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f04340edd90 tx=0x7f043402cc70 comp rx=0 tx=0).stop 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 -- 172.21.15.100:0/4197706491 shutdown_connections 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03cc240 0x55c6f03ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 --2- 172.21.15.100:0/4197706491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1060 0x55c6f03c1440 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 -- 172.21.15.100:0/4197706491 >> 172.21.15.100:0/4197706491 conn(0x55c6f03bd5f0 msgr2=0x55c6f03bd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 -- 172.21.15.100:0/4197706491 shutdown_connections 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.573+0000 7f044da54740 1 -- 172.21.15.100:0/4197706491 wait complete. 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 -- start start 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 Processor -- start 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1980 0x55c6f03c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03cc240 0x55c6f03c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c6f03cebd0 con 0x55c6f03c1980 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c6f02aef10 con 0x55c6f03cc240 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c6f03ced50 con 0x55c6f03c1060 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f044da54740 10 client.0 _ll_register_callbacks cb 0x55c6f02d2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f0448c16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1980 0x55c6f03c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f0448c16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1980 0x55c6f03c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35628/0 (socket says 172.21.15.100:35628) 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f0448c16640 1 -- 172.21.15.100:0/891340750 learned_addr learned my addr 172.21.15.100:0/891340750 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f0449417640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.574+0000 7f0449c18640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03cc240 0x55c6f03c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0448c16640 1 -- 172.21.15.100:0/891340750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 msgr2=0x55c6f03c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0448c16640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0448c16640 1 -- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03cc240 msgr2=0x55c6f03c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0448c16640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03cc240 0x55c6f03c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0448c16640 1 -- 172.21.15.100:0/891340750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f0035580 con 0x55c6f03c1980 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0449417640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:54.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0448c16640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1980 0x55c6f03c9730 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0438011800 tx=0x7f0438011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4fd266efbdb43a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0428ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0428ff9640 1 -- 172.21.15.100:0/891340750 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043800fe70 con 0x55c6f03c1980 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0428ff9640 1 -- 172.21.15.100:0/891340750 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f0438005020 con 0x55c6f03c1980 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04340bd1f0 con 0x55c6f03c1980 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0428ff9640 1 -- 172.21.15.100:0/891340750 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0438005220 con 0x55c6f03c1980 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 10 client.16452 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c6f00ff960 con 0x55c6f03c1980 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0428ff9640 1 -- 172.21.15.100:0/891340750 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04340bd1f0 con 0x55c6f03c1980 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f0428ff9640 1 -- 172.21.15.100:0/891340750 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0438018030 con 0x55c6f03c1980 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 10 client.16452 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 10 client.16452 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 20 client.16452 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f03dbc80 0x55c6f03de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 4 client.16452 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.575+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6f0333b90 con 0x55c6f03dbc80 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.576+0000 7f0449417640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f03dbc80 0x55c6f03de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.576+0000 7f0428ff9640 10 client.16452 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.576+0000 7f0449417640 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f03dbc80 0x55c6f03de0d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dac27b60415d7c47 server_cookie=a3ab7cba9068327c in_seq=0 out_seq=0 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f0428ff9640 1 -- 172.21.15.100:0/891340750 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6f0333b90 con 0x55c6f03dbc80 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f0428ff9640 10 client.16452 handle_command_reply: tid=0 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 client.16452 shutdown 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1980 msgr2=0x55c6f03c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1980 0x55c6f03c9730 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0438011800 tx=0x7f0438011cc0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 shutdown_connections 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f03dbc80 0x55c6f03de0d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03cc240 0x55c6f03c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03c1980 0x55c6f03c9730 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f0428ff9640 0 client.16452 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 --2- 172.21.15.100:0/891340750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 >> 172.21.15.100:0/891340750 conn(0x55c6f03bd5f0 msgr2=0x55c6f03c3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 shutdown_connections 2024-09-12T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 1 -- 172.21.15.100:0/891340750 wait complete. 2024-09-12T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.577+0000 7f044da54740 20 client.16452 trim_cache size 0 max 16384 2024-09-12T02:44:54.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 Processor -- start 2024-09-12T02:44:54.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 -- start start 2024-09-12T02:44:54.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1060 0x55c6f03cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1980 0x55c6f03e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04441afcf0 con 0x55c6f03cc240 2024-09-12T02:44:54.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04441ad5c0 con 0x55c6f03c1060 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f044da54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f04441ab410 con 0x55c6f03c1980 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f0449c18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f0449c18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03e3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35638/0 (socket says 172.21.15.100:35638) 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f0449c18640 1 -- 172.21.15.100:0/3019346965 learned_addr learned my addr 172.21.15.100:0/3019346965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.594+0000 7f0449417640 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1060 0x55c6f03cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f0448c16640 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1980 0x55c6f03e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f0449c18640 1 -- 172.21.15.100:0/3019346965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1980 msgr2=0x55c6f03e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f0449c18640 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1980 0x55c6f03e39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f0449c18640 1 -- 172.21.15.100:0/3019346965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1060 msgr2=0x55c6f03cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f0449c18640 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1060 0x55c6f03cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f0449c18640 1 -- 172.21.15.100:0/3019346965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f03da880 con 0x55c6f03cc240 2024-09-12T02:44:54.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f0449c18640 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03e3f20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f043c00ccf0 tx=0x7f043c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce869fd416b7139d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:54.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f042affd640 1 -- 172.21.15.100:0/3019346965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c02a680 con 0x55c6f03cc240 2024-09-12T02:44:54.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f042affd640 1 -- 172.21.15.100:0/3019346965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c02ad00 con 0x55c6f03cc240 2024-09-12T02:44:54.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.595+0000 7f042affd640 1 -- 172.21.15.100:0/3019346965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c01fda0 con 0x55c6f03cc240 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 -- 172.21.15.100:0/3019346965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 msgr2=0x55c6f03e3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03e3f20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f043c00ccf0 tx=0x7f043c01c000 comp rx=0 tx=0).stop 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 -- 172.21.15.100:0/3019346965 shutdown_connections 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03e3f20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1980 0x55c6f03e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 --2- 172.21.15.100:0/3019346965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1060 0x55c6f03cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 -- 172.21.15.100:0/3019346965 >> 172.21.15.100:0/3019346965 conn(0x55c6f03bd5f0 msgr2=0x55c6f03caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 -- 172.21.15.100:0/3019346965 shutdown_connections 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 -- 172.21.15.100:0/3019346965 wait complete. 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 -- start start 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.596+0000 7f044da54740 1 Processor -- start 2024-09-12T02:44:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04441aba80 con 0x55c6f03cc240 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04441acef0 con 0x55c6f03c1980 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f04441ac150 con 0x55c6f03c1060 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 10 client.0 _ll_register_callbacks cb 0x7f043800c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35652/0 (socket says 172.21.15.100:35652) 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 -- 172.21.15.100:0/39048692 learned_addr learned my addr 172.21.15.100:0/39048692 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0448c16640 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449417640 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 -- 172.21.15.100:0/39048692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 msgr2=0x55c6f03d4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03d4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 -- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 msgr2=0x55c6f03d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 -- 172.21.15.100:0/39048692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f03d12c0 con 0x55c6f03cc240 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0449c18640 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03d0d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f043c010c90 tx=0x7f043c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00b444947366d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0428ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0428ff9640 1 -- 172.21.15.100:0/39048692 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c01f400 con 0x55c6f03cc240 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f0428ff9640 1 -- 172.21.15.100:0/39048692 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f043c02a480 con 0x55c6f03cc240 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.597+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043c02ad00 con 0x55c6f03cc240 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f0428ff9640 1 -- 172.21.15.100:0/39048692 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f043c005660 con 0x55c6f03cc240 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 10 client.16458 fetch_fsmap learned FSMap version 27 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c6f0447790 con 0x55c6f03cc240 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f0428ff9640 1 -- 172.21.15.100:0/39048692 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c02ad00 con 0x55c6f03cc240 2024-09-12T02:44:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f0428ff9640 1 -- 172.21.15.100:0/39048692 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f043c03c050 con 0x55c6f03cc240 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 10 client.16458 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 10 client.16458 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 20 client.16458 populate_metadata read hostname 'smithi100' 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f0447e00 0x55c6f044a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 4 client.16458 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "21a85422", "release": true, "await": true}] 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "21a85422", "release": true, "await": true}) -- 0x55c6f032e0a0 con 0x55c6f0447e00 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f0449417640 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f0447e00 0x55c6f044a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f0428ff9640 10 client.16458 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.598+0000 7f0449417640 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f0447e00 0x55c6f044a220 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b34c184bc470af13 server_cookie=4eab2cd85571e99 in_seq=0 out_seq=0 2024-09-12T02:44:54.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.653+0000 7f0428ff9640 1 -- 172.21.15.100:0/39048692 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c6f032e0a0 con 0x55c6f0447e00 2024-09-12T02:44:54.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.653+0000 7f0428ff9640 10 client.16458 handle_command_reply: tid=0 2024-09-12T02:44:54.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.653+0000 7f044da54740 1 client.16458 shutdown 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 msgr2=0x55c6f03d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03d0d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f043c010c90 tx=0x7f043c005270 comp rx=0 tx=0).stop 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 shutdown_connections 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c6f0447e00 0x55c6f044a220 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6f03cc240 0x55c6f03d0d00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c6f03c1980 0x55c6f03d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 --2- 172.21.15.100:0/39048692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6f03c1060 0x55c6f03d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 >> 172.21.15.100:0/39048692 conn(0x55c6f03bd5f0 msgr2=0x55c6f03bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f0428ff9640 0 client.16458 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 shutdown_connections 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 1 -- 172.21.15.100:0/39048692 wait complete. 2024-09-12T02:44:54.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.654+0000 7f044da54740 20 client.16458 trim_cache size 0 max 16384 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 24, 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "21a85422": { 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 24, 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:44:54.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 140.1, 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:44:54.658 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.655+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f042c0a2c00 msgr2=0x7f042c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.655+0000 7f044b67b640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f042c0a2c00 0x7f042c0a50c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f043c005fd0 tx=0x7f043c0127c0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.655+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 msgr2=0x7f04441992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.655+0000 7f044b67b640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f04441992d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0434005cc0 tx=0x7f043402f6c0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.655+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 shutdown_connections 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.656+0000 7f044b67b640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f042c0a2c00 0x7f042c0a50c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.656+0000 7f044b67b640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0444102ef0 0x7f04441a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.656+0000 7f044b67b640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0444102570 0x7f0444199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.656+0000 7f044b67b640 1 --2- 172.21.15.100:0/581237557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0444100e20 0x7f04441992d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.656+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 >> 172.21.15.100:0/581237557 conn(0x7f04440fc7d0 msgr2=0x7f04440fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.656+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 shutdown_connections 2024-09-12T02:44:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:44:54.656+0000 7f044b67b640 1 -- 172.21.15.100:0/581237557 wait complete. 2024-09-12T02:44:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:54 smithi117 ceph-mon[34898]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 MiB/s wr, 807 op/s 2024-09-12T02:44:55.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:54 smithi100 ceph-mon[31390]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 MiB/s wr, 807 op/s 2024-09-12T02:44:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:54 smithi189 ceph-mon[35196]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 MiB/s wr, 807 op/s 2024-09-12T02:44:55.441 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '21a85422', total seconds elapsed: 23.6 2024-09-12T02:44:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 345.0 s, 1123.5 tps, lat 356.838 ms stddev 2438.545 2024-09-12T02:44:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:56 smithi117 ceph-mon[34898]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 27 MiB/s wr, 781 op/s 2024-09-12T02:44:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:56 smithi100 ceph-mon[31390]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 27 MiB/s wr, 781 op/s 2024-09-12T02:44:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:56 smithi189 ceph-mon[35196]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 27 MiB/s wr, 781 op/s 2024-09-12T02:44:58.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:44:57 smithi100 ceph-mon[31390]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 24 MiB/s wr, 724 op/s 2024-09-12T02:44:58.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:44:57 smithi189 ceph-mon[35196]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 24 MiB/s wr, 724 op/s 2024-09-12T02:44:58.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:44:57 smithi117 ceph-mon[34898]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 24 MiB/s wr, 724 op/s 2024-09-12T02:45:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:00 smithi189 ceph-mon[35196]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 20 MiB/s wr, 647 op/s 2024-09-12T02:45:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:00 smithi117 ceph-mon[34898]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 20 MiB/s wr, 647 op/s 2024-09-12T02:45:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:00 smithi100 ceph-mon[31390]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 20 MiB/s wr, 647 op/s 2024-09-12T02:45:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 350.0 s, 3256.6 tps, lat 30.704 ms stddev 32.521 2024-09-12T02:45:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:02 smithi189 ceph-mon[35196]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 597 op/s 2024-09-12T02:45:03.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:02 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:02 smithi117 ceph-mon[34898]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 597 op/s 2024-09-12T02:45:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:02 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:02 smithi100 ceph-mon[31390]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 597 op/s 2024-09-12T02:45:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:02 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:04.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:04.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:04.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:45:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:45:04.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:04.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:04.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:45:05.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:04 smithi189 ceph-mon[35196]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.6 MiB/s wr, 496 op/s 2024-09-12T02:45:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:04 smithi117 ceph-mon[34898]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.6 MiB/s wr, 496 op/s 2024-09-12T02:45:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:04 smithi100 ceph-mon[31390]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.6 MiB/s wr, 496 op/s 2024-09-12T02:45:06.299 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 355.0 s, 3350.6 tps, lat 29.785 ms stddev 32.652 2024-09-12T02:45:07.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:06 smithi189 ceph-mon[35196]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.4 MiB/s wr, 571 op/s 2024-09-12T02:45:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:06 smithi117 ceph-mon[34898]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.4 MiB/s wr, 571 op/s 2024-09-12T02:45:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:06 smithi100 ceph-mon[31390]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.4 MiB/s wr, 571 op/s 2024-09-12T02:45:09.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:08 smithi189 ceph-mon[35196]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 674 op/s 2024-09-12T02:45:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:08 smithi117 ceph-mon[34898]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 674 op/s 2024-09-12T02:45:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:08 smithi100 ceph-mon[31390]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 674 op/s 2024-09-12T02:45:11.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:10 smithi189 ceph-mon[35196]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.4 MiB/s wr, 719 op/s 2024-09-12T02:45:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:10 smithi117 ceph-mon[34898]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.4 MiB/s wr, 719 op/s 2024-09-12T02:45:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:10 smithi100 ceph-mon[31390]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.4 MiB/s wr, 719 op/s 2024-09-12T02:45:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 360.0 s, 3430.2 tps, lat 29.225 ms stddev 32.741 2024-09-12T02:45:12.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:45:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:12 smithi189 ceph-mon[35196]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.8 MiB/s wr, 744 op/s 2024-09-12T02:45:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:12 smithi117 ceph-mon[34898]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.8 MiB/s wr, 744 op/s 2024-09-12T02:45:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:12 smithi100 ceph-mon[31390]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.8 MiB/s wr, 744 op/s 2024-09-12T02:45:13.270 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.074+0000 7fab41c87640 1 -- 172.21.15.100:0/156750701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab3c1139e0 msgr2=0x7fab3c115e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.074+0000 7fab41c87640 1 --2- 172.21.15.100:0/156750701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab3c1139e0 0x7fab3c115e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab34009be0 tx=0x7fab3402e870 comp rx=0 tx=0).stop 2024-09-12T02:45:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.075+0000 7fab41c87640 1 -- 172.21.15.100:0/156750701 shutdown_connections 2024-09-12T02:45:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.075+0000 7fab41c87640 1 --2- 172.21.15.100:0/156750701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab3c1139e0 0x7fab3c115e70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.075+0000 7fab41c87640 1 --2- 172.21.15.100:0/156750701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10ae80 0x7fab3c113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.075+0000 7fab41c87640 1 --2- 172.21.15.100:0/156750701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab3c10a560 0x7fab3c10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.075+0000 7fab41c87640 1 -- 172.21.15.100:0/156750701 >> 172.21.15.100:0/156750701 conn(0x7fab3c06e2d0 msgr2=0x7fab3c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.075+0000 7fab41c87640 1 -- 172.21.15.100:0/156750701 shutdown_connections 2024-09-12T02:45:14.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.075+0000 7fab41c87640 1 -- 172.21.15.100:0/156750701 wait complete. 2024-09-12T02:45:14.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.076+0000 7fab41c87640 1 Processor -- start 2024-09-12T02:45:14.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.077+0000 7fab41c87640 1 -- start start 2024-09-12T02:45:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.077+0000 7fab41c87640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10a560 0x7fab3c1a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.078+0000 7fab41c87640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab3c10ae80 0x7fab3c1a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.078+0000 7fab41c87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab3c1139e0 0x7fab3c19e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.078+0000 7fab41c87640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1185e0 con 0x7fab3c10a560 2024-09-12T02:45:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.078+0000 7fab41c87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c118460 con 0x7fab3c1139e0 2024-09-12T02:45:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.078+0000 7fab41c87640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c118760 con 0x7fab3c10ae80 2024-09-12T02:45:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.078+0000 7fab3bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab3c1139e0 0x7fab3c19e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.080+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10a560 0x7fab3c1a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.080+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10a560 0x7fab3c1a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38124/0 (socket says 172.21.15.100:38124) 2024-09-12T02:45:14.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.080+0000 7fab3b7fe640 1 -- 172.21.15.100:0/299114019 learned_addr learned my addr 172.21.15.100:0/299114019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.086+0000 7fab3b7fe640 1 -- 172.21.15.100:0/299114019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab3c10ae80 msgr2=0x7fab3c1a4ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:45:14.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.086+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab3c10ae80 0x7fab3c1a4ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.086+0000 7fab3b7fe640 1 -- 172.21.15.100:0/299114019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab3c1139e0 msgr2=0x7fab3c19e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.086+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab3c1139e0 0x7fab3c19e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.086+0000 7fab3b7fe640 1 -- 172.21.15.100:0/299114019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c19eec0 con 0x7fab3c10a560 2024-09-12T02:45:14.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.087+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10a560 0x7fab3c1a4580 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007860 tx=0x7fab2c007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:14.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.088+0000 7fab38ff9640 1 -- 172.21.15.100:0/299114019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c019020 con 0x7fab3c10a560 2024-09-12T02:45:14.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.088+0000 7fab38ff9640 1 -- 172.21.15.100:0/299114019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2c015470 con 0x7fab3c10a560 2024-09-12T02:45:14.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.088+0000 7fab38ff9640 1 -- 172.21.15.100:0/299114019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c014630 con 0x7fab3c10a560 2024-09-12T02:45:14.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.089+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c19f1b0 con 0x7fab3c10a560 2024-09-12T02:45:14.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.089+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c1ab330 con 0x7fab3c10a560 2024-09-12T02:45:14.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.094+0000 7fab44060740 1 Processor -- start 2024-09-12T02:45:14.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.094+0000 7fab44060740 1 -- start start 2024-09-12T02:45:14.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.094+0000 7fab44060740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822c9b90 0x5593822c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.095+0000 7fab44060740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822ca4b0 0x5593822c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.095+0000 7fab44060740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x5593822dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.095+0000 7fab44060740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5593822272e0 con 0x5593822ca4b0 2024-09-12T02:45:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.095+0000 7fab44060740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5593821cece0 con 0x5593822c9b90 2024-09-12T02:45:14.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.095+0000 7fab44060740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5593822232a0 con 0x5593822dd900 2024-09-12T02:45:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.095+0000 7fab3bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822c9b90 0x5593822c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.096+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822ca4b0 0x5593822c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.096+0000 7fab38ff9640 1 -- 172.21.15.100:0/299114019 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fab2c01c020 con 0x7fab3c10a560 2024-09-12T02:45:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.096+0000 7fab3bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822c9b90 0x5593822c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34898/0 (socket says 172.21.15.100:34898) 2024-09-12T02:45:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.096+0000 7fab3bfff640 1 -- 172.21.15.100:0/892601530 learned_addr learned my addr 172.21.15.100:0/892601530 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.100+0000 7fab3affd640 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x5593822dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.101+0000 7fab38ff9640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fab240a2d10 0x7fab240a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.102+0000 7fab3bfff640 1 -- 172.21.15.100:0/892601530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 msgr2=0x5593822dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.102+0000 7fab3bfff640 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x5593822dfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.102+0000 7fab3bfff640 1 -- 172.21.15.100:0/892601530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822ca4b0 msgr2=0x5593822c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.102+0000 7fab3bfff640 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822ca4b0 0x5593822c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.102+0000 7fab3bfff640 1 -- 172.21.15.100:0/892601530 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593821b3440 con 0x5593822c9b90 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.102+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822ca4b0 0x5593822c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.102+0000 7fab3affd640 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x5593822dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.103+0000 7fab3bfff640 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822c9b90 0x5593822c9f70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab34009510 tx=0x7fab3400f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a148966f43f8fbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.103+0000 7fab3bfff640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fab240a2d10 0x7fab240a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.105+0000 7fab21ffb640 1 -- 172.21.15.100:0/892601530 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34043070 con 0x5593822c9b90 2024-09-12T02:45:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.105+0000 7fab21ffb640 1 -- 172.21.15.100:0/892601530 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab34003e50 con 0x5593822c9b90 2024-09-12T02:45:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.105+0000 7fab21ffb640 1 -- 172.21.15.100:0/892601530 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340042e0 con 0x5593822c9b90 2024-09-12T02:45:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.105+0000 7fab3bfff640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fab240a2d10 0x7fab240a51d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fab34034a90 tx=0x7fab34004560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.105+0000 7fab38ff9640 1 -- 172.21.15.100:0/299114019 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fab2c0d07b0 con 0x7fab3c10a560 2024-09-12T02:45:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.107+0000 7fab44060740 1 -- 172.21.15.100:0/892601530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822c9b90 msgr2=0x5593822c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.107+0000 7fab44060740 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822c9b90 0x5593822c9f70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab34009510 tx=0x7fab3400f150 comp rx=0 tx=0).stop 2024-09-12T02:45:14.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.107+0000 7fab44060740 1 -- 172.21.15.100:0/892601530 shutdown_connections 2024-09-12T02:45:14.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.107+0000 7fab44060740 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x5593822dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.107+0000 7fab44060740 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822ca4b0 0x5593822c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.107+0000 7fab44060740 1 --2- 172.21.15.100:0/892601530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822c9b90 0x5593822c9f70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.107+0000 7fab44060740 1 -- 172.21.15.100:0/892601530 >> 172.21.15.100:0/892601530 conn(0x5593822c6240 msgr2=0x5593822c6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.110+0000 7fab44060740 1 -- 172.21.15.100:0/892601530 shutdown_connections 2024-09-12T02:45:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.110+0000 7fab44060740 1 -- 172.21.15.100:0/892601530 wait complete. 2024-09-12T02:45:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.110+0000 7fab44060740 1 -- start start 2024-09-12T02:45:14.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.110+0000 7fab44060740 1 Processor -- start 2024-09-12T02:45:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab44060740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822c5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab44060740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822ca4b0 0x5593822c2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822c5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38140/0 (socket says 172.21.15.100:38140) 2024-09-12T02:45:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab44060740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822dd900 0x5593822c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab3affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822ca4b0 0x5593822c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab3affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822ca4b0 0x5593822c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35418/0 (socket says 172.21.15.100:35418) 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab44060740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5593822e0230 con 0x5593822c9b90 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab44060740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5593821e2050 con 0x5593822dd900 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab44060740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5593822e03b0 con 0x5593822ca4b0 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab44060740 10 client.0 _ll_register_callbacks cb 0x559382222160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.113+0000 7fab3affd640 1 -- 172.21.15.100:0/860311269 learned_addr learned my addr 172.21.15.100:0/860311269 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.115+0000 7fab3affd640 1 -- 172.21.15.100:0/860311269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822dd900 msgr2=0x5593822c2b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.115+0000 7fab3affd640 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822dd900 0x5593822c2b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.115+0000 7fab3affd640 1 -- 172.21.15.100:0/860311269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 msgr2=0x5593822c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.115+0000 7fab3affd640 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.115+0000 7fab3affd640 1 -- 172.21.15.100:0/860311269 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559381f983c0 con 0x5593822ca4b0 2024-09-12T02:45:14.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.124+0000 7fab3affd640 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822ca4b0 0x5593822c2620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab30005fd0 tx=0x7fab30010850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bc291cf96e77e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:14.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.124+0000 7fab1affd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:45:14.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.128+0000 7fab1affd640 1 -- 172.21.15.100:0/860311269 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30004220 con 0x5593822ca4b0 2024-09-12T02:45:14.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.128+0000 7fab1affd640 1 -- 172.21.15.100:0/860311269 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fab300043c0 con 0x5593822ca4b0 2024-09-12T02:45:14.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.128+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab34003e50 con 0x5593822ca4b0 2024-09-12T02:45:14.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.136+0000 7fab1affd640 1 -- 172.21.15.100:0/860311269 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab30012660 con 0x5593822ca4b0 2024-09-12T02:45:14.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.136+0000 7fab44060740 10 client.25831 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:14.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.136+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5593822ebc70 con 0x5593822ca4b0 2024-09-12T02:45:14.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab1affd640 1 -- 172.21.15.100:0/860311269 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab34003e50 con 0x5593822ca4b0 2024-09-12T02:45:14.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab1affd640 1 -- 172.21.15.100:0/860311269 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fab3000f040 con 0x5593822ca4b0 2024-09-12T02:45:14.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab44060740 10 client.25831 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:14.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab44060740 10 client.25831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:14.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab44060740 20 client.25831 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:14.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab44060740 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593822ed180 0x5593822ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab44060740 4 client.25831 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:14.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.139+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559382234850 con 0x5593822ed180 2024-09-12T02:45:14.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.142+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593822ed180 0x5593822ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.150+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593822ed180 0x5593822ef5e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63342e33e0bb6363 server_cookie=b00d0ce2916062bf in_seq=0 out_seq=0 2024-09-12T02:45:14.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.150+0000 7fab1affd640 10 client.25831 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:14.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.151+0000 7fab1affd640 1 -- 172.21.15.100:0/860311269 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559382234850 con 0x5593822ed180 2024-09-12T02:45:14.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.151+0000 7fab1affd640 10 client.25831 handle_command_reply: tid=0 2024-09-12T02:45:14.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.151+0000 7fab44060740 1 client.25831 shutdown 2024-09-12T02:45:14.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.152+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822ca4b0 msgr2=0x5593822c2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.152+0000 7fab44060740 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822ca4b0 0x5593822c2620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab30005fd0 tx=0x7fab30010850 comp rx=0 tx=0).stop 2024-09-12T02:45:14.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 shutdown_connections 2024-09-12T02:45:14.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593822ed180 0x5593822ef5e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822dd900 0x5593822c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822ca4b0 0x5593822c2620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 --2- 172.21.15.100:0/860311269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab1affd640 0 client.25831 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:14.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 >> 172.21.15.100:0/860311269 conn(0x5593822c6240 msgr2=0x5593822cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:14.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 shutdown_connections 2024-09-12T02:45:14.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 1 -- 172.21.15.100:0/860311269 wait complete. 2024-09-12T02:45:14.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.153+0000 7fab44060740 20 client.25831 trim_cache size 0 max 16384 2024-09-12T02:45:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.181+0000 7fab44060740 1 Processor -- start 2024-09-12T02:45:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.181+0000 7fab44060740 1 -- start start 2024-09-12T02:45:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.181+0000 7fab44060740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822c9b90 0x5593822e9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.181+0000 7fab44060740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.181+0000 7fab44060740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822dd900 0x5593822f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab44060740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b64b0 con 0x5593822dd900 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822c9b90 0x5593822e9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab44060740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b3d80 con 0x5593822ca4b0 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab44060740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b1bd0 con 0x5593822c9b90 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822c9b90 0x5593822e9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35430/0 (socket says 172.21.15.100:35430) 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 -- 172.21.15.100:0/144162659 learned_addr learned my addr 172.21.15.100:0/144162659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3affd640 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3bfff640 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822dd900 0x5593822f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 -- 172.21.15.100:0/144162659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 msgr2=0x5593822c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 -- 172.21.15.100:0/144162659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822dd900 msgr2=0x5593822f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822dd900 0x5593822f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 -- 172.21.15.100:0/144162659 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593822e0400 con 0x5593822c9b90 2024-09-12T02:45:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3bfff640 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822dd900 0x5593822f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.182+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822c9b90 0x5593822e9530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0980f0 tx=0x7fab2c0cce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=431ad04b9e5823c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.183+0000 7fab217fa640 1 -- 172.21.15.100:0/144162659 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c099d30 con 0x5593822c9b90 2024-09-12T02:45:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.183+0000 7fab217fa640 1 -- 172.21.15.100:0/144162659 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2c099f90 con 0x5593822c9b90 2024-09-12T02:45:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.183+0000 7fab217fa640 1 -- 172.21.15.100:0/144162659 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c025b60 con 0x5593822c9b90 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 -- 172.21.15.100:0/144162659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822c9b90 msgr2=0x5593822e9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822c9b90 0x5593822e9530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0980f0 tx=0x7fab2c0cce00 comp rx=0 tx=0).stop 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 -- 172.21.15.100:0/144162659 shutdown_connections 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822dd900 0x5593822f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 --2- 172.21.15.100:0/144162659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822c9b90 0x5593822e9530 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 -- 172.21.15.100:0/144162659 >> 172.21.15.100:0/144162659 conn(0x5593822c6240 msgr2=0x5593822c3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:14.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 -- 172.21.15.100:0/144162659 shutdown_connections 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.184+0000 7fab44060740 1 -- 172.21.15.100:0/144162659 wait complete. 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.185+0000 7fab44060740 1 -- start start 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.185+0000 7fab44060740 1 Processor -- start 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.186+0000 7fab44060740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.186+0000 7fab44060740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.186+0000 7fab44060740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x559382356e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.187+0000 7fab3affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.187+0000 7fab3affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822e1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34926/0 (socket says 172.21.15.100:34926) 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.187+0000 7fab3affd640 1 -- 172.21.15.100:0/2438192252 learned_addr learned my addr 172.21.15.100:0/2438192252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.187+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b2240 con 0x5593822c9b90 2024-09-12T02:45:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.187+0000 7fab3bfff640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x559382356e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.187+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.187+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b36b0 con 0x5593822ca4b0 2024-09-12T02:45:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b2910 con 0x5593822dd900 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab44060740 10 client.0 _ll_register_callbacks cb 0x7fab30009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab3affd640 1 -- 172.21.15.100:0/2438192252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 msgr2=0x559382356e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab3affd640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x559382356e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab3affd640 1 -- 172.21.15.100:0/2438192252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 msgr2=0x5593822e17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab3affd640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822e17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab3affd640 1 -- 172.21.15.100:0/2438192252 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593822e25e0 con 0x5593822ca4b0 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab3bfff640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x559382356e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.188+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822e17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab2c099f90 con 0x5593822ca4b0 2024-09-12T02:45:14.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab3affd640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822e1ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5593822c3bd0 tx=0x7fab30003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea7d60fa70e1fa93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:14.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab1affd640 10 client.25847 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:45:14.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab1affd640 1 -- 172.21.15.100:0/2438192252 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30033060 con 0x5593822ca4b0 2024-09-12T02:45:14.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab1affd640 1 -- 172.21.15.100:0/2438192252 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fab30012a00 con 0x5593822ca4b0 2024-09-12T02:45:14.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab1affd640 1 -- 172.21.15.100:0/2438192252 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab30029040 con 0x5593822ca4b0 2024-09-12T02:45:14.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab44060740 10 client.25847 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:14.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.189+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=27}) -- 0x559382358380 con 0x5593822ca4b0 2024-09-12T02:45:14.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab1affd640 1 -- 172.21.15.100:0/2438192252 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fab30012c40 con 0x5593822ca4b0 2024-09-12T02:45:14.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab44060740 10 client.25847 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:14.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab44060740 10 client.25847 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:14.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab44060740 20 client.25847 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:14.194 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:45:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:45:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:45:14.194 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:45:14.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab44060740 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559382358970 0x55938235ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:14.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab44060740 4 client.25847 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55938222ed60 con 0x559382358970 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.190+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559382358970 0x55938235ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab3b7fe640 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559382358970 0x55938235ad90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd7310e14500fef server_cookie=cac322c5f736bfb5 in_seq=0 out_seq=0 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab1affd640 10 client.25847 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab1affd640 1 -- 172.21.15.100:0/2438192252 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55938222ed60 con 0x559382358970 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab1affd640 10 client.25847 handle_command_reply: tid=0 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 client.25847 shutdown 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 msgr2=0x5593822e1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822e1ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5593822c3bd0 tx=0x7fab30003b80 comp rx=0 tx=0).stop 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 shutdown_connections 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559382358970 0x55938235ad90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593822dd900 0x559382356e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593822ca4b0 0x5593822e1ce0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 --2- 172.21.15.100:0/2438192252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593822c9b90 0x5593822e17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab1affd640 0 client.25847 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 >> 172.21.15.100:0/2438192252 conn(0x5593822c6240 msgr2=0x5593822c46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:14.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 shutdown_connections 2024-09-12T02:45:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 1 -- 172.21.15.100:0/2438192252 wait complete. 2024-09-12T02:45:14.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.191+0000 7fab44060740 20 client.25847 trim_cache size 0 max 16384 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.192+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fab240a2d10 msgr2=0x7fab240a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.192+0000 7fab41c87640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fab240a2d10 0x7fab240a51d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fab34034a90 tx=0x7fab34004560 comp rx=0 tx=0).stop 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.192+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10a560 msgr2=0x7fab3c1a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.192+0000 7fab41c87640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10a560 0x7fab3c1a4580 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007860 tx=0x7fab2c007d20 comp rx=0 tx=0).stop 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 shutdown_connections 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fab240a2d10 0x7fab240a51d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab3c1139e0 0x7fab3c19e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab3c10ae80 0x7fab3c1a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 --2- 172.21.15.100:0/299114019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab3c10a560 0x7fab3c1a4580 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 >> 172.21.15.100:0/299114019 conn(0x7fab3c06e2d0 msgr2=0x7fab3c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 shutdown_connections 2024-09-12T02:45:14.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:14.193+0000 7fab41c87640 1 -- 172.21.15.100:0/299114019 wait complete. 2024-09-12T02:45:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:14 smithi189 ceph-mon[35196]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.8 MiB/s wr, 700 op/s 2024-09-12T02:45:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:14 smithi117 ceph-mon[34898]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.8 MiB/s wr, 700 op/s 2024-09-12T02:45:15.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:14 smithi100 ceph-mon[31390]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.8 MiB/s wr, 700 op/s 2024-09-12T02:45:15.164 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:45:15.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:15.566 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:16.299 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 365.0 s, 3339.8 tps, lat 29.606 ms stddev 36.030 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 -- 172.21.15.100:0/873195751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c50101df0 msgr2=0x7f6c501021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/873195751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c50101df0 0x7f6c501021d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009900 tx=0x7f6c4002a410 comp rx=0 tx=0).stop 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 -- 172.21.15.100:0/873195751 shutdown_connections 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/873195751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c50106f20 0x7f6c5010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/873195751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c501027a0 0x7f6c501067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/873195751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c50101df0 0x7f6c501021d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 -- 172.21.15.100:0/873195751 >> 172.21.15.100:0/873195751 conn(0x7f6c500fd8f0 msgr2=0x7f6c500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 -- 172.21.15.100:0/873195751 shutdown_connections 2024-09-12T02:45:16.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.489+0000 7f6c56a0c640 1 -- 172.21.15.100:0/873195751 wait complete. 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.490+0000 7f6c56a0c640 1 Processor -- start 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.490+0000 7f6c56a0c640 1 -- start start 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c56a0c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c50101df0 0x7f6c50073b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c56a0c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c501027a0 0x7f6c5006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c56a0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c50106f20 0x7f6c5006e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c56a0c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5006c640 con 0x7f6c501027a0 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c56a0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5006c4c0 con 0x7f6c50106f20 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c56a0c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5006c7c0 con 0x7f6c50101df0 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c4ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c50101df0 0x7f6c50073b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c4ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c50101df0 0x7f6c50073b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:46230/0 (socket says 172.21.15.100:46230) 2024-09-12T02:45:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c4ffff640 1 -- 172.21.15.100:0/419219944 learned_addr learned my addr 172.21.15.100:0/419219944 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:16.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c54fa9640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c50106f20 0x7f6c5006e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:16.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.491+0000 7f6c4f7fe640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c501027a0 0x7f6c5006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:16.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c54fa9640 1 -- 172.21.15.100:0/419219944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c50101df0 msgr2=0x7f6c50073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:16.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c54fa9640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c50101df0 0x7f6c50073b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c54fa9640 1 -- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c501027a0 msgr2=0x7f6c5006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:16.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c54fa9640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c501027a0 0x7f6c5006dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c54fa9640 1 -- 172.21.15.100:0/419219944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5006e8c0 con 0x7f6c50106f20 2024-09-12T02:45:16.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c54fa9640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c50106f20 0x7f6c5006e140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800be20 tx=0x7f6c4800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:16.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c4d7fa640 1 -- 172.21.15.100:0/419219944 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48019070 con 0x7f6c50106f20 2024-09-12T02:45:16.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c501ad310 con 0x7f6c50106f20 2024-09-12T02:45:16.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c4d7fa640 1 -- 172.21.15.100:0/419219944 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c48014920 con 0x7f6c50106f20 2024-09-12T02:45:16.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c4d7fa640 1 -- 172.21.15.100:0/419219944 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48012920 con 0x7f6c50106f20 2024-09-12T02:45:16.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.492+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c501ad7c0 con 0x7f6c50106f20 2024-09-12T02:45:16.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.493+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c3c005290 con 0x7f6c50106f20 2024-09-12T02:45:16.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.494+0000 7f6c4d7fa640 1 -- 172.21.15.100:0/419219944 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6c4801c070 con 0x7f6c50106f20 2024-09-12T02:45:16.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.495+0000 7f6c4d7fa640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6c380a2c80 0x7f6c380a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:16.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.495+0000 7f6c4d7fa640 1 -- 172.21.15.100:0/419219944 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6c480ceb00 con 0x7f6c50106f20 2024-09-12T02:45:16.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.495+0000 7f6c4ffff640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6c380a2c80 0x7f6c380a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.496+0000 7f6c4ffff640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6c380a2c80 0x7f6c380a5140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6c400096c0 tx=0x7f6c400046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.498+0000 7f6c4d7fa640 1 -- 172.21.15.100:0/419219944 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c4809b3a0 con 0x7f6c50106f20 2024-09-12T02:45:16.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.825+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c3c005580 con 0x7f6c50106f20 2024-09-12T02:45:16.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.829+0000 7f6c4d7fa640 1 -- 172.21.15.100:0/419219944 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f6c4809f6a0 con 0x7f6c50106f20 2024-09-12T02:45:16.831 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:45:16.831 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:45:16.831 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:45:16.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.835+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6c380a2c80 msgr2=0x7f6c380a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:16.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.835+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6c380a2c80 0x7f6c380a5140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6c400096c0 tx=0x7f6c400046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.835+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c50106f20 msgr2=0x7f6c5006e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:16.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.835+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c50106f20 0x7f6c5006e140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800be20 tx=0x7f6c4800bf10 comp rx=0 tx=0).stop 2024-09-12T02:45:16.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.836+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 shutdown_connections 2024-09-12T02:45:16.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.836+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6c380a2c80 0x7f6c380a5140 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6c400096c0 tx=0x7f6c400046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.836+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c50106f20 0x7f6c5006e140 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.836+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c501027a0 0x7f6c5006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.836+0000 7f6c56a0c640 1 --2- 172.21.15.100:0/419219944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c50101df0 0x7f6c50073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:16.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.836+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 >> 172.21.15.100:0/419219944 conn(0x7f6c500fd8f0 msgr2=0x7f6c500fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:16.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.839+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 shutdown_connections 2024-09-12T02:45:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:16.840+0000 7f6c56a0c640 1 -- 172.21.15.100:0/419219944 wait complete. 2024-09-12T02:45:17.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:16 smithi189 ceph-mon[35196]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.7 MiB/s wr, 740 op/s 2024-09-12T02:45:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:16 smithi117 ceph-mon[34898]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.7 MiB/s wr, 740 op/s 2024-09-12T02:45:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:16 smithi100 ceph-mon[31390]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.7 MiB/s wr, 740 op/s 2024-09-12T02:45:17.918 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:17 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/419219944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:17.960 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:45:18.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:17 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/419219944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:18.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:17 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/419219944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:18.331 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 -- 172.21.15.100:0/578295076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c101de0 msgr2=0x7f428c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 --2- 172.21.15.100:0/578295076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c101de0 0x7f428c1021c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4284009ca0 tx=0x7f428402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 -- 172.21.15.100:0/578295076 shutdown_connections 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 --2- 172.21.15.100:0/578295076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f428c106f10 0x7f428c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 --2- 172.21.15.100:0/578295076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c102790 0x7f428c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 --2- 172.21.15.100:0/578295076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c101de0 0x7f428c1021c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 -- 172.21.15.100:0/578295076 >> 172.21.15.100:0/578295076 conn(0x7f428c0fd8c0 msgr2=0x7f428c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 -- 172.21.15.100:0/578295076 shutdown_connections 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.872+0000 7f42930b2640 1 -- 172.21.15.100:0/578295076 wait complete. 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.873+0000 7f42930b2640 1 Processor -- start 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.873+0000 7f42930b2640 1 -- start start 2024-09-12T02:45:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f42930b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c101de0 0x7f428c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f42930b2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f428c102790 0x7f428c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f42930b2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c106f10 0x7f428c19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f42930b2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f428c111fc0 con 0x7f428c106f10 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f42930b2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f428c111e40 con 0x7f428c101de0 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f42930b2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f428c112140 con 0x7f428c102790 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c101de0 0x7f428c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f429164f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c106f10 0x7f428c19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f428bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f428c102790 0x7f428c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c101de0 0x7f428c1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44308/0 (socket says 172.21.15.100:44308) 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 -- 172.21.15.100:0/3058732538 learned_addr learned my addr 172.21.15.100:0/3058732538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 -- 172.21.15.100:0/3058732538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f428c102790 msgr2=0x7f428c198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f428c102790 0x7f428c198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 -- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c106f10 msgr2=0x7f428c19ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c106f10 0x7f428c19ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 -- 172.21.15.100:0/3058732538 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c19d170 con 0x7f428c101de0 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f429164f640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c106f10 0x7f428c19ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f428bfff640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f428c102790 0x7f428c198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.874+0000 7f4290e4e640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c101de0 0x7f428c1981c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f428402aeb0 tx=0x7f4284003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.875+0000 7f4289ffb640 1 -- 172.21.15.100:0/3058732538 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428404c070 con 0x7f428c101de0 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.875+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428c19d400 con 0x7f428c101de0 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.875+0000 7f4289ffb640 1 -- 172.21.15.100:0/3058732538 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f428403cc00 con 0x7f428c101de0 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.875+0000 7f4289ffb640 1 -- 172.21.15.100:0/3058732538 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42840045a0 con 0x7f428c101de0 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.875+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f428c074420 con 0x7f428c101de0 2024-09-12T02:45:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.877+0000 7f4289ffb640 1 -- 172.21.15.100:0/3058732538 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f428404f070 con 0x7f428c101de0 2024-09-12T02:45:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.881+0000 7f4289ffb640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42740a2c00 0x7f42740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f4289ffb640 1 -- 172.21.15.100:0/3058732538 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f42840f3950 con 0x7f428c101de0 2024-09-12T02:45:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 Processor -- start 2024-09-12T02:45:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 -- start start 2024-09-12T02:45:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f428bfff640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42740a2c00 0x7f42740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5eb92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb925d0 0x564e5eb92a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564e5eaf82f0 con 0x564e5eba5b80 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564e5ea9fcf0 con 0x564e5eb925d0 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.882+0000 7f429548b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564e5eaf42b0 con 0x564e5eb93b40 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb925d0 0x564e5eb92a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb925d0 0x564e5eb92a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44324/0 (socket says 172.21.15.100:44324) 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 -- 172.21.15.100:0/1245004998 learned_addr learned my addr 172.21.15.100:0/1245004998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f429164f640 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f4290e4e640 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5eb92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 -- 172.21.15.100:0/1245004998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 msgr2=0x564e5eb92090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5eb92090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 -- 172.21.15.100:0/1245004998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 msgr2=0x564e5eba7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.883+0000 7f428bfff640 1 -- 172.21.15.100:0/1245004998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5ea843a0 con 0x564e5eb925d0 2024-09-12T02:45:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.884+0000 7f428bfff640 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb925d0 0x564e5eb92a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f428000fc80 tx=0x7f428001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38120d78721d4b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.884+0000 7f428bfff640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42740a2c00 0x7f42740a50c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4280011940 tx=0x7f4280011d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.884+0000 7f4272ffd640 1 -- 172.21.15.100:0/1245004998 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428001a040 con 0x564e5eb925d0 2024-09-12T02:45:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.884+0000 7f4272ffd640 1 -- 172.21.15.100:0/1245004998 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4280018070 con 0x564e5eb925d0 2024-09-12T02:45:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.884+0000 7f4272ffd640 1 -- 172.21.15.100:0/1245004998 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280003be0 con 0x564e5eb925d0 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 -- 172.21.15.100:0/1245004998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb925d0 msgr2=0x564e5eb92a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb925d0 0x564e5eb92a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f428000fc80 tx=0x7f428001b000 comp rx=0 tx=0).stop 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 -- 172.21.15.100:0/1245004998 shutdown_connections 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb925d0 0x564e5eb92a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 --2- 172.21.15.100:0/1245004998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5eb92090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 -- 172.21.15.100:0/1245004998 >> 172.21.15.100:0/1245004998 conn(0x564e5eb5b310 msgr2=0x564e5eb8ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 -- 172.21.15.100:0/1245004998 shutdown_connections 2024-09-12T02:45:18.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 -- 172.21.15.100:0/1245004998 wait complete. 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 -- start start 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.885+0000 7f429548b740 1 Processor -- start 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429548b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5eba5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429548b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eba27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429548b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429548b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564e5eba88c0 con 0x564e5eba5b80 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429548b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564e5eab3060 con 0x564e5eb93b40 2024-09-12T02:45:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429548b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564e5eba8a40 con 0x564e5eb925d0 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429164f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429164f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49126/0 (socket says 172.21.15.100:49126) 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429164f640 1 -- 172.21.15.100:0/3968053295 learned_addr learned my addr 172.21.15.100:0/3968053295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f4290e4e640 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5eba5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.886+0000 7f429548b740 10 client.0 _ll_register_callbacks cb 0x564e5e8068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f4290e4e640 1 -- 172.21.15.100:0/3968053295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 msgr2=0x564e5eba27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f4290e4e640 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eba27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f4290e4e640 1 -- 172.21.15.100:0/3968053295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 msgr2=0x564e5eba2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f4290e4e640 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f4290e4e640 1 -- 172.21.15.100:0/3968053295 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e5e8693c0 con 0x564e5eb925d0 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f4290e4e640 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5eba5520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4284005e30 tx=0x7f42840bff70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=732430a5cd5cc056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f426bfff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:45:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f426bfff640 1 -- 172.21.15.100:0/3968053295 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42840c4670 con 0x564e5eb925d0 2024-09-12T02:45:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f426bfff640 1 -- 172.21.15.100:0/3968053295 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f42840c4150 con 0x564e5eb925d0 2024-09-12T02:45:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.887+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4280018070 con 0x564e5eb925d0 2024-09-12T02:45:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.889+0000 7f426bfff640 1 -- 172.21.15.100:0/3968053295 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f42840c8f30 con 0x564e5eb925d0 2024-09-12T02:45:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.889+0000 7f429548b740 10 client.25849 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.889+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e5eba88c0 con 0x564e5eb925d0 2024-09-12T02:45:18.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.889+0000 7f426bfff640 1 -- 172.21.15.100:0/3968053295 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4284036030 con 0x564e5eb925d0 2024-09-12T02:45:18.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.889+0000 7f426bfff640 1 -- 172.21.15.100:0/3968053295 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4284004b40 con 0x564e5eb925d0 2024-09-12T02:45:18.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f429548b740 10 client.25849 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:18.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f429548b740 10 client.25849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f429548b740 20 client.25849 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f429548b740 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ebb31d0 0x564e5ebb5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f429548b740 4 client.25849 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4280018070 con 0x564e5ebb31d0 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f428bfff640 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ebb31d0 0x564e5ebb5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f426bfff640 10 client.25849 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.890+0000 7f428bfff640 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ebb31d0 0x564e5ebb5650 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4938d9f541f934e server_cookie=13d61bedcc2f32cc in_seq=0 out_seq=0 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f426bfff640 1 -- 172.21.15.100:0/3968053295 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4280018070 con 0x564e5ebb31d0 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f426bfff640 10 client.25849 handle_command_reply: tid=0 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 client.25849 shutdown 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 msgr2=0x564e5eba5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5eba5520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4284005e30 tx=0x7f42840bff70 comp rx=0 tx=0).stop 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 shutdown_connections 2024-09-12T02:45:18.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ebb31d0 0x564e5ebb5650 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5eba2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eba27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 --2- 172.21.15.100:0/3968053295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5eba5520 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 >> 172.21.15.100:0/3968053295 conn(0x564e5eb5b310 msgr2=0x564e5eb94960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.891+0000 7f426bfff640 0 client.25849 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.892+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 shutdown_connections 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.892+0000 7f429548b740 1 -- 172.21.15.100:0/3968053295 wait complete. 2024-09-12T02:45:18.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.892+0000 7f429548b740 20 client.25849 trim_cache size 0 max 16384 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.907+0000 7f429548b740 1 Processor -- start 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.907+0000 7f429548b740 1 -- start start 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.907+0000 7f429548b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5ebc2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.907+0000 7f429548b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eb8dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f429548b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5ebbaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f429548b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f428c1a5090 con 0x564e5eba5b80 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f429548b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f428c072040 con 0x564e5eb93b40 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f429548b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f428c06fe90 con 0x564e5eb925d0 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eb8dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eb8dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44334/0 (socket says 172.21.15.100:44334) 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 -- 172.21.15.100:0/785663510 learned_addr learned my addr 172.21.15.100:0/785663510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f429164f640 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5ebbaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f4290e4e640 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5ebc2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 -- 172.21.15.100:0/785663510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 msgr2=0x564e5ebc2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5ebc2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 -- 172.21.15.100:0/785663510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 msgr2=0x564e5ebbaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5ebbaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 -- 172.21.15.100:0/785663510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5eb91eb0 con 0x564e5eb93b40 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f428bfff640 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eb8dc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f428000efd0 tx=0x7f4280009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9dfd52724d34e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f42727fc640 1 -- 172.21.15.100:0/785663510 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428001a040 con 0x564e5eb93b40 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f42727fc640 1 -- 172.21.15.100:0/785663510 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4280018040 con 0x564e5eb93b40 2024-09-12T02:45:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.908+0000 7f42727fc640 1 -- 172.21.15.100:0/785663510 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280003a10 con 0x564e5eb93b40 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 -- 172.21.15.100:0/785663510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 msgr2=0x564e5eb8dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eb8dc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f428000efd0 tx=0x7f4280009fd0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 -- 172.21.15.100:0/785663510 shutdown_connections 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eba5b80 0x564e5ebbaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eb93b40 0x564e5eb8dc10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 --2- 172.21.15.100:0/785663510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb925d0 0x564e5ebc2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 -- 172.21.15.100:0/785663510 >> 172.21.15.100:0/785663510 conn(0x564e5eb5b310 msgr2=0x564e5eb8d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 -- 172.21.15.100:0/785663510 shutdown_connections 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.909+0000 7f429548b740 1 -- 172.21.15.100:0/785663510 wait complete. 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.910+0000 7f429548b740 1 -- start start 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.910+0000 7f429548b740 1 Processor -- start 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429548b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eb925d0 0x564e5ebadd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429548b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5ebae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429548b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eba5b80 0x564e5eb9ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429548b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f428c070500 con 0x564e5eb925d0 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429548b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f428c071970 con 0x564e5eba5b80 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429548b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f428c070bd0 con 0x564e5eb93b40 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429548b740 10 client.0 _ll_register_callbacks cb 0x7f4284005d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429164f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eba5b80 0x564e5eb9ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429164f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eba5b80 0x564e5eb9ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44350/0 (socket says 172.21.15.100:44350) 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f429164f640 1 -- 172.21.15.100:0/2740942639 learned_addr learned my addr 172.21.15.100:0/2740942639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f428bfff640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5ebae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.911+0000 7f4290e4e640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eb925d0 0x564e5ebadd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f429164f640 1 -- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 msgr2=0x564e5ebae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f429164f640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5ebae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f429164f640 1 -- 172.21.15.100:0/2740942639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eb925d0 msgr2=0x564e5ebadd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f429164f640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eb925d0 0x564e5ebadd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f429164f640 1 -- 172.21.15.100:0/2740942639 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e5eba0710 con 0x564e5eba5b80 2024-09-12T02:45:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f4290e4e640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eb925d0 0x564e5ebadd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:18.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f429164f640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eba5b80 0x564e5eb9ea80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f427c012ea0 tx=0x7f427c012f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b1e90607adbe50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:18.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.912+0000 7f426bfff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.913+0000 7f426bfff640 1 -- 172.21.15.100:0/2740942639 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c005020 con 0x564e5eba5b80 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.913+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4280018040 con 0x564e5eba5b80 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.913+0000 7f426bfff640 1 -- 172.21.15.100:0/2740942639 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f427c019040 con 0x564e5eba5b80 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.913+0000 7f426bfff640 1 -- 172.21.15.100:0/2740942639 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f427c0051c0 con 0x564e5eba5b80 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.913+0000 7f429548b740 10 client.25868 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.913+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e5ec209f0 con 0x564e5eba5b80 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f426bfff640 1 -- 172.21.15.100:0/2740942639 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4280018040 con 0x564e5eba5b80 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f426bfff640 1 -- 172.21.15.100:0/2740942639 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f427c010430 con 0x564e5eba5b80 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f429548b740 10 client.25868 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f429548b740 10 client.25868 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f429548b740 20 client.25868 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f429548b740 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ec211f0 0x564e5ec23610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f429548b740 4 client.25868 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e5eb05860 con 0x564e5ec211f0 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.914+0000 7f4290e4e640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ec211f0 0x564e5ec23610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f426bfff640 10 client.25868 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f4290e4e640 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ec211f0 0x564e5ec23610 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0de95c186fd17a4 server_cookie=e1bc76fbb160d0e2 in_seq=0 out_seq=0 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f426bfff640 1 -- 172.21.15.100:0/2740942639 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e5eb05860 con 0x564e5ec211f0 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f426bfff640 10 client.25868 handle_command_reply: tid=0 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 client.25868 shutdown 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eba5b80 msgr2=0x564e5eb9ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eba5b80 0x564e5eb9ea80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f427c012ea0 tx=0x7f427c012f90 comp rx=0 tx=0).stop 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 shutdown_connections 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x564e5ec211f0 0x564e5ec23610 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564e5eba5b80 0x564e5eb9ea80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e5eb93b40 0x564e5ebae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 --2- 172.21.15.100:0/2740942639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e5eb925d0 0x564e5ebadd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 >> 172.21.15.100:0/2740942639 conn(0x564e5eb5b310 msgr2=0x564e5eb94930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:18.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.915+0000 7f426bfff640 0 client.25868 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:45:18.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.916+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 shutdown_connections 2024-09-12T02:45:18.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.916+0000 7f429548b740 1 -- 172.21.15.100:0/2740942639 wait complete. 2024-09-12T02:45:18.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.916+0000 7f429548b740 20 client.25868 trim_cache size 0 max 16384 2024-09-12T02:45:18.920 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:45:18.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.916+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42740a2c00 msgr2=0x7f42740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.916+0000 7f42930b2640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42740a2c00 0x7f42740a50c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4280011940 tx=0x7f4280011d40 comp rx=0 tx=0).stop 2024-09-12T02:45:18.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.916+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c101de0 msgr2=0x7f428c1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:18.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.916+0000 7f42930b2640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c101de0 0x7f428c1981c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f428402aeb0 tx=0x7f4284003f10 comp rx=0 tx=0).stop 2024-09-12T02:45:18.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 shutdown_connections 2024-09-12T02:45:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f42740a2c00 0x7f42740a50c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f428c106f10 0x7f428c19ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f428c102790 0x7f428c198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 --2- 172.21.15.100:0/3058732538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428c101de0 0x7f428c1981c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 >> 172.21.15.100:0/3058732538 conn(0x7f428c0fd8c0 msgr2=0x7f428c0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 shutdown_connections 2024-09-12T02:45:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:18.917+0000 7f42930b2640 1 -- 172.21.15.100:0/3058732538 wait complete. 2024-09-12T02:45:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:18 smithi189 ceph-mon[35196]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 801 op/s 2024-09-12T02:45:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:18 smithi117 ceph-mon[34898]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 801 op/s 2024-09-12T02:45:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:18 smithi100 ceph-mon[31390]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.8 MiB/s wr, 801 op/s 2024-09-12T02:45:19.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:45:20.336 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 -- 172.21.15.100:0/1765739819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 msgr2=0x7fda501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 --2- 172.21.15.100:0/1765739819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 0x7fda501029b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda48009cd0 tx=0x7fda4802a980 comp rx=0 tx=0).stop 2024-09-12T02:45:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 -- 172.21.15.100:0/1765739819 shutdown_connections 2024-09-12T02:45:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 --2- 172.21.15.100:0/1765739819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50102ef0 0x7fda5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 --2- 172.21.15.100:0/1765739819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 0x7fda501029b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 --2- 172.21.15.100:0/1765739819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 0x7fda50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 -- 172.21.15.100:0/1765739819 >> 172.21.15.100:0/1765739819 conn(0x7fda500fc7d0 msgr2=0x7fda500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 -- 172.21.15.100:0/1765739819 shutdown_connections 2024-09-12T02:45:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.915+0000 7fda5745a640 1 -- 172.21.15.100:0/1765739819 wait complete. 2024-09-12T02:45:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.916+0000 7fda5745a640 1 Processor -- start 2024-09-12T02:45:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.916+0000 7fda5745a640 1 -- start start 2024-09-12T02:45:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.916+0000 7fda5745a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 0x7fda5019f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda5745a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 0x7fda5019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 0x7fda5019f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 0x7fda5019f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:46308/0 (socket says 172.21.15.100:46308) 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 -- 172.21.15.100:0/627154208 learned_addr learned my addr 172.21.15.100:0/627154208 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda5745a640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50102ef0 0x7fda5010ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda50112090 con 0x7fda50102ef0 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda50111f10 con 0x7fda50102570 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda50112210 con 0x7fda50100e20 2024-09-12T02:45:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda549f5640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 0x7fda5019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 -- 172.21.15.100:0/627154208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 msgr2=0x7fda5019f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 0x7fda5019f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 -- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50102ef0 msgr2=0x7fda5010ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50102ef0 0x7fda5010ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda551f6640 1 -- 172.21.15.100:0/627154208 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5010d6c0 con 0x7fda50100e20 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.917+0000 7fda549f5640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 0x7fda5019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.918+0000 7fda551f6640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 0x7fda5019f280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda4000e9f0 tx=0x7fda4000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.918+0000 7fda467fc640 1 -- 172.21.15.100:0/627154208 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4000cd80 con 0x7fda50100e20 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.918+0000 7fda467fc640 1 -- 172.21.15.100:0/627154208 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda40010910 con 0x7fda50100e20 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.918+0000 7fda467fc640 1 -- 172.21.15.100:0/627154208 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40018990 con 0x7fda50100e20 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.918+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5010d9b0 con 0x7fda50100e20 2024-09-12T02:45:20.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.918+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5019ae30 con 0x7fda50100e20 2024-09-12T02:45:20.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.922+0000 7fda467fc640 1 -- 172.21.15.100:0/627154208 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fda40010ac0 con 0x7fda50100e20 2024-09-12T02:45:20.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.923+0000 7fda467fc640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fda3c0a2c00 0x7fda3c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.923+0000 7fda549f5640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fda3c0a2c00 0x7fda3c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.923+0000 7fda467fc640 1 -- 172.21.15.100:0/627154208 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fda400cf3d0 con 0x7fda50100e20 2024-09-12T02:45:20.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.924+0000 7fda549f5640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fda3c0a2c00 0x7fda3c0a50c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda5010df50 tx=0x7fda48005f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.924+0000 7fda59833740 1 Processor -- start 2024-09-12T02:45:20.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.925+0000 7fda59833740 1 -- start start 2024-09-12T02:45:20.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.925+0000 7fda59833740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda59833740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a35d0 0x55e3a42a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda59833740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42ae370 0x55e3a42b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda549f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a35d0 0x55e3a42a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda549f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a35d0 0x55e3a42a3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49166/0 (socket says 172.21.15.100:49166) 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda549f5640 1 -- 172.21.15.100:0/795080128 learned_addr learned my addr 172.21.15.100:0/795080128 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e3a42092f0 con 0x55e3a42a35d0 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e3a41b0cf0 con 0x55e3a42a4b40 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e3a42052b0 con 0x55e3a42ae370 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda559f7640 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42ae370 0x55e3a42b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.926+0000 7fda551f6640 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.927+0000 7fda551f6640 1 -- 172.21.15.100:0/795080128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42ae370 msgr2=0x55e3a42b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.927+0000 7fda551f6640 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42ae370 0x55e3a42b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.927+0000 7fda551f6640 1 -- 172.21.15.100:0/795080128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a35d0 msgr2=0x55e3a42a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.927+0000 7fda551f6640 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a35d0 0x55e3a42a3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.927+0000 7fda551f6640 1 -- 172.21.15.100:0/795080128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3a41953a0 con 0x55e3a42a4b40 2024-09-12T02:45:20.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.928+0000 7fda551f6640 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42a3090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda4000e9c0 tx=0x7fda4009c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36003c61baf85505 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.929+0000 7fda3b7fe640 1 -- 172.21.15.100:0/795080128 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda400a4830 con 0x55e3a42a4b40 2024-09-12T02:45:20.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.929+0000 7fda3b7fe640 1 -- 172.21.15.100:0/795080128 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda400b2020 con 0x55e3a42a4b40 2024-09-12T02:45:20.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.929+0000 7fda3b7fe640 1 -- 172.21.15.100:0/795080128 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4009b010 con 0x55e3a42a4b40 2024-09-12T02:45:20.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.930+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 msgr2=0x55e3a42a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.931+0000 7fda59833740 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42a3090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda4000e9c0 tx=0x7fda4009c380 comp rx=0 tx=0).stop 2024-09-12T02:45:20.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.931+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 shutdown_connections 2024-09-12T02:45:20.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.931+0000 7fda59833740 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42ae370 0x55e3a42b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.931+0000 7fda59833740 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a35d0 0x55e3a42a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.931+0000 7fda59833740 1 --2- 172.21.15.100:0/795080128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42a3090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.932+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 >> 172.21.15.100:0/795080128 conn(0x55e3a426c310 msgr2=0x55e3a429fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.932+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 shutdown_connections 2024-09-12T02:45:20.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.932+0000 7fda59833740 1 -- 172.21.15.100:0/795080128 wait complete. 2024-09-12T02:45:20.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.933+0000 7fda59833740 1 -- start start 2024-09-12T02:45:20.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.933+0000 7fda59833740 1 Processor -- start 2024-09-12T02:45:20.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda59833740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda59833740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda59833740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda59833740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e3a42b1060 con 0x55e3a42ae370 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda559f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda551f6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda559f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49170/0 (socket says 172.21.15.100:49170) 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda559f7640 1 -- 172.21.15.100:0/1620655083 learned_addr learned my addr 172.21.15.100:0/1620655083 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda549f5640 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda59833740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e3a41c4060 con 0x55e3a42a4b40 2024-09-12T02:45:20.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e3a42b11e0 con 0x55e3a42a35d0 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.934+0000 7fda59833740 10 client.0 _ll_register_callbacks cb 0x55e3a3f178c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.935+0000 7fda559f7640 1 -- 172.21.15.100:0/1620655083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 msgr2=0x55e3a42adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.935+0000 7fda559f7640 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.935+0000 7fda559f7640 1 -- 172.21.15.100:0/1620655083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 msgr2=0x55e3a42aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.935+0000 7fda559f7640 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.935+0000 7fda559f7640 1 -- 172.21.15.100:0/1620655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3a3f7a3c0 con 0x55e3a42ae370 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.936+0000 7fda559f7640 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42ab5f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00e680 tx=0x7fda4c00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636443f909c80e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.936+0000 7fda38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:45:20.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.936+0000 7fda38ff9640 1 -- 172.21.15.100:0/1620655083 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00aa90 con 0x55e3a42ae370 2024-09-12T02:45:20.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.936+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda400b2020 con 0x55e3a42ae370 2024-09-12T02:45:20.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.936+0000 7fda38ff9640 1 -- 172.21.15.100:0/1620655083 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fda4c00ac30 con 0x55e3a42ae370 2024-09-12T02:45:20.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.937+0000 7fda38ff9640 1 -- 172.21.15.100:0/1620655083 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda4c00ee80 con 0x55e3a42ae370 2024-09-12T02:45:20.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.937+0000 7fda59833740 10 client.16500 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:20.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.937+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e3a42bcb70 con 0x55e3a42ae370 2024-09-12T02:45:20.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda38ff9640 1 -- 172.21.15.100:0/1620655083 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda400b2020 con 0x55e3a42ae370 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda38ff9640 1 -- 172.21.15.100:0/1620655083 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fda4c023050 con 0x55e3a42ae370 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda59833740 10 client.16500 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda59833740 10 client.16500 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda59833740 20 client.16500 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda59833740 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a42bdf80 0x55e3a42c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda59833740 4 client.16500 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3a4216860 con 0x55e3a42bdf80 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda551f6640 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a42bdf80 0x55e3a42c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.938+0000 7fda38ff9640 10 client.16500 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda551f6640 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a42bdf80 0x55e3a42c03d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6dc06cda3154bdd6 server_cookie=4951acac7cf9812b in_seq=0 out_seq=0 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda38ff9640 1 -- 172.21.15.100:0/1620655083 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3a4216860 con 0x55e3a42bdf80 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda38ff9640 10 client.16500 handle_command_reply: tid=0 2024-09-12T02:45:20.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 client.16500 shutdown 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 msgr2=0x55e3a42ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42ab5f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00e680 tx=0x7fda4c00eb40 comp rx=0 tx=0).stop 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 shutdown_connections 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a42bdf80 0x55e3a42c03d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42ab5f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a4b40 0x55e3a42aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 --2- 172.21.15.100:0/1620655083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda38ff9640 0 client.16500 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.939+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 >> 172.21.15.100:0/1620655083 conn(0x55e3a426c310 msgr2=0x55e3a42a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.940+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 shutdown_connections 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.940+0000 7fda59833740 1 -- 172.21.15.100:0/1620655083 wait complete. 2024-09-12T02:45:20.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.940+0000 7fda59833740 20 client.16500 trim_cache size 0 max 16384 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.956+0000 7fda59833740 1 Processor -- start 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.956+0000 7fda59833740 1 -- start start 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.956+0000 7fda59833740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.956+0000 7fda59833740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a4b40 0x55e3a42a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.956+0000 7fda59833740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42ae370 0x55e3a42c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda59833740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda501bee10 con 0x55e3a42a4b40 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda59833740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda501bc6e0 con 0x55e3a42ae370 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda59833740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda501ba530 con 0x55e3a42a35d0 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a4b40 0x55e3a42a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda551f6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a4b40 0x55e3a42a58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49174/0 (socket says 172.21.15.100:49174) 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 -- 172.21.15.100:0/1242875074 learned_addr learned my addr 172.21.15.100:0/1242875074 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda559f7640 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42ae370 0x55e3a42c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 -- 172.21.15.100:0/1242875074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 msgr2=0x55e3a42ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42ba350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 -- 172.21.15.100:0/1242875074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42ae370 msgr2=0x55e3a42c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42ae370 0x55e3a42c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 -- 172.21.15.100:0/1242875074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3a42c0a50 con 0x55e3a42a4b40 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.957+0000 7fda549f5640 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a4b40 0x55e3a42a58b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fda48035000 tx=0x7fda4803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c12476357d1e1e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.958+0000 7fda3affd640 1 -- 172.21.15.100:0/1242875074 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48034040 con 0x55e3a42a4b40 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.958+0000 7fda3affd640 1 -- 172.21.15.100:0/1242875074 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda48003e50 con 0x55e3a42a4b40 2024-09-12T02:45:20.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.958+0000 7fda3affd640 1 -- 172.21.15.100:0/1242875074 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48004810 con 0x55e3a42a4b40 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.959+0000 7fda59833740 1 -- 172.21.15.100:0/1242875074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a4b40 msgr2=0x55e3a42a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.959+0000 7fda59833740 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a4b40 0x55e3a42a58b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fda48035000 tx=0x7fda4803f000 comp rx=0 tx=0).stop 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.960+0000 7fda59833740 1 -- 172.21.15.100:0/1242875074 shutdown_connections 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.960+0000 7fda59833740 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42ae370 0x55e3a42c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.960+0000 7fda59833740 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42a4b40 0x55e3a42a58b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.960+0000 7fda59833740 1 --2- 172.21.15.100:0/1242875074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a35d0 0x55e3a42ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.960+0000 7fda59833740 1 -- 172.21.15.100:0/1242875074 >> 172.21.15.100:0/1242875074 conn(0x55e3a426c310 msgr2=0x55e3a42a51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.960+0000 7fda59833740 1 -- 172.21.15.100:0/1242875074 shutdown_connections 2024-09-12T02:45:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.960+0000 7fda59833740 1 -- 172.21.15.100:0/1242875074 wait complete. 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 -- start start 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 Processor -- start 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a35d0 0x55e3a42b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a4b40 0x55e3a42b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda501baba0 con 0x55e3a42ae370 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda501bc010 con 0x55e3a42a35d0 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda501bb270 con 0x55e3a42a4b40 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda59833740 10 client.0 _ll_register_callbacks cb 0x7fda4c005f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda551f6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a35d0 0x55e3a42b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda559f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda549f5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a4b40 0x55e3a42b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda551f6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a35d0 0x55e3a42b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44400/0 (socket says 172.21.15.100:44400) 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.961+0000 7fda551f6640 1 -- 172.21.15.100:0/1198061617 learned_addr learned my addr 172.21.15.100:0/1198061617 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda551f6640 1 -- 172.21.15.100:0/1198061617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a4b40 msgr2=0x55e3a42b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda551f6640 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a4b40 0x55e3a42b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda551f6640 1 -- 172.21.15.100:0/1198061617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 msgr2=0x55e3a42b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda551f6640 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda551f6640 1 -- 172.21.15.100:0/1198061617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3a42b27e0 con 0x55e3a42a35d0 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda551f6640 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a35d0 0x55e3a42b69b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda4009c470 tx=0x7fda400a00f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0344628cf0656d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda38ff9640 1 -- 172.21.15.100:0/1198061617 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40098230 con 0x55e3a42a35d0 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda38ff9640 1 -- 172.21.15.100:0/1198061617 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fda4009b010 con 0x55e3a42a35d0 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda48003e50 con 0x55e3a42a35d0 2024-09-12T02:45:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda38ff9640 1 -- 172.21.15.100:0/1198061617 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda4009b210 con 0x55e3a42a35d0 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda59833740 10 client.25886 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e3a4328a00 con 0x55e3a42a35d0 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda38ff9640 1 -- 172.21.15.100:0/1198061617 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda400b2040 con 0x55e3a42a35d0 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda38ff9640 1 -- 172.21.15.100:0/1198061617 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fda4009ab10 con 0x55e3a42a35d0 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda59833740 10 client.25886 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda59833740 10 client.25886 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda59833740 20 client.25886 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.962+0000 7fda59833740 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a4328cf0 0x55e3a432b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda59833740 4 client.25886 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:45:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fda48003e50 con 0x55e3a4328cf0 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda549f5640 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a4328cf0 0x55e3a432b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda38ff9640 10 client.25886 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda549f5640 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a4328cf0 0x55e3a432b0e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89154ecd077e066a server_cookie=5e649531c16d1de0 in_seq=0 out_seq=0 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda38ff9640 1 -- 172.21.15.100:0/1198061617 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fda48003e50 con 0x55e3a4328cf0 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda38ff9640 10 client.25886 handle_command_reply: tid=0 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.963+0000 7fda59833740 1 client.25886 shutdown 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a35d0 msgr2=0x55e3a42b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a35d0 0x55e3a42b69b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda4009c470 tx=0x7fda400a00f0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 shutdown_connections 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55e3a4328cf0 0x55e3a432b0e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3a42ae370 0x55e3a42b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda38ff9640 0 client.25886 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:45:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3a42a4b40 0x55e3a42b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 --2- 172.21.15.100:0/1198061617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3a42a35d0 0x55e3a42b69b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 >> 172.21.15.100:0/1198061617 conn(0x55e3a426c310 msgr2=0x55e3a42ad060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 shutdown_connections 2024-09-12T02:45:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.964+0000 7fda59833740 1 -- 172.21.15.100:0/1198061617 wait complete. 2024-09-12T02:45:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda59833740 20 client.25886 trim_cache size 0 max 16384 2024-09-12T02:45:20.971 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:45:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fda3c0a2c00 msgr2=0x7fda3c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fda3c0a2c00 0x7fda3c0a50c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda5010df50 tx=0x7fda48005f10 comp rx=0 tx=0).stop 2024-09-12T02:45:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 msgr2=0x7fda5019f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 0x7fda5019f280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda4000e9f0 tx=0x7fda4000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 shutdown_connections 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fda3c0a2c00 0x7fda3c0a50c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50102ef0 0x7fda5010ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda50102570 0x7fda5019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 --2- 172.21.15.100:0/627154208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda50100e20 0x7fda5019f280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.965+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 >> 172.21.15.100:0/627154208 conn(0x7fda500fc7d0 msgr2=0x7fda500fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.966+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 shutdown_connections 2024-09-12T02:45:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:20.966+0000 7fda5745a640 1 -- 172.21.15.100:0/627154208 wait complete. 2024-09-12T02:45:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:20 smithi117 ceph-mon[34898]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.4 MiB/s wr, 762 op/s 2024-09-12T02:45:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:20 smithi100 ceph-mon[31390]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.4 MiB/s wr, 762 op/s 2024-09-12T02:45:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:20 smithi189 ceph-mon[35196]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.4 MiB/s wr, 762 op/s 2024-09-12T02:45:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 370.0 s, 2779.2 tps, lat 36.338 ms stddev 44.065 2024-09-12T02:45:21.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:45:22.006 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:22.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1536945041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 msgr2=0x7f1a0010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1536945041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 0x7f1a0010ea80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009ca0 tx=0x7f19f802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1536945041 shutdown_connections 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1536945041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 0x7f1a0010ea80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1536945041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a00102780 0x7f1a001067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1536945041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a00101dd0 0x7f1a001021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1536945041 >> 172.21.15.100:0/1536945041 conn(0x7f1a000fd8b0 msgr2=0x7f1a000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1536945041 shutdown_connections 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.550+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1536945041 wait complete. 2024-09-12T02:45:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.551+0000 7f1a04fb7640 1 Processor -- start 2024-09-12T02:45:22.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.551+0000 7f1a04fb7640 1 -- start start 2024-09-12T02:45:22.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f1a04fb7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a00101dd0 0x7f1a001983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f1a04fb7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a00102780 0x7f1a00198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f1a04fb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 0x7f1a0019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f1a04fb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00111f60 con 0x7f1a00106f00 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f1a04fb7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00111de0 con 0x7f1a00101dd0 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f1a04fb7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001120e0 con 0x7f1a00102780 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fe59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a00101dd0 0x7f1a001983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fe59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a00101dd0 0x7f1a001983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44418/0 (socket says 172.21.15.100:44418) 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fe59c640 1 -- 172.21.15.100:0/1265308125 learned_addr learned my addr 172.21.15.100:0/1265308125 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fed9d640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 0x7f1a0019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a00102780 0x7f1a00198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fdd9b640 1 -- 172.21.15.100:0/1265308125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a00101dd0 msgr2=0x7f1a001983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a00101dd0 0x7f1a001983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fdd9b640 1 -- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 msgr2=0x7f1a0019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 0x7f1a0019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.552+0000 7f19fdd9b640 1 -- 172.21.15.100:0/1265308125 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0019d370 con 0x7f1a00102780 2024-09-12T02:45:22.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.553+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a00102780 0x7f1a00198900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19f400e9f0 tx=0x7f19f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.553+0000 7f19ef7fe640 1 -- 172.21.15.100:0/1265308125 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f400ccc0 con 0x7f1a00102780 2024-09-12T02:45:22.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.553+0000 7f19ef7fe640 1 -- 172.21.15.100:0/1265308125 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f4010910 con 0x7f1a00102780 2024-09-12T02:45:22.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.553+0000 7f19ef7fe640 1 -- 172.21.15.100:0/1265308125 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4018890 con 0x7f1a00102780 2024-09-12T02:45:22.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.553+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0019d660 con 0x7f1a00102780 2024-09-12T02:45:22.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.554+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0019da90 con 0x7f1a00102780 2024-09-12T02:45:22.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.557+0000 7f19ef7fe640 1 -- 172.21.15.100:0/1265308125 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f19f4018a30 con 0x7f1a00102780 2024-09-12T02:45:22.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.557+0000 7f1a07390740 1 Processor -- start 2024-09-12T02:45:22.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.557+0000 7f1a07390740 1 -- start start 2024-09-12T02:45:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.557+0000 7f1a07390740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6d8f50 0x55deeb6d74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.557+0000 7f1a07390740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f1a07390740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6e2780 0x55deeb6e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f1a07390740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55deeb6392f0 con 0x55deeb6e2780 2024-09-12T02:45:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f1a07390740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55deeb5e0cf0 con 0x55deeb6d8f50 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f1a07390740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55deeb6352b0 con 0x55deeb6d79e0 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6d8f50 0x55deeb6d74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6e2780 0x55deeb6e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6d8f50 0x55deeb6d74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44434/0 (socket says 172.21.15.100:44434) 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 -- 172.21.15.100:0/4023239238 learned_addr learned my addr 172.21.15.100:0/4023239238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fe59c640 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19ef7fe640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19e80a2c40 0x7f19e80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 -- 172.21.15.100:0/4023239238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 msgr2=0x55deeb6d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 -- 172.21.15.100:0/4023239238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6e2780 msgr2=0x55deeb6e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6e2780 0x55deeb6e4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 -- 172.21.15.100:0/4023239238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deeb5c53a0 con 0x55deeb6d8f50 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19ef7fe640 1 -- 172.21.15.100:0/1265308125 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f19f40cf320 con 0x7f1a00102780 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.558+0000 7f19fed9d640 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6d8f50 0x55deeb6d74a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009ca0 tx=0x7f19f8009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e5173a311b98f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.559+0000 7f19fed9d640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19e80a2c40 0x7f19e80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.559+0000 7f19ecff9640 1 -- 172.21.15.100:0/4023239238 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8031db0 con 0x55deeb6d8f50 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.559+0000 7f19ecff9640 1 -- 172.21.15.100:0/4023239238 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f8036030 con 0x55deeb6d8f50 2024-09-12T02:45:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.559+0000 7f19ecff9640 1 -- 172.21.15.100:0/4023239238 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8004330 con 0x55deeb6d8f50 2024-09-12T02:45:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.560+0000 7f1a07390740 1 -- 172.21.15.100:0/4023239238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6d8f50 msgr2=0x55deeb6d74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.560+0000 7f1a07390740 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6d8f50 0x55deeb6d74a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009ca0 tx=0x7f19f8009800 comp rx=0 tx=0).stop 2024-09-12T02:45:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.560+0000 7f19fed9d640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19e80a2c40 0x7f19e80a5100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f19f8045000 tx=0x7f19f8004600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.561+0000 7f1a07390740 1 -- 172.21.15.100:0/4023239238 shutdown_connections 2024-09-12T02:45:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.561+0000 7f1a07390740 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6e2780 0x55deeb6e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.561+0000 7f1a07390740 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.561+0000 7f1a07390740 1 --2- 172.21.15.100:0/4023239238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6d8f50 0x55deeb6d74a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.561+0000 7f1a07390740 1 -- 172.21.15.100:0/4023239238 >> 172.21.15.100:0/4023239238 conn(0x55deeb69c310 msgr2=0x55deeb6d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.561+0000 7f1a07390740 1 -- 172.21.15.100:0/4023239238 shutdown_connections 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.561+0000 7f1a07390740 1 -- 172.21.15.100:0/4023239238 wait complete. 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 -- start start 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 Processor -- start 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d79e0 0x55deeb6e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d8f50 0x55deeb6df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6df980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55deeb6e52a0 con 0x55deeb6d79e0 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55deeb5f4060 con 0x55deeb6e2780 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55deeb6e5420 con 0x55deeb6d8f50 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f1a07390740 10 client.0 _ll_register_callbacks cb 0x55deeb3478c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d8f50 0x55deeb6df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f19fe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d79e0 0x55deeb6e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d8f50 0x55deeb6df3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:46382/0 (socket says 172.21.15.100:46382) 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.562+0000 7f19fdd9b640 1 -- 172.21.15.100:0/3595464621 learned_addr learned my addr 172.21.15.100:0/3595464621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fe59c640 1 -- 172.21.15.100:0/3595464621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d8f50 msgr2=0x55deeb6df3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fe59c640 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d8f50 0x55deeb6df3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fe59c640 1 -- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 msgr2=0x55deeb6df980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fe59c640 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6df980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fe59c640 1 -- 172.21.15.100:0/3595464621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deeb3aa3c0 con 0x55deeb6d79e0 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d8f50 0x55deeb6df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fed9d640 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19fe59c640 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d79e0 0x55deeb6e2130 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55deeb6d4ed0 tx=0x7f19f0012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fdf3e27b372632 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3595464621 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f000f8c0 con 0x55deeb6d79e0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19f8036030 con 0x55deeb6d79e0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3595464621 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f19f000fa60 con 0x55deeb6d79e0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3595464621 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19f000fc60 con 0x55deeb6d79e0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f1a07390740 10 client.16518 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55deeb6f0d50 con 0x55deeb6d79e0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3595464621 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f8036030 con 0x55deeb6d79e0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.563+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3595464621 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f19f0025050 con 0x55deeb6d79e0 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f1a07390740 10 client.16518 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f1a07390740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f1a07390740 20 client.16518 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f1a07390740 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb6f2160 0x55deeb6f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f1a07390740 4 client.16518 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deeb646860 con 0x55deeb6f2160 2024-09-12T02:45:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb6f2160 0x55deeb6f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb6f2160 0x55deeb6f45e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0150df8ec3fdae8 server_cookie=b5d833f133166007 in_seq=0 out_seq=0 2024-09-12T02:45:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.564+0000 7f19e5ffb640 10 client.16518 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3595464621 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55deeb646860 con 0x55deeb6f2160 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f19e5ffb640 10 client.16518 handle_command_reply: tid=0 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 client.16518 shutdown 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d79e0 msgr2=0x55deeb6e2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d79e0 0x55deeb6e2130 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55deeb6d4ed0 tx=0x7f19f0012b60 comp rx=0 tx=0).stop 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 shutdown_connections 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb6f2160 0x55deeb6f45e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d8f50 0x55deeb6df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 --2- 172.21.15.100:0/3595464621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d79e0 0x55deeb6e2130 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 >> 172.21.15.100:0/3595464621 conn(0x55deeb69c310 msgr2=0x55deeb6d9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.565+0000 7f19e5ffb640 0 client.16518 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.566+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 shutdown_connections 2024-09-12T02:45:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.566+0000 7f1a07390740 1 -- 172.21.15.100:0/3595464621 wait complete. 2024-09-12T02:45:22.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.566+0000 7f1a07390740 20 client.16518 trim_cache size 0 max 16384 2024-09-12T02:45:22.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.586+0000 7f1a07390740 1 Processor -- start 2024-09-12T02:45:22.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.586+0000 7f1a07390740 1 -- start start 2024-09-12T02:45:22.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f1a07390740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f1a07390740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f1a07390740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6da530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f1a07390740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001adc50 con 0x55deeb6d8f50 2024-09-12T02:45:22.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f1a07390740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001ab520 con 0x55deeb6e2780 2024-09-12T02:45:22.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f1a07390740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001a9370 con 0x55deeb6d79e0 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6da530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:44458/0 (socket says 172.21.15.100:44458) 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 -- 172.21.15.100:0/171561378 learned_addr learned my addr 172.21.15.100:0/171561378 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fe59c640 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 -- 172.21.15.100:0/171561378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 msgr2=0x55deeb6d71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 -- 172.21.15.100:0/171561378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 msgr2=0x55deeb6e1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 -- 172.21.15.100:0/171561378 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deeb6de390 con 0x55deeb6e2780 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.587+0000 7f19fed9d640 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6da530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19f802fb40 tx=0x7f19f8050000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9577d9c98d0944 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f19e7fff640 1 -- 172.21.15.100:0/171561378 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8056040 con 0x55deeb6e2780 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f19e7fff640 1 -- 172.21.15.100:0/171561378 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f8061070 con 0x55deeb6e2780 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f19e7fff640 1 -- 172.21.15.100:0/171561378 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f804a040 con 0x55deeb6e2780 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f1a07390740 1 -- 172.21.15.100:0/171561378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 msgr2=0x55deeb6da530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f1a07390740 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6da530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19f802fb40 tx=0x7f19f8050000 comp rx=0 tx=0).stop 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f1a07390740 1 -- 172.21.15.100:0/171561378 shutdown_connections 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f1a07390740 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6da530 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f1a07390740 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f1a07390740 1 --2- 172.21.15.100:0/171561378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6d71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.588+0000 7f1a07390740 1 -- 172.21.15.100:0/171561378 >> 172.21.15.100:0/171561378 conn(0x55deeb69c310 msgr2=0x55deeb6e0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 -- 172.21.15.100:0/171561378 shutdown_connections 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 -- 172.21.15.100:0/171561378 wait complete. 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 -- start start 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 Processor -- start 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6ead80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001a99e0 con 0x55deeb6d8f50 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001aae50 con 0x55deeb6e2780 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001aa0b0 con 0x55deeb6d79e0 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f1a07390740 10 client.0 _ll_register_callbacks cb 0x7f19f0009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49230/0 (socket says 172.21.15.100:49230) 2024-09-12T02:45:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f19fdd9b640 1 -- 172.21.15.100:0/3171929338 learned_addr learned my addr 172.21.15.100:0/3171929338 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.589+0000 7f19fe59c640 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6ead80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.590+0000 7f19fed9d640 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.590+0000 7f19fdd9b640 1 -- 172.21.15.100:0/3171929338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 msgr2=0x55deeb6ead80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.590+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6ead80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.590+0000 7f19fdd9b640 1 -- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 msgr2=0x55deeb6e65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.590+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6e65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.590+0000 7f19fdd9b640 1 -- 172.21.15.100:0/3171929338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deeb6e6e20 con 0x55deeb6d8f50 2024-09-12T02:45:22.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.590+0000 7f19fdd9b640 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e60b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f19f40cd180 tx=0x7f19f4009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c87c5ab7967ae0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.591+0000 7f19e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:45:22.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.591+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3171929338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f409bc20 con 0x55deeb6d8f50 2024-09-12T02:45:22.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.591+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3171929338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f19f4099f20 con 0x55deeb6d8f50 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.591+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19f8061070 con 0x55deeb6d8f50 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.591+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3171929338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19f409ff20 con 0x55deeb6d8f50 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.591+0000 7f1a07390740 10 client.16524 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.591+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55deeb75ce60 con 0x55deeb6d8f50 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.592+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3171929338 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f40b4020 con 0x55deeb6d8f50 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3171929338 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f19f4097970 con 0x55deeb6d8f50 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 10 client.16524 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 20 client.16524 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb75d4f0 0x55deeb75f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 4 client.16524 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f19f8061070 con 0x55deeb75d4f0 2024-09-12T02:45:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f19fe59c640 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb75d4f0 0x55deeb75f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f19e5ffb640 10 client.16524 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f19fe59c640 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb75d4f0 0x55deeb75f910 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a211a9d76306d094 server_cookie=251294bab97b16bc in_seq=0 out_seq=0 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f19e5ffb640 1 -- 172.21.15.100:0/3171929338 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f19f8061070 con 0x55deeb75d4f0 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f19e5ffb640 10 client.16524 handle_command_reply: tid=0 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 1 client.16524 shutdown 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 msgr2=0x55deeb6e60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.593+0000 7f1a07390740 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e60b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f19f40cd180 tx=0x7f19f4009700 comp rx=0 tx=0).stop 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 shutdown_connections 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55deeb75d4f0 0x55deeb75f910 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55deeb6e2780 0x55deeb6e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55deeb6d8f50 0x55deeb6e60b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 --2- 172.21.15.100:0/3171929338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb6d79e0 0x55deeb6ead80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 >> 172.21.15.100:0/3171929338 conn(0x55deeb69c310 msgr2=0x55deeb6e1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f19e5ffb640 0 client.16524 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:22.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 shutdown_connections 2024-09-12T02:45:22.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 1 -- 172.21.15.100:0/3171929338 wait complete. 2024-09-12T02:45:22.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a07390740 20 client.16524 trim_cache size 0 max 16384 2024-09-12T02:45:22.599 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19e80a2c40 msgr2=0x7f19e80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19e80a2c40 0x7f19e80a5100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f19f8045000 tx=0x7f19f8004600 comp rx=0 tx=0).stop 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a00102780 msgr2=0x7f1a00198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.594+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a00102780 0x7f1a00198900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19f400e9f0 tx=0x7f19f400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 shutdown_connections 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f19e80a2c40 0x7f19e80a5100 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a00106f00 0x7f1a0019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a00102780 0x7f1a00198900 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 --2- 172.21.15.100:0/1265308125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a00101dd0 0x7f1a001983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 >> 172.21.15.100:0/1265308125 conn(0x7f1a000fd8b0 msgr2=0x7f1a000febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 shutdown_connections 2024-09-12T02:45:22.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:22.595+0000 7f1a04fb7640 1 -- 172.21.15.100:0/1265308125 wait complete. 2024-09-12T02:45:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:22 smithi117 ceph-mon[34898]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 8.9 MiB/s wr, 726 op/s 2024-09-12T02:45:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:22 smithi100 ceph-mon[31390]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 8.9 MiB/s wr, 726 op/s 2024-09-12T02:45:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:22 smithi189 ceph-mon[35196]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 8.9 MiB/s wr, 726 op/s 2024-09-12T02:45:24.906 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:45:24.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:45:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:24 smithi117 ceph-mon[34898]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.2 MiB/s wr, 672 op/s 2024-09-12T02:45:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:24 smithi100 ceph-mon[31390]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.2 MiB/s wr, 672 op/s 2024-09-12T02:45:25.254 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:24 smithi189 ceph-mon[35196]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.2 MiB/s wr, 672 op/s 2024-09-12T02:45:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 -- 172.21.15.100:0/2741355261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6b81082a0 msgr2=0x7fd6b810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 --2- 172.21.15.100:0/2741355261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6b81082a0 0x7fd6b810ec40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009be0 tx=0x7fd6b002a6d0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 -- 172.21.15.100:0/2741355261 shutdown_connections 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 --2- 172.21.15.100:0/2741355261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6b81082a0 0x7fd6b810ec40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 --2- 172.21.15.100:0/2741355261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81036e0 0x7fd6b8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 --2- 172.21.15.100:0/2741355261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b8102d30 0x7fd6b8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 -- 172.21.15.100:0/2741355261 >> 172.21.15.100:0/2741355261 conn(0x7fd6b80fc7d0 msgr2=0x7fd6b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 -- 172.21.15.100:0/2741355261 shutdown_connections 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.805+0000 7fd6beee8640 1 -- 172.21.15.100:0/2741355261 wait complete. 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.806+0000 7fd6beee8640 1 Processor -- start 2024-09-12T02:45:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.806+0000 7fd6beee8640 1 -- start start 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6beee8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6b8102d30 0x7fd6b8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6beee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b81036e0 0x7fd6b8198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6beee8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81082a0 0x7fd6b819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6beee8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8112050 con 0x7fd6b81082a0 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6beee8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8111ed0 con 0x7fd6b81036e0 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6beee8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b81121d0 con 0x7fd6b8102d30 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6bd485640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81082a0 0x7fd6b819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b81036e0 0x7fd6b8198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b81036e0 0x7fd6b8198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34836/0 (socket says 172.21.15.100:34836) 2024-09-12T02:45:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.807+0000 7fd6b7fff640 1 -- 172.21.15.100:0/4235135050 learned_addr learned my addr 172.21.15.100:0/4235135050 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.808+0000 7fd6b7fff640 1 -- 172.21.15.100:0/4235135050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6b8102d30 msgr2=0x7fd6b8198530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:45:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.808+0000 7fd6b7fff640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6b8102d30 0x7fd6b8198530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.808+0000 7fd6b7fff640 1 -- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81082a0 msgr2=0x7fd6b819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.808+0000 7fd6b7fff640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81082a0 0x7fd6b819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.808+0000 7fd6b7fff640 1 -- 172.21.15.100:0/4235135050 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b819d4e0 con 0x7fd6b81036e0 2024-09-12T02:45:25.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.809+0000 7fd6b7fff640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b81036e0 0x7fd6b8198a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009ea0 tx=0x7fd6a4009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.809+0000 7fd6b5ffb640 1 -- 172.21.15.100:0/4235135050 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400ccc0 con 0x7fd6b81036e0 2024-09-12T02:45:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.809+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b819d7d0 con 0x7fd6b81036e0 2024-09-12T02:45:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.809+0000 7fd6b5ffb640 1 -- 172.21.15.100:0/4235135050 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a4021920 con 0x7fd6b81036e0 2024-09-12T02:45:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.809+0000 7fd6b5ffb640 1 -- 172.21.15.100:0/4235135050 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4029820 con 0x7fd6b81036e0 2024-09-12T02:45:25.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.810+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b806bc10 con 0x7fd6b81036e0 2024-09-12T02:45:25.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.812+0000 7fd6c12c1740 1 Processor -- start 2024-09-12T02:45:25.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.812+0000 7fd6c12c1740 1 -- start start 2024-09-12T02:45:25.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412d3150 0x563f412d5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563f41229280 con 0x563f412d3150 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563f411d0b10 con 0x563f412c3a40 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563f41225240 con 0x563f412c4360 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412d2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:60308/0 (socket says 172.21.15.100:60308) 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 -- 172.21.15.100:0/3971829840 learned_addr learned my addr 172.21.15.100:0/3971829840 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bd485640 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6b5ffb640 1 -- 172.21.15.100:0/4235135050 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fd6a4021ad0 con 0x7fd6b81036e0 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 -- 172.21.15.100:0/3971829840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 msgr2=0x563f412c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 -- 172.21.15.100:0/3971829840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412d3150 msgr2=0x563f412d5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412d3150 0x563f412d5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 -- 172.21.15.100:0/3971829840 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f411dd1f0 con 0x563f412c4360 2024-09-12T02:45:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.813+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412d2c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00ba80 tx=0x7fd6ac00bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6641ad2f2ad88dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.814+0000 7fd6a2ffd640 1 -- 172.21.15.100:0/3971829840 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac016070 con 0x563f412c4360 2024-09-12T02:45:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.814+0000 7fd6a2ffd640 1 -- 172.21.15.100:0/3971829840 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6ac005500 con 0x563f412c4360 2024-09-12T02:45:25.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.814+0000 7fd6a2ffd640 1 -- 172.21.15.100:0/3971829840 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac010460 con 0x563f412c4360 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.814+0000 7fd6b5ffb640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd6a80a2c00 0x7fd6a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6bd485640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd6a80a2c00 0x7fd6a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6b5ffb640 1 -- 172.21.15.100:0/4235135050 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd6a40e0390 con 0x7fd6b81036e0 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3971829840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 msgr2=0x563f412d2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412d2c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00ba80 tx=0x7fd6ac00bf40 comp rx=0 tx=0).stop 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3971829840 shutdown_connections 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412d3150 0x563f412d5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412d2c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3971829840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3971829840 >> 172.21.15.100:0/3971829840 conn(0x563f412c00f0 msgr2=0x563f412c04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3971829840 shutdown_connections 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.815+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3971829840 wait complete. 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.816+0000 7fd6bd485640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd6a80a2c00 0x7fd6a80a50c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00099a0 tx=0x7fd6b0009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.816+0000 7fd6c12c1740 1 -- start start 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.816+0000 7fd6c12c1740 1 Processor -- start 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.816+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c4360 0x563f412d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563f412d5d20 con 0x563f412c3a40 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46474/0 (socket says 172.21.15.100:46474) 2024-09-12T02:45:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563f411e3f10 con 0x563f412c4360 2024-09-12T02:45:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 -- 172.21.15.100:0/4010129616 learned_addr learned my addr 172.21.15.100:0/4010129616 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563f412d5ea0 con 0x563f412d3150 2024-09-12T02:45:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6c12c1740 10 client.0 _ll_register_callbacks cb 0x563f411aca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bd485640 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 -- 172.21.15.100:0/4010129616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 msgr2=0x563f412d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 -- 172.21.15.100:0/4010129616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c4360 msgr2=0x563f412d0550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:45:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c4360 0x563f412d0550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.817+0000 7fd6bcc84640 1 -- 172.21.15.100:0/4010129616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f40f9a6a0 con 0x563f412c3a40 2024-09-12T02:45:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.818+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412d0010 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00bfd0 tx=0x7fd6ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6232e3aaed37bbc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.818+0000 7fd697fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:45:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.818+0000 7fd697fff640 1 -- 172.21.15.100:0/4010129616 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac016030 con 0x563f412c3a40 2024-09-12T02:45:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.818+0000 7fd697fff640 1 -- 172.21.15.100:0/4010129616 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd6ac005000 con 0x563f412c3a40 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.818+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6ac005500 con 0x563f412c3a40 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd697fff640 1 -- 172.21.15.100:0/4010129616 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6ac005220 con 0x563f412c3a40 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 10 client.16530 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563f412e1970 con 0x563f412c3a40 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd697fff640 1 -- 172.21.15.100:0/4010129616 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6ac005500 con 0x563f412c3a40 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd697fff640 1 -- 172.21.15.100:0/4010129616 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd6ac02d050 con 0x563f412c3a40 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 10 client.16530 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 20 client.16530 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f412e5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 4 client.16530 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f412367f0 con 0x563f412e2d20 2024-09-12T02:45:25.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.819+0000 7fd6b7fff640 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f412e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.820+0000 7fd697fff640 10 client.16530 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.820+0000 7fd6b7fff640 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f412e5110 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77cf024b90050f76 server_cookie=e6b9af15b6485b84 in_seq=0 out_seq=0 2024-09-12T02:45:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd697fff640 1 -- 172.21.15.100:0/4010129616 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f412367f0 con 0x563f412e2d20 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd697fff640 10 client.16530 handle_command_reply: tid=0 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 client.16530 shutdown 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 msgr2=0x563f412d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412d0010 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00bfd0 tx=0x7fd6ac004730 comp rx=0 tx=0).stop 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 shutdown_connections 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f412e5110 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd697fff640 0 client.16530 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c4360 0x563f412d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/4010129616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412d0010 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.821+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 >> 172.21.15.100:0/4010129616 conn(0x563f412c00f0 msgr2=0x563f412c5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.822+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 shutdown_connections 2024-09-12T02:45:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.822+0000 7fd6c12c1740 1 -- 172.21.15.100:0/4010129616 wait complete. 2024-09-12T02:45:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.822+0000 7fd6c12c1740 20 client.16530 trim_cache size 0 max 16384 2024-09-12T02:45:25.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.848+0000 7fd6c12c1740 1 Processor -- start 2024-09-12T02:45:25.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.848+0000 7fd6c12c1740 1 -- start start 2024-09-12T02:45:25.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c4360 0x563f412ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412eae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b81a5530 con 0x563f412c4360 2024-09-12T02:45:25.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8072160 con 0x563f412c3a40 2024-09-12T02:45:25.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b806ffb0 con 0x563f412d3150 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c4360 0x563f412ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c4360 0x563f412ea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46484/0 (socket says 172.21.15.100:46484) 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34878/0 (socket says 172.21.15.100:34878) 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6b7fff640 1 -- 172.21.15.100:0/3214100757 learned_addr learned my addr 172.21.15.100:0/3214100757 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bd485640 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bd485640 1 -- 172.21.15.100:0/3214100757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 msgr2=0x563f412cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bd485640 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bd485640 1 -- 172.21.15.100:0/3214100757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c4360 msgr2=0x563f412ea8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bd485640 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c4360 0x563f412ea8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.849+0000 7fd6bd485640 1 -- 172.21.15.100:0/3214100757 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f412c4190 con 0x563f412d3150 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.850+0000 7fd6bd485640 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412eae30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0034040 tx=0x7fd6b003d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6141d29ecbfb419 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.850+0000 7fd6a27fc640 1 -- 172.21.15.100:0/3214100757 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0036040 con 0x563f412d3150 2024-09-12T02:45:25.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.850+0000 7fd6a27fc640 1 -- 172.21.15.100:0/3214100757 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b0050070 con 0x563f412d3150 2024-09-12T02:45:25.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.850+0000 7fd6a27fc640 1 -- 172.21.15.100:0/3214100757 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00316a0 con 0x563f412d3150 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3214100757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 msgr2=0x563f412eae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412eae30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0034040 tx=0x7fd6b003d000 comp rx=0 tx=0).stop 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3214100757 shutdown_connections 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412d3150 0x563f412eae30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c4360 0x563f412ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/3214100757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412c3a40 0x563f412cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3214100757 >> 172.21.15.100:0/3214100757 conn(0x563f412c00f0 msgr2=0x563f412bf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3214100757 shutdown_connections 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 -- 172.21.15.100:0/3214100757 wait complete. 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 -- start start 2024-09-12T02:45:25.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.851+0000 7fd6c12c1740 1 Processor -- start 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6c12c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412d3150 0x563f412db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8070620 con 0x563f412c3a40 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8071a90 con 0x563f412d3150 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6c12c1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8070cf0 con 0x563f412c4360 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6c12c1740 10 client.0 _ll_register_callbacks cb 0x7fd6ac00b8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bcc84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46488/0 (socket says 172.21.15.100:46488) 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bcc84640 1 -- 172.21.15.100:0/2228795785 learned_addr learned my addr 172.21.15.100:0/2228795785 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bd485640 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412d3150 0x563f412db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bd485640 1 -- 172.21.15.100:0/2228795785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 msgr2=0x563f412ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bd485640 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bd485640 1 -- 172.21.15.100:0/2228795785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 msgr2=0x563f412ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bd485640 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bd485640 1 -- 172.21.15.100:0/2228795785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f412dbbe0 con 0x563f412d3150 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd6bd485640 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412d3150 0x563f412db3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0006010 tx=0x7fd6b0030590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f821e78f1357e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.852+0000 7fd697fff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.853+0000 7fd697fff640 1 -- 172.21.15.100:0/2228795785 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0059070 con 0x563f412d3150 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.853+0000 7fd697fff640 1 -- 172.21.15.100:0/2228795785 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd6b0003d80 con 0x563f412d3150 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.853+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6b0050070 con 0x563f412d3150 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd697fff640 1 -- 172.21.15.100:0/2228795785 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6b0036070 con 0x563f412d3150 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 10 client.25919 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563f412c8240 con 0x563f412d3150 2024-09-12T02:45:25.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd697fff640 1 -- 172.21.15.100:0/2228795785 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b0043070 con 0x563f412d3150 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd697fff640 1 -- 172.21.15.100:0/2228795785 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd6b0031990 con 0x563f412d3150 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 10 client.25919 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 10 client.25919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 20 client.25919 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f41354510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 4 client.25919 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fd6b0050070 con 0x563f412e2d20 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.854+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f41354510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.855+0000 7fd6bcc84640 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f41354510 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1493856b7014f8b server_cookie=918e7b957c6f9a90 in_seq=0 out_seq=0 2024-09-12T02:45:25.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.855+0000 7fd697fff640 10 client.25919 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.856+0000 7fd697fff640 1 -- 172.21.15.100:0/2228795785 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fd6b0050070 con 0x563f412e2d20 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.856+0000 7fd697fff640 10 client.25919 handle_command_reply: tid=0 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.856+0000 7fd6c12c1740 1 client.25919 shutdown 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.857+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412d3150 msgr2=0x563f412db3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.857+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412d3150 0x563f412db3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0006010 tx=0x7fd6b0030590 comp rx=0 tx=0).stop 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.857+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 shutdown_connections 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.857+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563f412e2d20 0x563f41354510 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563f412d3150 0x563f412db3b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f412c4360 0x563f412ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd6c12c1740 1 --2- 172.21.15.100:0/2228795785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f412c3a40 0x563f412ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 >> 172.21.15.100:0/2228795785 conn(0x563f412c00f0 msgr2=0x563f412ddfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd697fff640 0 client.25919 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:25.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 shutdown_connections 2024-09-12T02:45:25.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd6c12c1740 1 -- 172.21.15.100:0/2228795785 wait complete. 2024-09-12T02:45:25.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.858+0000 7fd6c12c1740 20 client.25919 trim_cache size 0 max 16384 2024-09-12T02:45:25.862 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:45:25.862 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:45:25.862 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "7d779201-aeaf-4337-8012-f1b72b66334f", 2024-09-12T02:45:25.862 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:45:25.862 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:45:25.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd6a80a2c00 msgr2=0x7fd6a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd6a80a2c00 0x7fd6a80a50c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00099a0 tx=0x7fd6b0009310 comp rx=0 tx=0).stop 2024-09-12T02:45:25.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b81036e0 msgr2=0x7fd6b8198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b81036e0 0x7fd6b8198a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009ea0 tx=0x7fd6a4009f90 comp rx=0 tx=0).stop 2024-09-12T02:45:25.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 shutdown_connections 2024-09-12T02:45:25.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd6a80a2c00 0x7fd6a80a50c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81082a0 0x7fd6b819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b81036e0 0x7fd6b8198a70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 --2- 172.21.15.100:0/4235135050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd6b8102d30 0x7fd6b8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 >> 172.21.15.100:0/4235135050 conn(0x7fd6b80fc7d0 msgr2=0x7fd6b8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 shutdown_connections 2024-09-12T02:45:25.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:25.859+0000 7fd6beee8640 1 -- 172.21.15.100:0/4235135050 wait complete. 2024-09-12T02:45:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 375.0 s, 2523.0 tps, lat 39.632 ms stddev 43.487 2024-09-12T02:45:26.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:45:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:27.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:26 smithi100 ceph-mon[31390]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 725 op/s 2024-09-12T02:45:27.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:26 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:45:27.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:26 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:26 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:45:27.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:26 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:45:27.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:26 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:26 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:26 smithi117 ceph-mon[34898]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 725 op/s 2024-09-12T02:45:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:26 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:45:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:26 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:26 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:45:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:26 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:45:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:26 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:26 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:26 smithi189 ceph-mon[35196]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 725 op/s 2024-09-12T02:45:27.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:26 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:45:27.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:26 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:26 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:45:27.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:26 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:45:27.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:26 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:26 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.647+0000 7f3cce1b3640 1 -- 172.21.15.100:0/426844604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc81011e0 msgr2=0x7f3cc8105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.647+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/426844604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc81011e0 0x7f3cc8105980 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009930 tx=0x7f3cb002a440 comp rx=0 tx=0).stop 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.648+0000 7f3cce1b3640 1 -- 172.21.15.100:0/426844604 shutdown_connections 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.648+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/426844604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc8105ec0 0x7f3cc8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.648+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/426844604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc81011e0 0x7f3cc8105980 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.648+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/426844604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc81008c0 0x7f3cc8100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.648+0000 7f3cce1b3640 1 -- 172.21.15.100:0/426844604 >> 172.21.15.100:0/426844604 conn(0x7f3cc80fc7d0 msgr2=0x7f3cc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.652+0000 7f3cce1b3640 1 -- 172.21.15.100:0/426844604 shutdown_connections 2024-09-12T02:45:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.656+0000 7f3cce1b3640 1 -- 172.21.15.100:0/426844604 wait complete. 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.657+0000 7f3cce1b3640 1 Processor -- start 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.657+0000 7f3cce1b3640 1 -- start start 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.658+0000 7f3cce1b3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc81008c0 0x7f3cc81a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.658+0000 7f3cce1b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc81011e0 0x7f3cc81a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.658+0000 7f3cce1b3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8105ec0 0x7f3cc819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.658+0000 7f3cce1b3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8118700 con 0x7f3cc8105ec0 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.658+0000 7f3cce1b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8118580 con 0x7f3cc81011e0 2024-09-12T02:45:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.658+0000 7f3cce1b3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8118880 con 0x7f3cc81008c0 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc81008c0 0x7f3cc81a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc81008c0 0x7f3cc81a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:60362/0 (socket says 172.21.15.100:60362) 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3816134387 learned_addr learned my addr 172.21.15.100:0/3816134387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3816134387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc81011e0 msgr2=0x7f3cc81a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc81011e0 0x7f3cc81a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8105ec0 msgr2=0x7f3cc819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8105ec0 0x7f3cc819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.659+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3816134387 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc819f220 con 0x7f3cc81008c0 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.661+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc81008c0 0x7f3cc81a4930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800b4a0 tx=0x7f3cb800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.662+0000 7f3cc57fa640 1 -- 172.21.15.100:0/3816134387 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8014070 con 0x7f3cc81008c0 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.662+0000 7f3cc57fa640 1 -- 172.21.15.100:0/3816134387 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb8010af0 con 0x7f3cc81008c0 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.663+0000 7f3cc57fa640 1 -- 172.21.15.100:0/3816134387 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8017d10 con 0x7f3cc81008c0 2024-09-12T02:45:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.663+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc819f510 con 0x7f3cc81008c0 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.663+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc81ab800 con 0x7f3cc81008c0 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.667+0000 7f3cc57fa640 1 -- 172.21.15.100:0/3816134387 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3cb8017070 con 0x7f3cc81008c0 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.669+0000 7f3cd058c740 1 Processor -- start 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.669+0000 7f3cc57fa640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3cb40a2cc0 0x7f3cb40a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.669+0000 7f3cc57fa640 1 -- 172.21.15.100:0/3816134387 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3cb80ce7b0 con 0x7f3cc81008c0 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.669+0000 7f3cd058c740 1 -- start start 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.669+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3cb40a2cc0 0x7f3cb40a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623a4a0 0x557ed623a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6245140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6247a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cd058c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557ed61a02e0 con 0x557ed6245680 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cd058c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557ed6147ce0 con 0x557ed623a4a0 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cd058c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557ed619c2a0 con 0x557ed623adc0 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623a4a0 0x557ed623a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6245140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623a4a0 0x557ed623a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34910/0 (socket says 172.21.15.100:34910) 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3558715885 learned_addr learned my addr 172.21.15.100:0/3558715885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6247a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3558715885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 msgr2=0x557ed6245140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6245140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3558715885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 msgr2=0x557ed6247a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6247a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3558715885 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed612c440 con 0x557ed623a4a0 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.670+0000 7f3cbffff640 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6245140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.671+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3cb40a2cc0 0x7f3cb40a5180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0005c40 tx=0x7f3cc0012a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.671+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623a4a0 0x557ed623a880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3cb809af30 tx=0x7f3cb8017730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96798867b02abee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.671+0000 7f3cbdffb640 1 -- 172.21.15.100:0/3558715885 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80a3c10 con 0x557ed623a4a0 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.671+0000 7f3cbdffb640 1 -- 172.21.15.100:0/3558715885 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb80992a0 con 0x557ed623a4a0 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.671+0000 7f3cbdffb640 1 -- 172.21.15.100:0/3558715885 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80b9e40 con 0x557ed623a4a0 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 -- 172.21.15.100:0/3558715885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623a4a0 msgr2=0x557ed623a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623a4a0 0x557ed623a880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3cb809af30 tx=0x7f3cb8017730 comp rx=0 tx=0).stop 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 -- 172.21.15.100:0/3558715885 shutdown_connections 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6247a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6245140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3558715885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623a4a0 0x557ed623a880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 -- 172.21.15.100:0/3558715885 >> 172.21.15.100:0/3558715885 conn(0x557ed6236a30 msgr2=0x557ed6236e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 -- 172.21.15.100:0/3558715885 shutdown_connections 2024-09-12T02:45:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.672+0000 7f3cd058c740 1 -- 172.21.15.100:0/3558715885 wait complete. 2024-09-12T02:45:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 -- start start 2024-09-12T02:45:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 Processor -- start 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed6245060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623adc0 0x557ed6242310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed62428e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557ed62482a0 con 0x557ed623adc0 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557ed615b050 con 0x557ed6245680 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.673+0000 7f3cd058c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557ed6248420 con 0x557ed623a4a0 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cd058c740 10 client.0 _ll_register_callbacks cb 0x557ed619b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed62428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed62428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34914/0 (socket says 172.21.15.100:34914) 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 -- 172.21.15.100:0/1281555022 learned_addr learned my addr 172.21.15.100:0/1281555022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cbffff640 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623adc0 0x557ed6242310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 -- 172.21.15.100:0/1281555022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 msgr2=0x557ed6245060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed6245060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 -- 172.21.15.100:0/1281555022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623adc0 msgr2=0x557ed6242310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623adc0 0x557ed6242310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.674+0000 7f3cc7fff640 1 -- 172.21.15.100:0/1281555022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed5f113c0 con 0x557ed6245680 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.676+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed62428e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000eb50 tx=0x7f3cc0009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebef140f0a633d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.676+0000 7f3ca6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.676+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/1281555022 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0025070 con 0x557ed6245680 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/1281555022 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3cc001e420 con 0x557ed6245680 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb80992a0 con 0x557ed6245680 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/1281555022 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3cc0031050 con 0x557ed6245680 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 10 client.25928 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ed6253ce0 con 0x557ed6245680 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/1281555022 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb80992a0 con 0x557ed6245680 2024-09-12T02:45:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/1281555022 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3cc001d5a0 con 0x557ed6245680 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 10 client.25928 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 10 client.25928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 20 client.25928 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62550f0 0x557ed6257560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 4 client.25928 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ed61ad850 con 0x557ed62550f0 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.677+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62550f0 0x557ed6257560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.678+0000 7f3ca6ffd640 10 client.25928 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.678+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62550f0 0x557ed6257560 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fbefe5e09615c0a server_cookie=52c4ba729849a3b in_seq=0 out_seq=0 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.678+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/1281555022 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ed61ad850 con 0x557ed62550f0 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.678+0000 7f3ca6ffd640 10 client.25928 handle_command_reply: tid=0 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.678+0000 7f3cd058c740 1 client.25928 shutdown 2024-09-12T02:45:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 msgr2=0x557ed62428e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed62428e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000eb50 tx=0x7f3cc0009500 comp rx=0 tx=0).stop 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 shutdown_connections 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62550f0 0x557ed6257560 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed62428e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623adc0 0x557ed6242310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 --2- 172.21.15.100:0/1281555022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed6245060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3ca6ffd640 0 client.25928 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 >> 172.21.15.100:0/1281555022 conn(0x557ed6236a30 msgr2=0x557ed623c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 shutdown_connections 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 1 -- 172.21.15.100:0/1281555022 wait complete. 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.679+0000 7f3cd058c740 20 client.25928 trim_cache size 0 max 16384 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.701+0000 7f3cd058c740 1 Processor -- start 2024-09-12T02:45:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cd058c740 1 -- start start 2024-09-12T02:45:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623a4a0 0x557ed6251500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6241bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed623d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cd058c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b6790 con 0x557ed623a4a0 2024-09-12T02:45:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cd058c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b4060 con 0x557ed6245680 2024-09-12T02:45:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cd058c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b1eb0 con 0x557ed623adc0 2024-09-12T02:45:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.702+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6241bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623a4a0 0x557ed6251500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623a4a0 0x557ed6251500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46514/0 (socket says 172.21.15.100:46514) 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cc77fe640 1 -- 172.21.15.100:0/42381979 learned_addr learned my addr 172.21.15.100:0/42381979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed623d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cbffff640 1 -- 172.21.15.100:0/42381979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 msgr2=0x557ed623d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cbffff640 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed623d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cbffff640 1 -- 172.21.15.100:0/42381979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623a4a0 msgr2=0x557ed6251500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cbffff640 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623a4a0 0x557ed6251500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.703+0000 7f3cbffff640 1 -- 172.21.15.100:0/42381979 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed62412c0 con 0x557ed623adc0 2024-09-12T02:45:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.704+0000 7f3cbffff640 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6241bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009230 tx=0x7f3cb00041c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a4ac77c5dd039b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.704+0000 7f3cbd7fa640 1 -- 172.21.15.100:0/42381979 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0035040 con 0x557ed623adc0 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.704+0000 7f3cbd7fa640 1 -- 172.21.15.100:0/42381979 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb0005510 con 0x557ed623adc0 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.704+0000 7f3cbd7fa640 1 -- 172.21.15.100:0/42381979 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00035f0 con 0x557ed623adc0 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.705+0000 7f3cd058c740 1 -- 172.21.15.100:0/42381979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 msgr2=0x557ed6241bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.705+0000 7f3cd058c740 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6241bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009230 tx=0x7f3cb00041c0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 -- 172.21.15.100:0/42381979 shutdown_connections 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed6245680 0x557ed623d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623adc0 0x557ed6241bd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 --2- 172.21.15.100:0/42381979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed623a4a0 0x557ed6251500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 -- 172.21.15.100:0/42381979 >> 172.21.15.100:0/42381979 conn(0x557ed6236a30 msgr2=0x557ed623d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 -- 172.21.15.100:0/42381979 shutdown_connections 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 -- 172.21.15.100:0/42381979 wait complete. 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 -- start start 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 Processor -- start 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.706+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed624dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623adc0 0x557ed6248ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cd058c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6249530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cd058c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b2520 con 0x557ed6245680 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cd058c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b3990 con 0x557ed623adc0 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cd058c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b2bf0 con 0x557ed623a4a0 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623adc0 0x557ed6248ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed624dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cd058c740 10 client.0 _ll_register_callbacks cb 0x7f3cc000ea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623adc0 0x557ed6248ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34944/0 (socket says 172.21.15.100:34944) 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cbffff640 1 -- 172.21.15.100:0/3026124965 learned_addr learned my addr 172.21.15.100:0/3026124965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6249530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3026124965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623adc0 msgr2=0x557ed6248ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623adc0 0x557ed6248ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3026124965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 msgr2=0x557ed6249530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6249530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc77fe640 1 -- 172.21.15.100:0/3026124965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed62453d0 con 0x557ed623a4a0 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc7fff640 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6249530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3cc77fe640 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed624dcc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009420 tx=0x7f3cb80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b938a7e0884b3393 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3ca6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.707+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/3026124965 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8097240 con 0x557ed623a4a0 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/3026124965 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3cb80cc350 con 0x557ed623a4a0 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb0005510 con 0x557ed623a4a0 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/3026124965 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3cb8097610 con 0x557ed623a4a0 2024-09-12T02:45:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 10 client.25921 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ed62bfb50 con 0x557ed623a4a0 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/3026124965 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb0005510 con 0x557ed623a4a0 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/3026124965 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3cb809a3f0 con 0x557ed623a4a0 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 10 client.25921 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 10 client.25921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 20 client.25921 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62bfe40 0x557ed62c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 4 client.25921 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557ed61a7d60 con 0x557ed62bfe40 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.708+0000 7f3cbffff640 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62bfe40 0x557ed62c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.709+0000 7f3cbffff640 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62bfe40 0x557ed62c2230 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e515b55a563827 server_cookie=8e05d00507230dab in_seq=0 out_seq=0 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.709+0000 7f3ca6ffd640 10 client.25921 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.709+0000 7f3ca6ffd640 1 -- 172.21.15.100:0/3026124965 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557ed61a7d60 con 0x557ed62bfe40 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.709+0000 7f3ca6ffd640 10 client.25921 handle_command_reply: tid=0 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.709+0000 7f3cd058c740 1 client.25921 shutdown 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.710+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 msgr2=0x557ed624dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.710+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed624dcc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009420 tx=0x7f3cb80046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.711+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 shutdown_connections 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.711+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557ed62bfe40 0x557ed62c2230 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.711+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ed6245680 0x557ed6249530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.711+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ed623adc0 0x557ed6248ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.711+0000 7f3cd058c740 1 --2- 172.21.15.100:0/3026124965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ed623a4a0 0x557ed624dcc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.711+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 >> 172.21.15.100:0/3026124965 conn(0x557ed6236a30 msgr2=0x557ed6244390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.712+0000 7f3ca6ffd640 0 client.25921 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.712+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 shutdown_connections 2024-09-12T02:45:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.712+0000 7f3cd058c740 1 -- 172.21.15.100:0/3026124965 wait complete. 2024-09-12T02:45:27.978 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:45:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:45:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:45:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "7d779201-aeaf-4337-8012-f1b72b66334f": { 2024-09-12T02:45:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:45:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "7d779201-aeaf-4337-8012-f1b72b66334f", 2024-09-12T02:45:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:45:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:27.979 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:45:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.712+0000 7f3cd058c740 20 client.25921 trim_cache size 0 max 16384 2024-09-12T02:45:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.712+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3cb40a2cc0 msgr2=0x7f3cb40a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.712+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3cb40a2cc0 0x7f3cb40a5180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0005c40 tx=0x7f3cc0012a30 comp rx=0 tx=0).stop 2024-09-12T02:45:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc81008c0 msgr2=0x7f3cc81a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc81008c0 0x7f3cc81a4930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800b4a0 tx=0x7f3cb800b960 comp rx=0 tx=0).stop 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 shutdown_connections 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3cb40a2cc0 0x7f3cb40a5180 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8105ec0 0x7f3cc819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc81011e0 0x7f3cc81a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 --2- 172.21.15.100:0/3816134387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3cc81008c0 0x7f3cc81a4930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 >> 172.21.15.100:0/3816134387 conn(0x7f3cc80fc7d0 msgr2=0x7f3cc8103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 shutdown_connections 2024-09-12T02:45:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:27.713+0000 7f3cce1b3640 1 -- 172.21.15.100:0/3816134387 wait complete. 2024-09-12T02:45:28.445 INFO:tasks.cephfs.filesystem:scrub status for tag:7d779201-aeaf-4337-8012-f1b72b66334f - {'path': '/', 'tag': '7d779201-aeaf-4337-8012-f1b72b66334f', 'options': 'recursive,force'} 2024-09-12T02:45:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:28 smithi117 ceph-mon[34898]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 753 op/s 2024-09-12T02:45:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:28 smithi100 ceph-mon[31390]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 753 op/s 2024-09-12T02:45:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:28 smithi189 ceph-mon[35196]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.5 MiB/s wr, 753 op/s 2024-09-12T02:45:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:30 smithi117 ceph-mon[34898]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 728 op/s 2024-09-12T02:45:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:30 smithi100 ceph-mon[31390]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 728 op/s 2024-09-12T02:45:31.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:30 smithi189 ceph-mon[35196]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 728 op/s 2024-09-12T02:45:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 380.0 s, 2772.8 tps, lat 36.044 ms stddev 36.511 2024-09-12T02:45:32.770 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-12T02:45:32.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:32 smithi117 ceph-mon[34898]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 728 op/s 2024-09-12T02:45:33.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:32 smithi100 ceph-mon[31390]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 728 op/s 2024-09-12T02:45:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:32 smithi189 ceph-mon[35196]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 728 op/s 2024-09-12T02:45:33.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 -- 172.21.15.100:0/3855985667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 msgr2=0x7f98cc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/3855985667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 0x7f98cc10ec40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009cd0 tx=0x7f98c402a910 comp rx=0 tx=0).stop 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 -- 172.21.15.100:0/3855985667 shutdown_connections 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/3855985667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 0x7f98cc10ec40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/3855985667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc1036e0 0x7f98cc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/3855985667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc102d30 0x7f98cc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 -- 172.21.15.100:0/3855985667 >> 172.21.15.100:0/3855985667 conn(0x7f98cc0fc7d0 msgr2=0x7f98cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 -- 172.21.15.100:0/3855985667 shutdown_connections 2024-09-12T02:45:33.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.625+0000 7f98d3c0a640 1 -- 172.21.15.100:0/3855985667 wait complete. 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 Processor -- start 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 -- start start 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc102d30 0x7f98cc198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1036e0 0x7f98cc198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 0x7f98cc19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc1120a0 con 0x7f98cc1082a0 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc111f20 con 0x7f98cc1036e0 2024-09-12T02:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.626+0000 7f98d3c0a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc112220 con 0x7f98cc102d30 2024-09-12T02:45:33.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d21a7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 0x7f98cc19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d21a7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 0x7f98cc19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46538/0 (socket says 172.21.15.100:46538) 2024-09-12T02:45:33.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d11a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1036e0 0x7f98cc198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d19a6640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc102d30 0x7f98cc198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d21a7640 1 -- 172.21.15.100:0/532839075 learned_addr learned my addr 172.21.15.100:0/532839075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d11a5640 1 -- 172.21.15.100:0/532839075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc102d30 msgr2=0x7f98cc198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d11a5640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc102d30 0x7f98cc198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d11a5640 1 -- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 msgr2=0x7f98cc19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d11a5640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 0x7f98cc19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.627+0000 7f98d11a5640 1 -- 172.21.15.100:0/532839075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc19d4f0 con 0x7f98cc1036e0 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.628+0000 7f98d11a5640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1036e0 0x7f98cc198a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0697d0 tx=0x7f98bc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.628+0000 7f98c2ffd640 1 -- 172.21.15.100:0/532839075 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00cc40 con 0x7f98cc1036e0 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.628+0000 7f98c2ffd640 1 -- 172.21.15.100:0/532839075 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98bc00cde0 con 0x7f98cc1036e0 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.628+0000 7f98c2ffd640 1 -- 172.21.15.100:0/532839075 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0188e0 con 0x7f98cc1036e0 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.628+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc19d7e0 con 0x7f98cc1036e0 2024-09-12T02:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.628+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc1a50c0 con 0x7f98cc1036e0 2024-09-12T02:45:33.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.629+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98cc103110 con 0x7f98cc1036e0 2024-09-12T02:45:33.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.631+0000 7f98c2ffd640 1 -- 172.21.15.100:0/532839075 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f98bc018a80 con 0x7f98cc1036e0 2024-09-12T02:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.632+0000 7f98c2ffd640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b80a2c80 0x7f98b80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.632+0000 7f98c2ffd640 1 -- 172.21.15.100:0/532839075 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f98bc0cf250 con 0x7f98cc1036e0 2024-09-12T02:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.632+0000 7f98d19a6640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b80a2c80 0x7f98b80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.632+0000 7f98d19a6640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b80a2c80 0x7f98b80a5140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98c800bbe0 tx=0x7f98c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.636+0000 7f98c2ffd640 1 -- 172.21.15.100:0/532839075 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98bc09baf0 con 0x7f98cc1036e0 2024-09-12T02:45:33.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.957+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98cc1a5290 con 0x7f98cc1036e0 2024-09-12T02:45:33.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.958+0000 7f98c2ffd640 1 -- 172.21.15.100:0/532839075 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f98bc09fdf0 con 0x7f98cc1036e0 2024-09-12T02:45:33.959 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:45:33.959 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:45:33.960 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:45:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b80a2c80 msgr2=0x7f98b80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b80a2c80 0x7f98b80a5140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98c800bbe0 tx=0x7f98c800b390 comp rx=0 tx=0).stop 2024-09-12T02:45:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1036e0 msgr2=0x7f98cc198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1036e0 0x7f98cc198a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0697d0 tx=0x7f98bc00ee50 comp rx=0 tx=0).stop 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 shutdown_connections 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b80a2c80 0x7f98b80a5140 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1082a0 0x7f98cc19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1036e0 0x7f98cc198a80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 --2- 172.21.15.100:0/532839075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc102d30 0x7f98cc198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 >> 172.21.15.100:0/532839075 conn(0x7f98cc0fc7d0 msgr2=0x7f98cc105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 shutdown_connections 2024-09-12T02:45:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:33.963+0000 7f98d3c0a640 1 -- 172.21.15.100:0/532839075 wait complete. 2024-09-12T02:45:34.757 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-12T02:45:34.757 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-12T02:45:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:34 smithi117 ceph-mon[34898]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 MiB/s wr, 670 op/s 2024-09-12T02:45:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:34 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/532839075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:34 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:45:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:34 smithi100 ceph-mon[31390]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 MiB/s wr, 670 op/s 2024-09-12T02:45:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/532839075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:34 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:45:35.128 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:34 smithi189 ceph-mon[35196]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 MiB/s wr, 670 op/s 2024-09-12T02:45:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/532839075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:34 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:45:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.693+0000 7f39ac09f640 1 -- 172.21.15.100:0/1240258757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a410c180 msgr2=0x7f39a410e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.693+0000 7f39ac09f640 1 --2- 172.21.15.100:0/1240258757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a410c180 0x7f39a410e620 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f399c009ca0 tx=0x7f399c02a950 comp rx=0 tx=0).stop 2024-09-12T02:45:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.693+0000 7f39ac09f640 1 -- 172.21.15.100:0/1240258757 shutdown_connections 2024-09-12T02:45:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.693+0000 7f39ac09f640 1 --2- 172.21.15.100:0/1240258757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a410c180 0x7f39a410e620 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.693+0000 7f39ac09f640 1 --2- 172.21.15.100:0/1240258757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 0x7f39a410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.693+0000 7f39ac09f640 1 --2- 172.21.15.100:0/1240258757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39a4102d50 0x7f39a4103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.693+0000 7f39ac09f640 1 -- 172.21.15.100:0/1240258757 >> 172.21.15.100:0/1240258757 conn(0x7f39a40fc7d0 msgr2=0x7f39a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.694+0000 7f39ac09f640 1 -- 172.21.15.100:0/1240258757 shutdown_connections 2024-09-12T02:45:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.694+0000 7f39ac09f640 1 -- 172.21.15.100:0/1240258757 wait complete. 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.694+0000 7f39ac09f640 1 Processor -- start 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.695+0000 7f39ac09f640 1 -- start start 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.695+0000 7f39ac09f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a4102d50 0x7f39a41a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.695+0000 7f39ac09f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 0x7f39a41a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.695+0000 7f39ac09f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39a410c180 0x7f39a410a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.695+0000 7f39ac09f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4111f90 con 0x7f39a4102d50 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.695+0000 7f39ac09f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4111e10 con 0x7f39a4103670 2024-09-12T02:45:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.695+0000 7f39ac09f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4112110 con 0x7f39a410c180 2024-09-12T02:45:35.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.696+0000 7f39a963a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 0x7f39a41a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.696+0000 7f39a963a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 0x7f39a41a4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:47378/0 (socket says 172.21.15.100:47378) 2024-09-12T02:45:35.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.696+0000 7f39a963a640 1 -- 172.21.15.100:0/2956092597 learned_addr learned my addr 172.21.15.100:0/2956092597 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:35.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.696+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a4102d50 0x7f39a41a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.697+0000 7f39a963a640 1 -- 172.21.15.100:0/2956092597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39a410c180 msgr2=0x7f39a410a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.697+0000 7f39a963a640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39a410c180 0x7f39a410a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.697+0000 7f39a963a640 1 -- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a4102d50 msgr2=0x7f39a41a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.697+0000 7f39a963a640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a4102d50 0x7f39a41a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.697+0000 7f39a963a640 1 -- 172.21.15.100:0/2956092597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a410b120 con 0x7f39a4103670 2024-09-12T02:45:35.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.697+0000 7f39a963a640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 0x7f39a41a4940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f399400e9f0 tx=0x7f399400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.697+0000 7f399affd640 1 -- 172.21.15.100:0/2956092597 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399400cd80 con 0x7f39a4103670 2024-09-12T02:45:35.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.698+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a410b410 con 0x7f39a4103670 2024-09-12T02:45:35.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.698+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a41ab2d0 con 0x7f39a4103670 2024-09-12T02:45:35.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.698+0000 7f399affd640 1 -- 172.21.15.100:0/2956092597 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39940035f0 con 0x7f39a4103670 2024-09-12T02:45:35.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.698+0000 7f399affd640 1 -- 172.21.15.100:0/2956092597 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994010670 con 0x7f39a4103670 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.700+0000 7f39ae478740 1 Processor -- start 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39ae478740 1 -- start start 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39ae478740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b1cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39ae478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b1d080 0x561842b27400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39ae478740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b29d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39ae478740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561842a822a0 con 0x561842b27940 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39ae478740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561842a29b10 con 0x561842b1c760 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39ae478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561842a7e260 con 0x561842b1d080 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39a9e3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b1d080 0x561842b27400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39a9e3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b1d080 0x561842b27400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:40174/0 (socket says 172.21.15.100:40174) 2024-09-12T02:45:35.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39a9e3b640 1 -- 172.21.15.100:0/4122099037 learned_addr learned my addr 172.21.15.100:0/4122099037 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:35.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f399affd640 1 -- 172.21.15.100:0/2956092597 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3994010810 con 0x7f39a4103670 2024-09-12T02:45:35.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39a9e3b640 1 -- 172.21.15.100:0/4122099037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 msgr2=0x561842b1cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:45:35.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/4122099037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b1cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39a9e3b640 1 -- 172.21.15.100:0/4122099037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 msgr2=0x561842b29d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.701+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/4122099037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b29d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.702+0000 7f39a9e3b640 1 -- 172.21.15.100:0/4122099037 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618427f3b90 con 0x561842b1d080 2024-09-12T02:45:35.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.702+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/4122099037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b1d080 0x561842b27400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009cf0 tx=0x7f39a0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc12292e285687a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.702+0000 7f398ffff640 1 -- 172.21.15.100:0/4122099037 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0004220 con 0x561842b1d080 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.702+0000 7f398ffff640 1 -- 172.21.15.100:0/4122099037 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39a00043c0 con 0x561842b1d080 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.702+0000 7f398ffff640 1 -- 172.21.15.100:0/4122099037 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0018910 con 0x561842b1d080 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f399affd640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39900a2c00 0x7f39900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f399affd640 1 -- 172.21.15.100:0/2956092597 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f39940cf1d0 con 0x7f39a4103670 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39ae478740 1 -- 172.21.15.100:0/4122099037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b1d080 msgr2=0x561842b27400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39ae478740 1 --2- 172.21.15.100:0/4122099037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b1d080 0x561842b27400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009cf0 tx=0x7f39a0011810 comp rx=0 tx=0).stop 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39aa63c640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39900a2c00 0x7f39900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39ae478740 1 -- 172.21.15.100:0/4122099037 shutdown_connections 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39ae478740 1 --2- 172.21.15.100:0/4122099037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b29d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39ae478740 1 --2- 172.21.15.100:0/4122099037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b1d080 0x561842b27400 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009cf0 tx=0x7f39a0011810 comp rx=0 tx=0).stop 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39ae478740 1 --2- 172.21.15.100:0/4122099037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b1cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.703+0000 7f39ae478740 1 -- 172.21.15.100:0/4122099037 >> 172.21.15.100:0/4122099037 conn(0x561842b18cf0 msgr2=0x561842b190d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.704+0000 7f39ae478740 1 -- 172.21.15.100:0/4122099037 shutdown_connections 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.704+0000 7f39ae478740 1 -- 172.21.15.100:0/4122099037 wait complete. 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.705+0000 7f39ae478740 1 -- start start 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.705+0000 7f39ae478740 1 Processor -- start 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.705+0000 7f39aa63c640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39900a2c00 0x7f39900a50c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f399c001190 tx=0x7f399c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39ae478740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b24a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39ae478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b27940 0x561842b24fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39ae478740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b254e0 0x561842b33a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39ae478740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561842b2a560 con 0x561842b254e0 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39ae478740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561842a0a6e0 con 0x561842b1c760 2024-09-12T02:45:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39ae478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561842b2a6e0 con 0x561842b27940 2024-09-12T02:45:35.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39ae478740 10 client.0 _ll_register_callbacks cb 0x561842a2ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:35.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39a9e3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b24a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39a963a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b27940 0x561842b24fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39a9e3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b24a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:47400/0 (socket says 172.21.15.100:47400) 2024-09-12T02:45:35.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.706+0000 7f39a9e3b640 1 -- 172.21.15.100:0/3614180489 learned_addr learned my addr 172.21.15.100:0/3614180489 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39aa63c640 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b254e0 0x561842b33a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39a9e3b640 1 -- 172.21.15.100:0/3614180489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b27940 msgr2=0x561842b24fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b27940 0x561842b24fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39a9e3b640 1 -- 172.21.15.100:0/3614180489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b254e0 msgr2=0x561842b33a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b254e0 0x561842b33a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39a9e3b640 1 -- 172.21.15.100:0/3614180489 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561842b34100 con 0x561842b1c760 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39aa63c640 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b254e0 0x561842b33a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b24a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009c40 tx=0x7f39a00056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1af56fab6509ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f398d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f398d7fa640 1 -- 172.21.15.100:0/3614180489 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0026070 con 0x561842b1c760 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f398d7fa640 1 -- 172.21.15.100:0/3614180489 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f39a0003800 con 0x561842b1c760 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.707+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39a00043c0 con 0x561842b1c760 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f398d7fa640 1 -- 172.21.15.100:0/3614180489 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f39a0032050 con 0x561842b1c760 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 10 client.25949 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561842b36a70 con 0x561842b1c760 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f398d7fa640 1 -- 172.21.15.100:0/3614180489 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39a00043c0 con 0x561842b1c760 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f398d7fa640 1 -- 172.21.15.100:0/3614180489 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f39a0019430 con 0x561842b1c760 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 10 client.25949 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 10 client.25949 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 20 client.25949 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842b37e80 0x561842b3a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 4 client.25949 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:35.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561842a8f9d0 con 0x561842b37e80 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.708+0000 7f39a963a640 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842b37e80 0x561842b3a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.709+0000 7f398d7fa640 10 client.25949 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.709+0000 7f39a963a640 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842b37e80 0x561842b3a270 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18f908b6a772c6e server_cookie=1c16b552bd5a4175 in_seq=0 out_seq=0 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.709+0000 7f398d7fa640 1 -- 172.21.15.100:0/3614180489 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561842a8f9d0 con 0x561842b37e80 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.709+0000 7f398d7fa640 10 client.25949 handle_command_reply: tid=0 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.709+0000 7f39ae478740 1 client.25949 shutdown 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 msgr2=0x561842b24a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b24a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009c40 tx=0x7f39a00056d0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 shutdown_connections 2024-09-12T02:45:35.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842b37e80 0x561842b3a270 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b254e0 0x561842b33a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b27940 0x561842b24fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 --2- 172.21.15.100:0/3614180489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b24a60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 >> 172.21.15.100:0/3614180489 conn(0x561842b18cf0 msgr2=0x561842b1ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:35.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f398d7fa640 0 client.25949 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:35.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 shutdown_connections 2024-09-12T02:45:35.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 1 -- 172.21.15.100:0/3614180489 wait complete. 2024-09-12T02:45:35.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.710+0000 7f39ae478740 20 client.25949 trim_cache size 0 max 16384 2024-09-12T02:45:35.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.739+0000 7f39ae478740 1 Processor -- start 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.739+0000 7f39ae478740 1 -- start start 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.739+0000 7f39ae478740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b33850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39ae478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b254e0 0x561842b3fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39ae478740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b3ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39ae478740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3988010d70 con 0x561842b27940 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39ae478740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f398800e640 con 0x561842b1c760 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39ae478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f398800c490 con 0x561842b254e0 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b254e0 0x561842b3fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39aa63c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b3ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b254e0 0x561842b3fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:40190/0 (socket says 172.21.15.100:40190) 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 -- 172.21.15.100:0/1229671672 learned_addr learned my addr 172.21.15.100:0/1229671672 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b33850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 -- 172.21.15.100:0/1229671672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 msgr2=0x561842b33850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b33850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 -- 172.21.15.100:0/1229671672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 msgr2=0x561842b3ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b3ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.740+0000 7f39a963a640 1 -- 172.21.15.100:0/1229671672 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561842b1ceb0 con 0x561842b254e0 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.741+0000 7f39a963a640 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b254e0 0x561842b3fa80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39940976a0 tx=0x7f3994086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9edc34fb1ac671b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.741+0000 7f398f7fe640 1 -- 172.21.15.100:0/1229671672 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399409b9c0 con 0x561842b254e0 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.741+0000 7f398f7fe640 1 -- 172.21.15.100:0/1229671672 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399409fd70 con 0x561842b254e0 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.741+0000 7f398f7fe640 1 -- 172.21.15.100:0/1229671672 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39940a41a0 con 0x561842b254e0 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 -- 172.21.15.100:0/1229671672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b254e0 msgr2=0x561842b3fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b254e0 0x561842b3fa80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39940976a0 tx=0x7f3994086040 comp rx=0 tx=0).stop 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 -- 172.21.15.100:0/1229671672 shutdown_connections 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b3ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b254e0 0x561842b3fa80 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39940976a0 tx=0x7f3994086040 comp rx=0 tx=0).stop 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 --2- 172.21.15.100:0/1229671672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b33850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 -- 172.21.15.100:0/1229671672 >> 172.21.15.100:0/1229671672 conn(0x561842b18cf0 msgr2=0x561842b1e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 -- 172.21.15.100:0/1229671672 shutdown_connections 2024-09-12T02:45:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 -- 172.21.15.100:0/1229671672 wait complete. 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.742+0000 7f39ae478740 1 -- start start 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 1 Processor -- start 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b2ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b2b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b2b6f0 0x561842b2bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f398800cb00 con 0x561842b27940 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f398800df70 con 0x561842b1c760 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f398800d1d0 con 0x561842b2b6f0 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39ae478740 10 client.0 _ll_register_callbacks cb 0x7f39a0005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39a963a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b2b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39a963a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b2b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36222/0 (socket says 172.21.15.100:36222) 2024-09-12T02:45:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39a963a640 1 -- 172.21.15.100:0/1248945119 learned_addr learned my addr 172.21.15.100:0/1248945119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.743+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b2ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.744+0000 7f39a9e3b640 1 -- 172.21.15.100:0/1248945119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b2b6f0 msgr2=0x561842b2bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.744+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b2b6f0 0x561842b2bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.744+0000 7f39a9e3b640 1 -- 172.21.15.100:0/1248945119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 msgr2=0x561842b2b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.744+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b2b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.744+0000 7f39a9e3b640 1 -- 172.21.15.100:0/1248945119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561842ba1a50 con 0x561842b1c760 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.744+0000 7f39a9e3b640 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b2ff20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f39a0019830 tx=0x7f39a0005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51ba85a8128c737 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.745+0000 7f398d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.745+0000 7f398d7fa640 1 -- 172.21.15.100:0/1248945119 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a003b060 con 0x561842b1c760 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.745+0000 7f398d7fa640 1 -- 172.21.15.100:0/1248945119 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f39a0004310 con 0x561842b1c760 2024-09-12T02:45:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.745+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f399409fd70 con 0x561842b1c760 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.746+0000 7f398d7fa640 1 -- 172.21.15.100:0/1248945119 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f39a0026040 con 0x561842b1c760 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.746+0000 7f39ae478740 10 client.25955 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.746+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561842ba2c10 con 0x561842b1c760 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.746+0000 7f398d7fa640 1 -- 172.21.15.100:0/1248945119 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399409fd70 con 0x561842b1c760 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.746+0000 7f398d7fa640 1 -- 172.21.15.100:0/1248945119 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f39a0005040 con 0x561842b1c760 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39ae478740 10 client.25955 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39ae478740 10 client.25955 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39ae478740 20 client.25955 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39ae478740 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842ba32f0 0x561842ba5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39ae478740 4 client.25955 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x561842a89d20 con 0x561842ba32f0 2024-09-12T02:45:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39a963a640 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842ba32f0 0x561842ba5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f398d7fa640 10 client.25955 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:35.747+0000 7f39a963a640 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842ba32f0 0x561842ba5740 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25ed3aa8db97d868 server_cookie=94fda426dc53cca5 in_seq=0 out_seq=0 2024-09-12T02:45:35.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:35 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:45:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f398d7fa640 1 -- 172.21.15.100:0/1248945119 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561842a89d20 con 0x561842ba32f0 2024-09-12T02:45:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f398d7fa640 10 client.25955 handle_command_reply: tid=0 2024-09-12T02:45:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 client.25955 shutdown 2024-09-12T02:45:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 msgr2=0x561842b2ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b2ff20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f39a0019830 tx=0x7f39a0005b90 comp rx=0 tx=0).stop 2024-09-12T02:45:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 shutdown_connections 2024-09-12T02:45:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561842ba32f0 0x561842ba5740 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561842b2b6f0 0x561842b2bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561842b27940 0x561842b2b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 --2- 172.21.15.100:0/1248945119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561842b1c760 0x561842b2ff20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f398d7fa640 0 client.25955 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 >> 172.21.15.100:0/1248945119 conn(0x561842b18cf0 msgr2=0x561842b23200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 shutdown_connections 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 1 -- 172.21.15.100:0/1248945119 wait complete. 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.063+0000 7f39ae478740 20 client.25955 trim_cache size 0 max 16384 2024-09-12T02:45:36.065 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 26, 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "6ceeee61": { 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 26, 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:45:36.066 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 136.6, 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:45:36.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39900a2c00 msgr2=0x7f39900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39900a2c00 0x7f39900a50c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f399c001190 tx=0x7f399c004a40 comp rx=0 tx=0).stop 2024-09-12T02:45:36.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 msgr2=0x7f39a41a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 0x7f39a41a4940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f399400e9f0 tx=0x7f399400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 shutdown_connections 2024-09-12T02:45:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f39900a2c00 0x7f39900a50c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39a410c180 0x7f39a410a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39a4103670 0x7f39a41a4940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 --2- 172.21.15.100:0/2956092597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39a4102d50 0x7f39a41a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 >> 172.21.15.100:0/2956092597 conn(0x7f39a40fc7d0 msgr2=0x7f39a410dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 shutdown_connections 2024-09-12T02:45:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:36.064+0000 7f39ac09f640 1 -- 172.21.15.100:0/2956092597 wait complete. 2024-09-12T02:45:36.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:35 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:45:36.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:35 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:45:36.299 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 385.0 s, 2507.5 tps, lat 35.715 ms stddev 37.287 2024-09-12T02:45:36.726 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6ceeee61', quiesce took 4.0 seconds. Will release after: 12.600000000000001 2024-09-12T02:45:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:36 smithi117 ceph-mon[34898]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.8 MiB/s wr, 759 op/s 2024-09-12T02:45:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:36 smithi100 ceph-mon[31390]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.8 MiB/s wr, 759 op/s 2024-09-12T02:45:37.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:36 smithi189 ceph-mon[35196]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.8 MiB/s wr, 759 op/s 2024-09-12T02:45:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:38 smithi117 ceph-mon[34898]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.0 MiB/s wr, 708 op/s 2024-09-12T02:45:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:38 smithi100 ceph-mon[31390]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.0 MiB/s wr, 708 op/s 2024-09-12T02:45:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:38 smithi189 ceph-mon[35196]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.0 MiB/s wr, 708 op/s 2024-09-12T02:45:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:40 smithi117 ceph-mon[34898]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.8 MiB/s wr, 633 op/s 2024-09-12T02:45:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:40 smithi100 ceph-mon[31390]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.8 MiB/s wr, 633 op/s 2024-09-12T02:45:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:40 smithi189 ceph-mon[35196]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.8 MiB/s wr, 633 op/s 2024-09-12T02:45:41.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:45:42.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:41 smithi100 ceph-mon[31390]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 488 op/s 2024-09-12T02:45:42.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:41 smithi189 ceph-mon[35196]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 488 op/s 2024-09-12T02:45:42.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:41 smithi117 ceph-mon[34898]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 488 op/s 2024-09-12T02:45:45.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:44 smithi189 ceph-mon[35196]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 398 op/s 2024-09-12T02:45:45.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:44 smithi117 ceph-mon[34898]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 398 op/s 2024-09-12T02:45:45.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:44 smithi100 ceph-mon[31390]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 398 op/s 2024-09-12T02:45:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:45:47.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:46 smithi189 ceph-mon[35196]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.6 MiB/s wr, 360 op/s 2024-09-12T02:45:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:46 smithi117 ceph-mon[34898]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.6 MiB/s wr, 360 op/s 2024-09-12T02:45:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:46 smithi100 ceph-mon[31390]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.6 MiB/s wr, 360 op/s 2024-09-12T02:45:49.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:48 smithi189 ceph-mon[35196]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 236 op/s 2024-09-12T02:45:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:48 smithi117 ceph-mon[34898]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 236 op/s 2024-09-12T02:45:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:48 smithi100 ceph-mon[31390]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 236 op/s 2024-09-12T02:45:49.328 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:49.588 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 -- 172.21.15.100:0/770914884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8102570 msgr2=0x7f7fa81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 --2- 172.21.15.100:0/770914884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8102570 0x7f7fa81029b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009900 tx=0x7f7f9002a480 comp rx=0 tx=0).stop 2024-09-12T02:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 -- 172.21.15.100:0/770914884 shutdown_connections 2024-09-12T02:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 --2- 172.21.15.100:0/770914884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa8102ef0 0x7f7fa810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 --2- 172.21.15.100:0/770914884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8102570 0x7f7fa81029b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 --2- 172.21.15.100:0/770914884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa8100e20 0x7f7fa8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 -- 172.21.15.100:0/770914884 >> 172.21.15.100:0/770914884 conn(0x7f7fa80fc7d0 msgr2=0x7f7fa80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 -- 172.21.15.100:0/770914884 shutdown_connections 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.108+0000 7f7face4b640 1 -- 172.21.15.100:0/770914884 wait complete. 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 Processor -- start 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 -- start start 2024-09-12T02:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8100e20 0x7f7fa8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:50.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa8102570 0x7f7fa8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:50.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa8102ef0 0x7f7fa81a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:50.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8110f80 con 0x7f7fa8100e20 2024-09-12T02:45:50.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8110e00 con 0x7f7fa8102ef0 2024-09-12T02:45:50.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7face4b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8111100 con 0x7f7fa8102570 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8100e20 0x7f7fa8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8100e20 0x7f7fa8199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45880/0 (socket says 172.21.15.100:45880) 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 -- 172.21.15.100:0/2143420884 learned_addr learned my addr 172.21.15.100:0/2143420884 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7f9ffff640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa8102570 0x7f7fa8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa6d9d640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa8102ef0 0x7f7fa81a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 -- 172.21.15.100:0/2143420884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa8102570 msgr2=0x7f7fa8199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa8102570 0x7f7fa8199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 -- 172.21.15.100:0/2143420884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa8102ef0 msgr2=0x7f7fa81a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa8102ef0 0x7f7fa81a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa659c640 1 -- 172.21.15.100:0/2143420884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa81a48d0 con 0x7f7fa8100e20 2024-09-12T02:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.109+0000 7f7fa6d9d640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa8102ef0 0x7f7fa81a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.110+0000 7f7fa659c640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8100e20 0x7f7fa8199310 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c970 tx=0x7f7f9800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.110+0000 7f7f9f7fe640 1 -- 172.21.15.100:0/2143420884 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98007bb0 con 0x7f7fa8100e20 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.110+0000 7f7f9f7fe640 1 -- 172.21.15.100:0/2143420884 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f98007d50 con 0x7f7fa8100e20 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.110+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa81a4aa0 con 0x7f7fa8100e20 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.110+0000 7f7f9f7fe640 1 -- 172.21.15.100:0/2143420884 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800f450 con 0x7f7fa8100e20 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.110+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa81a4f90 con 0x7f7fa8100e20 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.111+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa8101200 con 0x7f7fa8100e20 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.112+0000 7f7f9f7fe640 1 -- 172.21.15.100:0/2143420884 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7f98005020 con 0x7f7fa8100e20 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.113+0000 7f7f9f7fe640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f940a2b80 0x7f7f940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.113+0000 7f7f9ffff640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f940a2b80 0x7f7f940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.113+0000 7f7f9f7fe640 1 -- 172.21.15.100:0/2143420884 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7f980ceef0 con 0x7f7fa8100e20 2024-09-12T02:45:50.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.113+0000 7f7f9ffff640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f940a2b80 0x7f7f940a5040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806ab00 tx=0x7f7f90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:50.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.117+0000 7f7f9f7fe640 1 -- 172.21.15.100:0/2143420884 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f98014030 con 0x7f7fa8100e20 2024-09-12T02:45:50.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.329+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fa8109090 con 0x7f7fa8100e20 2024-09-12T02:45:50.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.330+0000 7f7f9f7fe640 1 -- 172.21.15.100:0/2143420884 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f7f9809be40 con 0x7f7fa8100e20 2024-09-12T02:45:50.332 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:45:50.332 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:45:50.332 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:45:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f940a2b80 msgr2=0x7f7f940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f940a2b80 0x7f7f940a5040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806ab00 tx=0x7f7f90005a20 comp rx=0 tx=0).stop 2024-09-12T02:45:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8100e20 msgr2=0x7f7fa8199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8100e20 0x7f7fa8199310 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c970 tx=0x7f7f9800ce30 comp rx=0 tx=0).stop 2024-09-12T02:45:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 shutdown_connections 2024-09-12T02:45:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7f940a2b80 0x7f7f940a5040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa8102ef0 0x7f7fa81a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa8102570 0x7f7fa8199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 --2- 172.21.15.100:0/2143420884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8100e20 0x7f7fa8199310 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 >> 172.21.15.100:0/2143420884 conn(0x7f7fa80fc7d0 msgr2=0x7f7fa80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:50.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 shutdown_connections 2024-09-12T02:45:50.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:50.332+0000 7f7face4b640 1 -- 172.21.15.100:0/2143420884 wait complete. 2024-09-12T02:45:51.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:50 smithi189 ceph-mon[35196]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 413 op/s 2024-09-12T02:45:51.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:50 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2143420884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:51.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:50 smithi100 ceph-mon[31390]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 413 op/s 2024-09-12T02:45:51.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:50 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2143420884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:50 smithi117 ceph-mon[34898]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 413 op/s 2024-09-12T02:45:51.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:50 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2143420884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:51.096 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 6ceeee61 --release --await' 2024-09-12T02:45:51.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 6ceeee61 --release --await 2024-09-12T02:45:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 400.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:45:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 -- 172.21.15.100:0/1832245156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 msgr2=0x7f9eec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 --2- 172.21.15.100:0/1832245156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec100ee0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009cd0 tx=0x7f9ee002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 -- 172.21.15.100:0/1832245156 shutdown_connections 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 --2- 172.21.15.100:0/1832245156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eec101420 0x7f9eec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 --2- 172.21.15.100:0/1832245156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec100ee0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 --2- 172.21.15.100:0/1832245156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eec106a80 0x7f9eec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 -- 172.21.15.100:0/1832245156 >> 172.21.15.100:0/1832245156 conn(0x7f9eec0fc7a0 msgr2=0x7f9eec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 -- 172.21.15.100:0/1832245156 shutdown_connections 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.848+0000 7f9ef449d640 1 -- 172.21.15.100:0/1832245156 wait complete. 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 Processor -- start 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 -- start start 2024-09-12T02:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eec101420 0x7f9eec199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eec106a80 0x7f9eec1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec110ea0 con 0x7f9eec100a80 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec110d20 con 0x7f9eec101420 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef449d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec111020 con 0x7f9eec106a80 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef2239640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef2239640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45896/0 (socket says 172.21.15.100:45896) 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef2239640 1 -- 172.21.15.100:0/914070655 learned_addr learned my addr 172.21.15.100:0/914070655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.849+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eec101420 0x7f9eec199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eec106a80 0x7f9eec1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef2239640 1 -- 172.21.15.100:0/914070655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eec106a80 msgr2=0x7f9eec1a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef2239640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eec106a80 0x7f9eec1a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef2239640 1 -- 172.21.15.100:0/914070655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eec101420 msgr2=0x7f9eec199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef2239640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eec101420 0x7f9eec199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef2239640 1 -- 172.21.15.100:0/914070655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec1a4890 con 0x7f9eec100a80 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef2239640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec1992d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00d950 tx=0x7f9edc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9eeb7fe640 1 -- 172.21.15.100:0/914070655 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc017070 con 0x7f9eec100a80 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec1a4a60 con 0x7f9eec100a80 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9eeb7fe640 1 -- 172.21.15.100:0/914070655 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9edc009c30 con 0x7f9eec100a80 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9eeb7fe640 1 -- 172.21.15.100:0/914070655 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00f6b0 con 0x7f9eec100a80 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.850+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec1a4f70 con 0x7f9eec100a80 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 Processor -- start 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 -- start start 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1be320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f6a123620 con 0x564f6a1be860 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564f6a0cae50 con 0x564f6a1cd650 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef6876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564f6a11f5e0 con 0x564f6a1bdf40 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9eeb7fe640 1 -- 172.21.15.100:0/914070655 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9edc0109d0 con 0x7f9eec100a80 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef2a3a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1be320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef1a38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef1a38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:33674/0 (socket says 172.21.15.100:33674) 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.853+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1004879421 learned_addr learned my addr 172.21.15.100:0/1004879421 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef2239640 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1004879421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 msgr2=0x564f6a1be320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1be320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1004879421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 msgr2=0x564f6a1cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1004879421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6a0bbd40 con 0x564f6a1cd650 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1be320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef2239640 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1cfa40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009cd0 tx=0x7f9ee00314e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b404f9d098c7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9eeb7fe640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9ed40a2b80 0x7f9ed40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9ed40a2b80 0x7f9ed40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9eeb7fe640 1 -- 172.21.15.100:0/914070655 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9edc0cecc0 con 0x7f9eec100a80 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ee8ff9640 1 -- 172.21.15.100:0/1004879421 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0048070 con 0x564f6a1cd650 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ee8ff9640 1 -- 172.21.15.100:0/1004879421 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee0036070 con 0x564f6a1cd650 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.854+0000 7f9ee8ff9640 1 -- 172.21.15.100:0/1004879421 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0004630 con 0x564f6a1cd650 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 -- 172.21.15.100:0/1004879421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 msgr2=0x564f6a1cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9ed40a2b80 0x7f9ed40a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006fd0 tx=0x7f9ee4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:51.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1cfa40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009cd0 tx=0x7f9ee00314e0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 -- 172.21.15.100:0/1004879421 shutdown_connections 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1cfa40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1004879421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1be320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 -- 172.21.15.100:0/1004879421 >> 172.21.15.100:0/1004879421 conn(0x564f6a1ba5f0 msgr2=0x564f6a1ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 -- 172.21.15.100:0/1004879421 shutdown_connections 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.855+0000 7f9ef6876740 1 -- 172.21.15.100:0/1004879421 wait complete. 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 -- start start 2024-09-12T02:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 Processor -- start 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f6a1d0220 con 0x564f6a1be860 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564f6a0abf10 con 0x564f6a1cd650 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564f6a1d03a0 con 0x564f6a1bdf40 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef6876740 10 client.0 _ll_register_callbacks cb 0x564f6a0cfdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45910/0 (socket says 172.21.15.100:45910) 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1823201283 learned_addr learned my addr 172.21.15.100:0/1823201283 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef2239640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1823201283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 msgr2=0x564f6a1ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 msgr2=0x564f6a1caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef1a38640 1 -- 172.21.15.100:0/1823201283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f69e32580 con 0x564f6a1be860 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.856+0000 7f9ef2239640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1caab0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0046040 tx=0x7f9ee0004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6139c496aa4d82fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ed1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/1823201283 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0052020 con 0x564f6a1be860 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/1823201283 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9ee0003970 con 0x564f6a1be860 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee0036070 con 0x564f6a1be860 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/1823201283 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9ee005d050 con 0x564f6a1be860 2024-09-12T02:45:51.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 10 client.16584 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f69efc960 con 0x564f6a1be860 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/1823201283 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee0036070 con 0x564f6a1be860 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/1823201283 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9ee004b030 con 0x564f6a1be860 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 10 client.16584 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 10 client.16584 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 20 client.16584 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a1dd060 0x564f6a1df450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 4 client.16584 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.857+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f6a130b90 con 0x564f6a1dd060 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.858+0000 7f9ef2239640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a1dd060 0x564f6a1df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.858+0000 7f9ed1ffb640 10 client.16584 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.858+0000 7f9ef2239640 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a1dd060 0x564f6a1df450 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e78740b924cbf1 server_cookie=f0423cf1d8593c89 in_seq=0 out_seq=0 2024-09-12T02:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/1823201283 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f6a130b90 con 0x564f6a1dd060 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ed1ffb640 10 client.16584 handle_command_reply: tid=0 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 client.16584 shutdown 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 msgr2=0x564f6a1caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1caab0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0046040 tx=0x7f9ee0004660 comp rx=0 tx=0).stop 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 shutdown_connections 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a1dd060 0x564f6a1df450 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1caab0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ed1ffb640 0 client.16584 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1823201283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 >> 172.21.15.100:0/1823201283 conn(0x564f6a1ba5f0 msgr2=0x564f6a1c0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 shutdown_connections 2024-09-12T02:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 1 -- 172.21.15.100:0/1823201283 wait complete. 2024-09-12T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.859+0000 7f9ef6876740 20 client.16584 trim_cache size 0 max 16384 2024-09-12T02:45:51.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 Processor -- start 2024-09-12T02:45:51.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 -- start start 2024-09-12T02:45:51.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1be860 0x564f6a1c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1cd650 0x564f6a1c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1adc50 con 0x564f6a1cd650 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1ab520 con 0x564f6a1be860 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef6876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1a9370 con 0x564f6a1bdf40 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1cd650 0x564f6a1c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1cd650 0x564f6a1c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45918/0 (socket says 172.21.15.100:45918) 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 -- 172.21.15.100:0/1145753666 learned_addr learned my addr 172.21.15.100:0/1145753666 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1be860 0x564f6a1c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2239640 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 -- 172.21.15.100:0/1145753666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 msgr2=0x564f6a1cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 -- 172.21.15.100:0/1145753666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1be860 msgr2=0x564f6a1c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1be860 0x564f6a1c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 -- 172.21.15.100:0/1145753666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6a1be690 con 0x564f6a1cd650 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.881+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1cd650 0x564f6a1c7d30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006ae0 tx=0x7f9ee4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b645fd5080de32ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ed3fff640 1 -- 172.21.15.100:0/1145753666 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4019030 con 0x564f6a1cd650 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ed3fff640 1 -- 172.21.15.100:0/1145753666 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee4024070 con 0x564f6a1cd650 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ed3fff640 1 -- 172.21.15.100:0/1145753666 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40133f0 con 0x564f6a1cd650 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 -- 172.21.15.100:0/1145753666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1cd650 msgr2=0x564f6a1c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1cd650 0x564f6a1c7d30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006ae0 tx=0x7f9ee4010000 comp rx=0 tx=0).stop 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 -- 172.21.15.100:0/1145753666 shutdown_connections 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1cd650 0x564f6a1c7d30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1be860 0x564f6a1c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 --2- 172.21.15.100:0/1145753666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 -- 172.21.15.100:0/1145753666 >> 172.21.15.100:0/1145753666 conn(0x564f6a1ba5f0 msgr2=0x564f6a1cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.882+0000 7f9ef6876740 1 -- 172.21.15.100:0/1145753666 shutdown_connections 2024-09-12T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 -- 172.21.15.100:0/1145753666 wait complete. 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 -- start start 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 Processor -- start 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1e2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1e0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1a99e0 con 0x564f6a1be860 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1aae50 con 0x564f6a1cd650 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1aa0b0 con 0x564f6a1bdf40 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef6876740 10 client.0 _ll_register_callbacks cb 0x7f9ee0031c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef1a38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1e0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef1a38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1e0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45920/0 (socket says 172.21.15.100:45920) 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef1a38640 1 -- 172.21.15.100:0/2477385652 learned_addr learned my addr 172.21.15.100:0/2477385652 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.883+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef2239640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef1a38640 1 -- 172.21.15.100:0/2477385652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 msgr2=0x564f6a1e2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1e2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef1a38640 1 -- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 msgr2=0x564f6a1e11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1e11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef1a38640 1 -- 172.21.15.100:0/2477385652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6a1e17b0 con 0x564f6a1be860 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef2a3a640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1e11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef2239640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef1a38640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1e0cb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0030790 tx=0x7f9ee0031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936bb9683d067478 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ed1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/2477385652 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0052070 con 0x564f6a1be860 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/2477385652 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9ee00046d0 con 0x564f6a1be860 2024-09-12T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee4024070 con 0x564f6a1be860 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/2477385652 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9ee0048040 con 0x564f6a1be860 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef6876740 10 client.16590 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f6a2487c0 con 0x564f6a1be860 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/2477385652 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee4024070 con 0x564f6a1be860 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/2477385652 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9ee004b070 con 0x564f6a1be860 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef6876740 10 client.16590 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef6876740 10 client.16590 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.884+0000 7f9ef6876740 20 client.16590 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.885+0000 7f9ef6876740 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a248f30 0x564f6a24b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.885+0000 7f9ef6876740 4 client.16590 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6ceeee61", "release": true, "await": true}] 2024-09-12T02:45:51.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.885+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6ceeee61", "release": true, "await": true}) -- 0x564f6a12b0a0 con 0x564f6a248f30 2024-09-12T02:45:51.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.885+0000 7f9ef2239640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a248f30 0x564f6a24b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:51.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.885+0000 7f9ed1ffb640 10 client.16590 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:51.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.885+0000 7f9ef2239640 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a248f30 0x564f6a24b350 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c8fb31d8a5aa1a server_cookie=8497e45d0dc5ed6f in_seq=0 out_seq=0 2024-09-12T02:45:51.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/2477385652 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564f6a12b0a0 con 0x564f6a248f30 2024-09-12T02:45:51.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ed1ffb640 10 client.16590 handle_command_reply: tid=0 2024-09-12T02:45:51.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 client.16590 shutdown 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 msgr2=0x564f6a1e0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1e0cb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0030790 tx=0x7f9ee0031000 comp rx=0 tx=0).stop 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 shutdown_connections 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564f6a248f30 0x564f6a24b350 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f6a1cd650 0x564f6a1e11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f6a1be860 0x564f6a1e0cb0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 --2- 172.21.15.100:0/2477385652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f6a1bdf40 0x564f6a1e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.933+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 >> 172.21.15.100:0/2477385652 conn(0x564f6a1ba5f0 msgr2=0x564f6a1cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.934+0000 7f9ed1ffb640 0 client.16590 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.934+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 shutdown_connections 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.934+0000 7f9ef6876740 1 -- 172.21.15.100:0/2477385652 wait complete. 2024-09-12T02:45:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.934+0000 7f9ef6876740 20 client.16590 trim_cache size 0 max 16384 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 28, 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "6ceeee61": { 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 28, 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:45:51.937 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 136.6, 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:45:51.938 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:45:51.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:51.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:51.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:51.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:51.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:45:51.939 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:45:51.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.935+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9ed40a2b80 msgr2=0x7f9ed40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.935+0000 7f9ef449d640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9ed40a2b80 0x7f9ed40a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006fd0 tx=0x7f9ee4008040 comp rx=0 tx=0).stop 2024-09-12T02:45:51.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.935+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 msgr2=0x7f9eec1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:51.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.935+0000 7f9ef449d640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec1992d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00d950 tx=0x7f9edc00de10 comp rx=0 tx=0).stop 2024-09-12T02:45:51.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.944+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 shutdown_connections 2024-09-12T02:45:51.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.944+0000 7f9ef449d640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9ed40a2b80 0x7f9ed40a5040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.944+0000 7f9ef449d640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eec106a80 0x7f9eec1a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.944+0000 7f9ef449d640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9eec101420 0x7f9eec199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.944+0000 7f9ef449d640 1 --2- 172.21.15.100:0/914070655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9eec100a80 0x7f9eec1992d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:51.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.944+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 >> 172.21.15.100:0/914070655 conn(0x7f9eec0fc7a0 msgr2=0x7f9eec0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:51.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.946+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 shutdown_connections 2024-09-12T02:45:51.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:51.946+0000 7f9ef449d640 1 -- 172.21.15.100:0/914070655 wait complete. 2024-09-12T02:45:52.778 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6ceeee61', total seconds elapsed: 20.0 2024-09-12T02:45:53.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:52 smithi189 ceph-mon[35196]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 470 op/s 2024-09-12T02:45:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:52 smithi117 ceph-mon[34898]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 470 op/s 2024-09-12T02:45:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:52 smithi100 ceph-mon[31390]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 470 op/s 2024-09-12T02:45:55.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:54 smithi189 ceph-mon[35196]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 495 op/s 2024-09-12T02:45:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:54 smithi117 ceph-mon[34898]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 495 op/s 2024-09-12T02:45:55.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:54 smithi100 ceph-mon[31390]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 495 op/s 2024-09-12T02:45:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 405.0 s, 2751.0 tps, lat 149.470 ms stddev 1378.991 2024-09-12T02:45:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:56 smithi189 ceph-mon[35196]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 15 MiB/s wr, 550 op/s 2024-09-12T02:45:57.097 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:56 smithi117 ceph-mon[34898]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 15 MiB/s wr, 550 op/s 2024-09-12T02:45:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:56 smithi100 ceph-mon[31390]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 15 MiB/s wr, 550 op/s 2024-09-12T02:45:58.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:45:58.805 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:59.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:45:58 smithi189 ceph-mon[35196]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 616 op/s 2024-09-12T02:45:59.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:45:58 smithi100 ceph-mon[31390]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 616 op/s 2024-09-12T02:45:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:45:58 smithi117 ceph-mon[34898]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 616 op/s 2024-09-12T02:45:59.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.344+0000 7f27a31a3640 1 -- 172.21.15.100:0/2317879258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 msgr2=0x7f279c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.344+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2317879258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 0x7f279c1021c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f278c009900 tx=0x7f278c02e820 comp rx=0 tx=0).stop 2024-09-12T02:45:59.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.344+0000 7f27a31a3640 1 -- 172.21.15.100:0/2317879258 shutdown_connections 2024-09-12T02:45:59.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.344+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2317879258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279c106f10 0x7f279c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.344+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2317879258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 0x7f279c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.344+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2317879258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 0x7f279c1021c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.344+0000 7f27a31a3640 1 -- 172.21.15.100:0/2317879258 >> 172.21.15.100:0/2317879258 conn(0x7f279c0fd8e0 msgr2=0x7f279c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.347+0000 7f27a31a3640 1 -- 172.21.15.100:0/2317879258 shutdown_connections 2024-09-12T02:45:59.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.348+0000 7f27a31a3640 1 -- 172.21.15.100:0/2317879258 wait complete. 2024-09-12T02:45:59.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 Processor -- start 2024-09-12T02:45:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 -- start start 2024-09-12T02:45:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 0x7f279c196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 0x7f279c1968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279c106f10 0x7f279c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f279c10fe70 con 0x7f279c101de0 2024-09-12T02:45:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f279c10fcf0 con 0x7f279c102790 2024-09-12T02:45:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.349+0000 7f27a31a3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f279c10fff0 con 0x7f279c106f10 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 0x7f279c1968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 0x7f279c1968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:33984/0 (socket says 172.21.15.100:33984) 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 -- 172.21.15.100:0/2756206321 learned_addr learned my addr 172.21.15.100:0/2756206321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f27a1740640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279c106f10 0x7f279c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 -- 172.21.15.100:0/2756206321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279c106f10 msgr2=0x7f279c19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279c106f10 0x7f279c19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 -- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 msgr2=0x7f279c196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 0x7f279c196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 0x7f279c196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 -- 172.21.15.100:0/2756206321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c19b340 con 0x7f279c102790 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 0x7f279c196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f279bfff640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 0x7f279c1968d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f279000b450 tx=0x7f279000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.350+0000 7f2799ffb640 1 -- 172.21.15.100:0/2756206321 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790015020 con 0x7f279c102790 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.351+0000 7f2799ffb640 1 -- 172.21.15.100:0/2756206321 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2790011d70 con 0x7f279c102790 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.351+0000 7f2799ffb640 1 -- 172.21.15.100:0/2756206321 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279000f340 con 0x7f279c102790 2024-09-12T02:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.351+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c19b630 con 0x7f279c102790 2024-09-12T02:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.351+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c1a2f10 con 0x7f279c102790 2024-09-12T02:45:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.355+0000 7f2799ffb640 1 -- 172.21.15.100:0/2756206321 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2790018020 con 0x7f279c102790 2024-09-12T02:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.356+0000 7f2799ffb640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27840a2c40 0x7f27840a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.356+0000 7f2799ffb640 1 -- 172.21.15.100:0/2756206321 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2790099380 con 0x7f279c102790 2024-09-12T02:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.357+0000 7f27a557c740 1 Processor -- start 2024-09-12T02:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.357+0000 7f27a557c740 1 -- start start 2024-09-12T02:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.357+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27840a2c40 0x7f27840a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a557c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5eff880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a557c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f0a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27840a2c40 0x7f27840a5100 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f278c0096c0 tx=0x7f278c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a557c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f0ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a0f3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5eff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a0f3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5eff880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44678/0 (socket says 172.21.15.100:44678) 2024-09-12T02:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a0f3f640 1 -- 172.21.15.100:0/1703784656 learned_addr learned my addr 172.21.15.100:0/1703784656 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f279bfff640 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f0a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562aa5e652e0 con 0x562aa5eff4a0 2024-09-12T02:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562aa5e0cce0 con 0x562aa5f0a680 2024-09-12T02:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562aa5e612a0 con 0x562aa5effdc0 2024-09-12T02:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f27a1740640 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f0ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f279bfff640 1 -- 172.21.15.100:0/1703784656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 msgr2=0x562aa5f0ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f279bfff640 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f0ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f279bfff640 1 -- 172.21.15.100:0/1703784656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 msgr2=0x562aa5eff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f279bfff640 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5eff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.358+0000 7f279bfff640 1 -- 172.21.15.100:0/1703784656 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa5df1440 con 0x562aa5effdc0 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.359+0000 7f279bfff640 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f0a140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2790097740 tx=0x7f279009ac40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9712612093061b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.359+0000 7f2782ffd640 1 -- 172.21.15.100:0/1703784656 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279009f690 con 0x562aa5effdc0 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.360+0000 7f2782ffd640 1 -- 172.21.15.100:0/1703784656 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27900a3f50 con 0x562aa5effdc0 2024-09-12T02:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.360+0000 7f2782ffd640 1 -- 172.21.15.100:0/1703784656 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900bb0b0 con 0x562aa5effdc0 2024-09-12T02:45:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 msgr2=0x562aa5f0a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f0a140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2790097740 tx=0x7f279009ac40 comp rx=0 tx=0).stop 2024-09-12T02:45:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 shutdown_connections 2024-09-12T02:45:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f0ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f0a140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 --2- 172.21.15.100:0/1703784656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5eff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 >> 172.21.15.100:0/1703784656 conn(0x562aa5efba30 msgr2=0x562aa5efbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 shutdown_connections 2024-09-12T02:45:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 -- 172.21.15.100:0/1703784656 wait complete. 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.361+0000 7f27a557c740 1 -- start start 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 1 Processor -- start 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f0a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f07330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f07920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562aa5f0d250 con 0x562aa5eff4a0 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a0f3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f0a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a0f3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f0a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44688/0 (socket says 172.21.15.100:44688) 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a0f3f640 1 -- 172.21.15.100:0/2988826155 learned_addr learned my addr 172.21.15.100:0/2988826155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a1740640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f07920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562aa5e20050 con 0x562aa5f0a680 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f279bfff640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f07330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562aa5f0d3d0 con 0x562aa5effdc0 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.362+0000 7f27a557c740 10 client.0 _ll_register_callbacks cb 0x562aa5e60160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f279bfff640 1 -- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 msgr2=0x562aa5f07920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f279bfff640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f07920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f279bfff640 1 -- 172.21.15.100:0/2988826155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 msgr2=0x562aa5f0a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f279bfff640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f0a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f279bfff640 1 -- 172.21.15.100:0/2988826155 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa5bd63c0 con 0x562aa5effdc0 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f27a1740640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f07920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f279bfff640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f07330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2790009fd0 tx=0x7f279009aae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4500a871c86412af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f277bfff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:45:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f277bfff640 1 -- 172.21.15.100:0/2988826155 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900b8020 con 0x562aa5effdc0 2024-09-12T02:45:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f277bfff640 1 -- 172.21.15.100:0/2988826155 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f27900995e0 con 0x562aa5effdc0 2024-09-12T02:45:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27900a3f50 con 0x562aa5effdc0 2024-09-12T02:45:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f277bfff640 1 -- 172.21.15.100:0/2988826155 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2790097af0 con 0x562aa5effdc0 2024-09-12T02:45:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f27a557c740 10 client.25951 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.363+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562aa5f0d250 con 0x562aa5effdc0 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f277bfff640 1 -- 172.21.15.100:0/2988826155 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27900a3f50 con 0x562aa5effdc0 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f277bfff640 1 -- 172.21.15.100:0/2988826155 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f27900bb0b0 con 0x562aa5effdc0 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f27a557c740 10 client.25951 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f27a557c740 10 client.25951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f27a557c740 20 client.25951 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f27a557c740 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f19dd0 0x562aa5f1c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f27a557c740 4 client.25951 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.365+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aa5e72850 con 0x562aa5f19dd0 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.366+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f19dd0 0x562aa5f1c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.366+0000 7f277bfff640 10 client.25951 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.366+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f19dd0 0x562aa5f1c1c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec024ae1650fbac server_cookie=c87fa60bc6e13ff9 in_seq=0 out_seq=0 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f277bfff640 1 -- 172.21.15.100:0/2988826155 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562aa5e72850 con 0x562aa5f19dd0 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f277bfff640 10 client.25951 handle_command_reply: tid=0 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 client.25951 shutdown 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 msgr2=0x562aa5f07330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f07330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2790009fd0 tx=0x7f279009aae0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 shutdown_connections 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f19dd0 0x562aa5f1c1c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f07920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f07330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 --2- 172.21.15.100:0/2988826155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f0a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 >> 172.21.15.100:0/2988826155 conn(0x562aa5efba30 msgr2=0x562aa5efab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f277bfff640 0 client.25951 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 shutdown_connections 2024-09-12T02:45:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 1 -- 172.21.15.100:0/2988826155 wait complete. 2024-09-12T02:45:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.367+0000 7f27a557c740 20 client.25951 trim_cache size 0 max 16384 2024-09-12T02:45:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 Processor -- start 2024-09-12T02:45:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 -- start start 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5eff4a0 0x562aa5f1ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5effdc0 0x562aa5f1f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5f0a680 0x562aa5f04590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ade00 con 0x562aa5effdc0 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ab6d0 con 0x562aa5eff4a0 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a557c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1a9520 con 0x562aa5f0a680 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5effdc0 0x562aa5f1f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5effdc0 0x562aa5f1f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44690/0 (socket says 172.21.15.100:44690) 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 -- 172.21.15.100:0/3793429909 learned_addr learned my addr 172.21.15.100:0/3793429909 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5eff4a0 0x562aa5f1ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a1740640 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5f0a680 0x562aa5f04590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 -- 172.21.15.100:0/3793429909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5f0a680 msgr2=0x562aa5f04590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5f0a680 0x562aa5f04590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 -- 172.21.15.100:0/3793429909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5eff4a0 msgr2=0x562aa5f1ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5eff4a0 0x562aa5f1ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f279bfff640 1 -- 172.21.15.100:0/3793429909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa5f07c90 con 0x562aa5effdc0 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.389+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5eff4a0 0x562aa5f1ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.390+0000 7f279bfff640 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5effdc0 0x562aa5f1f350 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f279009b270 tx=0x7f27900107f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc6cc0b41e24290 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.390+0000 7f27827fc640 1 -- 172.21.15.100:0/3793429909 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900b8030 con 0x562aa5effdc0 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.390+0000 7f27827fc640 1 -- 172.21.15.100:0/3793429909 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2790095e50 con 0x562aa5effdc0 2024-09-12T02:45:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.390+0000 7f27827fc640 1 -- 172.21.15.100:0/3793429909 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790097150 con 0x562aa5effdc0 2024-09-12T02:45:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.391+0000 7f27a557c740 1 -- 172.21.15.100:0/3793429909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5effdc0 msgr2=0x562aa5f1f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.391+0000 7f27a557c740 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5effdc0 0x562aa5f1f350 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f279009b270 tx=0x7f27900107f0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.391+0000 7f27a557c740 1 -- 172.21.15.100:0/3793429909 shutdown_connections 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.391+0000 7f27a557c740 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5f0a680 0x562aa5f04590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.391+0000 7f27a557c740 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5effdc0 0x562aa5f1f350 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.391+0000 7f27a557c740 1 --2- 172.21.15.100:0/3793429909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5eff4a0 0x562aa5f1ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.391+0000 7f27a557c740 1 -- 172.21.15.100:0/3793429909 >> 172.21.15.100:0/3793429909 conn(0x562aa5efba30 msgr2=0x562aa5f062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.392+0000 7f27a557c740 1 -- 172.21.15.100:0/3793429909 shutdown_connections 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.392+0000 7f27a557c740 1 -- 172.21.15.100:0/3793429909 wait complete. 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.392+0000 7f27a557c740 1 -- start start 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.392+0000 7f27a557c740 1 Processor -- start 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a557c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f1e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a557c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f1eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a557c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f7b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a557c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1a9b90 con 0x562aa5eff4a0 2024-09-12T02:45:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a557c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ab000 con 0x562aa5f0a680 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a557c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1aa260 con 0x562aa5effdc0 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a0f3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f1e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f1eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f1eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33144/0 (socket says 172.21.15.100:33144) 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 -- 172.21.15.100:0/2893529373 learned_addr learned my addr 172.21.15.100:0/2893529373 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a557c740 10 client.0 _ll_register_callbacks cb 0x7f278c045040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f27a1740640 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f7b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 -- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 msgr2=0x562aa5f7b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f7b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 -- 172.21.15.100:0/2893529373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 msgr2=0x562aa5f1e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f1e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.393+0000 7f279bfff640 1 -- 172.21.15.100:0/2893529373 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa5f7bd70 con 0x562aa5effdc0 2024-09-12T02:45:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f279bfff640 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f1eb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f27900b4450 tx=0x7f279009ac40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137c505dbf0faad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f277bfff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f277bfff640 1 -- 172.21.15.100:0/2893529373 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900b8040 con 0x562aa5effdc0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f277bfff640 1 -- 172.21.15.100:0/2893529373 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2790097350 con 0x562aa5effdc0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2790095e50 con 0x562aa5effdc0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f277bfff640 1 -- 172.21.15.100:0/2893529373 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f27900a3f50 con 0x562aa5effdc0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f27a557c740 10 client.25957 fetch_fsmap learned FSMap version 27 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562aa5f7bd70 con 0x562aa5effdc0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f277bfff640 1 -- 172.21.15.100:0/2893529373 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279009f690 con 0x562aa5effdc0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f277bfff640 1 -- 172.21.15.100:0/2893529373 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f279009f0d0 con 0x562aa5effdc0 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f27a557c740 10 client.25957 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f27a557c740 10 client.25957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.394+0000 7f27a557c740 20 client.25957 populate_metadata read hostname 'smithi100' 2024-09-12T02:45:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.395+0000 7f27a557c740 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f845d0 0x562aa5f869c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.395+0000 7f27a557c740 4 client.25957 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:45:59.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.395+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f2790095e50 con 0x562aa5f845d0 2024-09-12T02:45:59.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.396+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f845d0 0x562aa5f869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.396+0000 7f27a0f3f640 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f845d0 0x562aa5f869c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b94a08f67202583 server_cookie=b511cbc3726cb7ef in_seq=0 out_seq=0 2024-09-12T02:45:59.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.396+0000 7f277bfff640 10 client.25957 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.396+0000 7f277bfff640 1 -- 172.21.15.100:0/2893529373 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f2790095e50 con 0x562aa5f845d0 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.396+0000 7f277bfff640 10 client.25957 handle_command_reply: tid=0 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.396+0000 7f27a557c740 1 client.25957 shutdown 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 msgr2=0x562aa5f1eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f1eb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f27900b4450 tx=0x7f279009ac40 comp rx=0 tx=0).stop 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 shutdown_connections 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562aa5f845d0 0x562aa5f869c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f277bfff640 0 client.25957 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562aa5f0a680 0x562aa5f7b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aa5effdc0 0x562aa5f1eb60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 --2- 172.21.15.100:0/2893529373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562aa5eff4a0 0x562aa5f1e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 >> 172.21.15.100:0/2893529373 conn(0x562aa5efba30 msgr2=0x562aa5f08b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 shutdown_connections 2024-09-12T02:45:59.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.397+0000 7f27a557c740 1 -- 172.21.15.100:0/2893529373 wait complete. 2024-09-12T02:45:59.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a557c740 20 client.25957 trim_cache size 0 max 16384 2024-09-12T02:45:59.403 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:45:59.403 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:45:59.403 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:45:59.403 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27840a2c40 msgr2=0x7f27840a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27840a2c40 0x7f27840a5100 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f278c0096c0 tx=0x7f278c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 msgr2=0x7f279c1968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 0x7f279c1968d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f279000b450 tx=0x7f279000b910 comp rx=0 tx=0).stop 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 shutdown_connections 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f27840a2c40 0x7f27840a5100 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f279c106f10 0x7f279c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c102790 0x7f279c1968d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 --2- 172.21.15.100:0/2756206321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f279c101de0 0x7f279c196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 >> 172.21.15.100:0/2756206321 conn(0x7f279c0fd8e0 msgr2=0x7f279c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 shutdown_connections 2024-09-12T02:45:59.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:45:59.398+0000 7f27a31a3640 1 -- 172.21.15.100:0/2756206321 wait complete. 2024-09-12T02:46:00.509 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:46:00.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:46:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:00 smithi189 ceph-mon[35196]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 720 op/s 2024-09-12T02:46:01.015 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:00 smithi100 ceph-mon[31390]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 720 op/s 2024-09-12T02:46:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:00 smithi117 ceph-mon[34898]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 720 op/s 2024-09-12T02:46:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 410.0 s, 2666.0 tps, lat 37.438 ms stddev 39.375 2024-09-12T02:46:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.377+0000 7fcbadf1a640 1 -- 172.21.15.100:0/390089708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8101de0 msgr2=0x7fcba81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.377+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/390089708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8101de0 0x7fcba81021c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009900 tx=0x7fcb9802a410 comp rx=0 tx=0).stop 2024-09-12T02:46:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.378+0000 7fcbadf1a640 1 -- 172.21.15.100:0/390089708 shutdown_connections 2024-09-12T02:46:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.378+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/390089708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8106f10 0x7fcba810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.378+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/390089708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8102790 0x7fcba81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.378+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/390089708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8101de0 0x7fcba81021c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.378+0000 7fcbadf1a640 1 -- 172.21.15.100:0/390089708 >> 172.21.15.100:0/390089708 conn(0x7fcba80fd8e0 msgr2=0x7fcba80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.378+0000 7fcbadf1a640 1 -- 172.21.15.100:0/390089708 shutdown_connections 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.378+0000 7fcbadf1a640 1 -- 172.21.15.100:0/390089708 wait complete. 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.379+0000 7fcbadf1a640 1 Processor -- start 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.379+0000 7fcbadf1a640 1 -- start start 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcbadf1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8101de0 0x7fcba8108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcbadf1a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8102790 0x7fcba8108ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcbadf1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8106f10 0x7fcba8109530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcbadf1a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8111f30 con 0x7fcba8106f10 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcbadf1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8111db0 con 0x7fcba8101de0 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcbadf1a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcba81120b0 con 0x7fcba8102790 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcba77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8101de0 0x7fcba8108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcba77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8101de0 0x7fcba8108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34018/0 (socket says 172.21.15.100:34018) 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcba77fe640 1 -- 172.21.15.100:0/3468912907 learned_addr learned my addr 172.21.15.100:0/3468912907 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcb9ffff640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8102790 0x7fcba8108ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.380+0000 7fcba7fff640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8106f10 0x7fcba8109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcb9ffff640 1 -- 172.21.15.100:0/3468912907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8101de0 msgr2=0x7fcba8108ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcb9ffff640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8101de0 0x7fcba8108ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcb9ffff640 1 -- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8106f10 msgr2=0x7fcba8109530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcb9ffff640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8106f10 0x7fcba8109530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcb9ffff640 1 -- 172.21.15.100:0/3468912907 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba81aad10 con 0x7fcba8102790 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcb9ffff640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8102790 0x7fcba8108ff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000d950 tx=0x7fcb9000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcba57fa640 1 -- 172.21.15.100:0/3468912907 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90009c30 con 0x7fcba8102790 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcba57fa640 1 -- 172.21.15.100:0/3468912907 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb90009dd0 con 0x7fcba8102790 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba81aafa0 con 0x7fcba8102790 2024-09-12T02:46:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba81ab500 con 0x7fcba8102790 2024-09-12T02:46:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.381+0000 7fcba57fa640 1 -- 172.21.15.100:0/3468912907 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90010460 con 0x7fcba8102790 2024-09-12T02:46:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.382+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb88005290 con 0x7fcba8102790 2024-09-12T02:46:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.384+0000 7fcba57fa640 1 -- 172.21.15.100:0/3468912907 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fcb900035f0 con 0x7fcba8102790 2024-09-12T02:46:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.386+0000 7fcba57fa640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb940a2c80 0x7fcb940a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.386+0000 7fcba57fa640 1 -- 172.21.15.100:0/3468912907 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcb900ced60 con 0x7fcba8102790 2024-09-12T02:46:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.387+0000 7fcba77fe640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb940a2c80 0x7fcb940a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.387+0000 7fcba57fa640 1 -- 172.21.15.100:0/3468912907 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb90017020 con 0x7fcba8102790 2024-09-12T02:46:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.388+0000 7fcba77fe640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb940a2c80 0x7fcb940a5140 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcb980096c0 tx=0x7fcb98005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:01.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.704+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb88005580 con 0x7fcba8102790 2024-09-12T02:46:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.705+0000 7fcba57fa640 1 -- 172.21.15.100:0/3468912907 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fcb9009b680 con 0x7fcba8102790 2024-09-12T02:46:01.707 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:46:01.707 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:46:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:46:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb940a2c80 msgr2=0x7fcb940a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb940a2c80 0x7fcb940a5140 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcb980096c0 tx=0x7fcb98005a20 comp rx=0 tx=0).stop 2024-09-12T02:46:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8102790 msgr2=0x7fcba8108ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8102790 0x7fcba8108ff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000d950 tx=0x7fcb9000de10 comp rx=0 tx=0).stop 2024-09-12T02:46:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 shutdown_connections 2024-09-12T02:46:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb940a2c80 0x7fcb940a5140 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8106f10 0x7fcba8109530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8102790 0x7fcba8108ff0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 --2- 172.21.15.100:0/3468912907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8101de0 0x7fcba8108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.708+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 >> 172.21.15.100:0/3468912907 conn(0x7fcba80fd8e0 msgr2=0x7fcba80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:01.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.709+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 shutdown_connections 2024-09-12T02:46:01.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:01.709+0000 7fcbadf1a640 1 -- 172.21.15.100:0/3468912907 wait complete. 2024-09-12T02:46:02.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:01 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3468912907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:02.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:01 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3468912907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:01 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3468912907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:02.386 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:46:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:03.028 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:02 smithi100 ceph-mon[31390]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.5 MiB/s wr, 629 op/s 2024-09-12T02:46:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:02 smithi117 ceph-mon[34898]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.5 MiB/s wr, 629 op/s 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 -- 172.21.15.100:0/585369476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288106f10 msgr2=0x7ff28810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 --2- 172.21.15.100:0/585369476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288106f10 0x7ff28810ea90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff280009ca0 tx=0x7ff28002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 -- 172.21.15.100:0/585369476 shutdown_connections 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 --2- 172.21.15.100:0/585369476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288106f10 0x7ff28810ea90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 --2- 172.21.15.100:0/585369476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff288102790 0x7ff2881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 --2- 172.21.15.100:0/585369476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff288101de0 0x7ff2881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 -- 172.21.15.100:0/585369476 >> 172.21.15.100:0/585369476 conn(0x7ff2880fd880 msgr2=0x7ff2880ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.251+0000 7ff28e65b640 1 -- 172.21.15.100:0/585369476 shutdown_connections 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.252+0000 7ff28e65b640 1 -- 172.21.15.100:0/585369476 wait complete. 2024-09-12T02:46:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.252+0000 7ff28e65b640 1 Processor -- start 2024-09-12T02:46:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.252+0000 7ff28e65b640 1 -- start start 2024-09-12T02:46:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff28e65b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288101de0 0x7ff2880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff28e65b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff288102790 0x7ff288074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff28e65b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff288106f10 0x7ff288074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff28e65b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff288111f70 con 0x7ff288101de0 2024-09-12T02:46:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff28e65b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff288111df0 con 0x7ff288102790 2024-09-12T02:46:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff28e65b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881120f0 con 0x7ff288106f10 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff287fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288101de0 0x7ff2880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff287fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288101de0 0x7ff2880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44738/0 (socket says 172.21.15.100:44738) 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff287fff640 1 -- 172.21.15.100:0/3732522355 learned_addr learned my addr 172.21.15.100:0/3732522355 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff2877fe640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff288102790 0x7ff288074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff288106f10 0x7ff288074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff2877fe640 1 -- 172.21.15.100:0/3732522355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff288106f10 msgr2=0x7ff288074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff2877fe640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff288106f10 0x7ff288074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff2877fe640 1 -- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288101de0 msgr2=0x7ff2880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff2877fe640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288101de0 0x7ff2880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff2877fe640 1 -- 172.21.15.100:0/3732522355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2881a6890 con 0x7ff288102790 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.253+0000 7ff287fff640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288101de0 0x7ff2880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.254+0000 7ff2877fe640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff288102790 0x7ff288074a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00e9f0 tx=0x7ff27c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.254+0000 7ff2857fa640 1 -- 172.21.15.100:0/3732522355 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00ccc0 con 0x7ff288102790 2024-09-12T02:46:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.254+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2881a6b80 con 0x7ff288102790 2024-09-12T02:46:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.254+0000 7ff2857fa640 1 -- 172.21.15.100:0/3732522355 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff27c010910 con 0x7ff288102790 2024-09-12T02:46:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.254+0000 7ff2857fa640 1 -- 172.21.15.100:0/3732522355 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c018960 con 0x7ff288102790 2024-09-12T02:46:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.254+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2881a7000 con 0x7ff288102790 2024-09-12T02:46:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:02 smithi189 ceph-mon[35196]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.5 MiB/s wr, 629 op/s 2024-09-12T02:46:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.258+0000 7ff2857fa640 1 -- 172.21.15.100:0/3732522355 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff27c010ac0 con 0x7ff288102790 2024-09-12T02:46:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.259+0000 7ff2857fa640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff2700a2c00 0x7ff2700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.259+0000 7ff2857fa640 1 -- 172.21.15.100:0/3732522355 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff27c0cf3c0 con 0x7ff288102790 2024-09-12T02:46:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.260+0000 7ff287fff640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff2700a2c00 0x7ff2700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 Processor -- start 2024-09-12T02:46:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 -- start start 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f26090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f265d0 0x55e1d7f26a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f42380 0x55e1d7f44770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e1d7e8c2f0 con 0x55e1d7f27b40 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1d7e33cf0 con 0x55e1d7f265d0 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff290a34740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e1d7e882b0 con 0x55e1d7f42380 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.262+0000 7ff28cbf8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f42380 0x55e1d7f44770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f42380 0x55e1d7f44770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33172/0 (socket says 172.21.15.100:33172) 2024-09-12T02:46:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 -- 172.21.15.100:0/90076437 learned_addr learned my addr 172.21.15.100:0/90076437 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff287fff640 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f26090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 -- 172.21.15.100:0/90076437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f265d0 msgr2=0x55e1d7f26a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f265d0 0x55e1d7f26a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 -- 172.21.15.100:0/90076437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 msgr2=0x55e1d7f26090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f26090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 -- 172.21.15.100:0/90076437 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d7e183a0 con 0x55e1d7f42380 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.263+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f42380 0x55e1d7f44770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff280009ca0 tx=0x7ff280009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=711619edffaa050a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.264+0000 7ff26e7fc640 1 -- 172.21.15.100:0/90076437 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280031db0 con 0x55e1d7f42380 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.264+0000 7ff26e7fc640 1 -- 172.21.15.100:0/90076437 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff280036040 con 0x55e1d7f42380 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.264+0000 7ff26e7fc640 1 -- 172.21.15.100:0/90076437 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800042a0 con 0x55e1d7f42380 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 -- 172.21.15.100:0/90076437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f42380 msgr2=0x55e1d7f44770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f42380 0x55e1d7f44770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff280009ca0 tx=0x7ff280009800 comp rx=0 tx=0).stop 2024-09-12T02:46:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff287fff640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff2700a2c00 0x7ff2700a50c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff278014df0 tx=0x7ff278014970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 -- 172.21.15.100:0/90076437 shutdown_connections 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f42380 0x55e1d7f44770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f265d0 0x55e1d7f26a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 --2- 172.21.15.100:0/90076437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f26090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 -- 172.21.15.100:0/90076437 >> 172.21.15.100:0/90076437 conn(0x55e1d7eef310 msgr2=0x55e1d7f22c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 -- 172.21.15.100:0/90076437 shutdown_connections 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.265+0000 7ff290a34740 1 -- 172.21.15.100:0/90076437 wait complete. 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.266+0000 7ff290a34740 1 -- start start 2024-09-12T02:46:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.269+0000 7ff290a34740 1 Processor -- start 2024-09-12T02:46:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff290a34740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff290a34740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f33810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff290a34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f2e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff290a34740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e1d7f294b0 con 0x55e1d7f265d0 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff290a34740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1d7e47060 con 0x55e1d7f42380 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff290a34740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e1d7f29630 con 0x55e1d7f27b40 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff290a34740 10 client.0 _ll_register_callbacks cb 0x55e1d7b9a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f33810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f33810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33184/0 (socket says 172.21.15.100:33184) 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.270+0000 7ff2877fe640 1 -- 172.21.15.100:0/4162225281 learned_addr learned my addr 172.21.15.100:0/4162225281 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.271+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f2e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.271+0000 7ff287fff640 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.271+0000 7ff2877fe640 1 -- 172.21.15.100:0/4162225281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 msgr2=0x55e1d7f2e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.271+0000 7ff2877fe640 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f2e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.271+0000 7ff2877fe640 1 -- 172.21.15.100:0/4162225281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 msgr2=0x55e1d7f332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.271+0000 7ff2877fe640 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f332d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.271+0000 7ff2877fe640 1 -- 172.21.15.100:0/4162225281 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d7bfd3c0 con 0x55e1d7f27b40 2024-09-12T02:46:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.275+0000 7ff2877fe640 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f33810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff27c09bbf0 tx=0x7ff27c09b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb0a168c3a875f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.277+0000 7ff2677fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.279+0000 7ff2677fe640 1 -- 172.21.15.100:0/4162225281 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0b2020 con 0x55e1d7f27b40 2024-09-12T02:46:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.279+0000 7ff2677fe640 1 -- 172.21.15.100:0/4162225281 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff27c09b2b0 con 0x55e1d7f27b40 2024-09-12T02:46:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.280+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff280036040 con 0x55e1d7f27b40 2024-09-12T02:46:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.280+0000 7ff2677fe640 1 -- 172.21.15.100:0/4162225281 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff27c0a4820 con 0x55e1d7f27b40 2024-09-12T02:46:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.280+0000 7ff290a34740 10 client.25975 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.280+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e1d7f3d040 con 0x55e1d7f27b40 2024-09-12T02:46:03.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff2677fe640 1 -- 172.21.15.100:0/4162225281 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff280036040 con 0x55e1d7f27b40 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff2677fe640 1 -- 172.21.15.100:0/4162225281 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff27c0979b0 con 0x55e1d7f27b40 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff290a34740 10 client.25975 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff290a34740 10 client.25975 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff290a34740 20 client.25975 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff290a34740 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7f3e500 0x55e1d7f40910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff290a34740 4 client.25975 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.281+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1d7e99860 con 0x55e1d7f3e500 2024-09-12T02:46:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.282+0000 7ff287fff640 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7f3e500 0x55e1d7f40910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.286+0000 7ff287fff640 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7f3e500 0x55e1d7f40910 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bffe40719a7bc915 server_cookie=94fdd15c73833e9c in_seq=0 out_seq=0 2024-09-12T02:46:03.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.287+0000 7ff2677fe640 10 client.25975 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:03.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.289+0000 7ff2677fe640 1 -- 172.21.15.100:0/4162225281 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1d7e99860 con 0x55e1d7f3e500 2024-09-12T02:46:03.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.289+0000 7ff2677fe640 10 client.25975 handle_command_reply: tid=0 2024-09-12T02:46:03.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.289+0000 7ff290a34740 1 client.25975 shutdown 2024-09-12T02:46:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 msgr2=0x55e1d7f33810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f33810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff27c09bbf0 tx=0x7ff27c09b890 comp rx=0 tx=0).stop 2024-09-12T02:46:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 shutdown_connections 2024-09-12T02:46:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7f3e500 0x55e1d7f40910 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f2e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f33810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 --2- 172.21.15.100:0/4162225281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f332d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.292+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 >> 172.21.15.100:0/4162225281 conn(0x55e1d7eef310 msgr2=0x55e1d7f28930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.293+0000 7ff2677fe640 0 client.25975 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.293+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 shutdown_connections 2024-09-12T02:46:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.293+0000 7ff290a34740 1 -- 172.21.15.100:0/4162225281 wait complete. 2024-09-12T02:46:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.294+0000 7ff290a34740 20 client.25975 trim_cache size 0 max 16384 2024-09-12T02:46:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.319+0000 7ff290a34740 1 Processor -- start 2024-09-12T02:46:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.319+0000 7ff290a34740 1 -- start start 2024-09-12T02:46:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.319+0000 7ff290a34740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f22d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.319+0000 7ff290a34740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.319+0000 7ff290a34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f49d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff2877fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33188/0 (socket says 172.21.15.100:33188) 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff2877fe640 1 -- 172.21.15.100:0/3025015386 learned_addr learned my addr 172.21.15.100:0/3025015386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881a9880 con 0x55e1d7f265d0 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881a7290 con 0x55e1d7f42380 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff288072120 con 0x55e1d7f27b40 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f49d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff287fff640 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f22d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff28cbf8640 1 -- 172.21.15.100:0/3025015386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 msgr2=0x55e1d7f2d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff28cbf8640 1 -- 172.21.15.100:0/3025015386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 msgr2=0x55e1d7f22d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f22d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff28cbf8640 1 -- 172.21.15.100:0/3025015386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d7f224f0 con 0x55e1d7f42380 2024-09-12T02:46:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff287fff640 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f22d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.320+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f49d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff280009bf0 tx=0x7ff280000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46bee4e92252b584 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.321+0000 7ff26dffb640 1 -- 172.21.15.100:0/3025015386 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280003970 con 0x55e1d7f42380 2024-09-12T02:46:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.321+0000 7ff26dffb640 1 -- 172.21.15.100:0/3025015386 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff280036040 con 0x55e1d7f42380 2024-09-12T02:46:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.321+0000 7ff26dffb640 1 -- 172.21.15.100:0/3025015386 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800042a0 con 0x55e1d7f42380 2024-09-12T02:46:03.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.322+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 msgr2=0x55e1d7f49d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.322+0000 7ff290a34740 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f49d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff280009bf0 tx=0x7ff280000f40 comp rx=0 tx=0).stop 2024-09-12T02:46:03.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.322+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 shutdown_connections 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.322+0000 7ff290a34740 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f49d30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.322+0000 7ff290a34740 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.322+0000 7ff290a34740 1 --2- 172.21.15.100:0/3025015386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f265d0 0x55e1d7f22d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.322+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 >> 172.21.15.100:0/3025015386 conn(0x55e1d7eef310 msgr2=0x55e1d7f2cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.323+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 shutdown_connections 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.323+0000 7ff290a34740 1 -- 172.21.15.100:0/3025015386 wait complete. 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.323+0000 7ff290a34740 1 -- start start 2024-09-12T02:46:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 1 Processor -- start 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f265d0 0x55e1d7f2b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f391d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff288072790 con 0x55e1d7f27b40 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff288073c00 con 0x55e1d7f42380 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff288072e60 con 0x55e1d7f265d0 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.324+0000 7ff290a34740 10 client.0 _ll_register_callbacks cb 0x7ff27c010e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f265d0 0x55e1d7f2b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f265d0 0x55e1d7f2b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33204/0 (socket says 172.21.15.100:33204) 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 -- 172.21.15.100:0/727181407 learned_addr learned my addr 172.21.15.100:0/727181407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff2877fe640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 -- 172.21.15.100:0/727181407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 msgr2=0x55e1d7f391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f391d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 -- 172.21.15.100:0/727181407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 msgr2=0x55e1d7f2bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff287fff640 1 -- 172.21.15.100:0/727181407 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d7f39790 con 0x55e1d7f265d0 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.325+0000 7ff28cbf8640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.326+0000 7ff287fff640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f265d0 0x55e1d7f2b590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55e1d7f41150 tx=0x7ff278004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e6c7a3c8dea568f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.326+0000 7ff2677fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:03.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.326+0000 7ff2877fe640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.326+0000 7ff2677fe640 1 -- 172.21.15.100:0/727181407 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27802f060 con 0x55e1d7f265d0 2024-09-12T02:46:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.326+0000 7ff2677fe640 1 -- 172.21.15.100:0/727181407 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff278014500 con 0x55e1d7f265d0 2024-09-12T02:46:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.326+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff280036040 con 0x55e1d7f265d0 2024-09-12T02:46:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.327+0000 7ff2677fe640 1 -- 172.21.15.100:0/727181407 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff278014120 con 0x55e1d7f265d0 2024-09-12T02:46:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.328+0000 7ff290a34740 10 client.25981 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:03.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.329+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e1d7fef840 con 0x55e1d7f265d0 2024-09-12T02:46:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.330+0000 7ff2677fe640 1 -- 172.21.15.100:0/727181407 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff280036040 con 0x55e1d7f265d0 2024-09-12T02:46:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.330+0000 7ff2677fe640 1 -- 172.21.15.100:0/727181407 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff278022400 con 0x55e1d7f265d0 2024-09-12T02:46:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.331+0000 7ff290a34740 10 client.25981 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.331+0000 7ff290a34740 10 client.25981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:46:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.331+0000 7ff290a34740 20 client.25981 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.331+0000 7ff290a34740 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7feff50 0x55e1d7ff2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.331+0000 7ff290a34740 4 client.25981 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:46:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.331+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1d7e93d70 con 0x55e1d7feff50 2024-09-12T02:46:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.331+0000 7ff2877fe640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7feff50 0x55e1d7ff2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff2677fe640 10 client.25981 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff2877fe640 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7feff50 0x55e1d7ff2370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef5ec61130c3bb95 server_cookie=b00723768938a581 in_seq=0 out_seq=0 2024-09-12T02:46:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff2677fe640 1 -- 172.21.15.100:0/727181407 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1d7e93d70 con 0x55e1d7feff50 2024-09-12T02:46:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff2677fe640 10 client.25981 handle_command_reply: tid=0 2024-09-12T02:46:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 client.25981 shutdown 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f265d0 msgr2=0x55e1d7f2b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f265d0 0x55e1d7f2b590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55e1d7f41150 tx=0x7ff278004730 comp rx=0 tx=0).stop 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 shutdown_connections 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e1d7feff50 0x55e1d7ff2370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1d7f42380 0x55e1d7f391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1d7f27b40 0x55e1d7f2bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 --2- 172.21.15.100:0/727181407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1d7f265d0 0x55e1d7f2b590 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 >> 172.21.15.100:0/727181407 conn(0x55e1d7eef310 msgr2=0x55e1d7f411b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.332+0000 7ff2677fe640 0 client.25981 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 shutdown_connections 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff290a34740 1 -- 172.21.15.100:0/727181407 wait complete. 2024-09-12T02:46:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff290a34740 20 client.25981 trim_cache size 0 max 16384 2024-09-12T02:46:03.336 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:46:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff2700a2c00 msgr2=0x7ff2700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff28e65b640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff2700a2c00 0x7ff2700a50c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff278014df0 tx=0x7ff278014970 comp rx=0 tx=0).stop 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff288102790 msgr2=0x7ff288074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff28e65b640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff288102790 0x7ff288074a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00e9f0 tx=0x7ff27c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.333+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 shutdown_connections 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.334+0000 7ff28e65b640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff2700a2c00 0x7ff2700a50c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.334+0000 7ff28e65b640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff288106f10 0x7ff288074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.334+0000 7ff28e65b640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff288102790 0x7ff288074a30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.334+0000 7ff28e65b640 1 --2- 172.21.15.100:0/3732522355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff288101de0 0x7ff2880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.334+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 >> 172.21.15.100:0/3732522355 conn(0x7ff2880fd880 msgr2=0x7ff2880feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.334+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 shutdown_connections 2024-09-12T02:46:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:03.334+0000 7ff28e65b640 1 -- 172.21.15.100:0/3732522355 wait complete. 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:04.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:04.044 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:46:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:04.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:04.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:46:04.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:04.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:04.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:46:04.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:46:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:05.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:04 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T02:46:05.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:04 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi117 to 176.0M 2024-09-12T02:46:05.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:04 smithi100 ceph-mon[31390]: Unable to set osd_memory_target on smithi189 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:46:05.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:04 smithi100 ceph-mon[31390]: Unable to set osd_memory_target on smithi117 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-12T02:46:05.042 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:04 smithi100 ceph-mon[31390]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T02:46:05.042 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:04 smithi100 ceph-mon[31390]: Unable to set osd_memory_target on smithi100 to 184518656: error parsing value: Value '184518656' is below minimum 939524096 2024-09-12T02:46:05.042 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:04 smithi100 ceph-mon[31390]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.9 MiB/s wr, 542 op/s 2024-09-12T02:46:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:04 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T02:46:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:04 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi117 to 176.0M 2024-09-12T02:46:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:04 smithi117 ceph-mon[34898]: Unable to set osd_memory_target on smithi189 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:46:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:04 smithi117 ceph-mon[34898]: Unable to set osd_memory_target on smithi117 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-12T02:46:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:04 smithi117 ceph-mon[34898]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T02:46:05.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:04 smithi117 ceph-mon[34898]: Unable to set osd_memory_target on smithi100 to 184518656: error parsing value: Value '184518656' is below minimum 939524096 2024-09-12T02:46:05.095 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:04 smithi117 ceph-mon[34898]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.9 MiB/s wr, 542 op/s 2024-09-12T02:46:05.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:04 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T02:46:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:04 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi117 to 176.0M 2024-09-12T02:46:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:04 smithi189 ceph-mon[35196]: Unable to set osd_memory_target on smithi189 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:46:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:04 smithi189 ceph-mon[35196]: Unable to set osd_memory_target on smithi117 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-12T02:46:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:04 smithi189 ceph-mon[35196]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T02:46:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:04 smithi189 ceph-mon[35196]: Unable to set osd_memory_target on smithi100 to 184518656: error parsing value: Value '184518656' is below minimum 939524096 2024-09-12T02:46:05.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:04 smithi189 ceph-mon[35196]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.9 MiB/s wr, 542 op/s 2024-09-12T02:46:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.009+0000 7f4d52ccd640 1 -- 172.21.15.100:0/1289146807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d4c100480 msgr2=0x7f4d4c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.009+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/1289146807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d4c100480 0x7f4d4c100860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009be0 tx=0x7f4d4402b820 comp rx=0 tx=0).stop 2024-09-12T02:46:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.011+0000 7f4d52ccd640 1 -- 172.21.15.100:0/1289146807 shutdown_connections 2024-09-12T02:46:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.011+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/1289146807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c1055b0 0x7f4d4c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.011+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/1289146807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d4c100e30 0x7f4d4c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.011+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/1289146807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d4c100480 0x7f4d4c100860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.011+0000 7f4d52ccd640 1 -- 172.21.15.100:0/1289146807 >> 172.21.15.100:0/1289146807 conn(0x7f4d4c077210 msgr2=0x7f4d4c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:06.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.014+0000 7f4d52ccd640 1 -- 172.21.15.100:0/1289146807 shutdown_connections 2024-09-12T02:46:06.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.015+0000 7f4d52ccd640 1 -- 172.21.15.100:0/1289146807 wait complete. 2024-09-12T02:46:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.015+0000 7f4d52ccd640 1 Processor -- start 2024-09-12T02:46:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.015+0000 7f4d52ccd640 1 -- start start 2024-09-12T02:46:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.016+0000 7f4d52ccd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d4c100480 0x7f4d4c108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.016+0000 7f4d52ccd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d4c100e30 0x7f4d4c108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.016+0000 7f4d52ccd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c1055b0 0x7f4d4c109010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.016+0000 7f4d52ccd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c06dd90 con 0x7f4d4c100480 2024-09-12T02:46:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.016+0000 7f4d52ccd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c06dc10 con 0x7f4d4c100e30 2024-09-12T02:46:06.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.016+0000 7f4d52ccd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c06df10 con 0x7f4d4c1055b0 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.017+0000 7f4d5126a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c1055b0 0x7f4d4c109010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.017+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d4c100480 0x7f4d4c108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.017+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d4c100480 0x7f4d4c108590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42834/0 (socket says 172.21.15.100:42834) 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.017+0000 7f4d50a69640 1 -- 172.21.15.100:0/318417657 learned_addr learned my addr 172.21.15.100:0/318417657 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.018+0000 7f4d5126a640 1 -- 172.21.15.100:0/318417657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d4c100e30 msgr2=0x7f4d4c108ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.018+0000 7f4d5126a640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d4c100e30 0x7f4d4c108ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.018+0000 7f4d5126a640 1 -- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d4c100480 msgr2=0x7f4d4c108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.018+0000 7f4d5126a640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d4c100480 0x7f4d4c108590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.018+0000 7f4d5126a640 1 -- 172.21.15.100:0/318417657 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c199d50 con 0x7f4d4c1055b0 2024-09-12T02:46:06.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.018+0000 7f4d5126a640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c1055b0 0x7f4d4c109010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c01f950 tx=0x7f4d3c01fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:06.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.019+0000 7f4d49ffb640 1 -- 172.21.15.100:0/318417657 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c01db90 con 0x7f4d4c1055b0 2024-09-12T02:46:06.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.019+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c199fe0 con 0x7f4d4c1055b0 2024-09-12T02:46:06.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.020+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c19a520 con 0x7f4d4c1055b0 2024-09-12T02:46:06.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.020+0000 7f4d49ffb640 1 -- 172.21.15.100:0/318417657 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d3c01dd30 con 0x7f4d4c1055b0 2024-09-12T02:46:06.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.021+0000 7f4d49ffb640 1 -- 172.21.15.100:0/318417657 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c004a00 con 0x7f4d4c1055b0 2024-09-12T02:46:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.026+0000 7f4d550a6740 1 Processor -- start 2024-09-12T02:46:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d550a6740 1 -- start start 2024-09-12T02:46:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d49ffb640 1 -- 172.21.15.100:0/318417657 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4d3c004ba0 con 0x7f4d4c1055b0 2024-09-12T02:46:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f36090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f365d0 0x562007f36a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f43760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d550a6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562007e9c2f0 con 0x562007f37b40 2024-09-12T02:46:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d550a6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562007e43cf0 con 0x562007f365d0 2024-09-12T02:46:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.027+0000 7f4d550a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562007e982b0 con 0x562007f41370 2024-09-12T02:46:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.028+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f365d0 0x562007f36a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.028+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f365d0 0x562007f36a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60148/0 (socket says 172.21.15.100:60148) 2024-09-12T02:46:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d50a69640 1 -- 172.21.15.100:0/4038879430 learned_addr learned my addr 172.21.15.100:0/4038879430 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f43760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f36090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d4bfff640 1 -- 172.21.15.100:0/4038879430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f365d0 msgr2=0x562007f36a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f365d0 0x562007f36a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d4bfff640 1 -- 172.21.15.100:0/4038879430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 msgr2=0x562007f36090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f36090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.029+0000 7f4d4bfff640 1 -- 172.21.15.100:0/4038879430 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562007e283a0 con 0x562007f41370 2024-09-12T02:46:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.030+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f43760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c109de0 tx=0x7f4d40008c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21457a1eab938dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.030+0000 7f4d32ffd640 1 -- 172.21.15.100:0/4038879430 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40011040 con 0x562007f41370 2024-09-12T02:46:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.030+0000 7f4d32ffd640 1 -- 172.21.15.100:0/4038879430 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d40006110 con 0x562007f41370 2024-09-12T02:46:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.030+0000 7f4d32ffd640 1 -- 172.21.15.100:0/4038879430 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004b10 con 0x562007f41370 2024-09-12T02:46:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.030+0000 7f4d49ffb640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4d340a2ba0 0x7f4d340a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d49ffb640 1 -- 172.21.15.100:0/318417657 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4d3c0e0230 con 0x7f4d4c1055b0 2024-09-12T02:46:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d50a69640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4d340a2ba0 0x7f4d340a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d550a6740 1 -- 172.21.15.100:0/4038879430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 msgr2=0x562007f43760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f43760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c109de0 tx=0x7f4d40008c80 comp rx=0 tx=0).stop 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d550a6740 1 -- 172.21.15.100:0/4038879430 shutdown_connections 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f43760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f365d0 0x562007f36a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4038879430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f36090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.031+0000 7f4d550a6740 1 -- 172.21.15.100:0/4038879430 >> 172.21.15.100:0/4038879430 conn(0x562007eff310 msgr2=0x562007f32c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.032+0000 7f4d550a6740 1 -- 172.21.15.100:0/4038879430 shutdown_connections 2024-09-12T02:46:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.032+0000 7f4d50a69640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4d340a2ba0 0x7f4d340a5060 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d440099a0 tx=0x7f4d4400d340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.032+0000 7f4d550a6740 1 -- 172.21.15.100:0/4038879430 wait complete. 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.032+0000 7f4d550a6740 1 -- start start 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 1 Processor -- start 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f40cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f3df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f41370 0x562007f3e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562007f44070 con 0x562007f37b40 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562007e57060 con 0x562007f41370 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562007f441f0 con 0x562007f365d0 2024-09-12T02:46:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f40cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f40cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35774/0 (socket says 172.21.15.100:35774) 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 -- 172.21.15.100:0/365991636 learned_addr learned my addr 172.21.15.100:0/365991636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f3df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.033+0000 7f4d550a6740 10 client.0 _ll_register_callbacks cb 0x562007baa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d5126a640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f41370 0x562007f3e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 -- 172.21.15.100:0/365991636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f41370 msgr2=0x562007f3e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f41370 0x562007f3e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 -- 172.21.15.100:0/365991636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 msgr2=0x562007f3df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f3df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d50a69640 1 -- 172.21.15.100:0/365991636 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562007c0d3c0 con 0x562007f365d0 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.034+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f3df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.035+0000 7f4d50a69640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f40cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009b30 tx=0x7f4d4402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39da9d2e97a0f995 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.035+0000 7f4d2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.035+0000 7f4d2bfff640 1 -- 172.21.15.100:0/365991636 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4404f070 con 0x562007f365d0 2024-09-12T02:46:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.035+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d40006110 con 0x562007f365d0 2024-09-12T02:46:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.035+0000 7f4d2bfff640 1 -- 172.21.15.100:0/365991636 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4d44004790 con 0x562007f365d0 2024-09-12T02:46:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d2bfff640 1 -- 172.21.15.100:0/365991636 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d44059050 con 0x562007f365d0 2024-09-12T02:46:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 10 client.25993 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562007f4fb40 con 0x562007f365d0 2024-09-12T02:46:06.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d2bfff640 1 -- 172.21.15.100:0/365991636 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d40006110 con 0x562007f365d0 2024-09-12T02:46:06.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d2bfff640 1 -- 172.21.15.100:0/365991636 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d44032070 con 0x562007f365d0 2024-09-12T02:46:06.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 10 client.25993 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:06.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 10 client.25993 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:46:06.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 20 client.25993 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:06.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007f50f50 0x562007f53410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 4 client.25993 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562007ea9860 con 0x562007f50f50 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.036+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007f50f50 0x562007f53410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.037+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007f50f50 0x562007f53410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=979a0888a4e6f9a7 server_cookie=c7004c39ad1ad1bc in_seq=0 out_seq=0 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.037+0000 7f4d2bfff640 10 client.25993 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d2bfff640 1 -- 172.21.15.100:0/365991636 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562007ea9860 con 0x562007f50f50 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d2bfff640 10 client.25993 handle_command_reply: tid=0 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 client.25993 shutdown 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 msgr2=0x562007f40cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f40cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009b30 tx=0x7f4d4402b820 comp rx=0 tx=0).stop 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 shutdown_connections 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007f50f50 0x562007f53410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f41370 0x562007f3e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f37b40 0x562007f3df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 --2- 172.21.15.100:0/365991636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f40cc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 >> 172.21.15.100:0/365991636 conn(0x562007eff310 msgr2=0x562007f38930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.038+0000 7f4d2bfff640 0 client.25993 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.039+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 shutdown_connections 2024-09-12T02:46:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.039+0000 7f4d550a6740 1 -- 172.21.15.100:0/365991636 wait complete. 2024-09-12T02:46:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.039+0000 7f4d550a6740 20 client.25993 trim_cache size 0 max 16384 2024-09-12T02:46:06.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 Processor -- start 2024-09-12T02:46:06.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 -- start start 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f31bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f39120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f41370 0x562007f39660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38010de0 con 0x562007f41370 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3800e6b0 con 0x562007f37b40 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.056+0000 7f4d550a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3800c4a0 con 0x562007f365d0 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d5126a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f41370 0x562007f39660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f39120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f31bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f39120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60168/0 (socket says 172.21.15.100:60168) 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d5126a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f41370 0x562007f39660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42860/0 (socket says 172.21.15.100:42860) 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d4bfff640 1 -- 172.21.15.100:0/3784179173 learned_addr learned my addr 172.21.15.100:0/3784179173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d50a69640 1 -- 172.21.15.100:0/3784179173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 msgr2=0x562007f39120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d50a69640 1 --2- 172.21.15.100:0/3784179173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f39120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d50a69640 1 -- 172.21.15.100:0/3784179173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f41370 msgr2=0x562007f39660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d50a69640 1 --2- 172.21.15.100:0/3784179173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f41370 0x562007f39660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d50a69640 1 -- 172.21.15.100:0/3784179173 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562007f3c4c0 con 0x562007f365d0 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d50a69640 1 --2- 172.21.15.100:0/3784179173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f31bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d44052700 tx=0x7f4d44000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3287ddf6223063 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d327fc640 1 -- 172.21.15.100:0/3784179173 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44066070 con 0x562007f365d0 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d327fc640 1 -- 172.21.15.100:0/3784179173 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d4403d3a0 con 0x562007f365d0 2024-09-12T02:46:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.057+0000 7f4d327fc640 1 -- 172.21.15.100:0/3784179173 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44059050 con 0x562007f365d0 2024-09-12T02:46:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 -- 172.21.15.100:0/3784179173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 msgr2=0x562007f31bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 --2- 172.21.15.100:0/3784179173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f31bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d44052700 tx=0x7f4d44000f40 comp rx=0 tx=0).stop 2024-09-12T02:46:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 -- 172.21.15.100:0/3784179173 shutdown_connections 2024-09-12T02:46:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 --2- 172.21.15.100:0/3784179173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f41370 0x562007f39660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 --2- 172.21.15.100:0/3784179173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f39120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 --2- 172.21.15.100:0/3784179173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f365d0 0x562007f31bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 -- 172.21.15.100:0/3784179173 >> 172.21.15.100:0/3784179173 conn(0x562007eff310 msgr2=0x562007f314e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 -- 172.21.15.100:0/3784179173 shutdown_connections 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.058+0000 7f4d550a6740 1 -- 172.21.15.100:0/3784179173 wait complete. 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 -- start start 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 Processor -- start 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f365d0 0x562007f49510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f49a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3800cb70 con 0x562007f365d0 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3800dfe0 con 0x562007f37b40 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3800d240 con 0x562007f41370 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d550a6740 10 client.0 _ll_register_callbacks cb 0x7f4d44042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f365d0 0x562007f49510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d50a69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f365d0 0x562007f49510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42868/0 (socket says 172.21.15.100:42868) 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d50a69640 1 -- 172.21.15.100:0/4276892828 learned_addr learned my addr 172.21.15.100:0/4276892828 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.059+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f49a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d5126a640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d50a69640 1 -- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 msgr2=0x562007f464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d50a69640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d50a69640 1 -- 172.21.15.100:0/4276892828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 msgr2=0x562007f49a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d50a69640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f49a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d50a69640 1 -- 172.21.15.100:0/4276892828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562007f3be80 con 0x562007f365d0 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f49a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.060+0000 7f4d50a69640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f365d0 0x562007f49510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4d4404b040 tx=0x7f4d4403d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af957c0a3fb1ba2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:06.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.061+0000 7f4d2bfff640 1 -- 172.21.15.100:0/4276892828 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44066030 con 0x562007f365d0 2024-09-12T02:46:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.061+0000 7f4d2bfff640 1 -- 172.21.15.100:0/4276892828 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4d44067070 con 0x562007f365d0 2024-09-12T02:46:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.061+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d4403d3a0 con 0x562007f365d0 2024-09-12T02:46:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.061+0000 7f4d2bfff640 1 -- 172.21.15.100:0/4276892828 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d44066030 con 0x562007f365d0 2024-09-12T02:46:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.061+0000 7f4d550a6740 10 client.16644 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.061+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562007fbc150 con 0x562007f365d0 2024-09-12T02:46:06.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d2bfff640 1 -- 172.21.15.100:0/4276892828 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d4403d3a0 con 0x562007f365d0 2024-09-12T02:46:06.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d2bfff640 1 -- 172.21.15.100:0/4276892828 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d44032070 con 0x562007f365d0 2024-09-12T02:46:06.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d550a6740 10 client.16644 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:06.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d550a6740 10 client.16644 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:46:06.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d550a6740 20 client.16644 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:06.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007fbc800 0x562007fbec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d550a6740 4 client.16644 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.062+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562007ea3d70 con 0x562007fbc800 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.063+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007fbc800 0x562007fbec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.063+0000 7f4d4bfff640 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007fbc800 0x562007fbec20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c3b0c67806c43ae server_cookie=e985e74a06137b10 in_seq=0 out_seq=0 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.063+0000 7f4d2bfff640 10 client.16644 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.063+0000 7f4d2bfff640 1 -- 172.21.15.100:0/4276892828 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562007ea3d70 con 0x562007fbc800 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.063+0000 7f4d2bfff640 10 client.16644 handle_command_reply: tid=0 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.063+0000 7f4d550a6740 1 client.16644 shutdown 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.063+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f365d0 msgr2=0x562007f49510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f365d0 0x562007f49510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4d4404b040 tx=0x7f4d4403d5c0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 shutdown_connections 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x562007fbc800 0x562007fbec20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562007f41370 0x562007f464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562007f37b40 0x562007f49a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d2bfff640 0 client.16644 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 --2- 172.21.15.100:0/4276892828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562007f365d0 0x562007f49510 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 >> 172.21.15.100:0/4276892828 conn(0x562007eff310 msgr2=0x562007f31d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 shutdown_connections 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 1 -- 172.21.15.100:0/4276892828 wait complete. 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.064+0000 7f4d550a6740 20 client.16644 trim_cache size 0 max 16384 2024-09-12T02:46:06.069 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:46:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4d340a2ba0 msgr2=0x7f4d340a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4d340a2ba0 0x7f4d340a5060 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d440099a0 tx=0x7f4d4400d340 comp rx=0 tx=0).stop 2024-09-12T02:46:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c1055b0 msgr2=0x7f4d4c109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c1055b0 0x7f4d4c109010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c01f950 tx=0x7f4d3c01fe10 comp rx=0 tx=0).stop 2024-09-12T02:46:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 shutdown_connections 2024-09-12T02:46:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4d340a2ba0 0x7f4d340a5060 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d4c1055b0 0x7f4d4c109010 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d4c100e30 0x7f4d4c108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 --2- 172.21.15.100:0/318417657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d4c100480 0x7f4d4c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 >> 172.21.15.100:0/318417657 conn(0x7f4d4c077210 msgr2=0x7f4d4c0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 shutdown_connections 2024-09-12T02:46:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:06.065+0000 7f4d52ccd640 1 -- 172.21.15.100:0/318417657 wait complete. 2024-09-12T02:46:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 415.0 s, 2118.2 tps, lat 46.751 ms stddev 52.336 2024-09-12T02:46:06.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:46:07.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:06 smithi189 ceph-mon[35196]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.4 MiB/s wr, 611 op/s 2024-09-12T02:46:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:06 smithi117 ceph-mon[34898]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.4 MiB/s wr, 611 op/s 2024-09-12T02:46:07.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:06 smithi100 ceph-mon[31390]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.4 MiB/s wr, 611 op/s 2024-09-12T02:46:07.131 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:07.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 -- 172.21.15.100:0/2056611306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102570 msgr2=0x7f48801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 --2- 172.21.15.100:0/2056611306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102570 0x7f48801029b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4874009900 tx=0x7f487402a480 comp rx=0 tx=0).stop 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 -- 172.21.15.100:0/2056611306 shutdown_connections 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 --2- 172.21.15.100:0/2056611306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102ef0 0x7f488010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 --2- 172.21.15.100:0/2056611306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102570 0x7f48801029b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 --2- 172.21.15.100:0/2056611306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4880100e20 0x7f4880101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 -- 172.21.15.100:0/2056611306 >> 172.21.15.100:0/2056611306 conn(0x7f48800fc7d0 msgr2=0x7f48800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 -- 172.21.15.100:0/2056611306 shutdown_connections 2024-09-12T02:46:07.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.615+0000 7f48855c1640 1 -- 172.21.15.100:0/2056611306 wait complete. 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 Processor -- start 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 -- start start 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4880100e20 0x7f4880198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102570 0x7f4880198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102ef0 0x7f488019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4880112090 con 0x7f4880102ef0 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4880111f10 con 0x7f4880102570 2024-09-12T02:46:07.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.616+0000 7f48855c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4880112210 con 0x7f4880100e20 2024-09-12T02:46:07.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.617+0000 7f487effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4880100e20 0x7f4880198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.617+0000 7f487f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102ef0 0x7f488019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.617+0000 7f487e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102570 0x7f4880198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.617+0000 7f487e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102570 0x7f4880198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60196/0 (socket says 172.21.15.100:60196) 2024-09-12T02:46:07.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.618+0000 7f487e7fc640 1 -- 172.21.15.100:0/4159127880 learned_addr learned my addr 172.21.15.100:0/4159127880 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:07.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.618+0000 7f487e7fc640 1 -- 172.21.15.100:0/4159127880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4880100e20 msgr2=0x7f4880198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.618+0000 7f487e7fc640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4880100e20 0x7f4880198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.618+0000 7f487e7fc640 1 -- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102ef0 msgr2=0x7f488019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.618+0000 7f487e7fc640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102ef0 0x7f488019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.618+0000 7f487e7fc640 1 -- 172.21.15.100:0/4159127880 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488019d4c0 con 0x7f4880102570 2024-09-12T02:46:07.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.618+0000 7f487e7fc640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102570 0x7f4880198a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4874006010 tx=0x7f4874003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:07.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.619+0000 7f4867fff640 1 -- 172.21.15.100:0/4159127880 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487403f070 con 0x7f4880102570 2024-09-12T02:46:07.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.619+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488019d750 con 0x7f4880102570 2024-09-12T02:46:07.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.619+0000 7f4867fff640 1 -- 172.21.15.100:0/4159127880 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4874031c30 con 0x7f4880102570 2024-09-12T02:46:07.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.619+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48801a5090 con 0x7f4880102570 2024-09-12T02:46:07.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.619+0000 7f4867fff640 1 -- 172.21.15.100:0/4159127880 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487403f070 con 0x7f4880102570 2024-09-12T02:46:07.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.621+0000 7f4867fff640 1 -- 172.21.15.100:0/4159127880 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4874042070 con 0x7f4880102570 2024-09-12T02:46:07.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 Processor -- start 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 -- start start 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2f6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a301370 0x55fc6a303760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fc6a25c2f0 con 0x55fc6a301370 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fc6a203cf0 con 0x55fc6a2f7b40 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f488799a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc6a2582b0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f487effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f487f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f487effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35818/0 (socket says 172.21.15.100:35818) 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f487f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60202/0 (socket says 172.21.15.100:60202) 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f487effd640 1 -- 172.21.15.100:0/3361638739 learned_addr learned my addr 172.21.15.100:0/3361638739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:07.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f487e7fc640 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a301370 0x55fc6a303760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.622+0000 7f4867fff640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48680a2f90 0x7f48680a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f487effd640 1 -- 172.21.15.100:0/3361638739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a2f7b40 msgr2=0x55fc6a2f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f487effd640 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f487effd640 1 -- 172.21.15.100:0/3361638739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a301370 msgr2=0x55fc6a303760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f487effd640 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a301370 0x55fc6a303760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f487effd640 1 -- 172.21.15.100:0/3361638739 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6a1e83a0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f4867fff640 1 -- 172.21.15.100:0/4159127880 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4874003e00 con 0x7f4880102570 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f487effd640 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f6a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4878009f30 tx=0x7f487800f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf31c5193c41d72e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f487f7fe640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48680a2f90 0x7f48680a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f48657fa640 1 -- 172.21.15.100:0/3361638739 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878011640 con 0x55fc6a2f65d0 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f48657fa640 1 -- 172.21.15.100:0/3361638739 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4878011cc0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.623+0000 7f48657fa640 1 -- 172.21.15.100:0/3361638739 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878011640 con 0x55fc6a2f65d0 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.624+0000 7f487f7fe640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48680a2f90 0x7f48680a5450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f48700044c0 tx=0x7f48700046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.624+0000 7f488799a740 1 -- 172.21.15.100:0/3361638739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 msgr2=0x55fc6a2f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.624+0000 7f488799a740 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f6a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4878009f30 tx=0x7f487800f7f0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 -- 172.21.15.100:0/3361638739 shutdown_connections 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a301370 0x55fc6a303760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f6a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 --2- 172.21.15.100:0/3361638739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 -- 172.21.15.100:0/3361638739 >> 172.21.15.100:0/3361638739 conn(0x55fc6a2bf310 msgr2=0x55fc6a2f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 -- 172.21.15.100:0/3361638739 shutdown_connections 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 -- 172.21.15.100:0/3361638739 wait complete. 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 -- start start 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.625+0000 7f488799a740 1 Processor -- start 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f488799a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a300d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f488799a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f488799a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a2fe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f488799a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fc6a304070 con 0x55fc6a2f7b40 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f488799a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fc6a217060 con 0x55fc6a301370 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f488799a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc6a3041f0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f487effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a300d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f487effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a300d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35830/0 (socket says 172.21.15.100:35830) 2024-09-12T02:46:07.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f487effd640 1 -- 172.21.15.100:0/373107391 learned_addr learned my addr 172.21.15.100:0/373107391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:07.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f488799a740 10 client.0 _ll_register_callbacks cb 0x55fc69f6a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:07.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.626+0000 7f487e7fc640 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.627+0000 7f487effd640 1 -- 172.21.15.100:0/373107391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 msgr2=0x55fc6a2fe530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:46:07.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.627+0000 7f487effd640 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a2fe530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.627+0000 7f487effd640 1 -- 172.21.15.100:0/373107391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 msgr2=0x55fc6a2fdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:07.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.627+0000 7f487effd640 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.627+0000 7f487effd640 1 -- 172.21.15.100:0/373107391 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc69fcd3c0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.627+0000 7f487effd640 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a300d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4878006010 tx=0x7f4878010600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=317eab2c2035b4c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.627+0000 7f4862ff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.628+0000 7f4862ff5640 1 -- 172.21.15.100:0/373107391 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878029060 con 0x55fc6a2f65d0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.628+0000 7f4862ff5640 1 -- 172.21.15.100:0/373107391 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4878011440 con 0x55fc6a2f65d0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.628+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4878011cc0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f4862ff5640 1 -- 172.21.15.100:0/373107391 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4878011640 con 0x55fc6a2f65d0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 10 client.26008 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fc6a313eb0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f4862ff5640 1 -- 172.21.15.100:0/373107391 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4878011cc0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f4862ff5640 1 -- 172.21.15.100:0/373107391 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4878003970 con 0x55fc6a2f65d0 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 10 client.26008 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 10 client.26008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 20 client.26008 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a315200 0x55fc6a3175f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 4 client.26008 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.629+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc6a269860 con 0x55fc6a315200 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.630+0000 7f487e7fc640 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a315200 0x55fc6a3175f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.630+0000 7f4862ff5640 10 client.26008 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:07.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.630+0000 7f487e7fc640 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a315200 0x55fc6a3175f0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f331b894bdf0c8e server_cookie=f56d72def36f1f58 in_seq=0 out_seq=0 2024-09-12T02:46:07.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f4862ff5640 1 -- 172.21.15.100:0/373107391 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc6a269860 con 0x55fc6a315200 2024-09-12T02:46:07.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f4862ff5640 10 client.26008 handle_command_reply: tid=0 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 client.26008 shutdown 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 msgr2=0x55fc6a300d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a300d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4878006010 tx=0x7f4878010600 comp rx=0 tx=0).stop 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 shutdown_connections 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a315200 0x55fc6a3175f0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a2fe530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 --2- 172.21.15.100:0/373107391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a300d00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 >> 172.21.15.100:0/373107391 conn(0x55fc6a2bf310 msgr2=0x55fc6a2f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f4862ff5640 0 client.26008 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.631+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 shutdown_connections 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.632+0000 7f488799a740 1 -- 172.21.15.100:0/373107391 wait complete. 2024-09-12T02:46:07.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.632+0000 7f488799a740 20 client.26008 trim_cache size 0 max 16384 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 Processor -- start 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 -- start start 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a31a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48801add50 con 0x55fc6a2f65d0 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48801ab620 con 0x55fc6a301370 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f488799a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48801a9470 con 0x55fc6a2f7b40 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a31a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a31a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60216/0 (socket says 172.21.15.100:60216) 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35846/0 (socket says 172.21.15.100:35846) 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 -- 172.21.15.100:0/1313995061 learned_addr learned my addr 172.21.15.100:0/1313995061 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 -- 172.21.15.100:0/1313995061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f7b40 msgr2=0x55fc6a2fd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 --2- 172.21.15.100:0/1313995061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 -- 172.21.15.100:0/1313995061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f65d0 msgr2=0x55fc6a2f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 --2- 172.21.15.100:0/1313995061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.653+0000 7f487f7fe640 1 -- 172.21.15.100:0/1313995061 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6a2fcf80 con 0x55fc6a301370 2024-09-12T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.654+0000 7f487f7fe640 1 --2- 172.21.15.100:0/1313995061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a31a230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4870003be0 tx=0x7f4870016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21367a737a68e39b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.654+0000 7f4864ff9640 1 -- 172.21.15.100:0/1313995061 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870012ac0 con 0x55fc6a301370 2024-09-12T02:46:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.654+0000 7f4864ff9640 1 -- 172.21.15.100:0/1313995061 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4870025020 con 0x55fc6a301370 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.654+0000 7f4864ff9640 1 -- 172.21.15.100:0/1313995061 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870010400 con 0x55fc6a301370 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 -- 172.21.15.100:0/1313995061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 msgr2=0x55fc6a31a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 --2- 172.21.15.100:0/1313995061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a31a230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4870003be0 tx=0x7f4870016000 comp rx=0 tx=0).stop 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 -- 172.21.15.100:0/1313995061 shutdown_connections 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 --2- 172.21.15.100:0/1313995061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a31a230 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 --2- 172.21.15.100:0/1313995061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f7b40 0x55fc6a2fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 --2- 172.21.15.100:0/1313995061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f65d0 0x55fc6a2f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 -- 172.21.15.100:0/1313995061 >> 172.21.15.100:0/1313995061 conn(0x55fc6a2bf310 msgr2=0x55fc6a2f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 -- 172.21.15.100:0/1313995061 shutdown_connections 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 -- 172.21.15.100:0/1313995061 wait complete. 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.655+0000 7f488799a740 1 -- start start 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 1 Processor -- start 2024-09-12T02:46:07.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a31a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a317c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a318170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48801a9ae0 con 0x55fc6a2f7b40 2024-09-12T02:46:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48801aaf50 con 0x55fc6a301370 2024-09-12T02:46:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48801aa1b0 con 0x55fc6a2f65d0 2024-09-12T02:46:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f488799a740 10 client.0 _ll_register_callbacks cb 0x7f4878015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f487e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a317c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f487e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a317c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42930/0 (socket says 172.21.15.100:42930) 2024-09-12T02:46:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.656+0000 7f487e7fc640 1 -- 172.21.15.100:0/3546699659 learned_addr learned my addr 172.21.15.100:0/3546699659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487f7fe640 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a318170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487e7fc640 1 -- 172.21.15.100:0/3546699659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 msgr2=0x55fc6a31a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487e7fc640 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a31a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487e7fc640 1 -- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 msgr2=0x55fc6a318170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487e7fc640 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a318170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487e7fc640 1 -- 172.21.15.100:0/3546699659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6a2fe8a0 con 0x55fc6a2f7b40 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487f7fe640 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a318170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f487e7fc640 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a317c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f48740c47f0 tx=0x7f48740f29e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dc84386968e2f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.657+0000 7f4862ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.658+0000 7f4862ff5640 1 -- 172.21.15.100:0/3546699659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487403f040 con 0x55fc6a2f7b40 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.658+0000 7f4862ff5640 1 -- 172.21.15.100:0/3546699659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f487403b460 con 0x55fc6a2f7b40 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.658+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4870025020 con 0x55fc6a2f7b40 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.658+0000 7f4862ff5640 1 -- 172.21.15.100:0/3546699659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f48740c4630 con 0x55fc6a2f7b40 2024-09-12T02:46:07.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.658+0000 7f488799a740 10 client.16659 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:07.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.658+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fc6a313490 con 0x55fc6a2f7b40 2024-09-12T02:46:07.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f4862ff5640 1 -- 172.21.15.100:0/3546699659 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4870025020 con 0x55fc6a2f7b40 2024-09-12T02:46:07.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f4862ff5640 1 -- 172.21.15.100:0/3546699659 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f48740f10b0 con 0x55fc6a2f7b40 2024-09-12T02:46:07.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f488799a740 10 client.16659 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:07.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f488799a740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f488799a740 20 client.16659 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f488799a740 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a3843e0 0x55fc6a3867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f488799a740 4 client.16659 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc6a263d70 con 0x55fc6a3843e0 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.659+0000 7f487effd640 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a3843e0 0x55fc6a3867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f4862ff5640 10 client.16659 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f487effd640 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a3843e0 0x55fc6a3867f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee8d171ca7a00a91 server_cookie=1dc1adc1b5e6e041 in_seq=0 out_seq=0 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f4862ff5640 1 -- 172.21.15.100:0/3546699659 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc6a263d70 con 0x55fc6a3843e0 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f4862ff5640 10 client.16659 handle_command_reply: tid=0 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 client.16659 shutdown 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 msgr2=0x55fc6a317c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a317c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f48740c47f0 tx=0x7f48740f29e0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 shutdown_connections 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fc6a3843e0 0x55fc6a3867f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fc6a301370 0x55fc6a318170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc6a2f7b40 0x55fc6a317c30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f4862ff5640 0 client.16659 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 --2- 172.21.15.100:0/3546699659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc6a2f65d0 0x55fc6a31a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.660+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 >> 172.21.15.100:0/3546699659 conn(0x55fc6a2bf310 msgr2=0x55fc6a2f14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 shutdown_connections 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f488799a740 1 -- 172.21.15.100:0/3546699659 wait complete. 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f488799a740 20 client.16659 trim_cache size 0 max 16384 2024-09-12T02:46:07.664 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:46:07.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48680a2f90 msgr2=0x7f48680a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48680a2f90 0x7f48680a5450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f48700044c0 tx=0x7f48700046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102570 msgr2=0x7f4880198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102570 0x7f4880198a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4874006010 tx=0x7f4874003c10 comp rx=0 tx=0).stop 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 shutdown_connections 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48680a2f90 0x7f48680a5450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4880102ef0 0x7f488019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4880102570 0x7f4880198a50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 --2- 172.21.15.100:0/4159127880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4880100e20 0x7f4880198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.661+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 >> 172.21.15.100:0/4159127880 conn(0x7f48800fc7d0 msgr2=0x7f48800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.662+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 shutdown_connections 2024-09-12T02:46:07.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:07.662+0000 7f48855c1640 1 -- 172.21.15.100:0/4159127880 wait complete. 2024-09-12T02:46:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:08 smithi117 ceph-mon[34898]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-09-12T02:46:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:08 smithi100 ceph-mon[31390]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-09-12T02:46:09.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:08 smithi189 ceph-mon[35196]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-09-12T02:46:09.365 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:46:09.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:46:09.733 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:10.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.234+0000 7fe385518640 1 -- 172.21.15.100:0/3559189141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe380100860 msgr2=0x7fe3801045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.234+0000 7fe385518640 1 --2- 172.21.15.100:0/3559189141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe380100860 0x7fe3801045a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe37801acb0 tx=0x7fe37803b900 comp rx=0 tx=0).stop 2024-09-12T02:46:10.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.235+0000 7fe385518640 1 -- 172.21.15.100:0/3559189141 shutdown_connections 2024-09-12T02:46:10.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.235+0000 7fe385518640 1 --2- 172.21.15.100:0/3559189141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe380100860 0x7fe3801045a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.235+0000 7fe385518640 1 --2- 172.21.15.100:0/3559189141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380107440 0x7fe380100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.235+0000 7fe385518640 1 --2- 172.21.15.100:0/3559189141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe380106a90 0x7fe380106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.235+0000 7fe385518640 1 -- 172.21.15.100:0/3559189141 >> 172.21.15.100:0/3559189141 conn(0x7fe380077230 msgr2=0x7fe3800fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.236+0000 7fe385518640 1 -- 172.21.15.100:0/3559189141 shutdown_connections 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.236+0000 7fe385518640 1 -- 172.21.15.100:0/3559189141 wait complete. 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 Processor -- start 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 -- start start 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe380100860 0x7fe3801962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380106a90 0x7fe380196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38019ab90 0x7fe38019b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe380109df0 con 0x7fe38019ab90 2024-09-12T02:46:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe380109c70 con 0x7fe380106a90 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe385518640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe380109f70 con 0x7fe380100860 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380106a90 0x7fe380196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380106a90 0x7fe380196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60224/0 (socket says 172.21.15.100:60224) 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe37e7fc640 1 -- 172.21.15.100:0/1322736666 learned_addr learned my addr 172.21.15.100:0/1322736666 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.237+0000 7fe37f7fe640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38019ab90 0x7fe38019b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.238+0000 7fe37e7fc640 1 -- 172.21.15.100:0/1322736666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe380100860 msgr2=0x7fe3801962c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.238+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe380100860 0x7fe3801962c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.238+0000 7fe37e7fc640 1 -- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38019ab90 msgr2=0x7fe38019b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.238+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38019ab90 0x7fe38019b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.238+0000 7fe37e7fc640 1 -- 172.21.15.100:0/1322736666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38019b650 con 0x7fe380106a90 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.238+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380106a90 0x7fe380196800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b470 tx=0x7fe37000b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.239+0000 7fe367fff640 1 -- 172.21.15.100:0/1322736666 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370015020 con 0x7fe380106a90 2024-09-12T02:46:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.239+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38019b940 con 0x7fe380106a90 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.239+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3801a3120 con 0x7fe380106a90 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.239+0000 7fe367fff640 1 -- 172.21.15.100:0/1322736666 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe370011d70 con 0x7fe380106a90 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.239+0000 7fe367fff640 1 -- 172.21.15.100:0/1322736666 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37000f340 con 0x7fe380106a90 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 Processor -- start 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 -- start start 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe367fff640 1 -- 172.21.15.100:0/1322736666 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe370018020 con 0x7fe380106a90 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e02f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e0d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563746d68280 con 0x563746e0dd40 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563746d0fb10 con 0x563746e03480 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.243+0000 7fe3878f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563746d64240 con 0x563746e02b60 2024-09-12T02:46:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e10130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42970/0 (socket says 172.21.15.100:42970) 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37e7fc640 1 -- 172.21.15.100:0/1339040961 learned_addr learned my addr 172.21.15.100:0/1339040961 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37effd640 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e0d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37f7fe640 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e02f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37effd640 1 -- 172.21.15.100:0/1339040961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 msgr2=0x563746e02f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37effd640 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e02f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37effd640 1 -- 172.21.15.100:0/1339040961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 msgr2=0x563746e10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37effd640 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe367fff640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe3680a2cd0 0x7fe3680a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37effd640 1 -- 172.21.15.100:0/1339040961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563746d1c1f0 con 0x563746e03480 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37f7fe640 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e02f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe367fff640 1 -- 172.21.15.100:0/1322736666 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe3700ce970 con 0x7fe380106a90 2024-09-12T02:46:10.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37f7fe640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe3680a2cd0 0x7fe3680a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe37effd640 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e0d800 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe374009ad0 tx=0x7fe374009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54cbb46b40368727 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.244+0000 7fe3657fa640 1 -- 172.21.15.100:0/1339040961 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37400ed10 con 0x563746e03480 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3657fa640 1 -- 172.21.15.100:0/1339040961 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe374005020 con 0x563746e03480 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3657fa640 1 -- 172.21.15.100:0/1339040961 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374004b60 con 0x563746e03480 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3878f1740 1 -- 172.21.15.100:0/1339040961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 msgr2=0x563746e0d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe37f7fe640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe3680a2cd0 0x7fe3680a5190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe378006010 tx=0x7fe378005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3878f1740 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e0d800 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe374009ad0 tx=0x7fe374009f90 comp rx=0 tx=0).stop 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3878f1740 1 -- 172.21.15.100:0/1339040961 shutdown_connections 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3878f1740 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3878f1740 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e0d800 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3878f1740 1 --2- 172.21.15.100:0/1339040961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e02f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.245+0000 7fe3878f1740 1 -- 172.21.15.100:0/1339040961 >> 172.21.15.100:0/1339040961 conn(0x563746dff0f0 msgr2=0x563746dff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 -- 172.21.15.100:0/1339040961 shutdown_connections 2024-09-12T02:46:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 -- 172.21.15.100:0/1339040961 wait complete. 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 -- start start 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 Processor -- start 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e02b60 0x563746e0abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e03480 0x563746e0b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 0x563746e0b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563746e10910 con 0x563746e03480 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563746d22f10 con 0x563746e02b60 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563746e10a90 con 0x563746e0dd40 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.246+0000 7fe3878f1740 10 client.0 _ll_register_callbacks cb 0x563746ceba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e02b60 0x563746e0abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e02b60 0x563746e0abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60246/0 (socket says 172.21.15.100:60246) 2024-09-12T02:46:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 -- 172.21.15.100:0/2675837332 learned_addr learned my addr 172.21.15.100:0/2675837332 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 -- 172.21.15.100:0/2675837332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 msgr2=0x563746e0b660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 0x563746e0b660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 -- 172.21.15.100:0/2675837332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e03480 msgr2=0x563746e0b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e03480 0x563746e0b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.247+0000 7fe37effd640 1 -- 172.21.15.100:0/2675837332 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563746ad96a0 con 0x563746e02b60 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe37effd640 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e02b60 0x563746e0abe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe37400e7e0 tx=0x7fe374005400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3f8f668ec11bb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe362ff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe362ff5640 1 -- 172.21.15.100:0/2675837332 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374004440 con 0x563746e02b60 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe362ff5640 1 -- 172.21.15.100:0/2675837332 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe3740048a0 con 0x563746e02b60 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe374005020 con 0x563746e02b60 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe362ff5640 1 -- 172.21.15.100:0/2675837332 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe37402c050 con 0x563746e02b60 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe3878f1740 10 client.26048 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563746e1c4e0 con 0x563746e02b60 2024-09-12T02:46:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.248+0000 7fe362ff5640 1 -- 172.21.15.100:0/2675837332 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe374005020 con 0x563746e02b60 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe362ff5640 1 -- 172.21.15.100:0/2675837332 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe374023070 con 0x563746e02b60 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe3878f1740 10 client.26048 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe3878f1740 10 client.26048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe3878f1740 20 client.26048 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe3878f1740 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e20300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe3878f1740 4 client.26048 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563746d757f0 con 0x563746e1de40 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.249+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e20300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.250+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e20300 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6551c9f4243b36b server_cookie=56706d43046a3da1 in_seq=0 out_seq=0 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.250+0000 7fe362ff5640 10 client.26048 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe362ff5640 1 -- 172.21.15.100:0/2675837332 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563746d757f0 con 0x563746e1de40 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe362ff5640 10 client.26048 handle_command_reply: tid=0 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 client.26048 shutdown 2024-09-12T02:46:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e02b60 msgr2=0x563746e0abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e02b60 0x563746e0abe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe37400e7e0 tx=0x7fe374005400 comp rx=0 tx=0).stop 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 shutdown_connections 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e20300 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 0x563746e0b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e03480 0x563746e0b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe362ff5640 0 client.26048 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.251+0000 7fe3878f1740 1 --2- 172.21.15.100:0/2675837332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e02b60 0x563746e0abe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.252+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 >> 172.21.15.100:0/2675837332 conn(0x563746dff0f0 msgr2=0x563746e04dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.252+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 shutdown_connections 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.252+0000 7fe3878f1740 1 -- 172.21.15.100:0/2675837332 wait complete. 2024-09-12T02:46:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.252+0000 7fe3878f1740 20 client.26048 trim_cache size 0 max 16384 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 Processor -- start 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 -- start start 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e02b60 0x563746e25c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e26150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 0x563746e045b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c010e00 con 0x563746e02b60 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c00e6d0 con 0x563746e03480 2024-09-12T02:46:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe3878f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c00c520 con 0x563746e0dd40 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e26150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.275+0000 7fe37effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e02b60 0x563746e25c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e26150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60250/0 (socket says 172.21.15.100:60250) 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 -- 172.21.15.100:0/162563556 learned_addr learned my addr 172.21.15.100:0/162563556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37f7fe640 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 0x563746e045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 -- 172.21.15.100:0/162563556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 msgr2=0x563746e045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 0x563746e045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 -- 172.21.15.100:0/162563556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e02b60 msgr2=0x563746e25c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e02b60 0x563746e25c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 -- 172.21.15.100:0/162563556 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563746e09130 con 0x563746e03480 2024-09-12T02:46:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37effd640 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e02b60 0x563746e25c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e26150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe370097620 tx=0x7fe3700bb040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab0b232a243f8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.276+0000 7fe364ff9640 1 -- 172.21.15.100:0/162563556 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3700af070 con 0x563746e03480 2024-09-12T02:46:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe364ff9640 1 -- 172.21.15.100:0/162563556 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe37009f570 con 0x563746e03480 2024-09-12T02:46:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe364ff9640 1 -- 172.21.15.100:0/162563556 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370097830 con 0x563746e03480 2024-09-12T02:46:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 -- 172.21.15.100:0/162563556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 msgr2=0x563746e26150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e26150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe370097620 tx=0x7fe3700bb040 comp rx=0 tx=0).stop 2024-09-12T02:46:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 -- 172.21.15.100:0/162563556 shutdown_connections 2024-09-12T02:46:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e0dd40 0x563746e045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e26150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 --2- 172.21.15.100:0/162563556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e02b60 0x563746e25c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 -- 172.21.15.100:0/162563556 >> 172.21.15.100:0/162563556 conn(0x563746dff0f0 msgr2=0x563746e09cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 -- 172.21.15.100:0/162563556 shutdown_connections 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.277+0000 7fe3878f1740 1 -- 172.21.15.100:0/162563556 wait complete. 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 -- start start 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 Processor -- start 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e16050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e16590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e114d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c00cb90 con 0x563746e0dd40 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c00e000 con 0x563746e03480 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c00d260 con 0x563746e02b60 2024-09-12T02:46:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.278+0000 7fe3878f1740 10 client.0 _ll_register_callbacks cb 0x7fe3740099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e16590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e16590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60252/0 (socket says 172.21.15.100:60252) 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 -- 172.21.15.100:0/3333962161 learned_addr learned my addr 172.21.15.100:0/3333962161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37f7fe640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e114d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37effd640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e16050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 -- 172.21.15.100:0/3333962161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 msgr2=0x563746e16050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e16050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 -- 172.21.15.100:0/3333962161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 msgr2=0x563746e114d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e114d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 -- 172.21.15.100:0/3333962161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563746e11d00 con 0x563746e03480 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37effd640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e16050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe37e7fc640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e16590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe370006fd0 tx=0x7fe37009ad00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc5ee06c0047f839 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe362ff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.279+0000 7fe362ff5640 1 -- 172.21.15.100:0/3333962161 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3700af050 con 0x563746e03480 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe362ff5640 1 -- 172.21.15.100:0/3333962161 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe370097830 con 0x563746e03480 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe37009f570 con 0x563746e03480 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe362ff5640 1 -- 172.21.15.100:0/3333962161 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe3700cc570 con 0x563746e03480 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 10 client.26054 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563746e887a0 con 0x563746e03480 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe362ff5640 1 -- 172.21.15.100:0/3333962161 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe37009f570 con 0x563746e03480 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe362ff5640 1 -- 172.21.15.100:0/3333962161 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe3700af1f0 con 0x563746e03480 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 10 client.26054 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 10 client.26054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 20 client.26054 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e8add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 4 client.26054 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563746d6fd00 con 0x563746e1de40 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.280+0000 7fe37effd640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e8add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.281+0000 7fe362ff5640 10 client.26054 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.281+0000 7fe37effd640 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e8add0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=595ca42abccad7b1 server_cookie=c5a56e6cc956073 in_seq=0 out_seq=0 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe362ff5640 1 -- 172.21.15.100:0/3333962161 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563746d6fd00 con 0x563746e1de40 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe362ff5640 10 client.26054 handle_command_reply: tid=0 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 client.26054 shutdown 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 msgr2=0x563746e16590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e16590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe370006fd0 tx=0x7fe37009ad00 comp rx=0 tx=0).stop 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 shutdown_connections 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x563746e1de40 0x563746e8add0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563746e0dd40 0x563746e114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe362ff5640 0 client.26054 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563746e03480 0x563746e16590 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 --2- 172.21.15.100:0/3333962161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563746e02b60 0x563746e16050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 >> 172.21.15.100:0/3333962161 conn(0x563746dff0f0 msgr2=0x563746dfda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 shutdown_connections 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 1 -- 172.21.15.100:0/3333962161 wait complete. 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.282+0000 7fe3878f1740 20 client.26054 trim_cache size 0 max 16384 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:46:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "66e08f40-c91a-42a5-aaad-220e5b5a9f94", 2024-09-12T02:46:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:46:10.289 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe3680a2cd0 msgr2=0x7fe3680a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe3680a2cd0 0x7fe3680a5190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe378006010 tx=0x7fe378005d80 comp rx=0 tx=0).stop 2024-09-12T02:46:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380106a90 msgr2=0x7fe380196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380106a90 0x7fe380196800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b470 tx=0x7fe37000b930 comp rx=0 tx=0).stop 2024-09-12T02:46:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 shutdown_connections 2024-09-12T02:46:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe3680a2cd0 0x7fe3680a5190 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38019ab90 0x7fe38019b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380106a90 0x7fe380196800 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 --2- 172.21.15.100:0/1322736666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe380100860 0x7fe3801962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.283+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 >> 172.21.15.100:0/1322736666 conn(0x7fe380077230 msgr2=0x7fe380102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.284+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 shutdown_connections 2024-09-12T02:46:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:10.284+0000 7fe385518640 1 -- 172.21.15.100:0/1322736666 wait complete. 2024-09-12T02:46:10.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:46:11.024 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:10 smithi100 ceph-mon[31390]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.0 MiB/s wr, 771 op/s 2024-09-12T02:46:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:10 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:46:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:10 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:10 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:46:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:10 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:46:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:10 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:10 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:10 smithi117 ceph-mon[34898]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.0 MiB/s wr, 771 op/s 2024-09-12T02:46:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:10 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:46:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:10 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:10 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:46:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:10 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:46:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:10 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:10 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:10 smithi189 ceph-mon[35196]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.0 MiB/s wr, 771 op/s 2024-09-12T02:46:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:10 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:46:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:10 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:10 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:46:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:10 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:46:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:10 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:10 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 420.0 s, 2714.2 tps, lat 36.858 ms stddev 42.639 2024-09-12T02:46:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.760+0000 7ff83a362640 1 -- 172.21.15.100:0/325758934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff834109830 msgr2=0x7ff834109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.760+0000 7ff83a362640 1 --2- 172.21.15.100:0/325758934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff834109830 0x7ff834109c90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009ca0 tx=0x7ff82c02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.761+0000 7ff83a362640 1 -- 172.21.15.100:0/325758934 shutdown_connections 2024-09-12T02:46:12.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.761+0000 7ff83a362640 1 --2- 172.21.15.100:0/325758934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83411b140 0x7ff83411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.761+0000 7ff83a362640 1 --2- 172.21.15.100:0/325758934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff834109830 0x7ff834109c90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.761+0000 7ff83a362640 1 --2- 172.21.15.100:0/325758934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834109450 0x7ff834110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.761+0000 7ff83a362640 1 -- 172.21.15.100:0/325758934 >> 172.21.15.100:0/325758934 conn(0x7ff83406e140 msgr2=0x7ff83406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.764+0000 7ff83a362640 1 -- 172.21.15.100:0/325758934 shutdown_connections 2024-09-12T02:46:12.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.767+0000 7ff83a362640 1 -- 172.21.15.100:0/325758934 wait complete. 2024-09-12T02:46:12.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.768+0000 7ff83a362640 1 Processor -- start 2024-09-12T02:46:12.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.769+0000 7ff83a362640 1 -- start start 2024-09-12T02:46:12.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff83a362640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834109450 0x7ff83411a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff83a362640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff834109830 0x7ff83411ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff83a362640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff83411b140 0x7ff8341147c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff83a362640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff834111080 con 0x7ff83411b140 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff83a362640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff834110f00 con 0x7ff834109830 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff83a362640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff834111200 con 0x7ff834109450 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff834109830 0x7ff83411ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff834109830 0x7ff83411ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60268/0 (socket says 172.21.15.100:60268) 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff8337fe640 1 -- 172.21.15.100:0/3708548238 learned_addr learned my addr 172.21.15.100:0/3708548238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff833fff640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834109450 0x7ff83411a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.770+0000 7ff8388ff640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff83411b140 0x7ff8341147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.771+0000 7ff8337fe640 1 -- 172.21.15.100:0/3708548238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834109450 msgr2=0x7ff83411a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.771+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834109450 0x7ff83411a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.771+0000 7ff8337fe640 1 -- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff83411b140 msgr2=0x7ff8341147c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.771+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff83411b140 0x7ff8341147c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.771+0000 7ff8337fe640 1 -- 172.21.15.100:0/3708548238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff834115080 con 0x7ff834109830 2024-09-12T02:46:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.772+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff834109830 0x7ff83411ab60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff82c006010 tx=0x7ff82c003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.773+0000 7ff8317fa640 1 -- 172.21.15.100:0/3708548238 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c031780 con 0x7ff834109830 2024-09-12T02:46:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.773+0000 7ff8317fa640 1 -- 172.21.15.100:0/3708548238 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff82c02d070 con 0x7ff834109830 2024-09-12T02:46:12.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.773+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff834115310 con 0x7ff834109830 2024-09-12T02:46:12.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.773+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83407a620 con 0x7ff834109830 2024-09-12T02:46:12.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.773+0000 7ff8317fa640 1 -- 172.21.15.100:0/3708548238 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c02fac0 con 0x7ff834109830 2024-09-12T02:46:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.777+0000 7ff83c73b740 1 Processor -- start 2024-09-12T02:46:12.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.780+0000 7ff8317fa640 1 -- 172.21.15.100:0/3708548238 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff82c02fd60 con 0x7ff834109830 2024-09-12T02:46:12.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.781+0000 7ff8317fa640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff81c0a2d90 0x7ff81c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.781+0000 7ff8317fa640 1 -- 172.21.15.100:0/3708548238 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff82c0f0440 con 0x7ff834109830 2024-09-12T02:46:12.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.782+0000 7ff8388ff640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff81c0a2d90 0x7ff81c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.782+0000 7ff83c73b740 1 -- start start 2024-09-12T02:46:12.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.782+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd534a0 0x55da8cd53880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.782+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd53dc0 0x55da8cd5e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff83c73b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55da8ccb92e0 con 0x55da8cd53dc0 2024-09-12T02:46:12.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff83c73b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55da8cc60ce0 con 0x55da8cd5e680 2024-09-12T02:46:12.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff83c73b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55da8ccb52a0 con 0x55da8cd534a0 2024-09-12T02:46:12.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd53dc0 0x55da8cd5e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd53dc0 0x55da8cd5e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43040/0 (socket says 172.21.15.100:43040) 2024-09-12T02:46:12.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff8337fe640 1 -- 172.21.15.100:0/4194147515 learned_addr learned my addr 172.21.15.100:0/4194147515 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:12.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.783+0000 7ff833fff640 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd534a0 0x55da8cd53880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff8388ff640 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff833fff640 1 -- 172.21.15.100:0/4194147515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 msgr2=0x55da8cd60a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff833fff640 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd60a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff833fff640 1 -- 172.21.15.100:0/4194147515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd53dc0 msgr2=0x55da8cd5e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff833fff640 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd53dc0 0x55da8cd5e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff833fff640 1 -- 172.21.15.100:0/4194147515 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da8cc45440 con 0x55da8cd534a0 2024-09-12T02:46:12.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff833fff640 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd534a0 0x55da8cd53880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8240099a0 tx=0x7ff824009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404c115302dbc38b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.784+0000 7ff81a7fc640 1 -- 172.21.15.100:0/4194147515 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824017070 con 0x55da8cd534a0 2024-09-12T02:46:12.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.785+0000 7ff81a7fc640 1 -- 172.21.15.100:0/4194147515 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff824013470 con 0x55da8cd534a0 2024-09-12T02:46:12.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.785+0000 7ff81a7fc640 1 -- 172.21.15.100:0/4194147515 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824012630 con 0x55da8cd534a0 2024-09-12T02:46:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.786+0000 7ff83c73b740 1 -- 172.21.15.100:0/4194147515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd534a0 msgr2=0x55da8cd53880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.786+0000 7ff83c73b740 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd534a0 0x55da8cd53880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8240099a0 tx=0x7ff824009e60 comp rx=0 tx=0).stop 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff8388ff640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff81c0a2d90 0x7ff81c0a5250 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d90 tx=0x7ff8280156d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff83c73b740 1 -- 172.21.15.100:0/4194147515 shutdown_connections 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff83c73b740 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd60a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff83c73b740 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd53dc0 0x55da8cd5e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff83c73b740 1 --2- 172.21.15.100:0/4194147515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd534a0 0x55da8cd53880 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff83c73b740 1 -- 172.21.15.100:0/4194147515 >> 172.21.15.100:0/4194147515 conn(0x55da8cd4fa30 msgr2=0x55da8cd4fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff83c73b740 1 -- 172.21.15.100:0/4194147515 shutdown_connections 2024-09-12T02:46:12.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.787+0000 7ff83c73b740 1 -- 172.21.15.100:0/4194147515 wait complete. 2024-09-12T02:46:12.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.788+0000 7ff83c73b740 1 -- start start 2024-09-12T02:46:12.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.788+0000 7ff83c73b740 1 Processor -- start 2024-09-12T02:46:12.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd53dc0 0x55da8cd5b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd5b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff83c73b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55da8cd612f0 con 0x55da8cd534a0 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff83c73b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55da8cc74050 con 0x55da8cd5e680 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff83c73b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55da8cd61470 con 0x55da8cd53dc0 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff83c73b740 10 client.0 _ll_register_callbacks cb 0x55da8ccb4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff8388ff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd5b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff8388ff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd5b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60284/0 (socket says 172.21.15.100:60284) 2024-09-12T02:46:12.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff8388ff640 1 -- 172.21.15.100:0/2824773802 learned_addr learned my addr 172.21.15.100:0/2824773802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:12.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.789+0000 7ff833fff640 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.790+0000 7ff8388ff640 1 -- 172.21.15.100:0/2824773802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd53dc0 msgr2=0x55da8cd5b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.790+0000 7ff8388ff640 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd53dc0 0x55da8cd5b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.790+0000 7ff8388ff640 1 -- 172.21.15.100:0/2824773802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 msgr2=0x55da8cd5ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.790+0000 7ff8388ff640 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.790+0000 7ff8388ff640 1 -- 172.21.15.100:0/2824773802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da8ca2a3c0 con 0x55da8cd5e680 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.790+0000 7ff8388ff640 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd5b5f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff828018780 tx=0x7ff8280047a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2931887a41288ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.790+0000 7ff8137fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff8137fe640 1 -- 172.21.15.100:0/2824773802 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828029060 con 0x55da8cd5e680 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff8137fe640 1 -- 172.21.15.100:0/2824773802 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff828017960 con 0x55da8cd5e680 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff824013470 con 0x55da8cd5e680 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff8137fe640 1 -- 172.21.15.100:0/2824773802 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff828017b60 con 0x55da8cd5e680 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 10 client.26063 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55da8cd6cba0 con 0x55da8cd5e680 2024-09-12T02:46:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff8137fe640 1 -- 172.21.15.100:0/2824773802 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff824013470 con 0x55da8cd5e680 2024-09-12T02:46:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff8137fe640 1 -- 172.21.15.100:0/2824773802 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff82802f3f0 con 0x55da8cd5e680 2024-09-12T02:46:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 10 client.26063 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 10 client.26063 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 20 client.26063 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cd6e500 0x55da8cd709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 4 client.26063 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:12.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.791+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da8ccc6850 con 0x55da8cd6e500 2024-09-12T02:46:12.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.792+0000 7ff833fff640 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cd6e500 0x55da8cd709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.792+0000 7ff8137fe640 10 client.26063 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:12.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.793+0000 7ff833fff640 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cd6e500 0x55da8cd709c0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=444201a701ee3be3 server_cookie=f36d58cb520f9928 in_seq=0 out_seq=0 2024-09-12T02:46:12.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff8137fe640 1 -- 172.21.15.100:0/2824773802 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da8ccc6850 con 0x55da8cd6e500 2024-09-12T02:46:12.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff8137fe640 10 client.26063 handle_command_reply: tid=0 2024-09-12T02:46:12.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 client.26063 shutdown 2024-09-12T02:46:12.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 msgr2=0x55da8cd5b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd5b5f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff828018780 tx=0x7ff8280047a0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 shutdown_connections 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cd6e500 0x55da8cd709c0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd5e680 0x55da8cd5b5f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd53dc0 0x55da8cd5b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 --2- 172.21.15.100:0/2824773802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 >> 172.21.15.100:0/2824773802 conn(0x55da8cd4fa30 msgr2=0x55da8cd55710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.794+0000 7ff8137fe640 0 client.26063 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.795+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 shutdown_connections 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.795+0000 7ff83c73b740 1 -- 172.21.15.100:0/2824773802 wait complete. 2024-09-12T02:46:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.795+0000 7ff83c73b740 20 client.26063 trim_cache size 0 max 16384 2024-09-12T02:46:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.820+0000 7ff83c73b740 1 Processor -- start 2024-09-12T02:46:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.820+0000 7ff83c73b740 1 -- start start 2024-09-12T02:46:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.820+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff833fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd560e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff833fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43056/0 (socket says 172.21.15.100:43056) 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff833fff640 1 -- 172.21.15.100:0/3695894802 learned_addr learned my addr 172.21.15.100:0/3695894802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd56620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff820010d40 con 0x55da8cd534a0 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff82000e610 con 0x55da8cd53dc0 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff82000c460 con 0x55da8cd5e680 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff8388ff640 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd56620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff8337fe640 1 -- 172.21.15.100:0/3695894802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 msgr2=0x55da8cd56620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd56620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.821+0000 7ff8337fe640 1 -- 172.21.15.100:0/3695894802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 msgr2=0x55da8cd5a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.822+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.822+0000 7ff8337fe640 1 -- 172.21.15.100:0/3695894802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da8cd4f860 con 0x55da8cd53dc0 2024-09-12T02:46:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.822+0000 7ff833fff640 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.822+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd560e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0b9600 tx=0x7ff82c0bc770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83b9646271f7bea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.822+0000 7ff819ffb640 1 -- 172.21.15.100:0/3695894802 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0d5030 con 0x55da8cd53dc0 2024-09-12T02:46:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.822+0000 7ff819ffb640 1 -- 172.21.15.100:0/3695894802 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff82c036040 con 0x55da8cd53dc0 2024-09-12T02:46:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.822+0000 7ff819ffb640 1 -- 172.21.15.100:0/3695894802 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0bafc0 con 0x55da8cd53dc0 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 msgr2=0x55da8cd560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd560e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0b9600 tx=0x7ff82c0bc770 comp rx=0 tx=0).stop 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 shutdown_connections 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd56620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd560e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3695894802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 >> 172.21.15.100:0/3695894802 conn(0x55da8cd4fa30 msgr2=0x55da8cd59980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 shutdown_connections 2024-09-12T02:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.823+0000 7ff83c73b740 1 -- 172.21.15.100:0/3695894802 wait complete. 2024-09-12T02:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.824+0000 7ff83c73b740 1 -- start start 2024-09-12T02:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.824+0000 7ff83c73b740 1 Processor -- start 2024-09-12T02:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd5f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff83c73b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff83c73b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff82000cad0 con 0x55da8cd534a0 2024-09-12T02:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff83c73b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff82000df40 con 0x55da8cd53dc0 2024-09-12T02:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff83c73b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff82000d1a0 con 0x55da8cd5e680 2024-09-12T02:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd5f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd5f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:60292/0 (socket says 172.21.15.100:60292) 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 -- 172.21.15.100:0/3477454541 learned_addr learned my addr 172.21.15.100:0/3477454541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8388ff640 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff833fff640 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff83c73b740 10 client.0 _ll_register_callbacks cb 0x7ff828018480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 -- 172.21.15.100:0/3477454541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 msgr2=0x55da8cd657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 -- 172.21.15.100:0/3477454541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 msgr2=0x55da8cd5f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.825+0000 7ff8337fe640 1 -- 172.21.15.100:0/3477454541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da8cd65ce0 con 0x55da8cd53dc0 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.826+0000 7ff8337fe640 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd5f720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0bcbc0 tx=0x7ff82c0c0fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2790e77b9657c815 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.826+0000 7ff8137fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.826+0000 7ff8137fe640 1 -- 172.21.15.100:0/3477454541 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0d5050 con 0x55da8cd53dc0 2024-09-12T02:46:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.826+0000 7ff8137fe640 1 -- 172.21.15.100:0/3477454541 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff82c031920 con 0x55da8cd53dc0 2024-09-12T02:46:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.826+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff82c036040 con 0x55da8cd53dc0 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff8137fe640 1 -- 172.21.15.100:0/3477454541 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff82c0bd330 con 0x55da8cd53dc0 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 10 client.26069 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55da8cd66fa0 con 0x55da8cd53dc0 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff8137fe640 1 -- 172.21.15.100:0/3477454541 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff82c036040 con 0x55da8cd53dc0 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff8137fe640 1 -- 172.21.15.100:0/3477454541 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff82c0c5510 con 0x55da8cd53dc0 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 10 client.26069 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 10 client.26069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 20 client.26069 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cdd92a0 0x55da8cddb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 4 client.26069 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.828+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da8ccc0d60 con 0x55da8cdd92a0 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.829+0000 7ff833fff640 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cdd92a0 0x55da8cddb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.829+0000 7ff8137fe640 10 client.26069 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.829+0000 7ff833fff640 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cdd92a0 0x55da8cddb690 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfe0a5ac0bba4d70 server_cookie=a4b306ceb83e5952 in_seq=0 out_seq=0 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff8137fe640 1 -- 172.21.15.100:0/3477454541 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55da8ccc0d60 con 0x55da8cdd92a0 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff8137fe640 10 client.26069 handle_command_reply: tid=0 2024-09-12T02:46:12.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 client.26069 shutdown 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 msgr2=0x55da8cd5f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd5f720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0bcbc0 tx=0x7ff82c0c0fe0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 shutdown_connections 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55da8cdd92a0 0x55da8cddb690 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55da8cd5e680 0x55da8cd657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55da8cd53dc0 0x55da8cd5f720 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 --2- 172.21.15.100:0/3477454541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55da8cd534a0 0x55da8cd5f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 >> 172.21.15.100:0/3477454541 conn(0x55da8cd4fa30 msgr2=0x55da8cd5d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff8137fe640 0 client.26069 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 shutdown_connections 2024-09-12T02:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 1 -- 172.21.15.100:0/3477454541 wait complete. 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.830+0000 7ff83c73b740 20 client.26069 trim_cache size 0 max 16384 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout: "66e08f40-c91a-42a5-aaad-220e5b5a9f94": { 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "66e08f40-c91a-42a5-aaad-220e5b5a9f94", 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:46:12.833 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:12.834 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:12.834 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff81c0a2d90 msgr2=0x7ff81c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff81c0a2d90 0x7ff81c0a5250 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d90 tx=0x7ff8280156d0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff834109830 msgr2=0x7ff83411ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff834109830 0x7ff83411ab60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff82c006010 tx=0x7ff82c003f10 comp rx=0 tx=0).stop 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 shutdown_connections 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff81c0a2d90 0x7ff81c0a5250 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff83411b140 0x7ff8341147c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff834109830 0x7ff83411ab60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 --2- 172.21.15.100:0/3708548238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834109450 0x7ff83411a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.831+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 >> 172.21.15.100:0/3708548238 conn(0x7ff83406e140 msgr2=0x7ff834070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.832+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 shutdown_connections 2024-09-12T02:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:12.832+0000 7ff83a362640 1 -- 172.21.15.100:0/3708548238 wait complete. 2024-09-12T02:46:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:12 smithi117 ceph-mon[34898]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.2 MiB/s wr, 711 op/s 2024-09-12T02:46:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:12 smithi100 ceph-mon[31390]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.2 MiB/s wr, 711 op/s 2024-09-12T02:46:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:12 smithi189 ceph-mon[35196]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.2 MiB/s wr, 711 op/s 2024-09-12T02:46:13.579 INFO:tasks.cephfs.filesystem:scrub status for tag:66e08f40-c91a-42a5-aaad-220e5b5a9f94 - {'path': '/', 'tag': '66e08f40-c91a-42a5-aaad-220e5b5a9f94', 'options': 'recursive,force'} 2024-09-12T02:46:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:14 smithi117 ceph-mon[34898]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.4 MiB/s wr, 584 op/s 2024-09-12T02:46:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:14 smithi100 ceph-mon[31390]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.4 MiB/s wr, 584 op/s 2024-09-12T02:46:15.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:14 smithi189 ceph-mon[35196]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.4 MiB/s wr, 584 op/s 2024-09-12T02:46:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 425.0 s, 2877.5 tps, lat 35.070 ms stddev 39.168 2024-09-12T02:46:17.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:16 smithi117 ceph-mon[34898]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:46:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:16 smithi100 ceph-mon[31390]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:46:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:16 smithi189 ceph-mon[35196]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:46:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:18 smithi117 ceph-mon[34898]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.0 MiB/s wr, 646 op/s 2024-09-12T02:46:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:18 smithi100 ceph-mon[31390]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.0 MiB/s wr, 646 op/s 2024-09-12T02:46:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:18 smithi189 ceph-mon[35196]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.0 MiB/s wr, 646 op/s 2024-09-12T02:46:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:19 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:46:20.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:19 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:46:20.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:19 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:46:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:20 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:46:21.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:20 smithi117 ceph-mon[34898]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 7.6 MiB/s wr, 772 op/s 2024-09-12T02:46:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:20 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:46:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:20 smithi100 ceph-mon[31390]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 7.6 MiB/s wr, 772 op/s 2024-09-12T02:46:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:20 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:46:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:20 smithi189 ceph-mon[35196]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 7.6 MiB/s wr, 772 op/s 2024-09-12T02:46:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 430.0 s, 2938.2 tps, lat 34.069 ms stddev 33.914 2024-09-12T02:46:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:22 smithi117 ceph-mon[34898]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.4 MiB/s wr, 677 op/s 2024-09-12T02:46:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:22 smithi100 ceph-mon[31390]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.4 MiB/s wr, 677 op/s 2024-09-12T02:46:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:22 smithi189 ceph-mon[35196]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.4 MiB/s wr, 677 op/s 2024-09-12T02:46:23.608 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-12T02:46:23.609 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.4 2024-09-12T02:46:23.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:46:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 -- 172.21.15.100:0/771315658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1017e0 msgr2=0x7f98cc101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 --2- 172.21.15.100:0/771315658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1017e0 0x7f98cc101bc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009900 tx=0x7f98bc02a410 comp rx=0 tx=0).stop 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 -- 172.21.15.100:0/771315658 shutdown_connections 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 --2- 172.21.15.100:0/771315658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc105e00 0x7f98cc10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 --2- 172.21.15.100:0/771315658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc102190 0x7f98cc1056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 --2- 172.21.15.100:0/771315658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc1017e0 0x7f98cc101bc0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 -- 172.21.15.100:0/771315658 >> 172.21.15.100:0/771315658 conn(0x7f98cc0fba90 msgr2=0x7f98cc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 -- 172.21.15.100:0/771315658 shutdown_connections 2024-09-12T02:46:24.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.558+0000 7f98d20e4640 1 -- 172.21.15.100:0/771315658 wait complete. 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 Processor -- start 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 -- start start 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc1017e0 0x7f98cc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc102190 0x7f98cc1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc105e00 0x7f98cc1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc110e40 con 0x7f98cc105e00 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc110cc0 con 0x7f98cc102190 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98d20e4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc110fc0 con 0x7f98cc1017e0 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98cbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc105e00 0x7f98cc1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98cb7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc1017e0 0x7f98cc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98cbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc105e00 0x7f98cc1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44178/0 (socket says 172.21.15.100:44178) 2024-09-12T02:46:24.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98cbfff640 1 -- 172.21.15.100:0/3267522514 learned_addr learned my addr 172.21.15.100:0/3267522514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.559+0000 7f98caffd640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc102190 0x7f98cc1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.561+0000 7f98cbfff640 1 -- 172.21.15.100:0/3267522514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc1017e0 msgr2=0x7f98cc1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.561+0000 7f98cbfff640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc1017e0 0x7f98cc1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.561+0000 7f98cbfff640 1 -- 172.21.15.100:0/3267522514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc102190 msgr2=0x7f98cc1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.561+0000 7f98cbfff640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc102190 0x7f98cc1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.561+0000 7f98cbfff640 1 -- 172.21.15.100:0/3267522514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc1a4870 con 0x7f98cc105e00 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.561+0000 7f98cbfff640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc105e00 0x7f98cc1a4330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f98c400eaa0 tx=0x7f98c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.562+0000 7f98c8ff9640 1 -- 172.21.15.100:0/3267522514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c400cdb0 con 0x7f98cc105e00 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.562+0000 7f98c8ff9640 1 -- 172.21.15.100:0/3267522514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c4005020 con 0x7f98cc105e00 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.562+0000 7f98c8ff9640 1 -- 172.21.15.100:0/3267522514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c40116d0 con 0x7f98cc105e00 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.562+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc1970a0 con 0x7f98cc105e00 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.563+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc197590 con 0x7f98cc105e00 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.564+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98cc101bc0 con 0x7f98cc105e00 2024-09-12T02:46:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.565+0000 7f98c8ff9640 1 -- 172.21.15.100:0/3267522514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f98c4005540 con 0x7f98cc105e00 2024-09-12T02:46:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.566+0000 7f98c8ff9640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b40a2c50 0x7f98b40a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.567+0000 7f98cb7fe640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b40a2c50 0x7f98b40a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.567+0000 7f98c8ff9640 1 -- 172.21.15.100:0/3267522514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f98c40ced40 con 0x7f98cc105e00 2024-09-12T02:46:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.567+0000 7f98cb7fe640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b40a2c50 0x7f98b40a5110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009230 tx=0x7f98bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.573+0000 7f98c8ff9640 1 -- 172.21.15.100:0/3267522514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98c4016030 con 0x7f98cc105e00 2024-09-12T02:46:24.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.899+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98cc108fc0 con 0x7f98cc105e00 2024-09-12T02:46:24.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.901+0000 7f98c8ff9640 1 -- 172.21.15.100:0/3267522514 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f98c4097020 con 0x7f98cc105e00 2024-09-12T02:46:24.901 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:46:24.901 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:46:24.902 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b40a2c50 msgr2=0x7f98b40a5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b40a2c50 0x7f98b40a5110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009230 tx=0x7f98bc0058d0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc105e00 msgr2=0x7f98cc1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc105e00 0x7f98cc1a4330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f98c400eaa0 tx=0x7f98c400ef60 comp rx=0 tx=0).stop 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 shutdown_connections 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98b40a2c50 0x7f98b40a5110 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98cc105e00 0x7f98cc1a4330 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc102190 0x7f98cc1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 --2- 172.21.15.100:0/3267522514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98cc1017e0 0x7f98cc1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 >> 172.21.15.100:0/3267522514 conn(0x7f98cc0fba90 msgr2=0x7f98cc0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 shutdown_connections 2024-09-12T02:46:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:24.903+0000 7f98d20e4640 1 -- 172.21.15.100:0/3267522514 wait complete. 2024-09-12T02:46:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:24 smithi117 ceph-mon[34898]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.3 MiB/s wr, 621 op/s 2024-09-12T02:46:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:24 smithi100 ceph-mon[31390]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.3 MiB/s wr, 621 op/s 2024-09-12T02:46:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:24 smithi189 ceph-mon[35196]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.3 MiB/s wr, 621 op/s 2024-09-12T02:46:25.722 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0' 2024-09-12T02:46:25.722 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0 2024-09-12T02:46:26.088 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:26.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:25 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3267522514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:26.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:25 smithi117 ceph-mon[34898]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.2 MiB/s wr, 783 op/s 2024-09-12T02:46:26.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:25 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3267522514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:26.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:25 smithi100 ceph-mon[31390]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.2 MiB/s wr, 783 op/s 2024-09-12T02:46:26.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:25 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3267522514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:26.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:25 smithi189 ceph-mon[35196]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.2 MiB/s wr, 783 op/s 2024-09-12T02:46:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 435.0 s, 3062.0 tps, lat 32.383 ms stddev 33.714 2024-09-12T02:46:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 -- 172.21.15.100:0/3824905649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90410c160 msgr2=0x7fe90410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 --2- 172.21.15.100:0/3824905649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90410c160 0x7fe90410e600 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009ca0 tx=0x7fe8fc02a950 comp rx=0 tx=0).stop 2024-09-12T02:46:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 -- 172.21.15.100:0/3824905649 shutdown_connections 2024-09-12T02:46:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 --2- 172.21.15.100:0/3824905649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90410c160 0x7fe90410e600 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 --2- 172.21.15.100:0/3824905649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe904103650 0x7fe90410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 --2- 172.21.15.100:0/3824905649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102d30 0x7fe904103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 -- 172.21.15.100:0/3824905649 >> 172.21.15.100:0/3824905649 conn(0x7fe9040fc7d0 msgr2=0x7fe9040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 -- 172.21.15.100:0/3824905649 shutdown_connections 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.635+0000 7fe909a07640 1 -- 172.21.15.100:0/3824905649 wait complete. 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.637+0000 7fe909a07640 1 Processor -- start 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe909a07640 1 -- start start 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe909a07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102d30 0x7fe904198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe909a07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe904103650 0x7fe9041989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe909a07640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90410c160 0x7fe90419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe909a07640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe904111f60 con 0x7fe904103650 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe909a07640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe904111de0 con 0x7fe90410c160 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe909a07640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041120e0 con 0x7fe904102d30 2024-09-12T02:46:26.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe904103650 0x7fe9041989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe904103650 0x7fe9041989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44192/0 (socket says 172.21.15.100:44192) 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe9027fc640 1 -- 172.21.15.100:0/404934928 learned_addr learned my addr 172.21.15.100:0/404934928 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe9037fe640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90410c160 0x7fe90419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.638+0000 7fe902ffd640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102d30 0x7fe904198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe9027fc640 1 -- 172.21.15.100:0/404934928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102d30 msgr2=0x7fe904198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe9027fc640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102d30 0x7fe904198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe9027fc640 1 -- 172.21.15.100:0/404934928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90410c160 msgr2=0x7fe90419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe9027fc640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90410c160 0x7fe90419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe9027fc640 1 -- 172.21.15.100:0/404934928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90419d420 con 0x7fe904103650 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe9027fc640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe904103650 0x7fe9041989b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800e9f0 tx=0x7fe8f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe908a05640 1 -- 172.21.15.100:0/404934928 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f800ccc0 con 0x7fe904103650 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90419d710 con 0x7fe904103650 2024-09-12T02:46:26.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe908a05640 1 -- 172.21.15.100:0/404934928 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f8010910 con 0x7fe904103650 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe908a05640 1 -- 172.21.15.100:0/404934928 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8018920 con 0x7fe904103650 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.639+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9041a4ff0 con 0x7fe904103650 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.642+0000 7fe908a05640 1 -- 172.21.15.100:0/404934928 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe8f8010430 con 0x7fe904103650 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 Processor -- start 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 -- start start 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd86600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 0x56553cd86f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cd9c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56553ccec2a0 con 0x56553cd87ce0 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56553cc93b10 con 0x56553cd99fe0 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe90bde0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56553cce8260 con 0x56553cd86b40 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe9037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd86600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cd9c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cd9c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:57048/0 (socket says 172.21.15.100:57048) 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe9027fc640 1 -- 172.21.15.100:0/3787916707 learned_addr learned my addr 172.21.15.100:0/3787916707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.643+0000 7fe902ffd640 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 0x56553cd86f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.644+0000 7fe9027fc640 1 -- 172.21.15.100:0/3787916707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 msgr2=0x56553cd86f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.644+0000 7fe9027fc640 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 0x56553cd86f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.644+0000 7fe9027fc640 1 -- 172.21.15.100:0/3787916707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 msgr2=0x56553cd86600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.644+0000 7fe9027fc640 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd86600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.645+0000 7fe9027fc640 1 -- 172.21.15.100:0/3787916707 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553ca5db90 con 0x56553cd99fe0 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.645+0000 7fe9037fe640 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd86600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.645+0000 7fe908a05640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8ec0a2c00 0x7fe8ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.645+0000 7fe908a05640 1 -- 172.21.15.100:0/404934928 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe8f80cf250 con 0x7fe904103650 2024-09-12T02:46:26.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.645+0000 7fe9037fe640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8ec0a2c00 0x7fe8ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.645+0000 7fe9027fc640 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cd9c3d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80d74b0 tx=0x7fe8f80d7970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2784def0ea7e7080 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.646+0000 7fe8e9ffb640 1 -- 172.21.15.100:0/3787916707 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8097d40 con 0x56553cd99fe0 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.646+0000 7fe8e9ffb640 1 -- 172.21.15.100:0/3787916707 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f809c1a0 con 0x56553cd99fe0 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.646+0000 7fe8e9ffb640 1 -- 172.21.15.100:0/3787916707 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f809b400 con 0x56553cd99fe0 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 -- 172.21.15.100:0/3787916707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 msgr2=0x56553cd9c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe9037fe640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8ec0a2c00 0x7fe8ec0a50c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc005e30 tx=0x7fe8fc005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cd9c3d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80d74b0 tx=0x7fe8f80d7970 comp rx=0 tx=0).stop 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 -- 172.21.15.100:0/3787916707 shutdown_connections 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cd9c3d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 0x56553cd86f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 --2- 172.21.15.100:0/3787916707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd86600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 -- 172.21.15.100:0/3787916707 >> 172.21.15.100:0/3787916707 conn(0x56553cd82cf0 msgr2=0x56553cd830d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 -- 172.21.15.100:0/3787916707 shutdown_connections 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 -- 172.21.15.100:0/3787916707 wait complete. 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 -- start start 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.647+0000 7fe90bde0740 1 Processor -- start 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cd8a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd8a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd99fe0 0x56553cd8af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56553cd9ccb0 con 0x56553cd87ce0 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56553cc746e0 con 0x56553cd86b40 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56553cd9ce30 con 0x56553cd99fe0 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 10 client.0 _ll_register_callbacks cb 0x56553cc98a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:26.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cd8a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cd8a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:57052/0 (socket says 172.21.15.100:57052) 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 -- 172.21.15.100:0/1731774997 learned_addr learned my addr 172.21.15.100:0/1731774997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe9027fc640 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd8a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 -- 172.21.15.100:0/1731774997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd99fe0 msgr2=0x56553cd8af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd99fe0 0x56553cd8af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 -- 172.21.15.100:0/1731774997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 msgr2=0x56553cd8a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd8a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 -- 172.21.15.100:0/1731774997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553cda6390 con 0x56553cd86b40 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe902ffd640 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cd8a4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400bf00 tx=0x7fe8f4012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c2a5231ac4c6b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe8e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:46:26.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1731774997 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40108a0 con 0x56553cd86b40 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8f809c1a0 con 0x56553cd86b40 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.648+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1731774997 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe8f4010a40 con 0x56553cd86b40 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1731774997 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8f4010c40 con 0x56553cd86b40 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 10 client.26087 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56553cda8d90 con 0x56553cd86b40 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1731774997 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f809c1a0 con 0x56553cd86b40 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1731774997 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe8f4024050 con 0x56553cd86b40 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 10 client.26087 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:26.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 10 client.26087 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 20 client.26087 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cdaa1a0 0x56553cdac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 4 client.26087 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.649+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56553ccf99d0 con 0x56553cdaa1a0 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.650+0000 7fe9027fc640 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cdaa1a0 0x56553cdac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.650+0000 7fe9027fc640 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cdaa1a0 0x56553cdac630 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4245efa9f1dc4e12 server_cookie=714251e5ad15d942 in_seq=0 out_seq=0 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.650+0000 7fe8e2ffd640 10 client.26087 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1731774997 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56553ccf99d0 con 0x56553cdaa1a0 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe8e2ffd640 10 client.26087 handle_command_reply: tid=0 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 client.26087 shutdown 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 msgr2=0x56553cd8a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cd8a4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400bf00 tx=0x7fe8f4012820 comp rx=0 tx=0).stop 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 shutdown_connections 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cdaa1a0 0x56553cdac630 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd99fe0 0x56553cd8af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd8a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1731774997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cd8a4a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe8e2ffd640 0 client.26087 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.651+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 >> 172.21.15.100:0/1731774997 conn(0x56553cd82cf0 msgr2=0x56553cd88a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.652+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 shutdown_connections 2024-09-12T02:46:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.652+0000 7fe90bde0740 1 -- 172.21.15.100:0/1731774997 wait complete. 2024-09-12T02:46:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.652+0000 7fe90bde0740 20 client.26087 trim_cache size 0 max 16384 2024-09-12T02:46:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.679+0000 7fe90bde0740 1 Processor -- start 2024-09-12T02:46:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe90bde0740 1 -- start start 2024-09-12T02:46:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 0x56553cd88900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd88e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cdb1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd88e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd88e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44228/0 (socket says 172.21.15.100:44228) 2024-09-12T02:46:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe9027fc640 1 -- 172.21.15.100:0/2289812544 learned_addr learned my addr 172.21.15.100:0/2289812544 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041adc30 con 0x56553cd87ce0 2024-09-12T02:46:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041ab500 con 0x56553cd99fe0 2024-09-12T02:46:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.682+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041a9350 con 0x56553cd86b40 2024-09-12T02:46:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.683+0000 7fe9027fc640 1 -- 172.21.15.100:0/2289812544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 msgr2=0x56553cd88900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:46:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.683+0000 7fe9027fc640 1 --2- 172.21.15.100:0/2289812544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 0x56553cd88900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.683+0000 7fe9027fc640 1 -- 172.21.15.100:0/2289812544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 msgr2=0x56553cdb1f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:46:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.683+0000 7fe9027fc640 1 --2- 172.21.15.100:0/2289812544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cdb1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.683+0000 7fe9027fc640 1 -- 172.21.15.100:0/2289812544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553cd7e260 con 0x56553cd87ce0 2024-09-12T02:46:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.684+0000 7fe9027fc640 1 --2- 172.21.15.100:0/2289812544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd88e40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80d7480 tx=0x7fe8f800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e537e6f4dd5b9d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.684+0000 7fe8e97fa640 1 -- 172.21.15.100:0/2289812544 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f809b5e0 con 0x56553cd87ce0 2024-09-12T02:46:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.684+0000 7fe8e97fa640 1 -- 172.21.15.100:0/2289812544 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f809fe50 con 0x56553cd87ce0 2024-09-12T02:46:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.684+0000 7fe8e97fa640 1 -- 172.21.15.100:0/2289812544 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f809b870 con 0x56553cd87ce0 2024-09-12T02:46:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.685+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 msgr2=0x56553cd88e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.685+0000 7fe90bde0740 1 --2- 172.21.15.100:0/2289812544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd88e40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80d7480 tx=0x7fe8f800cf60 comp rx=0 tx=0).stop 2024-09-12T02:46:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.688+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 shutdown_connections 2024-09-12T02:46:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.688+0000 7fe90bde0740 1 --2- 172.21.15.100:0/2289812544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd99fe0 0x56553cdb1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.688+0000 7fe90bde0740 1 --2- 172.21.15.100:0/2289812544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd87ce0 0x56553cd88e40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.688+0000 7fe90bde0740 1 --2- 172.21.15.100:0/2289812544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd86b40 0x56553cd88900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.688+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 >> 172.21.15.100:0/2289812544 conn(0x56553cd82cf0 msgr2=0x56553cd881f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.691+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 shutdown_connections 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.691+0000 7fe90bde0740 1 -- 172.21.15.100:0/2289812544 wait complete. 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.692+0000 7fe90bde0740 1 -- start start 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.692+0000 7fe90bde0740 1 Processor -- start 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cda2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd87ce0 0x56553cd9d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe90bde0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd99fe0 0x56553cd9d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe902ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cda2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe902ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cda2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:57064/0 (socket says 172.21.15.100:57064) 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd87ce0 0x56553cd9d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe9027fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd87ce0 0x56553cd9d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:57896/0 (socket says 172.21.15.100:57896) 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe902ffd640 1 -- 172.21.15.100:0/1736310821 learned_addr learned my addr 172.21.15.100:0/1736310821 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041a99c0 con 0x56553cd99fe0 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041aae30 con 0x56553cd86b40 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041aa090 con 0x56553cd87ce0 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe9037fe640 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd99fe0 0x56553cd9d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.693+0000 7fe90bde0740 10 client.0 _ll_register_callbacks cb 0x7fe8f400bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.694+0000 7fe9027fc640 1 -- 172.21.15.100:0/1736310821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 msgr2=0x56553cda2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.694+0000 7fe9027fc640 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cda2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.694+0000 7fe9027fc640 1 -- 172.21.15.100:0/1736310821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd99fe0 msgr2=0x56553cd9d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.694+0000 7fe9027fc640 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd99fe0 0x56553cd9d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.694+0000 7fe9027fc640 1 -- 172.21.15.100:0/1736310821 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553cd87550 con 0x56553cd87ce0 2024-09-12T02:46:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.697+0000 7fe9027fc640 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd87ce0 0x56553cd9d0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c6a0 tx=0x7fe8f80d28b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59d3ad2248ca1636 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.697+0000 7fe8e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:26.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.700+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1736310821 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80b3070 con 0x56553cd87ce0 2024-09-12T02:46:26.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.700+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1736310821 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe8f8098110 con 0x56553cd87ce0 2024-09-12T02:46:26.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.700+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56553ccf3d20 con 0x56553cd87ce0 2024-09-12T02:46:26.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.701+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1736310821 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8f80ba050 con 0x56553cd87ce0 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 10 client.26050 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56553cd94730 con 0x56553cd87ce0 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1736310821 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f809c1a0 con 0x56553cd87ce0 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1736310821 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe8f80d2b00 con 0x56553cd87ce0 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 10 client.26050 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 10 client.26050 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 20 client.26050 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cd94a20 0x56553cd94e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 4 client.26050 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}] 2024-09-12T02:46:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.704+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}) -- 0x56553ccf3d20 con 0x56553cd94a20 2024-09-12T02:46:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.705+0000 7fe902ffd640 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cd94a20 0x56553cd94e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.709+0000 7fe8e2ffd640 10 client.26050 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.709+0000 7fe902ffd640 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cd94a20 0x56553cd94e30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2af26960f5ffc864 server_cookie=f2ab90d170b6dc1d in_seq=0 out_seq=0 2024-09-12T02:46:26.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe8e2ffd640 1 -- 172.21.15.100:0/1736310821 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56553ccf3d20 con 0x56553cd94a20 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe8e2ffd640 10 client.26050 handle_command_reply: tid=0 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 client.26050 shutdown 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd87ce0 msgr2=0x56553cd9d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd87ce0 0x56553cd9d0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c6a0 tx=0x7fe8f80d28b0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 shutdown_connections 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56553cd94a20 0x56553cd94e30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553cd99fe0 0x56553cd9d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe8e2ffd640 0 client.26050 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56553cd87ce0 0x56553cd9d0b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 --2- 172.21.15.100:0/1736310821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56553cd86b40 0x56553cda2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 >> 172.21.15.100:0/1736310821 conn(0x56553cd82cf0 msgr2=0x56553cd88a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 shutdown_connections 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 1 -- 172.21.15.100:0/1736310821 wait complete. 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.988+0000 7fe90bde0740 20 client.26050 trim_cache size 0 max 16384 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 30, 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stdout: "ee19e4ab": { 2024-09-12T02:46:26.991 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 30, 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 139.4, 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:46:26.992 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8ec0a2c00 msgr2=0x7fe8ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8ec0a2c00 0x7fe8ec0a50c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc005e30 tx=0x7fe8fc005c50 comp rx=0 tx=0).stop 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe904103650 msgr2=0x7fe9041989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe904103650 0x7fe9041989b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800e9f0 tx=0x7fe8f800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 shutdown_connections 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8ec0a2c00 0x7fe8ec0a50c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90410c160 0x7fe90419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe904103650 0x7fe9041989b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 --2- 172.21.15.100:0/404934928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102d30 0x7fe904198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 >> 172.21.15.100:0/404934928 conn(0x7fe9040fc7d0 msgr2=0x7fe9040fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 shutdown_connections 2024-09-12T02:46:26.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:26.989+0000 7fe909a07640 1 -- 172.21.15.100:0/404934928 wait complete. 2024-09-12T02:46:28.655 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ee19e4ab', quiesce took 5.0 seconds. Will release after: 14.399999999999999 2024-09-12T02:46:29.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:28 smithi189 ceph-mon[35196]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.7 MiB/s wr, 730 op/s 2024-09-12T02:46:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:28 smithi117 ceph-mon[34898]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.7 MiB/s wr, 730 op/s 2024-09-12T02:46:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:28 smithi100 ceph-mon[31390]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.7 MiB/s wr, 730 op/s 2024-09-12T02:46:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:30 smithi189 ceph-mon[35196]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 8.7 MiB/s wr, 785 op/s 2024-09-12T02:46:31.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:30 smithi117 ceph-mon[34898]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 8.7 MiB/s wr, 785 op/s 2024-09-12T02:46:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:30 smithi100 ceph-mon[31390]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 8.7 MiB/s wr, 785 op/s 2024-09-12T02:46:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 440.0 s, 222.4 tps, lat 41.383 ms stddev 42.079 2024-09-12T02:46:33.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:32 smithi189 ceph-mon[35196]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 584 op/s 2024-09-12T02:46:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:32 smithi117 ceph-mon[34898]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 584 op/s 2024-09-12T02:46:33.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:32 smithi100 ceph-mon[31390]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 584 op/s 2024-09-12T02:46:35.010 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:34 smithi100 ceph-mon[31390]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 502 op/s 2024-09-12T02:46:35.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:34 smithi189 ceph-mon[35196]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 502 op/s 2024-09-12T02:46:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:34 smithi117 ceph-mon[34898]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 502 op/s 2024-09-12T02:46:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:46:37.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:36 smithi189 ceph-mon[35196]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 507 op/s 2024-09-12T02:46:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:36 smithi117 ceph-mon[34898]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 507 op/s 2024-09-12T02:46:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:36 smithi100 ceph-mon[31390]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 507 op/s 2024-09-12T02:46:39.097 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:38 smithi117 ceph-mon[34898]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 341 op/s 2024-09-12T02:46:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:38 smithi100 ceph-mon[31390]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 341 op/s 2024-09-12T02:46:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:38 smithi189 ceph-mon[35196]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 341 op/s 2024-09-12T02:46:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:40 smithi117 ceph-mon[34898]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-09-12T02:46:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:40 smithi100 ceph-mon[31390]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-09-12T02:46:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:40 smithi189 ceph-mon[35196]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-09-12T02:46:41.302 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:46:43.057 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:46:43.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:42 smithi100 ceph-mon[31390]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-09-12T02:46:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:42 smithi117 ceph-mon[34898]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-09-12T02:46:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:42 smithi189 ceph-mon[35196]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-09-12T02:46:43.334 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:43.580 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 -- 172.21.15.100:0/2942299836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0108290 msgr2=0x7f51d010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2942299836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0108290 0x7f51d010ec30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009cd0 tx=0x7f51c802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 -- 172.21.15.100:0/2942299836 shutdown_connections 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2942299836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0108290 0x7f51d010ec30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2942299836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d0103740 0x7f51d0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2942299836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51d0102d90 0x7f51d0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 -- 172.21.15.100:0/2942299836 >> 172.21.15.100:0/2942299836 conn(0x7f51d00fc7d0 msgr2=0x7f51d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 -- 172.21.15.100:0/2942299836 shutdown_connections 2024-09-12T02:46:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 -- 172.21.15.100:0/2942299836 wait complete. 2024-09-12T02:46:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 Processor -- start 2024-09-12T02:46:43.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.818+0000 7f51d5e82640 1 -- start start 2024-09-12T02:46:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51d5e82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51d0102d90 0x7f51d01009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51d5e82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0103740 0x7f51d0100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51d5e82640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d0108290 0x7f51d0101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51d5e82640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0112150 con 0x7f51d0103740 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51d5e82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0111fd0 con 0x7f51d0102d90 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51d5e82640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51d01122d0 con 0x7f51d0108290 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0103740 0x7f51d0100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0103740 0x7f51d0100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45124/0 (socket says 172.21.15.100:45124) 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 -- 172.21.15.100:0/2188543983 learned_addr learned my addr 172.21.15.100:0/2188543983 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51cf7fe640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51d0102d90 0x7f51d01009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51cffff640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d0108290 0x7f51d0101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 -- 172.21.15.100:0/2188543983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d0108290 msgr2=0x7f51d0101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d0108290 0x7f51d0101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 -- 172.21.15.100:0/2188543983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51d0102d90 msgr2=0x7f51d01009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51d0102d90 0x7f51d01009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 -- 172.21.15.100:0/2188543983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d01a6bb0 con 0x7f51d0103740 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51cffff640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d0108290 0x7f51d0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.819+0000 7f51c6ffd640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0103740 0x7f51d0100f30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f51b800b450 tx=0x7f51b800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.820+0000 7f51cd7fa640 1 -- 172.21.15.100:0/2188543983 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b8015020 con 0x7f51d0103740 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.820+0000 7f51cd7fa640 1 -- 172.21.15.100:0/2188543983 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51b8011d10 con 0x7f51d0103740 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.820+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d01a6ea0 con 0x7f51d0103740 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.820+0000 7f51cd7fa640 1 -- 172.21.15.100:0/2188543983 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b800f2e0 con 0x7f51d0103740 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.820+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d01a7300 con 0x7f51d0103740 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.821+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d006a7f0 con 0x7f51d0103740 2024-09-12T02:46:43.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.822+0000 7f51cd7fa640 1 -- 172.21.15.100:0/2188543983 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f51b8018020 con 0x7f51d0103740 2024-09-12T02:46:43.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.823+0000 7f51cd7fa640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51bc0a2b80 0x7f51bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.823+0000 7f51cf7fe640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51bc0a2b80 0x7f51bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.823+0000 7f51cd7fa640 1 -- 172.21.15.100:0/2188543983 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f51b80ce980 con 0x7f51d0103740 2024-09-12T02:46:43.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.823+0000 7f51cf7fe640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51bc0a2b80 0x7f51bc0a5040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009990 tx=0x7f51c0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:43.827+0000 7f51cd7fa640 1 -- 172.21.15.100:0/2188543983 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51b801f020 con 0x7f51d0103740 2024-09-12T02:46:43.893 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.043+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51d010a2a0 con 0x7f51d0103740 2024-09-12T02:46:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.043+0000 7f51cd7fa640 1 -- 172.21.15.100:0/2188543983 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f51b809b8d0 con 0x7f51d0103740 2024-09-12T02:46:44.044 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:46:44.044 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:46:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51bc0a2b80 msgr2=0x7f51bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51bc0a2b80 0x7f51bc0a5040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009990 tx=0x7f51c0009110 comp rx=0 tx=0).stop 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0103740 msgr2=0x7f51d0100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0103740 0x7f51d0100f30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f51b800b450 tx=0x7f51b800b850 comp rx=0 tx=0).stop 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 shutdown_connections 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f51bc0a2b80 0x7f51bc0a5040 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d0108290 0x7f51d0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d0103740 0x7f51d0100f30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 --2- 172.21.15.100:0/2188543983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51d0102d90 0x7f51d01009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.045+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 >> 172.21.15.100:0/2188543983 conn(0x7f51d00fc7d0 msgr2=0x7f51d0105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.046+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 shutdown_connections 2024-09-12T02:46:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:44.046+0000 7f51d5e82640 1 -- 172.21.15.100:0/2188543983 wait complete. 2024-09-12T02:46:44.881 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id ee19e4ab --release --await' 2024-09-12T02:46:44.882 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id ee19e4ab --release --await 2024-09-12T02:46:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:44 smithi100 ceph-mon[31390]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-12T02:46:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:44 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2188543983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 -- 172.21.15.100:0/2330720960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c100e20 msgr2=0x7fdc7c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 --2- 172.21.15.100:0/2330720960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c100e20 0x7fdc7c101200 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009900 tx=0x7fdc6c02a480 comp rx=0 tx=0).stop 2024-09-12T02:46:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 -- 172.21.15.100:0/2330720960 shutdown_connections 2024-09-12T02:46:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 --2- 172.21.15.100:0/2330720960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc7c102ef0 0x7fdc7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 --2- 172.21.15.100:0/2330720960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc7c102570 0x7fdc7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 --2- 172.21.15.100:0/2330720960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c100e20 0x7fdc7c101200 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 -- 172.21.15.100:0/2330720960 >> 172.21.15.100:0/2330720960 conn(0x7fdc7c0fc7d0 msgr2=0x7fdc7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 -- 172.21.15.100:0/2330720960 shutdown_connections 2024-09-12T02:46:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.080+0000 7fdc8383c640 1 -- 172.21.15.100:0/2330720960 wait complete. 2024-09-12T02:46:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 Processor -- start 2024-09-12T02:46:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 -- start start 2024-09-12T02:46:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc7c100e20 0x7fdc7c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c102570 0x7fdc7c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc7c102ef0 0x7fdc7c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c110f80 con 0x7fdc7c102570 2024-09-12T02:46:45.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c110e00 con 0x7fdc7c102ef0 2024-09-12T02:46:45.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.081+0000 7fdc8383c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c111100 con 0x7fdc7c100e20 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c102570 0x7fdc7c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c102570 0x7fdc7c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54522/0 (socket says 172.21.15.100:54522) 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 -- 172.21.15.100:0/380962205 learned_addr learned my addr 172.21.15.100:0/380962205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc815d8640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc7c100e20 0x7fdc7c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 -- 172.21.15.100:0/380962205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc7c100e20 msgr2=0x7fdc7c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc7c100e20 0x7fdc7c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 -- 172.21.15.100:0/380962205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc7c102ef0 msgr2=0x7fdc7c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc7c102ef0 0x7fdc7c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 -- 172.21.15.100:0/380962205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1a6980 con 0x7fdc7c102570 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c102570 0x7fdc7c0fd1c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800d950 tx=0x7fdc7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc727fc640 1 -- 172.21.15.100:0/380962205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78017030 con 0x7fdc7c102570 2024-09-12T02:46:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c1a6c70 con 0x7fdc7c102570 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.082+0000 7fdc727fc640 1 -- 172.21.15.100:0/380962205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc78004020 con 0x7fdc7c102570 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.083+0000 7fdc727fc640 1 -- 172.21.15.100:0/380962205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc780047a0 con 0x7fdc7c102570 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.083+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1a71b0 con 0x7fdc7c102570 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.085+0000 7fdc727fc640 1 -- 172.21.15.100:0/380962205 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fdc780041d0 con 0x7fdc7c102570 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.085+0000 7fdc85c15740 1 Processor -- start 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.085+0000 7fdc85c15740 1 -- start start 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc727fc640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc680a2c00 0x7fdc680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e074a0 0x55e9a2e07880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e12140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e12680 0x55e9a2e14a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc85c15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e9a2d6d2e0 con 0x55e9a2e12680 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc85c15740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e9a2d14ce0 con 0x55e9a2e07dc0 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc85c15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9a2d692a0 con 0x55e9a2e074a0 2024-09-12T02:46:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc727fc640 1 -- 172.21.15.100:0/380962205 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdc780cea50 con 0x7fdc7c102570 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc680a2c00 0x7fdc680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc80dd7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e074a0 0x55e9a2e07880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e074a0 0x55e9a2e07880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:49740/0 (socket says 172.21.15.100:49740) 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 -- 172.21.15.100:0/1254083445 learned_addr learned my addr 172.21.15.100:0/1254083445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e12680 0x55e9a2e14a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 -- 172.21.15.100:0/1254083445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 msgr2=0x55e9a2e12140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e12140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 -- 172.21.15.100:0/1254083445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e12680 msgr2=0x55e9a2e14a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e12680 0x55e9a2e14a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.086+0000 7fdc815d8640 1 -- 172.21.15.100:0/1254083445 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a2cf9440 con 0x55e9a2e074a0 2024-09-12T02:46:45.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.087+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc680a2c00 0x7fdc680a50c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc74005fd0 tx=0x7fdc74009bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.087+0000 7fdc815d8640 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e074a0 0x55e9a2e07880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c02a9a0 tx=0x7fdc6c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5540c3e148f661bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.087+0000 7fdc677fe640 1 -- 172.21.15.100:0/1254083445 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c035030 con 0x55e9a2e074a0 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.087+0000 7fdc677fe640 1 -- 172.21.15.100:0/1254083445 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc6c040070 con 0x55e9a2e074a0 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.087+0000 7fdc677fe640 1 -- 172.21.15.100:0/1254083445 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0039e0 con 0x55e9a2e074a0 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 -- 172.21.15.100:0/1254083445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e074a0 msgr2=0x55e9a2e07880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e074a0 0x55e9a2e07880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c02a9a0 tx=0x7fdc6c0040c0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 -- 172.21.15.100:0/1254083445 shutdown_connections 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e12680 0x55e9a2e14a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e12140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 --2- 172.21.15.100:0/1254083445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e074a0 0x55e9a2e07880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 -- 172.21.15.100:0/1254083445 >> 172.21.15.100:0/1254083445 conn(0x55e9a2e03a30 msgr2=0x55e9a2e03e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 -- 172.21.15.100:0/1254083445 shutdown_connections 2024-09-12T02:46:45.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 -- 172.21.15.100:0/1254083445 wait complete. 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 -- start start 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.088+0000 7fdc85c15740 1 Processor -- start 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e11fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e0f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e0f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc85c15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e9a2e15250 con 0x55e9a2e074a0 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc85c15740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e9a2d28050 con 0x55e9a2e07dc0 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc85c15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9a2e153d0 con 0x55e9a2e12680 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc85c15740 10 client.0 _ll_register_callbacks cb 0x55e9a2d68160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e11fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e11fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54534/0 (socket says 172.21.15.100:54534) 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 -- 172.21.15.100:0/4214713711 learned_addr learned my addr 172.21.15.100:0/4214713711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e0f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e0f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 -- 172.21.15.100:0/4214713711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 msgr2=0x55e9a2e0f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e0f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 -- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 msgr2=0x55e9a2e0f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e0f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc815d8640 1 -- 172.21.15.100:0/4214713711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a2ade3c0 con 0x55e9a2e074a0 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.089+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e0f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc815d8640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e11fa0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c006010 tx=0x7fdc6c02ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd68804fd9e16a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc64ff9640 1 -- 172.21.15.100:0/4214713711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c035050 con 0x55e9a2e074a0 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc64ff9640 1 -- 172.21.15.100:0/4214713711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdc6c003b70 con 0x55e9a2e074a0 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc6c040070 con 0x55e9a2e074a0 2024-09-12T02:46:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc64ff9640 1 -- 172.21.15.100:0/4214713711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc6c003d70 con 0x55e9a2e074a0 2024-09-12T02:46:45.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc85c15740 10 client.16734 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:45.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e9a2e20bd0 con 0x55e9a2e074a0 2024-09-12T02:46:45.097 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:44 smithi117 ceph-mon[34898]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-12T02:46:45.097 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:44 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2188543983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc64ff9640 1 -- 172.21.15.100:0/4214713711 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc6c040070 con 0x55e9a2e074a0 2024-09-12T02:46:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.090+0000 7fdc64ff9640 1 -- 172.21.15.100:0/4214713711 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdc6c004b40 con 0x55e9a2e074a0 2024-09-12T02:46:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc85c15740 10 client.16734 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc85c15740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc85c15740 20 client.16734 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc85c15740 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e21f20 0x55e9a2e24310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc85c15740 4 client.16734 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9a2d7a850 con 0x55e9a2e21f20 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e21f20 0x55e9a2e24310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc64ff9640 10 client.16734 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.091+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e21f20 0x55e9a2e24310 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced626be5fbe1338 server_cookie=f619a4aec2b2f629 in_seq=0 out_seq=0 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.092+0000 7fdc64ff9640 1 -- 172.21.15.100:0/4214713711 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9a2d7a850 con 0x55e9a2e21f20 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.092+0000 7fdc64ff9640 10 client.16734 handle_command_reply: tid=0 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.092+0000 7fdc85c15740 1 client.16734 shutdown 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.092+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 msgr2=0x55e9a2e11fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.092+0000 7fdc85c15740 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e11fa0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c006010 tx=0x7fdc6c02ab80 comp rx=0 tx=0).stop 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 shutdown_connections 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e21f20 0x55e9a2e24310 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc64ff9640 0 client.16734 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e0f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e0f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 --2- 172.21.15.100:0/4214713711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e11fa0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 >> 172.21.15.100:0/4214713711 conn(0x55e9a2e03a30 msgr2=0x55e9a2e02b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 shutdown_connections 2024-09-12T02:46:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 1 -- 172.21.15.100:0/4214713711 wait complete. 2024-09-12T02:46:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.093+0000 7fdc85c15740 20 client.16734 trim_cache size 0 max 16384 2024-09-12T02:46:45.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 Processor -- start 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 -- start start 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e298e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e29e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1b2090 con 0x55e9a2e074a0 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1af960 con 0x55e9a2e07dc0 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc85c15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ad7b0 con 0x55e9a2e12680 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54546/0 (socket says 172.21.15.100:54546) 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 -- 172.21.15.100:0/3253731041 learned_addr learned my addr 172.21.15.100:0/3253731041 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:45.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e298e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e29e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 -- 172.21.15.100:0/3253731041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 msgr2=0x55e9a2e29e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e29e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 -- 172.21.15.100:0/3253731041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 msgr2=0x55e9a2e298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e298e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc815d8640 1 -- 172.21.15.100:0/3253731041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a2e0d7a0 con 0x55e9a2e074a0 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.112+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e29e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.113+0000 7fdc815d8640 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1e4b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009850 tx=0x7fdc6c0040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e249a7ab1cb636 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.113+0000 7fdc66ffd640 1 -- 172.21.15.100:0/3253731041 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c035040 con 0x55e9a2e074a0 2024-09-12T02:46:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.113+0000 7fdc66ffd640 1 -- 172.21.15.100:0/3253731041 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc6c040070 con 0x55e9a2e074a0 2024-09-12T02:46:45.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.113+0000 7fdc66ffd640 1 -- 172.21.15.100:0/3253731041 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c031b30 con 0x55e9a2e074a0 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 -- 172.21.15.100:0/3253731041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 msgr2=0x55e9a2e1e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1e4b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009850 tx=0x7fdc6c0040a0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 -- 172.21.15.100:0/3253731041 shutdown_connections 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e12680 0x55e9a2e29e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e298e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 --2- 172.21.15.100:0/3253731041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1e4b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 -- 172.21.15.100:0/3253731041 >> 172.21.15.100:0/3253731041 conn(0x55e9a2e03a30 msgr2=0x55e9a2e0e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 -- 172.21.15.100:0/3253731041 shutdown_connections 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 -- 172.21.15.100:0/3253731041 wait complete. 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 -- start start 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.114+0000 7fdc85c15740 1 Processor -- start 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e1af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc85c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e12680 0x55e9a2e17f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc85c15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ade20 con 0x55e9a2e074a0 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc85c15740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1af290 con 0x55e9a2e12680 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc85c15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ae4f0 con 0x55e9a2e07dc0 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc85c15740 10 client.0 _ll_register_callbacks cb 0x7fdc74012490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54556/0 (socket says 172.21.15.100:54556) 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 -- 172.21.15.100:0/2179121777 learned_addr learned my addr 172.21.15.100:0/2179121777 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e1af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e12680 0x55e9a2e17f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 -- 172.21.15.100:0/2179121777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e07dc0 msgr2=0x55e9a2e1af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e1af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 -- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e12680 msgr2=0x55e9a2e17f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e12680 0x55e9a2e17f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc815d8640 1 -- 172.21.15.100:0/2179121777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a2e187a0 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.115+0000 7fdc81dd9640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e12680 0x55e9a2e17f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc815d8640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1a9d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0057c0 tx=0x7fdc6c005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6e8cbcc9fb0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc64ff9640 1 -- 172.21.15.100:0/2179121777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c065060 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc64ff9640 1 -- 172.21.15.100:0/2179121777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdc6c0319c0 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc6c040070 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc64ff9640 1 -- 172.21.15.100:0/2179121777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc6c035040 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 10 client.16740 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e9a2e8c540 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc64ff9640 1 -- 172.21.15.100:0/2179121777 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc6c040070 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc64ff9640 1 -- 172.21.15.100:0/2179121777 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdc6c031c30 con 0x55e9a2e074a0 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 10 client.16740 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 20 client.16740 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e8cb40 0x55e9a2e8ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 4 client.16740 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.116+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e9a2d74d60 con 0x55e9a2e8cb40 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.117+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e8cb40 0x55e9a2e8ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.117+0000 7fdc64ff9640 10 client.16740 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.117+0000 7fdc80dd7640 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e8cb40 0x55e9a2e8ef30 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca964dd779627e server_cookie=7d61c382c55055b9 in_seq=0 out_seq=0 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.117+0000 7fdc64ff9640 1 -- 172.21.15.100:0/2179121777 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e9a2d74d60 con 0x55e9a2e8cb40 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.117+0000 7fdc64ff9640 10 client.16740 handle_command_reply: tid=0 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.117+0000 7fdc85c15740 1 client.16740 shutdown 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 msgr2=0x55e9a2e1a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1a9d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0057c0 tx=0x7fdc6c005680 comp rx=0 tx=0).stop 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 shutdown_connections 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9a2e8cb40 0x55e9a2e8ef30 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc64ff9640 0 client.16740 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9a2e12680 0x55e9a2e17f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9a2e07dc0 0x55e9a2e1af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 --2- 172.21.15.100:0/2179121777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9a2e074a0 0x55e9a2e1a9d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 >> 172.21.15.100:0/2179121777 conn(0x55e9a2e03a30 msgr2=0x55e9a2e02350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 shutdown_connections 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 1 -- 172.21.15.100:0/2179121777 wait complete. 2024-09-12T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.118+0000 7fdc85c15740 20 client.16740 trim_cache size 0 max 16384 2024-09-12T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc680a2c00 msgr2=0x7fdc680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc680a2c00 0x7fdc680a50c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc74005fd0 tx=0x7fdc74009bd0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c102570 msgr2=0x7fdc7c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c102570 0x7fdc7c0fd1c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800d950 tx=0x7fdc7800de10 comp rx=0 tx=0).stop 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 shutdown_connections 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdc680a2c00 0x7fdc680a50c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc7c102ef0 0x7fdc7c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc7c102570 0x7fdc7c0fd1c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 --2- 172.21.15.100:0/380962205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc7c100e20 0x7fdc7c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 >> 172.21.15.100:0/380962205 conn(0x7fdc7c0fc7d0 msgr2=0x7fdc7c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 shutdown_connections 2024-09-12T02:46:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:45.119+0000 7fdc8383c640 1 -- 172.21.15.100:0/380962205 wait complete. 2024-09-12T02:46:45.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:44 smithi189 ceph-mon[35196]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-12T02:46:45.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:44 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2188543983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:45.326 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:45.837 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:46:45.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:46:46.305 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:46:46.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.292+0000 7fef70c1c640 1 -- 172.21.15.100:0/3606853216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c106a80 msgr2=0x7fef6c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.292+0000 7fef70c1c640 1 --2- 172.21.15.100:0/3606853216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c106a80 0x7fef6c106e60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fef64009930 tx=0x7fef6402a440 comp rx=0 tx=0).stop 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 -- 172.21.15.100:0/3606853216 shutdown_connections 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 --2- 172.21.15.100:0/3606853216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c101420 0x7fef6c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 --2- 172.21.15.100:0/3606853216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6c100a80 0x7fef6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 --2- 172.21.15.100:0/3606853216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c106a80 0x7fef6c106e60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 -- 172.21.15.100:0/3606853216 >> 172.21.15.100:0/3606853216 conn(0x7fef6c0fc7a0 msgr2=0x7fef6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 -- 172.21.15.100:0/3606853216 shutdown_connections 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 -- 172.21.15.100:0/3606853216 wait complete. 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 Processor -- start 2024-09-12T02:46:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.293+0000 7fef70c1c640 1 -- start start 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c100a80 0x7fef6c199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6c101420 0x7fef6c1999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c106a80 0x7fef6c1a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c110f40 con 0x7fef6c100a80 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c110dc0 con 0x7fef6c106a80 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c1110c0 con 0x7fef6c101420 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c100a80 0x7fef6c199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c100a80 0x7fef6c199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54572/0 (socket says 172.21.15.100:54572) 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 -- 172.21.15.100:0/1878320476 learned_addr learned my addr 172.21.15.100:0/1878320476 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef69d9b640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6c101420 0x7fef6c1999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c106a80 0x7fef6c1a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 -- 172.21.15.100:0/1878320476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6c101420 msgr2=0x7fef6c1999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6c101420 0x7fef6c1999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 -- 172.21.15.100:0/1878320476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c106a80 msgr2=0x7fef6c1a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c106a80 0x7fef6c1a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 -- 172.21.15.100:0/1878320476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6c1a4a50 con 0x7fef6c100a80 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef6a59c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c100a80 0x7fef6c199490 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fef64009a50 tx=0x7fef64004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef637fe640 1 -- 172.21.15.100:0/1878320476 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6403f030 con 0x7fef6c100a80 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef637fe640 1 -- 172.21.15.100:0/1878320476 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef64003ce0 con 0x7fef6c100a80 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6c1a4c20 con 0x7fef6c100a80 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef637fe640 1 -- 172.21.15.100:0/1878320476 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64035070 con 0x7fef6c100a80 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.294+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6c1a5070 con 0x7fef6c100a80 2024-09-12T02:46:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.297+0000 7fef637fe640 1 -- 172.21.15.100:0/1878320476 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fef64042030 con 0x7fef6c100a80 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.297+0000 7fef72ff5740 1 Processor -- start 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.297+0000 7fef72ff5740 1 -- start start 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.297+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588e9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef637fe640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef580a2b80 0x7fef580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9980 0x5629588f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef72ff5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56295884e620 con 0x5629588f4240 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef72ff5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5629587f5e50 con 0x5629588e9980 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef72ff5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56295884a5e0 con 0x5629588e9060 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef69d9b640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef580a2b80 0x7fef580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54578/0 (socket says 172.21.15.100:54578) 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 -- 172.21.15.100:0/3939151881 learned_addr learned my addr 172.21.15.100:0/3939151881 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef637fe640 1 -- 172.21.15.100:0/1878320476 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fef640ef6f0 con 0x7fef6c100a80 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6a59c640 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9980 0x5629588f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 -- 172.21.15.100:0/3939151881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 msgr2=0x5629588e9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588e9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 -- 172.21.15.100:0/3939151881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9980 msgr2=0x5629588f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9980 0x5629588f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 -- 172.21.15.100:0/3939151881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629587e6d40 con 0x5629588f4240 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef69d9b640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef580a2b80 0x7fef580a5040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef54006fd0 tx=0x7fef54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f6630 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00ace0 tx=0x7fef5c0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6b1b4e19f17e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef60ff9640 1 -- 172.21.15.100:0/3939151881 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c013040 con 0x5629588f4240 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef60ff9640 1 -- 172.21.15.100:0/3939151881 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef5c01a430 con 0x5629588f4240 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.298+0000 7fef60ff9640 1 -- 172.21.15.100:0/3939151881 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c019640 con 0x5629588f4240 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 -- 172.21.15.100:0/3939151881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 msgr2=0x5629588f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f6630 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00ace0 tx=0x7fef5c0097c0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 -- 172.21.15.100:0/3939151881 shutdown_connections 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f6630 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9980 0x5629588f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 --2- 172.21.15.100:0/3939151881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 -- 172.21.15.100:0/3939151881 >> 172.21.15.100:0/3939151881 conn(0x5629588e55f0 msgr2=0x5629588e59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 -- 172.21.15.100:0/3939151881 shutdown_connections 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.299+0000 7fef72ff5740 1 -- 172.21.15.100:0/3939151881 wait complete. 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 -- start start 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 Processor -- start 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9060 0x5629588f1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x5629588f1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5629588f6e10 con 0x5629588f4240 2024-09-12T02:46:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5629587d6f10 con 0x5629588e9060 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5629588f6f90 con 0x5629588e9980 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef72ff5740 10 client.0 _ll_register_callbacks cb 0x5629587fadb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54594/0 (socket says 172.21.15.100:54594) 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 -- 172.21.15.100:0/1994881173 learned_addr learned my addr 172.21.15.100:0/1994881173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef69d9b640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x5629588f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6a59c640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9060 0x5629588f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 -- 172.21.15.100:0/1994881173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 msgr2=0x5629588f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x5629588f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 -- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9060 msgr2=0x5629588f1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9060 0x5629588f1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 -- 172.21.15.100:0/1994881173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56295855d580 con 0x5629588f4240 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6a59c640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9060 0x5629588f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f1b90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fef5c002230 tx=0x7fef5c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78d15cfc0f48798 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.300+0000 7fef51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef51ffb640 1 -- 172.21.15.100:0/1994881173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c026070 con 0x5629588f4240 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef51ffb640 1 -- 172.21.15.100:0/1994881173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fef5c01a7f0 con 0x5629588f4240 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef5c01a430 con 0x5629588f4240 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef51ffb640 1 -- 172.21.15.100:0/1994881173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef5c01a9f0 con 0x5629588f4240 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 10 client.16752 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562958627960 con 0x5629588f4240 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef51ffb640 1 -- 172.21.15.100:0/1994881173 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef5c01a430 con 0x5629588f4240 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef51ffb640 1 -- 172.21.15.100:0/1994881173 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fef5c022b00 con 0x5629588f4240 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 10 client.16752 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 10 client.16752 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 20 client.16752 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562958903c80 0x562958906070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 4 client.16752 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.301+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56295885bb90 con 0x562958903c80 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.302+0000 7fef6a59c640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562958903c80 0x562958906070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.302+0000 7fef51ffb640 10 client.16752 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.302+0000 7fef6a59c640 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562958903c80 0x562958906070 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74c070d8b96169bb server_cookie=2a682be2909245c5 in_seq=0 out_seq=0 2024-09-12T02:46:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef51ffb640 1 -- 172.21.15.100:0/1994881173 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56295885bb90 con 0x562958903c80 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef51ffb640 10 client.16752 handle_command_reply: tid=0 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 client.16752 shutdown 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 msgr2=0x5629588f1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f1b90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fef5c002230 tx=0x7fef5c0094c0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 shutdown_connections 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562958903c80 0x562958906070 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588f4240 0x5629588f1b90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x5629588f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef51ffb640 0 client.16752 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 --2- 172.21.15.100:0/1994881173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588e9060 0x5629588f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 >> 172.21.15.100:0/1994881173 conn(0x5629588e55f0 msgr2=0x5629588eb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 shutdown_connections 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 1 -- 172.21.15.100:0/1994881173 wait complete. 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.303+0000 7fef72ff5740 20 client.16752 trim_cache size 0 max 16384 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.319+0000 7fef72ff5740 1 Processor -- start 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef72ff5740 1 -- start start 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9060 0x5629588eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x56295890b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 0x56295890bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef72ff5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c1afed0 con 0x5629588e9060 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef72ff5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c1ad7a0 con 0x5629588f4240 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef72ff5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c1ab5f0 con 0x5629588e9980 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9060 0x5629588eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9060 0x5629588eb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54606/0 (socket says 172.21.15.100:54606) 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 -- 172.21.15.100:0/330309358 learned_addr learned my addr 172.21.15.100:0/330309358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 -- 172.21.15.100:0/330309358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 msgr2=0x56295890b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef69d9b640 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x56295890b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x56295890b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 -- 172.21.15.100:0/330309358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 msgr2=0x56295890bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 0x56295890bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 -- 172.21.15.100:0/330309358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629588e3bb0 con 0x5629588e9060 2024-09-12T02:46:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef6a59c640 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9060 0x5629588eb180 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fef640bbed0 tx=0x7fef640314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17286fbee2df639e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef53fff640 1 -- 172.21.15.100:0/330309358 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64049040 con 0x5629588e9060 2024-09-12T02:46:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef53fff640 1 -- 172.21.15.100:0/330309358 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef640bc640 con 0x5629588e9060 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.320+0000 7fef53fff640 1 -- 172.21.15.100:0/330309358 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6403b460 con 0x5629588e9060 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 -- 172.21.15.100:0/330309358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9060 msgr2=0x5629588eb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9060 0x5629588eb180 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fef640bbed0 tx=0x7fef640314b0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 -- 172.21.15.100:0/330309358 shutdown_connections 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 0x56295890bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9980 0x56295890b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 --2- 172.21.15.100:0/330309358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9060 0x5629588eb180 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 -- 172.21.15.100:0/330309358 >> 172.21.15.100:0/330309358 conn(0x5629588e55f0 msgr2=0x5629588eaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 -- 172.21.15.100:0/330309358 shutdown_connections 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 -- 172.21.15.100:0/330309358 wait complete. 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 -- start start 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.321+0000 7fef72ff5740 1 Processor -- start 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9980 0x5629588f9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef72ff5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 0x562958966770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef72ff5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c1abc60 con 0x5629588e9980 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef72ff5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c1ad0d0 con 0x5629588f4240 2024-09-12T02:46:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef72ff5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef6c1ac330 con 0x5629588e9060 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef72ff5740 10 client.0 _ll_register_callbacks cb 0x7fef5c00abb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9980 0x5629588f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9980 0x5629588f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54618/0 (socket says 172.21.15.100:54618) 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 -- 172.21.15.100:0/113291342 learned_addr learned my addr 172.21.15.100:0/113291342 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef6a59c640 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef6ad9d640 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 0x562958966770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 -- 172.21.15.100:0/113291342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 msgr2=0x5629588f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 -- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 msgr2=0x562958966770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 0x562958966770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 -- 172.21.15.100:0/113291342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562958966fa0 con 0x5629588e9980 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef69d9b640 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9980 0x5629588f9030 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5629588f2750 tx=0x7fef540046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec2c1180d1dc8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.322+0000 7fef51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef51ffb640 1 -- 172.21.15.100:0/113291342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54025020 con 0x5629588e9980 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef51ffb640 1 -- 172.21.15.100:0/113291342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fef5400f040 con 0x5629588e9980 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef640bc640 con 0x5629588e9980 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef51ffb640 1 -- 172.21.15.100:0/113291342 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef54030050 con 0x5629588e9980 2024-09-12T02:46:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 10 client.16758 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56295896f3e0 con 0x5629588e9980 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef51ffb640 1 -- 172.21.15.100:0/113291342 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef640bc640 con 0x5629588e9980 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef51ffb640 1 -- 172.21.15.100:0/113291342 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fef54013070 con 0x5629588e9980 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 10 client.16758 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 10 client.16758 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 20 client.16758 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56295896fbe0 0x562958972000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 4 client.16758 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ee19e4ab", "release": true, "await": true}] 2024-09-12T02:46:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ee19e4ab", "release": true, "await": true}) -- 0x5629588560a0 con 0x56295896fbe0 2024-09-12T02:46:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.323+0000 7fef6a59c640 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56295896fbe0 0x562958972000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.324+0000 7fef51ffb640 10 client.16758 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.324+0000 7fef6a59c640 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56295896fbe0 0x562958972000 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8112b6b862eb4920 server_cookie=2ad726707ae0b2c in_seq=0 out_seq=0 2024-09-12T02:46:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.377+0000 7fef51ffb640 1 -- 172.21.15.100:0/113291342 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5629588560a0 con 0x56295896fbe0 2024-09-12T02:46:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.377+0000 7fef51ffb640 10 client.16758 handle_command_reply: tid=0 2024-09-12T02:46:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.378+0000 7fef72ff5740 1 client.16758 shutdown 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9980 msgr2=0x5629588f9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9980 0x5629588f9030 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5629588f2750 tx=0x7fef540046e0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 shutdown_connections 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56295896fbe0 0x562958972000 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5629588f4240 0x562958966770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5629588e9980 0x5629588f9030 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef51ffb640 0 client.16758 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 --2- 172.21.15.100:0/113291342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5629588e9060 0x5629588f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.382+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 >> 172.21.15.100:0/113291342 conn(0x5629588e55f0 msgr2=0x5629588e4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.383+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 shutdown_connections 2024-09-12T02:46:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.383+0000 7fef72ff5740 1 -- 172.21.15.100:0/113291342 wait complete. 2024-09-12T02:46:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.383+0000 7fef72ff5740 20 client.16758 trim_cache size 0 max 16384 2024-09-12T02:46:46.384 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:46.384 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:46:46.384 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:46:46.384 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 32, 2024-09-12T02:46:46.384 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "ee19e4ab": { 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 32, 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 139.4, 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:46:46.385 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:46:46.386 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:46:46.386 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:46.386 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:46.386 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:46.386 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:46.386 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:46.386 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef580a2b80 msgr2=0x7fef580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef580a2b80 0x7fef580a5040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef54006fd0 tx=0x7fef54008040 comp rx=0 tx=0).stop 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c100a80 msgr2=0x7fef6c199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c100a80 0x7fef6c199490 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fef64009a50 tx=0x7fef64004270 comp rx=0 tx=0).stop 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 shutdown_connections 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef580a2b80 0x7fef580a5040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c106a80 0x7fef6c1a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef6c101420 0x7fef6c1999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 --2- 172.21.15.100:0/1878320476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef6c100a80 0x7fef6c199490 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.384+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 >> 172.21.15.100:0/1878320476 conn(0x7fef6c0fc7a0 msgr2=0x7fef6c0fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.385+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 shutdown_connections 2024-09-12T02:46:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:46.385+0000 7fef70c1c640 1 -- 172.21.15.100:0/1878320476 wait complete. 2024-09-12T02:46:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:46 smithi117 ceph-mon[34898]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.2 MiB/s wr, 83 op/s 2024-09-12T02:46:47.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:46 smithi100 ceph-mon[31390]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.2 MiB/s wr, 83 op/s 2024-09-12T02:46:47.148 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ee19e4ab', total seconds elapsed: 23.5 2024-09-12T02:46:47.149 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.4 2024-09-12T02:46:47.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:46:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:46 smithi189 ceph-mon[35196]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.2 MiB/s wr, 83 op/s 2024-09-12T02:46:47.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 -- 172.21.15.100:0/4228622721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918106f00 msgr2=0x7f291810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:47.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4228622721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918106f00 0x7f291810ea80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2910009ca0 tx=0x7f291002a8b0 comp rx=0 tx=0).stop 2024-09-12T02:46:47.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 -- 172.21.15.100:0/4228622721 shutdown_connections 2024-09-12T02:46:47.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4228622721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918106f00 0x7f291810ea80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:47.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4228622721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2918102780 0x7f29181067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:47.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4228622721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2918101dd0 0x7f29181021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:47.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 -- 172.21.15.100:0/4228622721 >> 172.21.15.100:0/4228622721 conn(0x7f29180fd8b0 msgr2=0x7f29180ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:47.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 -- 172.21.15.100:0/4228622721 shutdown_connections 2024-09-12T02:46:47.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.737+0000 7f291d2ae640 1 -- 172.21.15.100:0/4228622721 wait complete. 2024-09-12T02:46:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.738+0000 7f291d2ae640 1 Processor -- start 2024-09-12T02:46:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.739+0000 7f291d2ae640 1 -- start start 2024-09-12T02:46:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.739+0000 7f291d2ae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2918101dd0 0x7f29181984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.739+0000 7f291d2ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918102780 0x7f2918198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.739+0000 7f291d2ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2918106f00 0x7f291819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f291d2ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2918111f80 con 0x7f2918106f00 2024-09-12T02:46:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f29167fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918102780 0x7f2918198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f29167fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918102780 0x7f2918198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42816/0 (socket says 172.21.15.100:42816) 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f29167fc640 1 -- 172.21.15.100:0/4001539660 learned_addr learned my addr 172.21.15.100:0/4001539660 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2918111e00 con 0x7f2918102780 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2918112100 con 0x7f2918101dd0 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f2916ffd640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2918101dd0 0x7f29181984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.740+0000 7f29177fe640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2918106f00 0x7f291819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f29167fc640 1 -- 172.21.15.100:0/4001539660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2918101dd0 msgr2=0x7f29181984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f29167fc640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2918101dd0 0x7f29181984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f29167fc640 1 -- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2918106f00 msgr2=0x7f291819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f29167fc640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2918106f00 0x7f291819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f29167fc640 1 -- 172.21.15.100:0/4001539660 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291819d470 con 0x7f2918102780 2024-09-12T02:46:47.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f29167fc640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918102780 0x7f2918198a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f290c00b4a0 tx=0x7f290c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f28fffff640 1 -- 172.21.15.100:0/4001539660 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c014070 con 0x7f2918102780 2024-09-12T02:46:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291819d760 con 0x7f2918102780 2024-09-12T02:46:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f28fffff640 1 -- 172.21.15.100:0/4001539660 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f290c010af0 con 0x7f2918102780 2024-09-12T02:46:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f28fffff640 1 -- 172.21.15.100:0/4001539660 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c017d10 con 0x7f2918102780 2024-09-12T02:46:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.741+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29181a5040 con 0x7f2918102780 2024-09-12T02:46:47.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.743+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29181021b0 con 0x7f2918102780 2024-09-12T02:46:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.745+0000 7f28fffff640 1 -- 172.21.15.100:0/4001539660 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f290c017070 con 0x7f2918102780 2024-09-12T02:46:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.746+0000 7f28fffff640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29000a2c80 0x7f29000a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.746+0000 7f2916ffd640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29000a2c80 0x7f29000a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.746+0000 7f28fffff640 1 -- 172.21.15.100:0/4001539660 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f290c0ce3a0 con 0x7f2918102780 2024-09-12T02:46:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.747+0000 7f2916ffd640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29000a2c80 0x7f29000a5140 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2908009bd0 tx=0x7f2908005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:47.750+0000 7f28fffff640 1 -- 172.21.15.100:0/4001539660 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f290c09b290 con 0x7f2918102780 2024-09-12T02:46:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:48.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.043+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2918109bb0 con 0x7f2918102780 2024-09-12T02:46:48.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.044+0000 7f28fffff640 1 -- 172.21.15.100:0/4001539660 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f290c09ab90 con 0x7f2918102780 2024-09-12T02:46:48.045 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:46:48.045 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:46:48.045 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:46:48.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.046+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29000a2c80 msgr2=0x7f29000a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.046+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29000a2c80 0x7f29000a5140 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2908009bd0 tx=0x7f2908005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.046+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918102780 msgr2=0x7f2918198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.046+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918102780 0x7f2918198a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f290c00b4a0 tx=0x7f290c00b960 comp rx=0 tx=0).stop 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 shutdown_connections 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f29000a2c80 0x7f29000a5140 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2918106f00 0x7f291819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2918102780 0x7f2918198a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 --2- 172.21.15.100:0/4001539660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2918101dd0 0x7f29181984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 >> 172.21.15.100:0/4001539660 conn(0x7f29180fd8b0 msgr2=0x7f29180febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 shutdown_connections 2024-09-12T02:46:48.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.047+0000 7f291d2ae640 1 -- 172.21.15.100:0/4001539660 wait complete. 2024-09-12T02:46:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.232+0000 7fe8e91ef640 1 -- 172.21.15.100:0/2029907915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e4105ec0 msgr2=0x7fe8e4106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/2029907915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e4105ec0 0x7fe8e4106340 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009860 tx=0x7fe8d402a340 comp rx=0 tx=0).stop 2024-09-12T02:46:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 -- 172.21.15.100:0/2029907915 shutdown_connections 2024-09-12T02:46:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/2029907915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e4105ec0 0x7fe8e4106340 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/2029907915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e41011e0 0x7fe8e4105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/2029907915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e41008c0 0x7fe8e4100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 -- 172.21.15.100:0/2029907915 >> 172.21.15.100:0/2029907915 conn(0x7fe8e40fc7d0 msgr2=0x7fe8e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 -- 172.21.15.100:0/2029907915 shutdown_connections 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 -- 172.21.15.100:0/2029907915 wait complete. 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.233+0000 7fe8e91ef640 1 Processor -- start 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e91ef640 1 -- start start 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e91ef640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e41008c0 0x7fe8e41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e91ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41011e0 0x7fe8e41a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e91ef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e4105ec0 0x7fe8e419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e91ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4118630 con 0x7fe8e41011e0 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e91ef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41184b0 con 0x7fe8e4105ec0 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e91ef640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41187b0 con 0x7fe8e41008c0 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41011e0 0x7fe8e41a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41011e0 0x7fe8e41a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54678/0 (socket says 172.21.15.100:54678) 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e259c640 1 -- 172.21.15.100:0/3497418664 learned_addr learned my addr 172.21.15.100:0/3497418664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e359e640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e4105ec0 0x7fe8e419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.234+0000 7fe8e2d9d640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e41008c0 0x7fe8e41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e359e640 1 -- 172.21.15.100:0/3497418664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e41008c0 msgr2=0x7fe8e41a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e359e640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e41008c0 0x7fe8e41a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e359e640 1 -- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41011e0 msgr2=0x7fe8e41a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e359e640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41011e0 0x7fe8e41a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e359e640 1 -- 172.21.15.100:0/3497418664 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e419f070 con 0x7fe8e4105ec0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e259c640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41011e0 0x7fe8e41a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e359e640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e4105ec0 0x7fe8e419e940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe8d402a860 tx=0x7fe8d4033ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8cbfff640 1 -- 172.21.15.100:0/3497418664 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d403f020 con 0x7fe8e4105ec0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8cbfff640 1 -- 172.21.15.100:0/3497418664 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d4004040 con 0x7fe8e4105ec0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e419f300 con 0x7fe8e4105ec0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8cbfff640 1 -- 172.21.15.100:0/3497418664 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4037040 con 0x7fe8e4105ec0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.235+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41ab650 con 0x7fe8e4105ec0 2024-09-12T02:46:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.237+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e4105980 con 0x7fe8e4105ec0 2024-09-12T02:46:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.237+0000 7fe8cbfff640 1 -- 172.21.15.100:0/3497418664 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe8d4042020 con 0x7fe8e4105ec0 2024-09-12T02:46:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.238+0000 7fe8cbfff640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.238+0000 7fe8cbfff640 1 -- 172.21.15.100:0/3497418664 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe8d40eef80 con 0x7fe8e4105ec0 2024-09-12T02:46:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.238+0000 7fe8e2d9d640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.239+0000 7fe8e2d9d640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe8e419fa80 tx=0x7fe8d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.242+0000 7fe8cbfff640 1 -- 172.21.15.100:0/3497418664 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8d4049020 con 0x7fe8e4105ec0 2024-09-12T02:46:48.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.555+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8e41ab820 con 0x7fe8e4105ec0 2024-09-12T02:46:48.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.556+0000 7fe8cbfff640 1 -- 172.21.15.100:0/3497418664 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fe8d40bbed0 con 0x7fe8e4105ec0 2024-09-12T02:46:48.557 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:46:48.557 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:46:48.557 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:46:48.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.558+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8cc0a2b80 msgr2=0x7fe8cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.558+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe8e419fa80 tx=0x7fe8d8005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:48.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.558+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e4105ec0 msgr2=0x7fe8e419e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.558+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e4105ec0 0x7fe8e419e940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe8d402a860 tx=0x7fe8d4033ae0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 shutdown_connections 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e4105ec0 0x7fe8e419e940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41011e0 0x7fe8e41a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 --2- 172.21.15.100:0/3497418664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e41008c0 0x7fe8e41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 >> 172.21.15.100:0/3497418664 conn(0x7fe8e40fc7d0 msgr2=0x7fe8e4103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 shutdown_connections 2024-09-12T02:46:48.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:48.559+0000 7fe8e91ef640 1 -- 172.21.15.100:0/3497418664 wait complete. 2024-09-12T02:46:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:48 smithi117 ceph-mon[34898]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 419 KiB/s wr, 44 op/s 2024-09-12T02:46:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4001539660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:49.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3497418664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:48 smithi100 ceph-mon[31390]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 419 KiB/s wr, 44 op/s 2024-09-12T02:46:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4001539660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3497418664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:49.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:46:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:48 smithi189 ceph-mon[35196]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 419 KiB/s wr, 44 op/s 2024-09-12T02:46:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4001539660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3497418664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:49.962 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0' 2024-09-12T02:46:49.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 139.4 --await-for 45.0 2024-09-12T02:46:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.526+0000 7fa8c8293640 1 -- 172.21.15.100:0/3864818241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c0102570 msgr2=0x7fa8c01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.526+0000 7fa8c8293640 1 --2- 172.21.15.100:0/3864818241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c0102570 0x7fa8c01029b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009890 tx=0x7fa8b002a410 comp rx=0 tx=0).stop 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.527+0000 7fa8c8293640 1 -- 172.21.15.100:0/3864818241 shutdown_connections 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.527+0000 7fa8c8293640 1 --2- 172.21.15.100:0/3864818241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 0x7fa8c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.527+0000 7fa8c8293640 1 --2- 172.21.15.100:0/3864818241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c0102570 0x7fa8c01029b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.527+0000 7fa8c8293640 1 --2- 172.21.15.100:0/3864818241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8c0100e20 0x7fa8c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.527+0000 7fa8c8293640 1 -- 172.21.15.100:0/3864818241 >> 172.21.15.100:0/3864818241 conn(0x7fa8c00fc7d0 msgr2=0x7fa8c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.527+0000 7fa8c8293640 1 -- 172.21.15.100:0/3864818241 shutdown_connections 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.528+0000 7fa8c8293640 1 -- 172.21.15.100:0/3864818241 wait complete. 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.528+0000 7fa8c8293640 1 Processor -- start 2024-09-12T02:46:50.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c8293640 1 -- start start 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c8293640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c0100e20 0x7fa8c01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c8293640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8c0102570 0x7fa8c01976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c8293640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 0x7fa8c019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c8293640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0110f80 con 0x7fa8c0102ef0 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c8293640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0110e00 con 0x7fa8c0102570 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c8293640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0111100 con 0x7fa8c0100e20 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c6830640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 0x7fa8c019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c6830640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 0x7fa8c019c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54690/0 (socket says 172.21.15.100:54690) 2024-09-12T02:46:50.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.529+0000 7fa8c6830640 1 -- 172.21.15.100:0/415807152 learned_addr learned my addr 172.21.15.100:0/415807152 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:50.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.530+0000 7fa8c6830640 1 -- 172.21.15.100:0/415807152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c0100e20 msgr2=0x7fa8c01971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.530+0000 7fa8c6830640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c0100e20 0x7fa8c01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.530+0000 7fa8c6830640 1 -- 172.21.15.100:0/415807152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8c0102570 msgr2=0x7fa8c01976e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.530+0000 7fa8c6830640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8c0102570 0x7fa8c01976e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.530+0000 7fa8c6830640 1 -- 172.21.15.100:0/415807152 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c019c730 con 0x7fa8c0102ef0 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.530+0000 7fa8c6830640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 0x7fa8c019c1f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800efc0 tx=0x7fa8b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.530+0000 7fa8b77fe640 1 -- 172.21.15.100:0/415807152 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8003970 con 0x7fa8c0102ef0 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.531+0000 7fa8b77fe640 1 -- 172.21.15.100:0/415807152 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8b8004020 con 0x7fa8c0102ef0 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.531+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c019ca20 con 0x7fa8c0102ef0 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.531+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c019ce50 con 0x7fa8c0102ef0 2024-09-12T02:46:50.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.531+0000 7fa8b77fe640 1 -- 172.21.15.100:0/415807152 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800b9f0 con 0x7fa8c0102ef0 2024-09-12T02:46:50.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.536+0000 7fa8ca66c740 1 Processor -- start 2024-09-12T02:46:50.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.536+0000 7fa8b77fe640 1 -- 172.21.15.100:0/415807152 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fa8b801d020 con 0x7fa8c0102ef0 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.536+0000 7fa8ca66c740 1 -- start start 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc511aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 0x55ecc5127760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ecc50802f0 con 0x55ecc511a5d0 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecc5027cf0 con 0x55ecc511bb40 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ecc507c2b0 con 0x55ecc5125370 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8c582e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8c582e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42860/0 (socket says 172.21.15.100:42860) 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.537+0000 7fa8c582e640 1 -- 172.21.15.100:0/636539238 learned_addr learned my addr 172.21.15.100:0/636539238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c582e640 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 0x55ecc5127760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8b77fe640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8ac0a2b80 0x7fa8ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c602f640 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc511aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c6830640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8ac0a2b80 0x7fa8ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8b77fe640 1 -- 172.21.15.100:0/415807152 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa8b80cef60 con 0x7fa8c0102ef0 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c602f640 1 -- 172.21.15.100:0/636539238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 msgr2=0x55ecc5127760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c602f640 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 0x55ecc5127760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c602f640 1 -- 172.21.15.100:0/636539238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 msgr2=0x55ecc511a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c602f640 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.538+0000 7fa8c602f640 1 -- 172.21.15.100:0/636539238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc500c3a0 con 0x55ecc511a5d0 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.539+0000 7fa8c602f640 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc511aa10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc005fd0 tx=0x7fa8bc00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca218a7197af112 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.539+0000 7fa8c6830640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8ac0a2b80 0x7fa8ac0a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8005c40 tx=0x7fa8b8066320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:50.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.540+0000 7fa8b4dea640 1 -- 172.21.15.100:0/636539238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00dc40 con 0x55ecc511a5d0 2024-09-12T02:46:50.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.540+0000 7fa8b4dea640 1 -- 172.21.15.100:0/636539238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8bc00dde0 con 0x55ecc511a5d0 2024-09-12T02:46:50.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.540+0000 7fa8b4dea640 1 -- 172.21.15.100:0/636539238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc010460 con 0x55ecc511a5d0 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.541+0000 7fa8ca66c740 1 -- 172.21.15.100:0/636539238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 msgr2=0x55ecc511aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.541+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc511aa10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc005fd0 tx=0x7fa8bc00bf00 comp rx=0 tx=0).stop 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.541+0000 7fa8ca66c740 1 -- 172.21.15.100:0/636539238 shutdown_connections 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.541+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 0x55ecc5127760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.541+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc511aa10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.541+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/636539238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.541+0000 7fa8ca66c740 1 -- 172.21.15.100:0/636539238 >> 172.21.15.100:0/636539238 conn(0x55ecc50e3310 msgr2=0x55ecc5116c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.542+0000 7fa8ca66c740 1 -- 172.21.15.100:0/636539238 shutdown_connections 2024-09-12T02:46:50.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.542+0000 7fa8ca66c740 1 -- 172.21.15.100:0/636539238 wait complete. 2024-09-12T02:46:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.542+0000 7fa8ca66c740 1 -- start start 2024-09-12T02:46:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.542+0000 7fa8ca66c740 1 Processor -- start 2024-09-12T02:46:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.543+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511a5d0 0x55ecc5124d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.543+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5122000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.543+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc5125370 0x55ecc51225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.543+0000 7fa8c582e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511a5d0 0x55ecc5124d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.543+0000 7fa8c582e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511a5d0 0x55ecc5124d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42866/0 (socket says 172.21.15.100:42866) 2024-09-12T02:46:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.543+0000 7fa8c602f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.543+0000 7fa8c602f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5122000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:49864/0 (socket says 172.21.15.100:49864) 2024-09-12T02:46:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8c582e640 1 -- 172.21.15.100:0/468845164 learned_addr learned my addr 172.21.15.100:0/468845164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ecc5128070 con 0x55ecc5125370 2024-09-12T02:46:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecc503b060 con 0x55ecc511a5d0 2024-09-12T02:46:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ecc51281f0 con 0x55ecc511bb40 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8ca66c740 10 client.0 _ll_register_callbacks cb 0x55ecc4d8e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8c602f640 1 -- 172.21.15.100:0/468845164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511a5d0 msgr2=0x55ecc5124d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8c602f640 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511a5d0 0x55ecc5124d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8c602f640 1 -- 172.21.15.100:0/468845164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc5125370 msgr2=0x55ecc51225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8c602f640 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc5125370 0x55ecc51225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8c602f640 1 -- 172.21.15.100:0/468845164 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc4df13c0 con 0x55ecc511bb40 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8bc00dde0 con 0x55ecc511bb40 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8c602f640 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5122000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc005d00 tx=0x7fa8bc00dc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a750fc9c4eaf91e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.544+0000 7fa8a9ffb640 10 client.26101 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.545+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/468845164 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc005220 con 0x55ecc511bb40 2024-09-12T02:46:50.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.545+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/468845164 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa8bc0053c0 con 0x55ecc511bb40 2024-09-12T02:46:50.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.545+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/468845164 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa8bc00b690 con 0x55ecc511bb40 2024-09-12T02:46:50.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.545+0000 7fa8c582e640 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511a5d0 0x55ecc5124d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:50.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.545+0000 7fa8ca66c740 10 client.26101 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:50.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ecc5133aa0 con 0x55ecc511bb40 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/468845164 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa8bc003e50 con 0x55ecc511bb40 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8ca66c740 10 client.26101 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8ca66c740 10 client.26101 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8ca66c740 20 client.26101 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc5134df0 0x55ecc51371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8ca66c740 4 client.26101 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.546+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa8bc00dde0 con 0x55ecc5134df0 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.547+0000 7fa8c582e640 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc5134df0 0x55ecc51371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.548+0000 7fa8a9ffb640 10 client.26101 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:50.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.548+0000 7fa8c582e640 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc5134df0 0x55ecc51371e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=356ecf9f26471b2 server_cookie=b0373fa2358b0cc5 in_seq=0 out_seq=0 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/468845164 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa8bc00dde0 con 0x55ecc5134df0 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8a9ffb640 10 client.26101 handle_command_reply: tid=0 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 client.26101 shutdown 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 msgr2=0x55ecc5122000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5122000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc005d00 tx=0x7fa8bc00dc70 comp rx=0 tx=0).stop 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 shutdown_connections 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc5134df0 0x55ecc51371e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8a9ffb640 0 client.26101 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc5125370 0x55ecc51225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5122000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/468845164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511a5d0 0x55ecc5124d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.549+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 >> 172.21.15.100:0/468845164 conn(0x55ecc50e3310 msgr2=0x55ecc511c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:50.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.550+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 shutdown_connections 2024-09-12T02:46:50.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.550+0000 7fa8ca66c740 1 -- 172.21.15.100:0/468845164 wait complete. 2024-09-12T02:46:50.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.550+0000 7fa8ca66c740 20 client.26101 trim_cache size 0 max 16384 2024-09-12T02:46:50.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.568+0000 7fa8ca66c740 1 Processor -- start 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.568+0000 7fa8ca66c740 1 -- start start 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc51313a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5116700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc5125370 0x55ecc5116c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a4010d70 con 0x55ecc511a5d0 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a400e640 con 0x55ecc5125370 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a400c490 con 0x55ecc511bb40 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c582e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc51313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5116700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5116700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:49872/0 (socket says 172.21.15.100:49872) 2024-09-12T02:46:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 -- 172.21.15.100:0/3538516129 learned_addr learned my addr 172.21.15.100:0/3538516129 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c582e640 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc5125370 0x55ecc5116c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 -- 172.21.15.100:0/3538516129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc5125370 msgr2=0x55ecc5116c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc5125370 0x55ecc5116c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 -- 172.21.15.100:0/3538516129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 msgr2=0x55ecc51313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc51313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.569+0000 7fa8c602f640 1 -- 172.21.15.100:0/3538516129 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc5117180 con 0x55ecc511bb40 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.570+0000 7fa8c602f640 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5116700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc003c10 tx=0x7fa8bc01e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ec84a06a3c8c551 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.570+0000 7fa8abfff640 1 -- 172.21.15.100:0/3538516129 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00b690 con 0x55ecc511bb40 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.570+0000 7fa8abfff640 1 -- 172.21.15.100:0/3538516129 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8bc003e50 con 0x55ecc511bb40 2024-09-12T02:46:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.570+0000 7fa8abfff640 1 -- 172.21.15.100:0/3538516129 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0053c0 con 0x55ecc511bb40 2024-09-12T02:46:50.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 -- 172.21.15.100:0/3538516129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 msgr2=0x55ecc5116700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5116700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc003c10 tx=0x7fa8bc01e000 comp rx=0 tx=0).stop 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 -- 172.21.15.100:0/3538516129 shutdown_connections 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc5125370 0x55ecc5116c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc511bb40 0x55ecc5116700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/3538516129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc51313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 -- 172.21.15.100:0/3538516129 >> 172.21.15.100:0/3538516129 conn(0x55ecc50e3310 msgr2=0x55ecc5121fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 -- 172.21.15.100:0/3538516129 shutdown_connections 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 -- 172.21.15.100:0/3538516129 wait complete. 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 -- start start 2024-09-12T02:46:50.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.571+0000 7fa8ca66c740 1 Processor -- start 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc512dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8ca66c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 0x55ecc511f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a400cb00 con 0x55ecc511a5d0 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a400df70 con 0x55ecc511bb40 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8c602f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8c602f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42882/0 (socket says 172.21.15.100:42882) 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8c602f640 1 -- 172.21.15.100:0/931381311 learned_addr learned my addr 172.21.15.100:0/931381311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.572+0000 7fa8ca66c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a400d1d0 con 0x55ecc5125370 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8ca66c740 10 client.0 _ll_register_callbacks cb 0x7fa8b8009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8c602f640 1 -- 172.21.15.100:0/931381311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 msgr2=0x55ecc511f210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8c602f640 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 0x55ecc511f210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8c602f640 1 -- 172.21.15.100:0/931381311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 msgr2=0x55ecc512dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8c602f640 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc512dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8c602f640 1 -- 172.21.15.100:0/931381311 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc511fa20 con 0x55ecc511bb40 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8bc003e50 con 0x55ecc511bb40 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8c602f640 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511ecd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0043d0 tx=0x7fa8bc0049d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d8188b3106620c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.573+0000 7fa8a9ffb640 10 client.26147 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/931381311 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc004590 con 0x55ecc511bb40 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/931381311 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa8bc005020 con 0x55ecc511bb40 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/931381311 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa8bc00b690 con 0x55ecc511bb40 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 10 client.26147 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:50.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ecc519f600 con 0x55ecc511bb40 2024-09-12T02:46:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/931381311 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa8bc044060 con 0x55ecc511bb40 2024-09-12T02:46:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 10 client.26147 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 10 client.26147 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:46:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 20 client.26147 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:50.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc519f9e0 0x55ecc51a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 4 client.26147 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.574+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ecc508d860 con 0x55ecc519f9e0 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.575+0000 7fa8c582e640 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc519f9e0 0x55ecc51a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.575+0000 7fa8c582e640 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc519f9e0 0x55ecc51a1dd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44d4aae538ede265 server_cookie=4268c86350d5e055 in_seq=0 out_seq=0 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.575+0000 7fa8a9ffb640 10 client.26147 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8a9ffb640 1 -- 172.21.15.100:0/931381311 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ecc508d860 con 0x55ecc519f9e0 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8a9ffb640 10 client.26147 handle_command_reply: tid=0 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 client.26147 shutdown 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 msgr2=0x55ecc511ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511ecd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0043d0 tx=0x7fa8bc0049d0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 shutdown_connections 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55ecc519f9e0 0x55ecc51a1dd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8a9ffb640 0 client.26147 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ecc5125370 0x55ecc511f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecc511bb40 0x55ecc511ecd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 --2- 172.21.15.100:0/931381311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc511a5d0 0x55ecc512dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 >> 172.21.15.100:0/931381311 conn(0x55ecc50e3310 msgr2=0x55ecc5123860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 shutdown_connections 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.576+0000 7fa8ca66c740 1 -- 172.21.15.100:0/931381311 wait complete. 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.577+0000 7fa8ca66c740 20 client.26147 trim_cache size 0 max 16384 2024-09-12T02:46:50.581 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.577+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8ac0a2b80 msgr2=0x7fa8ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.577+0000 7fa8c8293640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8ac0a2b80 0x7fa8ac0a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8005c40 tx=0x7fa8b8066320 comp rx=0 tx=0).stop 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.577+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 msgr2=0x7fa8c019c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.577+0000 7fa8c8293640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 0x7fa8c019c1f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800efc0 tx=0x7fa8b800c800 comp rx=0 tx=0).stop 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 shutdown_connections 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa8ac0a2b80 0x7fa8ac0a5040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8c0102ef0 0x7fa8c019c1f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8c0102570 0x7fa8c01976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 --2- 172.21.15.100:0/415807152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c0100e20 0x7fa8c01971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 >> 172.21.15.100:0/415807152 conn(0x7fa8c00fc7d0 msgr2=0x7fa8c01048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 shutdown_connections 2024-09-12T02:46:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:50.578+0000 7fa8c8293640 1 -- 172.21.15.100:0/415807152 wait complete. 2024-09-12T02:46:50.583 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:50 smithi117 ceph-mon[34898]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 913 KiB/s wr, 94 op/s 2024-09-12T02:46:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:50 smithi100 ceph-mon[31390]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 913 KiB/s wr, 94 op/s 2024-09-12T02:46:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:50 smithi189 ceph-mon[35196]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 913 KiB/s wr, 94 op/s 2024-09-12T02:46:51.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:46:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 460.0 s, 2725.0 tps, lat 180.490 ms stddev 1683.551 2024-09-12T02:46:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 -- 172.21.15.100:0/1914671191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694101dd0 msgr2=0x7fb6941021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/1914671191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694101dd0 0x7fb6941021b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb690009900 tx=0x7fb69002a410 comp rx=0 tx=0).stop 2024-09-12T02:46:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 -- 172.21.15.100:0/1914671191 shutdown_connections 2024-09-12T02:46:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/1914671191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb694106f00 0x7fb69410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/1914671191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb694102780 0x7fb6941067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/1914671191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694101dd0 0x7fb6941021b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 -- 172.21.15.100:0/1914671191 >> 172.21.15.100:0/1914671191 conn(0x7fb6940fd8b0 msgr2=0x7fb6940ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 -- 172.21.15.100:0/1914671191 shutdown_connections 2024-09-12T02:46:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.776+0000 7fb69b3cc640 1 -- 172.21.15.100:0/1914671191 wait complete. 2024-09-12T02:46:51.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.778+0000 7fb69b3cc640 1 Processor -- start 2024-09-12T02:46:51.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.778+0000 7fb69b3cc640 1 -- start start 2024-09-12T02:46:51.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb69b3cc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb694101dd0 0x7fb6940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb69b3cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694102780 0x7fb694074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb69b3cc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb694106f00 0x7fb694074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb69b3cc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb694111f20 con 0x7fb694102780 2024-09-12T02:46:51.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb69b3cc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb694111da0 con 0x7fb694101dd0 2024-09-12T02:46:51.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb69b3cc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941120a0 con 0x7fb694106f00 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694102780 0x7fb694074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694102780 0x7fb694074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54738/0 (socket says 172.21.15.100:54738) 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb699168640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb694101dd0 0x7fb6940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 -- 172.21.15.100:0/3472587965 learned_addr learned my addr 172.21.15.100:0/3472587965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb699969640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb694106f00 0x7fb694074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 -- 172.21.15.100:0/3472587965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb694106f00 msgr2=0x7fb694074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb694106f00 0x7fb694074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 -- 172.21.15.100:0/3472587965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb694101dd0 msgr2=0x7fb6940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb694101dd0 0x7fb6940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 -- 172.21.15.100:0/3472587965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941a6900 con 0x7fb694102780 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb699168640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb694101dd0 0x7fb6940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:51.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.779+0000 7fb698967640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694102780 0x7fb694074a30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb68400d950 tx=0x7fb68400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.780+0000 7fb68a7fc640 1 -- 172.21.15.100:0/3472587965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb684017030 con 0x7fb694102780 2024-09-12T02:46:51.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.780+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb694198200 con 0x7fb694102780 2024-09-12T02:46:51.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.780+0000 7fb68a7fc640 1 -- 172.21.15.100:0/3472587965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb684004020 con 0x7fb694102780 2024-09-12T02:46:51.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.780+0000 7fb68a7fc640 1 -- 172.21.15.100:0/3472587965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6840047a0 con 0x7fb694102780 2024-09-12T02:46:51.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.780+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb694198740 con 0x7fb694102780 2024-09-12T02:46:51.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.785+0000 7fb69d7a5740 1 Processor -- start 2024-09-12T02:46:51.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.785+0000 7fb69d7a5740 1 -- start start 2024-09-12T02:46:51.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.785+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.785+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179ab1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ab3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560179a0c2a0 con 0x560179aa7080 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5601799b3b10 con 0x560179ab1940 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560179a08260 con 0x560179aa6760 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179ab1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179ab1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54744/0 (socket says 172.21.15.100:54744) 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 -- 172.21.15.100:0/1740823778 learned_addr learned my addr 172.21.15.100:0/1740823778 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb68a7fc640 1 -- 172.21.15.100:0/3472587965 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb684004940 con 0x7fb694102780 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699969640 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 -- 172.21.15.100:0/1740823778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 msgr2=0x560179aa6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb698967640 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ab3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 -- 172.21.15.100:0/1740823778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 msgr2=0x560179ab3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ab3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 -- 172.21.15.100:0/1740823778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017977db90 con 0x560179aa7080 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb698967640 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ab3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb699168640 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179ab1400 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb690009900 tx=0x7fb690005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b52d4d308da3e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb67f7fe640 1 -- 172.21.15.100:0/1740823778 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690035040 con 0x560179aa7080 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb67f7fe640 1 -- 172.21.15.100:0/1740823778 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6900319f0 con 0x560179aa7080 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.786+0000 7fb67f7fe640 1 -- 172.21.15.100:0/1740823778 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690004a00 con 0x560179aa7080 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb68a7fc640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6800a2b80 0x7fb6800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb699969640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6800a2b80 0x7fb6800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb68a7fc640 1 -- 172.21.15.100:0/3472587965 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb6840ce9e0 con 0x7fb694102780 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1740823778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 msgr2=0x560179ab1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179ab1400 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb690009900 tx=0x7fb690005e80 comp rx=0 tx=0).stop 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb699969640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6800a2b80 0x7fb6800a5040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005fd0 tx=0x7fb68c016040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1740823778 shutdown_connections 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ab3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179ab1400 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1740823778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1740823778 >> 172.21.15.100:0/1740823778 conn(0x560179aa2cf0 msgr2=0x560179aa30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.787+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1740823778 shutdown_connections 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.788+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1740823778 wait complete. 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.788+0000 7fb69d7a5740 1 -- start start 2024-09-12T02:46:51.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.788+0000 7fb69d7a5740 1 Processor -- start 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179aae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aaec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179ab1940 0x560179aaf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560179ab4510 con 0x560179aa7080 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5601799946e0 con 0x560179aa6760 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb698967640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aaec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb699969640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179ab1940 0x560179aaf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb698967640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aaec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54748/0 (socket says 172.21.15.100:54748) 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb698967640 1 -- 172.21.15.100:0/2944689151 learned_addr learned my addr 172.21.15.100:0/2944689151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb699168640 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179aae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.789+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560179ab4690 con 0x560179ab1940 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb69d7a5740 10 client.0 _ll_register_callbacks cb 0x5601799b8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb699969640 1 -- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 msgr2=0x560179aae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb699969640 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179aae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb699969640 1 -- 172.21.15.100:0/2944689151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 msgr2=0x560179aaec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb699969640 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aaec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb699969640 1 -- 172.21.15.100:0/2944689151 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560179abd980 con 0x560179ab1940 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb698967640 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aaec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6900319f0 con 0x560179ab1940 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb699969640 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179ab1940 0x560179aaf1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb68c008b70 tx=0x7fb68c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f786fce9a074eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.790+0000 7fb67cff9640 10 client.26116 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.791+0000 7fb67cff9640 1 -- 172.21.15.100:0/2944689151 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c025070 con 0x560179ab1940 2024-09-12T02:46:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.791+0000 7fb67cff9640 1 -- 172.21.15.100:0/2944689151 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb68c004b20 con 0x560179ab1940 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.791+0000 7fb67cff9640 1 -- 172.21.15.100:0/2944689151 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb68c004d20 con 0x560179ab1940 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.791+0000 7fb69d7a5740 10 client.26116 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.791+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=27}) -- 0x560179ac01a0 con 0x560179ab1940 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb67cff9640 1 -- 172.21.15.100:0/2944689151 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb68c004390 con 0x560179ab1940 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb69d7a5740 10 client.26116 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb69d7a5740 10 client.26116 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb69d7a5740 20 client.26116 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179ac1550 0x560179ac3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb69d7a5740 4 client.26116 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560179a199d0 con 0x560179ac1550 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.792+0000 7fb699168640 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179ac1550 0x560179ac3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.793+0000 7fb67cff9640 10 client.26116 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.793+0000 7fb699168640 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179ac1550 0x560179ac3960 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be81975561edabe server_cookie=e7e5f11932db3c3b in_seq=0 out_seq=0 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.793+0000 7fb67cff9640 1 -- 172.21.15.100:0/2944689151 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560179a199d0 con 0x560179ac1550 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.793+0000 7fb67cff9640 10 client.26116 handle_command_reply: tid=0 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.793+0000 7fb69d7a5740 1 client.26116 shutdown 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179ab1940 msgr2=0x560179aaf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179ab1940 0x560179aaf1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb68c008b70 tx=0x7fb68c004ab0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 shutdown_connections 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179ac1550 0x560179ac3960 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179ab1940 0x560179aaf1c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aaec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/2944689151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179aae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 >> 172.21.15.100:0/2944689151 conn(0x560179aa2cf0 msgr2=0x560179aa1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:51.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb67cff9640 0 client.26116 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:51.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 shutdown_connections 2024-09-12T02:46:51.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 1 -- 172.21.15.100:0/2944689151 wait complete. 2024-09-12T02:46:51.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.794+0000 7fb69d7a5740 20 client.26116 trim_cache size 0 max 16384 2024-09-12T02:46:51.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.816+0000 7fb69d7a5740 1 Processor -- start 2024-09-12T02:46:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.817+0000 7fb69d7a5740 1 -- start start 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.817+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.817+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb699168640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb699168640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:49930/0 (socket says 172.21.15.100:49930) 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb698967640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb698967640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54762/0 (socket says 172.21.15.100:54762) 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb699168640 1 -- 172.21.15.100:0/3044174701 learned_addr learned my addr 172.21.15.100:0/3044174701 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ac9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941add90 con 0x560179aa7080 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941ab660 con 0x560179ab1940 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb699969640 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ac9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.818+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941a94b0 con 0x560179aa6760 2024-09-12T02:46:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb699969640 1 -- 172.21.15.100:0/3044174701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 msgr2=0x560179aa91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb699969640 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb699969640 1 -- 172.21.15.100:0/3044174701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 msgr2=0x560179aae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb699969640 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb699969640 1 -- 172.21.15.100:0/3044174701 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560179aa2b20 con 0x560179ab1940 2024-09-12T02:46:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb698967640 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb699969640 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ac9200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb68c008f70 tx=0x7fb68c02a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab8acc3e9ca5c2b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.819+0000 7fb67effd640 1 -- 172.21.15.100:0/3044174701 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c044020 con 0x560179ab1940 2024-09-12T02:46:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.820+0000 7fb67effd640 1 -- 172.21.15.100:0/3044174701 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6900319f0 con 0x560179ab1940 2024-09-12T02:46:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.820+0000 7fb67effd640 1 -- 172.21.15.100:0/3044174701 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c021430 con 0x560179ab1940 2024-09-12T02:46:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.821+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 msgr2=0x560179ac9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.821+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ac9200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb68c008f70 tx=0x7fb68c02a000 comp rx=0 tx=0).stop 2024-09-12T02:46:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.821+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 shutdown_connections 2024-09-12T02:46:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.821+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179ab1940 0x560179ac9200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.821+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179aa7080 0x560179aae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.821+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/3044174701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa6760 0x560179aa91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.821+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 >> 172.21.15.100:0/3044174701 conn(0x560179aa2cf0 msgr2=0x560179aa1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.822+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 shutdown_connections 2024-09-12T02:46:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.822+0000 7fb69d7a5740 1 -- 172.21.15.100:0/3044174701 wait complete. 2024-09-12T02:46:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.822+0000 7fb69d7a5740 1 -- start start 2024-09-12T02:46:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.822+0000 7fb69d7a5740 1 Processor -- start 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.823+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179ab5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.823+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa7080 0x560179ab5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.823+0000 7fb69d7a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179ab1940 0x560179ab6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.823+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941a9b20 con 0x560179ab1940 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.823+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941aaf90 con 0x560179aa6760 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.823+0000 7fb69d7a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941aa1f0 con 0x560179aa7080 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.823+0000 7fb69d7a5740 10 client.0 _ll_register_callbacks cb 0x5601799b8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179ab5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179ab5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42924/0 (socket says 172.21.15.100:42924) 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 -- 172.21.15.100:0/1550980037 learned_addr learned my addr 172.21.15.100:0/1550980037 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb698967640 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa7080 0x560179ab5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 -- 172.21.15.100:0/1550980037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa7080 msgr2=0x560179ab5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa7080 0x560179ab5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 -- 172.21.15.100:0/1550980037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179ab1940 msgr2=0x560179ab6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179ab1940 0x560179ab6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb699168640 1 -- 172.21.15.100:0/1550980037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560179a9e260 con 0x560179aa6760 2024-09-12T02:46:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.824+0000 7fb698967640 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa7080 0x560179ab5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:51.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.825+0000 7fb699168640 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179ab5940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb690031ba0 tx=0x7fb690005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6249e8e03ced4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.826+0000 7fb67cff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:46:51.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.826+0000 7fb67cff9640 1 -- 172.21.15.100:0/1550980037 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690035040 con 0x560179aa6760 2024-09-12T02:46:51.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.826+0000 7fb67cff9640 1 -- 172.21.15.100:0/1550980037 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb690004450 con 0x560179aa6760 2024-09-12T02:46:51.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.826+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6900319f0 con 0x560179aa6760 2024-09-12T02:46:51.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.826+0000 7fb67cff9640 1 -- 172.21.15.100:0/1550980037 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb690005040 con 0x560179aa6760 2024-09-12T02:46:51.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.826+0000 7fb69d7a5740 10 client.26162 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:51.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.826+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560179b3d640 con 0x560179aa6760 2024-09-12T02:46:51.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb67cff9640 1 -- 172.21.15.100:0/1550980037 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6900319f0 con 0x560179aa6760 2024-09-12T02:46:51.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb67cff9640 1 -- 172.21.15.100:0/1550980037 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb690052470 con 0x560179aa6760 2024-09-12T02:46:51.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb69d7a5740 10 client.26162 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:51.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb69d7a5740 10 client.26162 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:46:51.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb69d7a5740 20 client.26162 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:51.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179b3d930 0x560179b3fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb69d7a5740 4 client.26162 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}] 2024-09-12T02:46:51.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.827+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.4, "await_for": 45.0}) -- 0x560179a13d20 con 0x560179b3d930 2024-09-12T02:46:51.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.829+0000 7fb698967640 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179b3d930 0x560179b3fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.829+0000 7fb698967640 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179b3d930 0x560179b3fd20 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4fea601a09187c7 server_cookie=9e83f98ddadc3b30 in_seq=0 out_seq=0 2024-09-12T02:46:51.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:51.829+0000 7fb67cff9640 10 client.26162 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.081+0000 7fb67cff9640 1 -- 172.21.15.100:0/1550980037 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560179a13d20 con 0x560179b3d930 2024-09-12T02:46:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.081+0000 7fb67cff9640 10 client.26162 handle_command_reply: tid=0 2024-09-12T02:46:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.081+0000 7fb69d7a5740 1 client.26162 shutdown 2024-09-12T02:46:52.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.081+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 msgr2=0x560179ab5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.081+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179ab5940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb690031ba0 tx=0x7fb690005e00 comp rx=0 tx=0).stop 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 shutdown_connections 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560179b3d930 0x560179b3fd20 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560179ab1940 0x560179ab6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560179aa7080 0x560179ab5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb67cff9640 0 client.26162 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 --2- 172.21.15.100:0/1550980037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560179aa6760 0x560179ab5940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 >> 172.21.15.100:0/1550980037 conn(0x560179aa2cf0 msgr2=0x560179abc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 shutdown_connections 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 1 -- 172.21.15.100:0/1550980037 wait complete. 2024-09-12T02:46:52.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69d7a5740 20 client.26162 trim_cache size 0 max 16384 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 34, 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "8dc7cb5b": { 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 34, 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:46:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 139.4, 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6800a2b80 msgr2=0x7fb6800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6800a2b80 0x7fb6800a5040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005fd0 tx=0x7fb68c016040 comp rx=0 tx=0).stop 2024-09-12T02:46:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694102780 msgr2=0x7fb694074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694102780 0x7fb694074a30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb68400d950 tx=0x7fb68400de10 comp rx=0 tx=0).stop 2024-09-12T02:46:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 shutdown_connections 2024-09-12T02:46:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6800a2b80 0x7fb6800a5040 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb694106f00 0x7fb694074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb694102780 0x7fb694074a30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.082+0000 7fb69b3cc640 1 --2- 172.21.15.100:0/3472587965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb694101dd0 0x7fb6940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.083+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 >> 172.21.15.100:0/3472587965 conn(0x7fb6940fd8b0 msgr2=0x7fb6940fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.083+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 shutdown_connections 2024-09-12T02:46:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:52.083+0000 7fb69b3cc640 1 -- 172.21.15.100:0/3472587965 wait complete. 2024-09-12T02:46:52.860 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8dc7cb5b', quiesce took 5.7 seconds. Will release after: 13.7 2024-09-12T02:46:53.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:52 smithi100 ceph-mon[31390]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.8 MiB/s wr, 195 op/s 2024-09-12T02:46:53.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 -- 172.21.15.100:0/1938908469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88106a70 msgr2=0x7ffa88106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 --2- 172.21.15.100:0/1938908469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88106a70 0x7ffa88106e50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009930 tx=0x7ffa8402a420 comp rx=0 tx=0).stop 2024-09-12T02:46:53.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 -- 172.21.15.100:0/1938908469 shutdown_connections 2024-09-12T02:46:53.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 --2- 172.21.15.100:0/1938908469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa88101410 0x7ffa8810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 --2- 172.21.15.100:0/1938908469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa88100a70 0x7ffa88100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 --2- 172.21.15.100:0/1938908469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88106a70 0x7ffa88106e50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 -- 172.21.15.100:0/1938908469 >> 172.21.15.100:0/1938908469 conn(0x7ffa880fc790 msgr2=0x7ffa880febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 -- 172.21.15.100:0/1938908469 shutdown_connections 2024-09-12T02:46:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.082+0000 7ffa90507640 1 -- 172.21.15.100:0/1938908469 wait complete. 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 Processor -- start 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 -- start start 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88100a70 0x7ffa881972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa88101410 0x7ffa88197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa88106a70 0x7ffa8819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88110e70 con 0x7ffa88100a70 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88110cf0 con 0x7ffa88106a70 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa90507640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88110ff0 con 0x7ffa88101410 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88100a70 0x7ffa881972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88100a70 0x7ffa881972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54788/0 (socket says 172.21.15.100:54788) 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/1866958664 learned_addr learned my addr 172.21.15.100:0/1866958664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa88106a70 0x7ffa8819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa88101410 0x7ffa88197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/1866958664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa88101410 msgr2=0x7ffa88197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa88101410 0x7ffa88197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/1866958664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa88106a70 msgr2=0x7ffa8819bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa88106a70 0x7ffa8819bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.083+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/1866958664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8819c280 con 0x7ffa88100a70 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.084+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88100a70 0x7ffa881972d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009230 tx=0x7ffa84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:53.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.084+0000 7ffa7f7fe640 1 -- 172.21.15.100:0/1866958664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8403f030 con 0x7ffa88100a70 2024-09-12T02:46:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.084+0000 7ffa7f7fe640 1 -- 172.21.15.100:0/1866958664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa84003ad0 con 0x7ffa88100a70 2024-09-12T02:46:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.084+0000 7ffa7f7fe640 1 -- 172.21.15.100:0/1866958664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84035070 con 0x7ffa88100a70 2024-09-12T02:46:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.084+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8819c510 con 0x7ffa88100a70 2024-09-12T02:46:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.084+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8819c9a0 con 0x7ffa88100a70 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.086+0000 7ffa7f7fe640 1 -- 172.21.15.100:0/1866958664 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ffa84042030 con 0x7ffa88100a70 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 Processor -- start 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 -- start start 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa7f7fe640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa740a2b80 0x7ffa740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x559503590090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x559503590a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa740a2b80 0x7ffa740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x55950359d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5595034f62f0 con 0x5595035905d0 2024-09-12T02:46:53.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55950349dcf0 con 0x559503591b40 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa928e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595034f22b0 con 0x55950359b370 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa7f7fe640 1 -- 172.21.15.100:0/1866958664 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa840ef660 con 0x7ffa88100a70 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa8daa2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x559503590a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa8daa2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x559503590a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54804/0 (socket says 172.21.15.100:54804) 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.087+0000 7ffa8daa2640 1 -- 172.21.15.100:0/1093685625 learned_addr learned my addr 172.21.15.100:0/1093685625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x559503590090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8daa2640 1 -- 172.21.15.100:0/1093685625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 msgr2=0x55950359d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x55950359d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8daa2640 1 -- 172.21.15.100:0/1093685625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 msgr2=0x559503590090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x559503590090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8daa2640 1 -- 172.21.15.100:0/1093685625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595034823a0 con 0x5595035905d0 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x559503590090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:53.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x559503590a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800edd0 tx=0x7ffa7800a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce682c0af8a9c064 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa740a2b80 0x7ffa740a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ffa80005fd0 tx=0x7ffa800098d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa7cff9640 1 -- 172.21.15.100:0/1093685625 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800e050 con 0x5595035905d0 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa7cff9640 1 -- 172.21.15.100:0/1093685625 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa78005500 con 0x5595035905d0 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.088+0000 7ffa7cff9640 1 -- 172.21.15.100:0/1093685625 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800d4d0 con 0x5595035905d0 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 -- 172.21.15.100:0/1093685625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 msgr2=0x559503590a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x559503590a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800edd0 tx=0x7ffa7800a680 comp rx=0 tx=0).stop 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 -- 172.21.15.100:0/1093685625 shutdown_connections 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x55950359d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x559503590a10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 --2- 172.21.15.100:0/1093685625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x559503590090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 -- 172.21.15.100:0/1093685625 >> 172.21.15.100:0/1093685625 conn(0x559503559310 msgr2=0x55950358cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:53.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 -- 172.21.15.100:0/1093685625 shutdown_connections 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 -- 172.21.15.100:0/1093685625 wait complete. 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 -- start start 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.089+0000 7ffa928e0740 1 Processor -- start 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595035905d0 0x55950359ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559503591b40 0x559503598000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55950359b370 0x5595035985d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa928e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55950359e070 con 0x559503591b40 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa928e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5595034b1060 con 0x55950359b370 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa928e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55950359e1f0 con 0x5595035905d0 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa928e0740 10 client.0 _ll_register_callbacks cb 0x5595032048c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8daa2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559503591b40 0x559503598000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8daa2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559503591b40 0x559503598000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54814/0 (socket says 172.21.15.100:54814) 2024-09-12T02:46:53.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8e2a3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595035905d0 0x55950359ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8daa2640 1 -- 172.21.15.100:0/945710522 learned_addr learned my addr 172.21.15.100:0/945710522 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55950359b370 0x5595035985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/945710522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55950359b370 msgr2=0x5595035985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55950359b370 0x5595035985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/945710522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559503591b40 msgr2=0x559503598000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559503591b40 0x559503598000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/945710522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595032673c0 con 0x5595035905d0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595035905d0 0x55950359ad50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa840ed0f0 tx=0x7ffa840bb870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=997363ca676ee7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.090+0000 7ffa71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa71ffb640 1 -- 172.21.15.100:0/945710522 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84049040 con 0x5595035905d0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa71ffb640 1 -- 172.21.15.100:0/945710522 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa84003c80 con 0x5595035905d0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa78005500 con 0x5595035905d0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa71ffb640 1 -- 172.21.15.100:0/945710522 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffa840c0200 con 0x5595035905d0 2024-09-12T02:46:53.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 10 client.26128 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55950359e0d0 con 0x5595035905d0 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa71ffb640 1 -- 172.21.15.100:0/945710522 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa78005500 con 0x5595035905d0 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa71ffb640 1 -- 172.21.15.100:0/945710522 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ffa840c4630 con 0x5595035905d0 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 10 client.26128 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 10 client.26128 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 20 client.26128 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5595035aaec0 0x5595035ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 4 client.26128 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.091+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559503503860 con 0x5595035aaec0 2024-09-12T02:46:53.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.092+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5595035aaec0 0x5595035ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.098 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:52 smithi117 ceph-mon[34898]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.8 MiB/s wr, 195 op/s 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.092+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5595035aaec0 0x5595035ad2f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac79e3ccbad03cb8 server_cookie=843282a48f764432 in_seq=0 out_seq=0 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.092+0000 7ffa71ffb640 10 client.26128 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa71ffb640 1 -- 172.21.15.100:0/945710522 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559503503860 con 0x5595035aaec0 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa71ffb640 10 client.26128 handle_command_reply: tid=0 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 client.26128 shutdown 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595035905d0 msgr2=0x55950359ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595035905d0 0x55950359ad50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa840ed0f0 tx=0x7ffa840bb870 comp rx=0 tx=0).stop 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 shutdown_connections 2024-09-12T02:46:53.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5595035aaec0 0x5595035ad2f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55950359b370 0x5595035985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa71ffb640 0 client.26128 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559503591b40 0x559503598000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 --2- 172.21.15.100:0/945710522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595035905d0 0x55950359ad50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 >> 172.21.15.100:0/945710522 conn(0x559503559310 msgr2=0x559503592930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 shutdown_connections 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 1 -- 172.21.15.100:0/945710522 wait complete. 2024-09-12T02:46:53.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.093+0000 7ffa928e0740 20 client.26128 trim_cache size 0 max 16384 2024-09-12T02:46:53.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 Processor -- start 2024-09-12T02:46:53.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 -- start start 2024-09-12T02:46:53.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595035905d0 0x55950358bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559503591b40 0x559503593120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55950359b370 0x559503593660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881adbd0 con 0x55950359b370 2024-09-12T02:46:53.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881ab4a0 con 0x5595035905d0 2024-09-12T02:46:53.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa928e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881a92f0 con 0x559503591b40 2024-09-12T02:46:53.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55950359b370 0x559503593660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55950359b370 0x559503593660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54824/0 (socket says 172.21.15.100:54824) 2024-09-12T02:46:53.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 -- 172.21.15.100:0/2459751672 learned_addr learned my addr 172.21.15.100:0/2459751672 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595035905d0 0x55950358bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559503591b40 0x559503593120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 -- 172.21.15.100:0/2459751672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559503591b40 msgr2=0x559503593120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559503591b40 0x559503593120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 -- 172.21.15.100:0/2459751672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595035905d0 msgr2=0x55950358bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595035905d0 0x55950358bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8eaa4640 1 -- 172.21.15.100:0/2459751672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950358d960 con 0x55950359b370 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.106+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595035905d0 0x55950358bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55950359b370 0x559503593660 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffa800126f0 tx=0x7ffa80014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f65342c3cfb5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa73fff640 1 -- 172.21.15.100:0/2459751672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000e710 con 0x55950359b370 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa73fff640 1 -- 172.21.15.100:0/2459751672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa80016070 con 0x55950359b370 2024-09-12T02:46:53.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa73fff640 1 -- 172.21.15.100:0/2459751672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80028d60 con 0x55950359b370 2024-09-12T02:46:53.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa928e0740 1 -- 172.21.15.100:0/2459751672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55950359b370 msgr2=0x559503593660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa928e0740 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55950359b370 0x559503593660 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffa800126f0 tx=0x7ffa80014000 comp rx=0 tx=0).stop 2024-09-12T02:46:53.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa928e0740 1 -- 172.21.15.100:0/2459751672 shutdown_connections 2024-09-12T02:46:53.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa928e0740 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55950359b370 0x559503593660 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa928e0740 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559503591b40 0x559503593120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa928e0740 1 --2- 172.21.15.100:0/2459751672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595035905d0 0x55950358bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.107+0000 7ffa928e0740 1 -- 172.21.15.100:0/2459751672 >> 172.21.15.100:0/2459751672 conn(0x559503559310 msgr2=0x55950358b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 -- 172.21.15.100:0/2459751672 shutdown_connections 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 -- 172.21.15.100:0/2459751672 wait complete. 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 -- start start 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 Processor -- start 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x5595035a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x5595035a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x5595035a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881a9960 con 0x5595035905d0 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881aadd0 con 0x559503591b40 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa881aa030 con 0x55950359b370 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa928e0740 10 client.0 _ll_register_callbacks cb 0x7ffa84009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa8e2a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x5595035a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa8e2a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x5595035a24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54828/0 (socket says 172.21.15.100:54828) 2024-09-12T02:46:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/183134131 learned_addr learned my addr 172.21.15.100:0/183134131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.108+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x5595035a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x5595035a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 msgr2=0x5595035a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x5595035a2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/183134131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 msgr2=0x5595035a29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x5595035a29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8e2a3640 1 -- 172.21.15.100:0/183134131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595035a3760 con 0x5595035905d0 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8eaa4640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x5595035a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x5595035a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa8e2a3640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x5595035a24b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ffa840c03c0 tx=0x7ffa84005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f335ff2cf16da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa71ffb640 1 -- 172.21.15.100:0/183134131 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84049040 con 0x5595035905d0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa71ffb640 1 -- 172.21.15.100:0/183134131 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffa8403b460 con 0x5595035905d0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa80016070 con 0x5595035905d0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa71ffb640 1 -- 172.21.15.100:0/183134131 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffa840c4ac0 con 0x5595035905d0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa928e0740 10 client.16815 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55950361a650 con 0x5595035905d0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa71ffb640 1 -- 172.21.15.100:0/183134131 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa80016070 con 0x5595035905d0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.109+0000 7ffa71ffb640 1 -- 172.21.15.100:0/183134131 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ffa840bb2f0 con 0x5595035905d0 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 10 client.16815 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 10 client.16815 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 20 client.16815 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55950361abe0 0x55950361cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 4 client.16815 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595034fdd70 con 0x55950361abe0 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55950361abe0 0x55950361cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa71ffb640 10 client.16815 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa8daa2640 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55950361abe0 0x55950361cfd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24c09bc4af633d4c server_cookie=c895351b5551890a in_seq=0 out_seq=0 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa71ffb640 1 -- 172.21.15.100:0/183134131 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595034fdd70 con 0x55950361abe0 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa71ffb640 10 client.16815 handle_command_reply: tid=0 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 1 client.16815 shutdown 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 msgr2=0x5595035a24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x5595035a24b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ffa840c03c0 tx=0x7ffa84005e50 comp rx=0 tx=0).stop 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 shutdown_connections 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.110+0000 7ffa928e0740 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55950361abe0 0x55950361cfd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa928e0740 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55950359b370 0x5595035a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa928e0740 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559503591b40 0x5595035a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa928e0740 1 --2- 172.21.15.100:0/183134131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595035905d0 0x5595035a24b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 >> 172.21.15.100:0/183134131 conn(0x559503559310 msgr2=0x55950358bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa71ffb640 0 client.16815 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:46:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 shutdown_connections 2024-09-12T02:46:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa928e0740 1 -- 172.21.15.100:0/183134131 wait complete. 2024-09-12T02:46:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa928e0740 20 client.16815 trim_cache size 0 max 16384 2024-09-12T02:46:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa740a2b80 msgr2=0x7ffa740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa740a2b80 0x7ffa740a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ffa80005fd0 tx=0x7ffa800098d0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88100a70 msgr2=0x7ffa881972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88100a70 0x7ffa881972d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009230 tx=0x7ffa84004270 comp rx=0 tx=0).stop 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 shutdown_connections 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffa740a2b80 0x7ffa740a5040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa88106a70 0x7ffa8819bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa88101410 0x7ffa88197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 --2- 172.21.15.100:0/1866958664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa88100a70 0x7ffa881972d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 >> 172.21.15.100:0/1866958664 conn(0x7ffa880fc790 msgr2=0x7ffa880fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 shutdown_connections 2024-09-12T02:46:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:53.111+0000 7ffa90507640 1 -- 172.21.15.100:0/1866958664 wait complete. 2024-09-12T02:46:53.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:52 smithi189 ceph-mon[35196]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.8 MiB/s wr, 195 op/s 2024-09-12T02:46:54.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:46:54.401 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:54.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.892+0000 7f80cc2db640 1 -- 172.21.15.100:0/3029609581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4106a80 msgr2=0x7f80c4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.892+0000 7f80cc2db640 1 --2- 172.21.15.100:0/3029609581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4106a80 0x7f80c4106e60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009930 tx=0x7f80c002a420 comp rx=0 tx=0).stop 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- 172.21.15.100:0/3029609581 shutdown_connections 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 --2- 172.21.15.100:0/3029609581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80c4101420 0x7f80c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 --2- 172.21.15.100:0/3029609581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c4100a80 0x7f80c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 --2- 172.21.15.100:0/3029609581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4106a80 0x7f80c4106e60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- 172.21.15.100:0/3029609581 >> 172.21.15.100:0/3029609581 conn(0x7f80c40fc7a0 msgr2=0x7f80c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- 172.21.15.100:0/3029609581 shutdown_connections 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- 172.21.15.100:0/3029609581 wait complete. 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 Processor -- start 2024-09-12T02:46:54.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- start start 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80c4100a80 0x7f80c4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4101420 0x7f80c41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c4106a80 0x7f80c419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4110e80 con 0x7f80c4101420 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4110d00 con 0x7f80c4100a80 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80cc2db640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4111000 con 0x7f80c4106a80 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4101420 0x7f80c41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.893+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4101420 0x7f80c41989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42758/0 (socket says 172.21.15.100:42758) 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80c9876640 1 -- 172.21.15.100:0/140561346 learned_addr learned my addr 172.21.15.100:0/140561346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80ca077640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80c4100a80 0x7f80c4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80c9876640 1 -- 172.21.15.100:0/140561346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c4106a80 msgr2=0x7f80c419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80c9876640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c4106a80 0x7f80c419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80c9876640 1 -- 172.21.15.100:0/140561346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80c4100a80 msgr2=0x7f80c4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80c9876640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80c4100a80 0x7f80c4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80c9876640 1 -- 172.21.15.100:0/140561346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c419d420 con 0x7f80c4101420 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80ca077640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80c4100a80 0x7f80c4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80c9876640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4101420 0x7f80c41989b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e9f0 tx=0x7f80b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80bb7fe640 1 -- 172.21.15.100:0/140561346 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b400cd80 con 0x7f80c4101420 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80bb7fe640 1 -- 172.21.15.100:0/140561346 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b4005500 con 0x7f80c4101420 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c419d710 con 0x7f80c4101420 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80bb7fe640 1 -- 172.21.15.100:0/140561346 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4010690 con 0x7f80c4101420 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.894+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c41a4ff0 con 0x7f80c4101420 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.896+0000 7f80bb7fe640 1 -- 172.21.15.100:0/140561346 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f80b40046c0 con 0x7f80c4101420 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 Processor -- start 2024-09-12T02:46:54.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 -- start start 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b2435090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2435a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2446b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e1b239b2f0 con 0x55e1b2444780 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1b2342cf0 con 0x55e1b24355d0 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e1b23972b0 con 0x55e1b2436b40 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80bb7fe640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80b00a2b80 0x7f80b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2446b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2446b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42774/0 (socket says 172.21.15.100:42774) 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80c9876640 1 -- 172.21.15.100:0/3069235829 learned_addr learned my addr 172.21.15.100:0/3069235829 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.897+0000 7f80ca077640 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2435a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80ca878640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80b00a2b80 0x7f80b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80ca878640 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b2435090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80bb7fe640 1 -- 172.21.15.100:0/140561346 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f80b40cf5b0 con 0x7f80c4101420 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80c9876640 1 -- 172.21.15.100:0/3069235829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 msgr2=0x55e1b2435090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80c9876640 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b2435090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80c9876640 1 -- 172.21.15.100:0/3069235829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 msgr2=0x55e1b2435a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80c9876640 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2435a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80c9876640 1 -- 172.21.15.100:0/3069235829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b23273a0 con 0x55e1b2444780 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80c9876640 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2446b70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f80b400f7c0 tx=0x7f80b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fd3374f68887b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80ca878640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80b00a2b80 0x7f80b00a5040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009810 tx=0x7f80bc009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80b8dea640 1 -- 172.21.15.100:0/3069235829 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b409bbd0 con 0x55e1b2444780 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80b8dea640 1 -- 172.21.15.100:0/3069235829 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b409c500 con 0x55e1b2444780 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.898+0000 7f80b8dea640 1 -- 172.21.15.100:0/3069235829 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b409b760 con 0x55e1b2444780 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3069235829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 msgr2=0x55e1b2446b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2446b70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f80b400f7c0 tx=0x7f80b4004a40 comp rx=0 tx=0).stop 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3069235829 shutdown_connections 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2446b70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2435a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3069235829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b2435090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3069235829 >> 172.21.15.100:0/3069235829 conn(0x55e1b23fe310 msgr2=0x55e1b2431c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3069235829 shutdown_connections 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3069235829 wait complete. 2024-09-12T02:46:54.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 -- start start 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.899+0000 7f80ce6b4740 1 Processor -- start 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2444230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b24414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2441c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e1b2447420 con 0x55e1b2444780 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1b2356060 con 0x55e1b24355d0 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e1b24475a0 con 0x55e1b2436b40 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 10 client.0 _ll_register_callbacks cb 0x55e1b20a98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2441c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca077640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2444230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2441c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42776/0 (socket says 172.21.15.100:42776) 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 -- 172.21.15.100:0/1901833846 learned_addr learned my addr 172.21.15.100:0/1901833846 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:54.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80c9876640 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b24414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 -- 172.21.15.100:0/1901833846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 msgr2=0x55e1b24414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b24414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 -- 172.21.15.100:0/1901833846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 msgr2=0x55e1b2444230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2444230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 -- 172.21.15.100:0/1901833846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b210c3c0 con 0x55e1b2444780 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ca878640 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2441c70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009cb0 tx=0x7f80bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632dd47a9efbc8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80adffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80adffb640 1 -- 172.21.15.100:0/1901833846 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc004b20 con 0x55e1b2444780 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80adffb640 1 -- 172.21.15.100:0/1901833846 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f80bc004cc0 con 0x55e1b2444780 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.900+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b409c500 con 0x55e1b2444780 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80adffb640 1 -- 172.21.15.100:0/1901833846 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80bc004260 con 0x55e1b2444780 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 10 client.16827 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:54.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e1b2452ff0 con 0x55e1b2444780 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80adffb640 1 -- 172.21.15.100:0/1901833846 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b409c500 con 0x55e1b2444780 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80adffb640 1 -- 172.21.15.100:0/1901833846 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f80bc00f040 con 0x55e1b2444780 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 10 client.16827 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 20 client.16827 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b2454400 0x55e1b24567f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 4 client.16827 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1b23a8860 con 0x55e1b2454400 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.901+0000 7f80ca077640 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b2454400 0x55e1b24567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.902+0000 7f80ca077640 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b2454400 0x55e1b24567f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95c4f85a16083d2f server_cookie=f8554038e8858c57 in_seq=0 out_seq=0 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.902+0000 7f80adffb640 10 client.16827 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:54.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.902+0000 7f80adffb640 1 -- 172.21.15.100:0/1901833846 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1b23a8860 con 0x55e1b2454400 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.902+0000 7f80adffb640 10 client.16827 handle_command_reply: tid=0 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.902+0000 7f80ce6b4740 1 client.16827 shutdown 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 msgr2=0x55e1b2441c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2441c70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009cb0 tx=0x7f80bc004a40 comp rx=0 tx=0).stop 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 shutdown_connections 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b2454400 0x55e1b24567f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2444780 0x55e1b2441c70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b2436b40 0x55e1b24414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1901833846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b24355d0 0x55e1b2444230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 >> 172.21.15.100:0/1901833846 conn(0x55e1b23fe310 msgr2=0x55e1b2437990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80adffb640 0 client.16827 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 shutdown_connections 2024-09-12T02:46:54.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1901833846 wait complete. 2024-09-12T02:46:54.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.903+0000 7f80ce6b4740 20 client.16827 trim_cache size 0 max 16384 2024-09-12T02:46:54.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.915+0000 7f80ce6b4740 1 Processor -- start 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.915+0000 7f80ce6b4740 1 -- start start 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b24363a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b243c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b243cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41add30 con 0x55e1b2436b40 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41ab600 con 0x55e1b2444780 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41a9450 con 0x55e1b24355d0 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b243c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b243c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42784/0 (socket says 172.21.15.100:42784) 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 -- 172.21.15.100:0/1506316423 learned_addr learned my addr 172.21.15.100:0/1506316423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ca077640 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b24363a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ca878640 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b243cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 -- 172.21.15.100:0/1506316423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 msgr2=0x55e1b24363a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b24363a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 -- 172.21.15.100:0/1506316423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 msgr2=0x55e1b243cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b243cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 -- 172.21.15.100:0/1506316423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b24506c0 con 0x55e1b2436b40 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ca077640 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b24363a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80ca878640 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b243cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80c9876640 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b243c720 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f80b400cfd0 tx=0x7f80b4098610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee0767cc986a5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80affff640 1 -- 172.21.15.100:0/1506316423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b409b940 con 0x55e1b2436b40 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80affff640 1 -- 172.21.15.100:0/1506316423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b409c500 con 0x55e1b2436b40 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.916+0000 7f80affff640 1 -- 172.21.15.100:0/1506316423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b409c060 con 0x55e1b2436b40 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1506316423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 msgr2=0x55e1b243c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b243c720 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f80b400cfd0 tx=0x7f80b4098610 comp rx=0 tx=0).stop 2024-09-12T02:46:54.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1506316423 shutdown_connections 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b243cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b243c720 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/1506316423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b24363a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1506316423 >> 172.21.15.100:0/1506316423 conn(0x55e1b23fe310 msgr2=0x55e1b242ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1506316423 shutdown_connections 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 -- 172.21.15.100:0/1506316423 wait complete. 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 -- start start 2024-09-12T02:46:54.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.917+0000 7f80ce6b4740 1 Processor -- start 2024-09-12T02:46:54.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b244c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b244ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b2447d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41a9ac0 con 0x55e1b2436b40 2024-09-12T02:46:54.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41aaf30 con 0x55e1b2444780 2024-09-12T02:46:54.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41aa190 con 0x55e1b24355d0 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 10 client.0 _ll_register_callbacks cb 0x7f80bc009f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b244ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b244ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42794/0 (socket says 172.21.15.100:42794) 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 -- 172.21.15.100:0/3853670421 learned_addr learned my addr 172.21.15.100:0/3853670421 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ca077640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b244c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ca878640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b2447d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 -- 172.21.15.100:0/3853670421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 msgr2=0x55e1b244c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b244c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 -- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 msgr2=0x55e1b2447d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b2447d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 -- 172.21.15.100:0/3853670421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b24485c0 con 0x55e1b2436b40 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ca077640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b244c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:54.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ca878640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b2447d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80c9876640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b244ce40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c6a0 tx=0x7f80b40cf920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c129d62e3ebe889 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80adffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80adffb640 1 -- 172.21.15.100:0/3853670421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b40a4a70 con 0x55e1b2436b40 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80adffb640 1 -- 172.21.15.100:0/3853670421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f80b40a45e0 con 0x55e1b2436b40 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.918+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b409c500 con 0x55e1b2436b40 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80adffb640 1 -- 172.21.15.100:0/3853670421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80b409be00 con 0x55e1b2436b40 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 10 client.16833 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e1b24beae0 con 0x55e1b2436b40 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80adffb640 1 -- 172.21.15.100:0/3853670421 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b409c500 con 0x55e1b2436b40 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80adffb640 1 -- 172.21.15.100:0/3853670421 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f80b409acc0 con 0x55e1b2436b40 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 10 client.16833 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 20 client.16833 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b24bed10 0x55e1b24c1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 4 client.16833 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1b23a2d70 con 0x55e1b24bed10 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ca077640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b24bed10 0x55e1b24c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80adffb640 10 client.16833 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.919+0000 7f80ca077640 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b24bed10 0x55e1b24c1100 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d67d5b5c297bcf server_cookie=5fbf3c61092ec17f in_seq=0 out_seq=0 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80adffb640 1 -- 172.21.15.100:0/3853670421 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1b23a2d70 con 0x55e1b24bed10 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80adffb640 10 client.16833 handle_command_reply: tid=0 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 client.16833 shutdown 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 msgr2=0x55e1b244ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b244ce40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c6a0 tx=0x7f80b40cf920 comp rx=0 tx=0).stop 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 shutdown_connections 2024-09-12T02:46:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e1b24bed10 0x55e1b24c1100 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b2444780 0x55e1b2447d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e1b2436b40 0x55e1b244ce40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80adffb640 0 client.16833 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 --2- 172.21.15.100:0/3853670421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1b24355d0 0x55e1b244c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 >> 172.21.15.100:0/3853670421 conn(0x55e1b23fe310 msgr2=0x55e1b243c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 shutdown_connections 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 1 -- 172.21.15.100:0/3853670421 wait complete. 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80ce6b4740 20 client.16833 trim_cache size 0 max 16384 2024-09-12T02:46:54.927 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:46:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80b00a2b80 msgr2=0x7f80b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80b00a2b80 0x7f80b00a5040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009810 tx=0x7f80bc009760 comp rx=0 tx=0).stop 2024-09-12T02:46:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4101420 msgr2=0x7f80c41989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4101420 0x7f80c41989b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e9f0 tx=0x7f80b400edf0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 shutdown_connections 2024-09-12T02:46:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f80b00a2b80 0x7f80b00a5040 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c4106a80 0x7f80c419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.920+0000 7f80cc2db640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c4101420 0x7f80c41989b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.921+0000 7f80cc2db640 1 --2- 172.21.15.100:0/140561346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80c4100a80 0x7f80c4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.921+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 >> 172.21.15.100:0/140561346 conn(0x7f80c40fc7a0 msgr2=0x7f80c406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.921+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 shutdown_connections 2024-09-12T02:46:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:54.921+0000 7f80cc2db640 1 -- 172.21.15.100:0/140561346 wait complete. 2024-09-12T02:46:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:54 smithi117 ceph-mon[34898]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 267 op/s 2024-09-12T02:46:55.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:54 smithi100 ceph-mon[31390]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 267 op/s 2024-09-12T02:46:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:54 smithi189 ceph-mon[35196]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 267 op/s 2024-09-12T02:46:56.301 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 465.0 s, 401.8 tps, lat 28.396 ms stddev 35.881 2024-09-12T02:46:56.627 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:46:56.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:57.008 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:56 smithi100 ceph-mon[31390]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.0 MiB/s wr, 325 op/s 2024-09-12T02:46:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:56 smithi117 ceph-mon[34898]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.0 MiB/s wr, 325 op/s 2024-09-12T02:46:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:56 smithi189 ceph-mon[35196]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.0 MiB/s wr, 325 op/s 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.353+0000 7f669829b640 1 -- 172.21.15.100:0/3453613743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 msgr2=0x7f6690107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.353+0000 7f669829b640 1 --2- 172.21.15.100:0/3453613743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690107bc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6684009930 tx=0x7f668402a420 comp rx=0 tx=0).stop 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- 172.21.15.100:0/3453613743 shutdown_connections 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 --2- 172.21.15.100:0/3453613743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690108300 0x7f669010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 --2- 172.21.15.100:0/3453613743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690107bc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 --2- 172.21.15.100:0/3453613743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6690102dd0 0x7f66901031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- 172.21.15.100:0/3453613743 >> 172.21.15.100:0/3453613743 conn(0x7f66900fc7d0 msgr2=0x7f66900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- 172.21.15.100:0/3453613743 shutdown_connections 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- 172.21.15.100:0/3453613743 wait complete. 2024-09-12T02:46:57.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 Processor -- start 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- start start 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6690102dd0 0x7f66901985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690108300 0x7f669019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6690112070 con 0x7f6690103780 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6690111ef0 con 0x7f6690108300 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.354+0000 7f669829b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66901121f0 con 0x7f6690102dd0 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42810/0 (socket says 172.21.15.100:42810) 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 -- 172.21.15.100:0/1562235141 learned_addr learned my addr 172.21.15.100:0/1562235141 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6696037640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6690102dd0 0x7f66901985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6696838640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690108300 0x7f669019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 -- 172.21.15.100:0/1562235141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6690102dd0 msgr2=0x7f66901985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6690102dd0 0x7f66901985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 -- 172.21.15.100:0/1562235141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690108300 msgr2=0x7f669019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690108300 0x7f669019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 -- 172.21.15.100:0/1562235141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669019d580 con 0x7f6690103780 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f6695836640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690198b10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6684005940 tx=0x7f66840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f668f7fe640 1 -- 172.21.15.100:0/1562235141 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668403f030 con 0x7f6690103780 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669019d810 con 0x7f6690103780 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f668f7fe640 1 -- 172.21.15.100:0/1562235141 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6684003ce0 con 0x7f6690103780 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f668f7fe640 1 -- 172.21.15.100:0/1562235141 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684035070 con 0x7f6690103780 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.355+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901a5150 con 0x7f6690103780 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.357+0000 7f668f7fe640 1 -- 172.21.15.100:0/1562235141 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6684042030 con 0x7f6690103780 2024-09-12T02:46:57.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 Processor -- start 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 -- start start 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bdfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08beec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f668f7fe640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66780a2b80 0x7f66780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08bf1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562c08b45280 con 0x562c08be0360 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562c08aecb10 con 0x562c08bef150 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f669a674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c08b41240 con 0x562c08bdfa40 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f6696037640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08beec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f6696037640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08beec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42824/0 (socket says 172.21.15.100:42824) 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f6696037640 1 -- 172.21.15.100:0/1560337379 learned_addr learned my addr 172.21.15.100:0/1560337379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:57.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.358+0000 7f6695836640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66780a2b80 0x7f66780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696838640 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08bf1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696838640 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bdfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f668f7fe640 1 -- 172.21.15.100:0/1562235141 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f66840ef4b0 con 0x7f6690103780 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696037640 1 -- 172.21.15.100:0/1560337379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 msgr2=0x562c08bdfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696037640 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bdfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696037640 1 -- 172.21.15.100:0/1560337379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 msgr2=0x562c08bf1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696037640 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08bf1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696037640 1 -- 172.21.15.100:0/1560337379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c08af91f0 con 0x562c08be0360 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6695836640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66780a2b80 0x7f66780a5040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f66840b81b0 tx=0x7f6684040fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f6696037640 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08beec10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f668000af30 tx=0x7f668000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75c314eede51b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f668cdea640 1 -- 172.21.15.100:0/1560337379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680010900 con 0x562c08be0360 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f668cdea640 1 -- 172.21.15.100:0/1560337379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6680018430 con 0x562c08be0360 2024-09-12T02:46:57.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.359+0000 7f668cdea640 1 -- 172.21.15.100:0/1560337379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680017640 con 0x562c08be0360 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 -- 172.21.15.100:0/1560337379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 msgr2=0x562c08beec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08beec10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f668000af30 tx=0x7f668000f850 comp rx=0 tx=0).stop 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 -- 172.21.15.100:0/1560337379 shutdown_connections 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08bf1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08beec10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 --2- 172.21.15.100:0/1560337379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bdfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 -- 172.21.15.100:0/1560337379 >> 172.21.15.100:0/1560337379 conn(0x562c08bdc0f0 msgr2=0x562c08bdc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 -- 172.21.15.100:0/1560337379 shutdown_connections 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 -- 172.21.15.100:0/1560337379 wait complete. 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.360+0000 7f669a674740 1 -- start start 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 1 Processor -- start 2024-09-12T02:46:57.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bec080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08bec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08becb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562c08bf1d20 con 0x562c08be0360 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562c08afff10 con 0x562c08bef150 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c08bf1ea0 con 0x562c08bdfa40 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f669a674740 10 client.0 _ll_register_callbacks cb 0x562c08ac8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08bec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08bec5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42838/0 (socket says 172.21.15.100:42838) 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 -- 172.21.15.100:0/1033021305 learned_addr learned my addr 172.21.15.100:0/1033021305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696838640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08becb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696838640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 -- 172.21.15.100:0/1033021305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 msgr2=0x562c08bec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bec080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 -- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 msgr2=0x562c08becb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08becb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 -- 172.21.15.100:0/1033021305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c088b66a0 con 0x562c08be0360 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696838640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08becb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6696037640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08bec5c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f668000a7e0 tx=0x7f668000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558c323af83c1467 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.361+0000 7f6675ffb640 1 -- 172.21.15.100:0/1033021305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680026070 con 0x562c08be0360 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f6675ffb640 1 -- 172.21.15.100:0/1033021305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6680010700 con 0x562c08be0360 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6680018430 con 0x562c08be0360 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f6675ffb640 1 -- 172.21.15.100:0/1033021305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6680032050 con 0x562c08be0360 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 10 client.16845 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562c08bfd9a0 con 0x562c08be0360 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f6675ffb640 1 -- 172.21.15.100:0/1033021305 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6680018430 con 0x562c08be0360 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f6675ffb640 1 -- 172.21.15.100:0/1033021305 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f66800054f0 con 0x562c08be0360 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 10 client.16845 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 20 client.16845 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08bfed50 0x562c08c01140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 4 client.16845 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c08b527f0 con 0x562c08bfed50 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.362+0000 7f6696838640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08bfed50 0x562c08c01140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.363+0000 7f6675ffb640 10 client.16845 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.363+0000 7f6696838640 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08bfed50 0x562c08c01140 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e59c5eb5658e90 server_cookie=4356139382e76ece in_seq=0 out_seq=0 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.363+0000 7f6675ffb640 1 -- 172.21.15.100:0/1033021305 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c08b527f0 con 0x562c08bfed50 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.363+0000 7f6675ffb640 10 client.16845 handle_command_reply: tid=0 2024-09-12T02:46:57.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.363+0000 7f669a674740 1 client.16845 shutdown 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.363+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 msgr2=0x562c08bec5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.363+0000 7f669a674740 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08bec5c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f668000a7e0 tx=0x7f668000a360 comp rx=0 tx=0).stop 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 shutdown_connections 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08bfed50 0x562c08c01140 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08bef150 0x562c08becb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08be0360 0x562c08bec5c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f6675ffb640 0 client.16845 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 --2- 172.21.15.100:0/1033021305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08bec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 >> 172.21.15.100:0/1033021305 conn(0x562c08bdc0f0 msgr2=0x562c08bdb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 shutdown_connections 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 1 -- 172.21.15.100:0/1033021305 wait complete. 2024-09-12T02:46:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.364+0000 7f669a674740 20 client.16845 trim_cache size 0 max 16384 2024-09-12T02:46:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 Processor -- start 2024-09-12T02:46:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 -- start start 2024-09-12T02:46:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08beaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08c067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bef150 0x562c08c06d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66901adc70 con 0x562c08bef150 2024-09-12T02:46:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66901ab540 con 0x562c08be0360 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f669a674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66901a9390 con 0x562c08bdfa40 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bef150 0x562c08c06d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bef150 0x562c08c06d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42842/0 (socket says 172.21.15.100:42842) 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 -- 172.21.15.100:0/999066863 learned_addr learned my addr 172.21.15.100:0/999066863 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 -- 172.21.15.100:0/999066863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 msgr2=0x562c08beaf30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08beaf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696037640 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08c067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 -- 172.21.15.100:0/999066863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 msgr2=0x562c08c067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08c067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 -- 172.21.15.100:0/999066863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c08bdbb90 con 0x562c08bef150 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.381+0000 7f6696838640 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bef150 0x562c08c06d30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x562c08bdd470 tx=0x7f668800b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fe9483f5983d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f6677fff640 1 -- 172.21.15.100:0/999066863 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688003e00 con 0x562c08bef150 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f6677fff640 1 -- 172.21.15.100:0/999066863 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6688023030 con 0x562c08bef150 2024-09-12T02:46:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f6677fff640 1 -- 172.21.15.100:0/999066863 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880129e0 con 0x562c08bef150 2024-09-12T02:46:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 -- 172.21.15.100:0/999066863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bef150 msgr2=0x562c08c06d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bef150 0x562c08c06d30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x562c08bdd470 tx=0x7f668800b2e0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 -- 172.21.15.100:0/999066863 shutdown_connections 2024-09-12T02:46:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bef150 0x562c08c06d30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08c067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 --2- 172.21.15.100:0/999066863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bdfa40 0x562c08beaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 -- 172.21.15.100:0/999066863 >> 172.21.15.100:0/999066863 conn(0x562c08bdc0f0 msgr2=0x562c08bea820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 -- 172.21.15.100:0/999066863 shutdown_connections 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 -- 172.21.15.100:0/999066863 wait complete. 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.382+0000 7f669a674740 1 -- start start 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 1 Processor -- start 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bdfa40 0x562c08bf7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08bf2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bef150 0x562c08bf3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66901a9a00 con 0x562c08bdfa40 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66901aae70 con 0x562c08be0360 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66901aa0d0 con 0x562c08bef150 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f669a674740 10 client.0 _ll_register_callbacks cb 0x7f668800b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bdfa40 0x562c08bf7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bdfa40 0x562c08bf7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42846/0 (socket says 172.21.15.100:42846) 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 -- 172.21.15.100:0/2337808537 learned_addr learned my addr 172.21.15.100:0/2337808537 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696037640 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08bf2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 -- 172.21.15.100:0/2337808537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bef150 msgr2=0x562c08bf3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bef150 0x562c08bf3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 -- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 msgr2=0x562c08bf2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08bf2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.383+0000 7f6696838640 1 -- 172.21.15.100:0/2337808537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c08bf3b50 con 0x562c08bdfa40 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f6696838640 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bdfa40 0x562c08bf7960 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6688005d80 tx=0x7f6688003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cbaf96bdbc643a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f6675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f6675ffb640 1 -- 172.21.15.100:0/2337808537 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688037060 con 0x562c08bdfa40 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f6675ffb640 1 -- 172.21.15.100:0/2337808537 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6688003e30 con 0x562c08bdfa40 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6688023030 con 0x562c08bdfa40 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f6675ffb640 1 -- 172.21.15.100:0/2337808537 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f66880126c0 con 0x562c08bdfa40 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 10 client.16851 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562c08c698e0 con 0x562c08bdfa40 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f6675ffb640 1 -- 172.21.15.100:0/2337808537 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6688023030 con 0x562c08bdfa40 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f6675ffb640 1 -- 172.21.15.100:0/2337808537 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f668801fa60 con 0x562c08bdfa40 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 10 client.16851 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 20 client.16851 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08c69f50 0x562c08c6c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 4 client.16851 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.384+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562c08b4cd00 con 0x562c08c69f50 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.385+0000 7f6696037640 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08c69f50 0x562c08c6c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.385+0000 7f6696037640 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08c69f50 0x562c08c6c340 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e47871692cdd3fd7 server_cookie=abdeba62a7c50575 in_seq=0 out_seq=0 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.385+0000 7f6675ffb640 10 client.16851 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f6675ffb640 1 -- 172.21.15.100:0/2337808537 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562c08b4cd00 con 0x562c08c69f50 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f6675ffb640 10 client.16851 handle_command_reply: tid=0 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 client.16851 shutdown 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bdfa40 msgr2=0x562c08bf7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bdfa40 0x562c08bf7960 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6688005d80 tx=0x7f6688003c00 comp rx=0 tx=0).stop 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 shutdown_connections 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x562c08c69f50 0x562c08c6c340 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c08bef150 0x562c08bf3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562c08be0360 0x562c08bf2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 --2- 172.21.15.100:0/2337808537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c08bdfa40 0x562c08bf7960 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 >> 172.21.15.100:0/2337808537 conn(0x562c08bdc0f0 msgr2=0x562c08bdb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f6675ffb640 0 client.16851 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 shutdown_connections 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 1 -- 172.21.15.100:0/2337808537 wait complete. 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.386+0000 7f669a674740 20 client.16851 trim_cache size 0 max 16384 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "866355e7-7380-4560-b54e-960af8204a20", 2024-09-12T02:46:57.393 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:46:57.394 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66780a2b80 msgr2=0x7f66780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66780a2b80 0x7f66780a5040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f66840b81b0 tx=0x7f6684040fb0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 msgr2=0x7f6690198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690198b10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6684005940 tx=0x7f66840042f0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 shutdown_connections 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f66780a2b80 0x7f66780a5040 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6690108300 0x7f669019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6690103780 0x7f6690198b10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 --2- 172.21.15.100:0/1562235141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6690102dd0 0x7f66901985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 >> 172.21.15.100:0/1562235141 conn(0x7f66900fc7d0 msgr2=0x7f6690105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 shutdown_connections 2024-09-12T02:46:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:57.387+0000 7f669829b640 1 -- 172.21.15.100:0/1562235141 wait complete. 2024-09-12T02:46:58.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:57 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:46:58.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:57 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:57 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:46:58.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:57 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:46:58.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:57 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:57 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.062 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:46:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:57 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:46:58.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:57 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:57 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:46:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:57 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:46:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:57 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:57 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:57 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:46:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:57 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:57 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:46:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:57 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:46:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:57 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:57 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.793+0000 7f1529949640 1 -- 172.21.15.100:0/4007466248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524100a70 msgr2=0x7f1524100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.793+0000 7f1529949640 1 --2- 172.21.15.100:0/4007466248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524100a70 0x7f1524100ed0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f150c009930 tx=0x7f150c02a420 comp rx=0 tx=0).stop 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.793+0000 7f1529949640 1 -- 172.21.15.100:0/4007466248 shutdown_connections 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.793+0000 7f1529949640 1 --2- 172.21.15.100:0/4007466248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1524101410 0x7f152410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.793+0000 7f1529949640 1 --2- 172.21.15.100:0/4007466248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524100a70 0x7f1524100ed0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.793+0000 7f1529949640 1 --2- 172.21.15.100:0/4007466248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1524106a70 0x7f1524106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.793+0000 7f1529949640 1 -- 172.21.15.100:0/4007466248 >> 172.21.15.100:0/4007466248 conn(0x7f15240fc790 msgr2=0x7f15240febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.794+0000 7f1529949640 1 -- 172.21.15.100:0/4007466248 shutdown_connections 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.794+0000 7f1529949640 1 -- 172.21.15.100:0/4007466248 wait complete. 2024-09-12T02:46:58.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.794+0000 7f1529949640 1 Processor -- start 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.794+0000 7f1529949640 1 -- start start 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f1529949640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1524100a70 0x7f152419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f1529949640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524101410 0x7f152419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f1529949640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1524106a70 0x7f152419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f1529949640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1524110e30 con 0x7f1524101410 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f1529949640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1524110cb0 con 0x7f1524100a70 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f1529949640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1524110fb0 con 0x7f1524106a70 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524101410 0x7f152419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524101410 0x7f152419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42856/0 (socket says 172.21.15.100:42856) 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 -- 172.21.15.100:0/2516166005 learned_addr learned my addr 172.21.15.100:0/2516166005 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f1522ffd640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1524100a70 0x7f152419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f15237fe640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1524106a70 0x7f152419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 -- 172.21.15.100:0/2516166005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1524106a70 msgr2=0x7f152419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1524106a70 0x7f152419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 -- 172.21.15.100:0/2516166005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1524100a70 msgr2=0x7f152419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1524100a70 0x7f152419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 -- 172.21.15.100:0/2516166005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152419f510 con 0x7f1524101410 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.795+0000 7f151a7fc640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524101410 0x7f152419aaa0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f150c009a50 tx=0x7f150c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.797+0000 7f1528947640 1 -- 172.21.15.100:0/2516166005 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c03f030 con 0x7f1524101410 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.797+0000 7f1528947640 1 -- 172.21.15.100:0/2516166005 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c003ad0 con 0x7f1524101410 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.797+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152419f7a0 con 0x7f1524101410 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.797+0000 7f1528947640 1 -- 172.21.15.100:0/2516166005 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c035070 con 0x7f1524101410 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.797+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15241a70e0 con 0x7f1524101410 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.800+0000 7f1528947640 1 -- 172.21.15.100:0/2516166005 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f150c042030 con 0x7f1524101410 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.800+0000 7f152bd22740 1 Processor -- start 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.800+0000 7f152bd22740 1 -- start start 2024-09-12T02:46:58.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f152bd22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4a4a0 0x558076a4a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f152bd22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a55140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f152bd22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a55680 0x558076a57a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f152bd22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5580769b02e0 con 0x558076a55680 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f152bd22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558076957ce0 con 0x558076a4a4a0 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f152bd22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5580769ac2a0 con 0x558076a4adc0 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a55680 0x558076a57a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a55680 0x558076a57a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42862/0 (socket says 172.21.15.100:42862) 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f151a7fc640 1 -- 172.21.15.100:0/56200296 learned_addr learned my addr 172.21.15.100:0/56200296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1522ffd640 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a55140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1528947640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15100a2b80 0x7f15100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f15237fe640 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4a4a0 0x558076a4a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f15237fe640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15100a2b80 0x7f15100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1528947640 1 -- 172.21.15.100:0/2516166005 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f150c0ef820 con 0x7f1524101410 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1522ffd640 1 -- 172.21.15.100:0/56200296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4a4a0 msgr2=0x558076a4a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1522ffd640 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4a4a0 0x558076a4a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1522ffd640 1 -- 172.21.15.100:0/56200296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a55680 msgr2=0x558076a57a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1522ffd640 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a55680 0x558076a57a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1522ffd640 1 -- 172.21.15.100:0/56200296 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807693c440 con 0x558076a4adc0 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f151a7fc640 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a55680 0x558076a57a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.801+0000 7f1522ffd640 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a55140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f151400ab70 tx=0x7f151400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d903252f56fb707 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f1519ffb640 1 -- 172.21.15.100:0/56200296 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514005220 con 0x558076a4adc0 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f15237fe640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15100a2b80 0x7f15100a5040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f151c007fd0 tx=0x7f151c007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f1519ffb640 1 -- 172.21.15.100:0/56200296 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1514004c80 con 0x558076a4adc0 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f1519ffb640 1 -- 172.21.15.100:0/56200296 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514018800 con 0x558076a4adc0 2024-09-12T02:46:58.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 -- 172.21.15.100:0/56200296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 msgr2=0x558076a55140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a55140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f151400ab70 tx=0x7f151400f790 comp rx=0 tx=0).stop 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 -- 172.21.15.100:0/56200296 shutdown_connections 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a55680 0x558076a57a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a55140 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 --2- 172.21.15.100:0/56200296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4a4a0 0x558076a4a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 -- 172.21.15.100:0/56200296 >> 172.21.15.100:0/56200296 conn(0x558076a46a30 msgr2=0x558076a46e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 -- 172.21.15.100:0/56200296 shutdown_connections 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.802+0000 7f152bd22740 1 -- 172.21.15.100:0/56200296 wait complete. 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 -- start start 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 Processor -- start 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4a4a0 0x558076a54fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4adc0 0x558076a52250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a55680 0x558076a52790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558076a58250 con 0x558076a4adc0 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55807696b050 con 0x558076a55680 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558076a583d0 con 0x558076a4a4a0 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f152bd22740 10 client.0 _ll_register_callbacks cb 0x5580769ab160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4adc0 0x558076a52250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4adc0 0x558076a52250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42866/0 (socket says 172.21.15.100:42866) 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f151a7fc640 1 -- 172.21.15.100:0/3254923997 learned_addr learned my addr 172.21.15.100:0/3254923997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.803+0000 7f1522ffd640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4a4a0 0x558076a54fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f15237fe640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a55680 0x558076a52790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f151a7fc640 1 -- 172.21.15.100:0/3254923997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4a4a0 msgr2=0x558076a54fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f151a7fc640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4a4a0 0x558076a54fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f151a7fc640 1 -- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a55680 msgr2=0x558076a52790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f151a7fc640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a55680 0x558076a52790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f151a7fc640 1 -- 172.21.15.100:0/3254923997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580767213c0 con 0x558076a4adc0 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f15237fe640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a55680 0x558076a52790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f151a7fc640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4adc0 0x558076a52250 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f150c009900 tx=0x7f150c0314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a19b69173dd000c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f1502ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f1502ffd640 1 -- 172.21.15.100:0/3254923997 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c049030 con 0x558076a4adc0 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1514004c80 con 0x558076a4adc0 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f1502ffd640 1 -- 172.21.15.100:0/3254923997 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f150c003c80 con 0x558076a4adc0 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f1502ffd640 1 -- 172.21.15.100:0/3254923997 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f150c0bb970 con 0x558076a4adc0 2024-09-12T02:46:58.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f152bd22740 10 client.16863 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558076a63bd0 con 0x558076a4adc0 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f1502ffd640 1 -- 172.21.15.100:0/3254923997 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1514004c80 con 0x558076a4adc0 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.804+0000 7f1502ffd640 1 -- 172.21.15.100:0/3254923997 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f150c0b8680 con 0x558076a4adc0 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f152bd22740 10 client.16863 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f152bd22740 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f152bd22740 20 client.16863 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f152bd22740 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a650c0 0x558076a674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f152bd22740 4 client.16863 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580769bd850 con 0x558076a650c0 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f1522ffd640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a650c0 0x558076a674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f1502ffd640 10 client.16863 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.805+0000 7f1522ffd640 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a650c0 0x558076a674e0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b74d54518e84259 server_cookie=462c0b335277a451 in_seq=0 out_seq=0 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f1502ffd640 1 -- 172.21.15.100:0/3254923997 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580769bd850 con 0x558076a650c0 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f1502ffd640 10 client.16863 handle_command_reply: tid=0 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 client.16863 shutdown 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4adc0 msgr2=0x558076a52250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4adc0 0x558076a52250 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f150c009900 tx=0x7f150c0314b0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 shutdown_connections 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a650c0 0x558076a674e0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a55680 0x558076a52790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4adc0 0x558076a52250 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f1502ffd640 0 client.16863 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:58.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 --2- 172.21.15.100:0/3254923997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4a4a0 0x558076a54fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 >> 172.21.15.100:0/3254923997 conn(0x558076a46a30 msgr2=0x558076a4c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 shutdown_connections 2024-09-12T02:46:58.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 1 -- 172.21.15.100:0/3254923997 wait complete. 2024-09-12T02:46:58.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.806+0000 7f152bd22740 20 client.16863 trim_cache size 0 max 16384 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 Processor -- start 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 -- start start 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a46a30 0x558076a614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a4d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4adc0 0x558076a6cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15241b1f00 con 0x558076a4a4a0 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15241af7d0 con 0x558076a4adc0 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.823+0000 7f152bd22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15241ad620 con 0x558076a46a30 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a4d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a4d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42870/0 (socket says 172.21.15.100:42870) 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 -- 172.21.15.100:0/443915796 learned_addr learned my addr 172.21.15.100:0/443915796 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:58.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f1522ffd640 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a46a30 0x558076a614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 -- 172.21.15.100:0/443915796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a46a30 msgr2=0x558076a614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a46a30 0x558076a614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 -- 172.21.15.100:0/443915796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4adc0 msgr2=0x558076a6cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4adc0 0x558076a6cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 -- 172.21.15.100:0/443915796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558076a4ba20 con 0x558076a4a4a0 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f1522ffd640 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a46a30 0x558076a614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f151a7fc640 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a4d7f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f150c000c00 tx=0x7f150c0ba520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a361d096481f670 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f15197fa640 1 -- 172.21.15.100:0/443915796 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c049070 con 0x558076a4a4a0 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f15197fa640 1 -- 172.21.15.100:0/443915796 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c0dc0f0 con 0x558076a4a4a0 2024-09-12T02:46:58.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.824+0000 7f15197fa640 1 -- 172.21.15.100:0/443915796 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0b7d60 con 0x558076a4a4a0 2024-09-12T02:46:58.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 -- 172.21.15.100:0/443915796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 msgr2=0x558076a4d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a4d7f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f150c000c00 tx=0x7f150c0ba520 comp rx=0 tx=0).stop 2024-09-12T02:46:58.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 -- 172.21.15.100:0/443915796 shutdown_connections 2024-09-12T02:46:58.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a4adc0 0x558076a6cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a4d7f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 --2- 172.21.15.100:0/443915796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a46a30 0x558076a614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 -- 172.21.15.100:0/443915796 >> 172.21.15.100:0/443915796 conn(0x558076a528f0 msgr2=0x558076a4d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 -- 172.21.15.100:0/443915796 shutdown_connections 2024-09-12T02:46:58.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 -- 172.21.15.100:0/443915796 wait complete. 2024-09-12T02:46:58.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.825+0000 7f152bd22740 1 -- start start 2024-09-12T02:46:58.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 1 Processor -- start 2024-09-12T02:46:58.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a46a30 0x558076a5da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a58da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15241adc90 con 0x558076a4a4a0 2024-09-12T02:46:58.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15241af100 con 0x558076a46a30 2024-09-12T02:46:58.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15241ae360 con 0x558076a4adc0 2024-09-12T02:46:58.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f152bd22740 10 client.0 _ll_register_callbacks cb 0x7f150c005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:58.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a58da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a58da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42882/0 (socket says 172.21.15.100:42882) 2024-09-12T02:46:58.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 -- 172.21.15.100:0/2761702707 learned_addr learned my addr 172.21.15.100:0/2761702707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:46:58.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f15237fe640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f1522ffd640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a46a30 0x558076a5da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 -- 172.21.15.100:0/2761702707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 msgr2=0x558076a592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 -- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a46a30 msgr2=0x558076a5da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a46a30 0x558076a5da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 -- 172.21.15.100:0/2761702707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558076a59820 con 0x558076a4a4a0 2024-09-12T02:46:58.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f15237fe640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:58.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f151a7fc640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a58da0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f150c0bbd10 tx=0x7f150c03b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648c6fcaedcee110 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f1502ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:46:58.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.826+0000 7f1502ffd640 1 -- 172.21.15.100:0/2761702707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c049070 con 0x558076a4a4a0 2024-09-12T02:46:58.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f1502ffd640 1 -- 172.21.15.100:0/2761702707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f150c0c49f0 con 0x558076a4a4a0 2024-09-12T02:46:58.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5580769b7d60 con 0x558076a4a4a0 2024-09-12T02:46:58.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f1502ffd640 1 -- 172.21.15.100:0/2761702707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f150c0bc010 con 0x558076a4a4a0 2024-09-12T02:46:58.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 10 client.16869 fetch_fsmap learned FSMap version 27 2024-09-12T02:46:58.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558076a59820 con 0x558076a4a4a0 2024-09-12T02:46:58.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f1502ffd640 1 -- 172.21.15.100:0/2761702707 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5580769b7d60 con 0x558076a4a4a0 2024-09-12T02:46:58.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f1502ffd640 1 -- 172.21.15.100:0/2761702707 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f150c0b6b80 con 0x558076a4a4a0 2024-09-12T02:46:58.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 10 client.16869 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:46:58.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:46:58.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 20 client.16869 populate_metadata read hostname 'smithi100' 2024-09-12T02:46:58.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a55680 0x558076ad1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 4 client.16869 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:46:58.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558076934210 con 0x558076a55680 2024-09-12T02:46:58.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.827+0000 7f1522ffd640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a55680 0x558076ad1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f1522ffd640 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a55680 0x558076ad1de0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82aa0a5ac8759f3b server_cookie=2ac5d60e19b9b938 in_seq=0 out_seq=0 2024-09-12T02:46:58.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f1502ffd640 10 client.16869 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:58.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f1502ffd640 1 -- 172.21.15.100:0/2761702707 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558076934210 con 0x558076a55680 2024-09-12T02:46:58.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f1502ffd640 10 client.16869 handle_command_reply: tid=0 2024-09-12T02:46:58.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 client.16869 shutdown 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 msgr2=0x558076a58da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a58da0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f150c0bbd10 tx=0x7f150c03b690 comp rx=0 tx=0).stop 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 shutdown_connections 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558076a55680 0x558076ad1de0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558076a4adc0 0x558076a592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558076a4a4a0 0x558076a58da0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 --2- 172.21.15.100:0/2761702707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558076a46a30 0x558076a5da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f1502ffd640 0 client.16869 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 >> 172.21.15.100:0/2761702707 conn(0x558076a528f0 msgr2=0x558076a50720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 shutdown_connections 2024-09-12T02:46:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 1 -- 172.21.15.100:0/2761702707 wait complete. 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.828+0000 7f152bd22740 20 client.16869 trim_cache size 0 max 16384 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout: "866355e7-7380-4560-b54e-960af8204a20": { 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "866355e7-7380-4560-b54e-960af8204a20", 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:46:58.840 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:58.841 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:46:58.841 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:46:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15100a2b80 msgr2=0x7f15100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15100a2b80 0x7f15100a5040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f151c007fd0 tx=0x7f151c007520 comp rx=0 tx=0).stop 2024-09-12T02:46:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524101410 msgr2=0x7f152419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524101410 0x7f152419aaa0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f150c009a50 tx=0x7f150c004270 comp rx=0 tx=0).stop 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 shutdown_connections 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f15100a2b80 0x7f15100a5040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1524106a70 0x7f152419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1524101410 0x7f152419aaa0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 --2- 172.21.15.100:0/2516166005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1524100a70 0x7f152419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 >> 172.21.15.100:0/2516166005 conn(0x7f15240fc790 msgr2=0x7f15240fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 shutdown_connections 2024-09-12T02:46:58.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:46:58.829+0000 7f1529949640 1 -- 172.21.15.100:0/2516166005 wait complete. 2024-09-12T02:46:59.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:46:58 smithi117 ceph-mon[34898]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.7 MiB/s wr, 392 op/s 2024-09-12T02:46:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:46:58 smithi100 ceph-mon[31390]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.7 MiB/s wr, 392 op/s 2024-09-12T02:46:59.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:46:58 smithi189 ceph-mon[35196]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.7 MiB/s wr, 392 op/s 2024-09-12T02:46:59.572 INFO:tasks.cephfs.filesystem:scrub status for tag:866355e7-7380-4560-b54e-960af8204a20 - {'path': '/', 'tag': '866355e7-7380-4560-b54e-960af8204a20', 'options': 'recursive,force'} 2024-09-12T02:47:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:00 smithi117 ceph-mon[34898]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 403 op/s 2024-09-12T02:47:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:00 smithi100 ceph-mon[31390]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 403 op/s 2024-09-12T02:47:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:00 smithi189 ceph-mon[35196]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 403 op/s 2024-09-12T02:47:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:47:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:02 smithi117 ceph-mon[34898]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-09-12T02:47:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:02 smithi100 ceph-mon[31390]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-09-12T02:47:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:02 smithi189 ceph-mon[35196]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-09-12T02:47:04.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:03 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:04.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:03 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:04.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:03 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:04 smithi117 ceph-mon[34898]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.6 MiB/s wr, 220 op/s 2024-09-12T02:47:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:47:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:04 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:47:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:04 smithi100 ceph-mon[31390]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.6 MiB/s wr, 220 op/s 2024-09-12T02:47:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:47:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:04 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:47:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:04 smithi189 ceph-mon[35196]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.6 MiB/s wr, 220 op/s 2024-09-12T02:47:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:47:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:04 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:47:06.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:05 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:47:06.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:05 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:47:06.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:05 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:47:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:47:06.561 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:47:06.828 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:06.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:06 smithi100 ceph-mon[31390]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-09-12T02:47:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:06 smithi117 ceph-mon[34898]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-09-12T02:47:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:06 smithi189 ceph-mon[35196]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 -- 172.21.15.100:0/2376742986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c106a80 msgr2=0x7ff69c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 --2- 172.21.15.100:0/2376742986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c106a80 0x7ff69c106e60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009930 tx=0x7ff68c02a420 comp rx=0 tx=0).stop 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 -- 172.21.15.100:0/2376742986 shutdown_connections 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 --2- 172.21.15.100:0/2376742986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff69c101420 0x7ff69c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 --2- 172.21.15.100:0/2376742986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c100a80 0x7ff69c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 --2- 172.21.15.100:0/2376742986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c106a80 0x7ff69c106e60 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 -- 172.21.15.100:0/2376742986 >> 172.21.15.100:0/2376742986 conn(0x7ff69c0fc7a0 msgr2=0x7ff69c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 -- 172.21.15.100:0/2376742986 shutdown_connections 2024-09-12T02:47:07.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 -- 172.21.15.100:0/2376742986 wait complete. 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 Processor -- start 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.318+0000 7ff6a2942640 1 -- start start 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c100a80 0x7ff69c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c101420 0x7ff69c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff69c106a80 0x7ff69c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c110e80 con 0x7ff69c100a80 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c110d00 con 0x7ff69c101420 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c111000 con 0x7ff69c106a80 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c100a80 0x7ff69c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c100a80 0x7ff69c197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33148/0 (socket says 172.21.15.100:33148) 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 -- 172.21.15.100:0/3053889449 learned_addr learned my addr 172.21.15.100:0/3053889449 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a0edf640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff69c106a80 0x7ff69c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff693fff640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c101420 0x7ff69c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 -- 172.21.15.100:0/3053889449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff69c106a80 msgr2=0x7ff69c19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff69c106a80 0x7ff69c19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 -- 172.21.15.100:0/3053889449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c101420 msgr2=0x7ff69c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c101420 0x7ff69c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 -- 172.21.15.100:0/3053889449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c19c2b0 con 0x7ff69c100a80 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a0edf640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff69c106a80 0x7ff69c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff693fff640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c101420 0x7ff69c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff69bfff640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c100a80 0x7ff69c197300 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009a50 tx=0x7ff68c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff699ffb640 1 -- 172.21.15.100:0/3053889449 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c03f030 con 0x7ff69c100a80 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c19c540 con 0x7ff69c100a80 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff699ffb640 1 -- 172.21.15.100:0/3053889449 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff68c003ce0 con 0x7ff69c100a80 2024-09-12T02:47:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff699ffb640 1 -- 172.21.15.100:0/3053889449 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c035070 con 0x7ff69c100a80 2024-09-12T02:47:07.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.319+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c1a3e80 con 0x7ff69c100a80 2024-09-12T02:47:07.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.320+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c1021c0 con 0x7ff69c100a80 2024-09-12T02:47:07.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.321+0000 7ff699ffb640 1 -- 172.21.15.100:0/3053889449 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff68c042030 con 0x7ff69c100a80 2024-09-12T02:47:07.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.322+0000 7ff699ffb640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6880a2b80 0x7ff6880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.323+0000 7ff699ffb640 1 -- 172.21.15.100:0/3053889449 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff68c0ef6c0 con 0x7ff69c100a80 2024-09-12T02:47:07.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.323+0000 7ff693fff640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6880a2b80 0x7ff6880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.323+0000 7ff693fff640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6880a2b80 0x7ff6880a5040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0fedb0 tx=0x7ff684005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:07.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.327+0000 7ff699ffb640 1 -- 172.21.15.100:0/3053889449 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff68c0bc610 con 0x7ff69c100a80 2024-09-12T02:47:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.526+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff69c108ff0 con 0x7ff69c100a80 2024-09-12T02:47:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.527+0000 7ff699ffb640 1 -- 172.21.15.100:0/3053889449 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7ff68c0bbf10 con 0x7ff69c100a80 2024-09-12T02:47:07.529 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:47:07.529 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:47:07.529 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6880a2b80 msgr2=0x7ff6880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6880a2b80 0x7ff6880a5040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0fedb0 tx=0x7ff684005d90 comp rx=0 tx=0).stop 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c100a80 msgr2=0x7ff69c197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c100a80 0x7ff69c197300 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009a50 tx=0x7ff68c004270 comp rx=0 tx=0).stop 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 shutdown_connections 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff6880a2b80 0x7ff6880a5040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff69c106a80 0x7ff69c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c101420 0x7ff69c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 --2- 172.21.15.100:0/3053889449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff69c100a80 0x7ff69c197300 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 >> 172.21.15.100:0/3053889449 conn(0x7ff69c0fc7a0 msgr2=0x7ff69c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 shutdown_connections 2024-09-12T02:47:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:07.530+0000 7ff6a2942640 1 -- 172.21.15.100:0/3053889449 wait complete. 2024-09-12T02:47:08.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:07 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3053889449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:08.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:07 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3053889449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:08.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:07 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3053889449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:08.173 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 8dc7cb5b --release --await' 2024-09-12T02:47:08.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 8dc7cb5b --release --await 2024-09-12T02:47:08.416 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 -- 172.21.15.100:0/451697262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 msgr2=0x7feccc10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 --2- 172.21.15.100:0/451697262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc10bc00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009900 tx=0x7fecc002a410 comp rx=0 tx=0).stop 2024-09-12T02:47:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 -- 172.21.15.100:0/451697262 shutdown_connections 2024-09-12T02:47:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 --2- 172.21.15.100:0/451697262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feccc10c2f0 0x7feccc10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 --2- 172.21.15.100:0/451697262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc10bc00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 --2- 172.21.15.100:0/451697262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feccc102df0 0x7feccc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 -- 172.21.15.100:0/451697262 >> 172.21.15.100:0/451697262 conn(0x7feccc0fc7d0 msgr2=0x7feccc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 -- 172.21.15.100:0/451697262 shutdown_connections 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 -- 172.21.15.100:0/451697262 wait complete. 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 Processor -- start 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.887+0000 7fecd34ce640 1 -- start start 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd34ce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feccc102df0 0x7feccc100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd34ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd34ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feccc10c2f0 0x7feccc1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd34ce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feccc112120 con 0x7feccc1037a0 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd34ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feccc111fa0 con 0x7feccc10c2f0 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd34ce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1122a0 con 0x7feccc102df0 2024-09-12T02:47:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33174/0 (socket says 172.21.15.100:33174) 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 -- 172.21.15.100:0/1357362397 learned_addr learned my addr 172.21.15.100:0/1357362397 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feccc10c2f0 0x7feccc1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd126a640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feccc102df0 0x7feccc100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 -- 172.21.15.100:0/1357362397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feccc102df0 msgr2=0x7feccc100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feccc102df0 0x7feccc100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 -- 172.21.15.100:0/1357362397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feccc10c2f0 msgr2=0x7feccc1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feccc10c2f0 0x7feccc1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 -- 172.21.15.100:0/1357362397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc1a6b20 con 0x7feccc1037a0 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd0a69640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc100f90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fecc002a930 tx=0x7fecc0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecca7fc640 1 -- 172.21.15.100:0/1357362397 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc003f070 con 0x7feccc1037a0 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecca7fc640 1 -- 172.21.15.100:0/1357362397 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc0031c90 con 0x7feccc1037a0 2024-09-12T02:47:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.888+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc1a6db0 con 0x7feccc1037a0 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.889+0000 7fecca7fc640 1 -- 172.21.15.100:0/1357362397 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0035030 con 0x7feccc1037a0 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.889+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc1a7230 con 0x7feccc1037a0 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecca7fc640 1 -- 172.21.15.100:0/1357362397 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fecc0042070 con 0x7feccc1037a0 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 Processor -- start 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 -- start start 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb93d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb947d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb948240 0x5643cb94a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5643cb8a2620 con 0x5643cb93d060 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5643cb849e50 con 0x5643cb948240 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.891+0000 7fecd58a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5643cb89e5e0 con 0x5643cb93d980 2024-09-12T02:47:08.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb93d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb93d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33178/0 (socket says 172.21.15.100:33178) 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 -- 172.21.15.100:0/54533029 learned_addr learned my addr 172.21.15.100:0/54533029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd0a69640 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb948240 0x5643cb94a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd126a640 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb947d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 -- 172.21.15.100:0/54533029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 msgr2=0x5643cb947d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecca7fc640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fecb40a2b80 0x7fecb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb947d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 -- 172.21.15.100:0/54533029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb948240 msgr2=0x5643cb94a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb948240 0x5643cb94a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 -- 172.21.15.100:0/54533029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643cb83ad40 con 0x5643cb93d060 2024-09-12T02:47:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd126a640 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb947d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecca7fc640 1 -- 172.21.15.100:0/1357362397 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fecc00ef490 con 0x7feccc1037a0 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fecb40a2b80 0x7fecb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb93d440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fecc400ab00 tx=0x7fecc400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8152571e0463d8de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.892+0000 7fecb37fe640 1 -- 172.21.15.100:0/54533029 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc401a880 con 0x5643cb93d060 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecb37fe640 1 -- 172.21.15.100:0/54533029 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc4010e30 con 0x5643cb93d060 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecb37fe640 1 -- 172.21.15.100:0/54533029 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc40173b0 con 0x5643cb93d060 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 -- 172.21.15.100:0/54533029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 msgr2=0x5643cb93d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fecb40a2b80 0x7fecb40a5040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fecc401f000 tx=0x7fecc4020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb93d440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fecc400ab00 tx=0x7fecc400f3c0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 -- 172.21.15.100:0/54533029 shutdown_connections 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb948240 0x5643cb94a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb947d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 --2- 172.21.15.100:0/54533029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb93d440 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 -- 172.21.15.100:0/54533029 >> 172.21.15.100:0/54533029 conn(0x5643cb9395f0 msgr2=0x5643cb9399d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 -- 172.21.15.100:0/54533029 shutdown_connections 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.893+0000 7fecd58a7740 1 -- 172.21.15.100:0/54533029 wait complete. 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 -- start start 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 Processor -- start 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d060 0x5643cb9450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb945610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb945b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5643cb94ae10 con 0x5643cb948240 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5643cb82af10 con 0x5643cb93d060 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5643cb94af90 con 0x5643cb93d980 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd58a7740 10 client.0 _ll_register_callbacks cb 0x5643cb84edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd1a6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb945b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd1a6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb945b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33194/0 (socket says 172.21.15.100:33194) 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.894+0000 7fecd1a6b640 1 -- 172.21.15.100:0/889453714 learned_addr learned my addr 172.21.15.100:0/889453714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd126a640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d060 0x5643cb9450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd0a69640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb945610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd1a6b640 1 -- 172.21.15.100:0/889453714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 msgr2=0x5643cb945610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb945610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd1a6b640 1 -- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d060 msgr2=0x5643cb9450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d060 0x5643cb9450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd1a6b640 1 -- 172.21.15.100:0/889453714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643cb5b1580 con 0x5643cb948240 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd0a69640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb945610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd126a640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d060 0x5643cb9450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb945b50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fecc400fb00 tx=0x7fecc401a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a0891c3a940149 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecb0ff9640 1 -- 172.21.15.100:0/889453714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4031070 con 0x5643cb948240 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecb0ff9640 1 -- 172.21.15.100:0/889453714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fecc4018630 con 0x5643cb948240 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc4010e30 con 0x5643cb948240 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecb0ff9640 1 -- 172.21.15.100:0/889453714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fecc403d050 con 0x5643cb948240 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd58a7740 10 client.16887 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5643cb67b960 con 0x5643cb948240 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecb0ff9640 1 -- 172.21.15.100:0/889453714 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc4010e30 con 0x5643cb948240 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecb0ff9640 1 -- 172.21.15.100:0/889453714 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fecc4036b10 con 0x5643cb948240 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd58a7740 10 client.16887 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd58a7740 10 client.16887 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.895+0000 7fecd58a7740 20 client.16887 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.896+0000 7fecd58a7740 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb957bd0 0x5643cb959fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.896+0000 7fecd58a7740 4 client.16887 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.896+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643cb8afb90 con 0x5643cb957bd0 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.896+0000 7fecd126a640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb957bd0 0x5643cb959fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.896+0000 7fecd126a640 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb957bd0 0x5643cb959fc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a146b043cac0245 server_cookie=b024235ee88e9854 in_seq=0 out_seq=0 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.896+0000 7fecb0ff9640 10 client.16887 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecb0ff9640 1 -- 172.21.15.100:0/889453714 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643cb8afb90 con 0x5643cb957bd0 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecb0ff9640 10 client.16887 handle_command_reply: tid=0 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 client.16887 shutdown 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 msgr2=0x5643cb945b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb945b50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fecc400fb00 tx=0x7fecc401a580 comp rx=0 tx=0).stop 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 shutdown_connections 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb957bd0 0x5643cb959fc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb945b50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d980 0x5643cb945610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 --2- 172.21.15.100:0/889453714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d060 0x5643cb9450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecb0ff9640 0 client.16887 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 >> 172.21.15.100:0/889453714 conn(0x5643cb9395f0 msgr2=0x5643cb938750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 shutdown_connections 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 1 -- 172.21.15.100:0/889453714 wait complete. 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.897+0000 7fecd58a7740 20 client.16887 trim_cache size 0 max 16384 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 Processor -- start 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 -- start start 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb95f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 0x5643cb95fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb948240 0x5643cb942330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1b2160 con 0x5643cb93d060 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1afa30 con 0x5643cb93d980 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd58a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ad880 con 0x5643cb948240 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb95f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb95f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33206/0 (socket says 172.21.15.100:33206) 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 -- 172.21.15.100:0/2886413533 learned_addr learned my addr 172.21.15.100:0/2886413533 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 -- 172.21.15.100:0/2886413533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb948240 msgr2=0x5643cb942330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 --2- 172.21.15.100:0/2886413533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb948240 0x5643cb942330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 -- 172.21.15.100:0/2886413533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 msgr2=0x5643cb95fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 --2- 172.21.15.100:0/2886413533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 0x5643cb95fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 -- 172.21.15.100:0/2886413533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643cb943620 con 0x5643cb93d060 2024-09-12T02:47:08.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecd126a640 1 --2- 172.21.15.100:0/2886413533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb95f5f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x5643cb95a590 tx=0x7fecbc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fc9479270091f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.914+0000 7fecb2ffd640 1 -- 172.21.15.100:0/2886413533 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc003b70 con 0x5643cb93d060 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecb2ffd640 1 -- 172.21.15.100:0/2886413533 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecbc01f070 con 0x5643cb93d060 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecb2ffd640 1 -- 172.21.15.100:0/2886413533 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc01a810 con 0x5643cb93d060 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 -- 172.21.15.100:0/2886413533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 msgr2=0x5643cb95f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 --2- 172.21.15.100:0/2886413533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb95f5f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x5643cb95a590 tx=0x7fecbc009680 comp rx=0 tx=0).stop 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 -- 172.21.15.100:0/2886413533 shutdown_connections 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 --2- 172.21.15.100:0/2886413533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb948240 0x5643cb942330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 --2- 172.21.15.100:0/2886413533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 0x5643cb95fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 --2- 172.21.15.100:0/2886413533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb93d060 0x5643cb95f5f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 -- 172.21.15.100:0/2886413533 >> 172.21.15.100:0/2886413533 conn(0x5643cb9395f0 msgr2=0x5643cb9439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 -- 172.21.15.100:0/2886413533 shutdown_connections 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.915+0000 7fecd58a7740 1 -- 172.21.15.100:0/2886413533 wait complete. 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 -- start start 2024-09-12T02:47:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 Processor -- start 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d060 0x5643cb950380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 0x5643cb9508c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb94c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1adef0 con 0x5643cb948240 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1af360 con 0x5643cb93d980 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ae5c0 con 0x5643cb93d060 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd58a7740 10 client.0 _ll_register_callbacks cb 0x7fecc400a950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd1a6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb94c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd1a6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb94c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33208/0 (socket says 172.21.15.100:33208) 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd1a6b640 1 -- 172.21.15.100:0/1123789601 learned_addr learned my addr 172.21.15.100:0/1123789601 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.916+0000 7fecd0a69640 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 0x5643cb9508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd126a640 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d060 0x5643cb950380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd1a6b640 1 -- 172.21.15.100:0/1123789601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d060 msgr2=0x5643cb950380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d060 0x5643cb950380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd1a6b640 1 -- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 msgr2=0x5643cb9508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 0x5643cb9508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd1a6b640 1 -- 172.21.15.100:0/1123789601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643cb94cfd0 con 0x5643cb948240 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd1a6b640 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb94c7a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fecc400aa20 tx=0x7fecc4024680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d624c1a4b5dfc24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecb0ff9640 1 -- 172.21.15.100:0/1123789601 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4031040 con 0x5643cb948240 2024-09-12T02:47:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecb0ff9640 1 -- 172.21.15.100:0/1123789601 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fecc4018630 con 0x5643cb948240 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecbc01f070 con 0x5643cb948240 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecb0ff9640 1 -- 172.21.15.100:0/1123789601 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fecc4028040 con 0x5643cb948240 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd58a7740 10 client.16893 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5643cb9c30d0 con 0x5643cb948240 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.917+0000 7fecb0ff9640 1 -- 172.21.15.100:0/1123789601 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecbc01f070 con 0x5643cb948240 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecb0ff9640 1 -- 172.21.15.100:0/1123789601 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fecc4010c40 con 0x5643cb948240 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd58a7740 10 client.16893 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd58a7740 10 client.16893 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd58a7740 20 client.16893 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd58a7740 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb9c3730 0x5643cb9c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd58a7740 4 client.16893 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8dc7cb5b", "release": true, "await": true}] 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8dc7cb5b", "release": true, "await": true}) -- 0x5643cb8aa0a0 con 0x5643cb9c3730 2024-09-12T02:47:08.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd126a640 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb9c3730 0x5643cb9c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:08.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecd126a640 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb9c3730 0x5643cb9c5b50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3790f3933c8b9f6f server_cookie=87455ef799a87057 in_seq=0 out_seq=0 2024-09-12T02:47:08.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.918+0000 7fecb0ff9640 10 client.16893 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:08.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecb0ff9640 1 -- 172.21.15.100:0/1123789601 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5643cb8aa0a0 con 0x5643cb9c3730 2024-09-12T02:47:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecb0ff9640 10 client.16893 handle_command_reply: tid=0 2024-09-12T02:47:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 client.16893 shutdown 2024-09-12T02:47:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 msgr2=0x5643cb94c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb94c7a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fecc400aa20 tx=0x7fecc4024680 comp rx=0 tx=0).stop 2024-09-12T02:47:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 shutdown_connections 2024-09-12T02:47:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5643cb9c3730 0x5643cb9c5b50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643cb948240 0x5643cb94c7a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643cb93d980 0x5643cb9508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 --2- 172.21.15.100:0/1123789601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5643cb93d060 0x5643cb950380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 >> 172.21.15.100:0/1123789601 conn(0x5643cb9395f0 msgr2=0x5643cb945070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecb0ff9640 0 client.16893 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:08.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.983+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 shutdown_connections 2024-09-12T02:47:08.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.984+0000 7fecd58a7740 1 -- 172.21.15.100:0/1123789601 wait complete. 2024-09-12T02:47:08.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.984+0000 7fecd58a7740 20 client.16893 trim_cache size 0 max 16384 2024-09-12T02:47:08.991 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:47:08.992 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:47:08.992 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:47:08.992 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 36, 2024-09-12T02:47:08.992 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:47:08.992 INFO:teuthology.orchestra.run.smithi100.stdout: "8dc7cb5b": { 2024-09-12T02:47:08.993 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 36, 2024-09-12T02:47:08.993 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:47:08.993 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:47:08.993 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:47:08.993 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:47:08.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:47:08.994 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:47:08.994 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 139.4, 2024-09-12T02:47:08.994 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:47:08.994 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:47:08.994 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:47:08.994 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:47:08.995 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:47:08.995 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:47:08.995 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:47:08.995 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:47:08.995 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:47:08.996 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:47:08.996 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:47:08.996 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:47:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.986+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fecb40a2b80 msgr2=0x7fecb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.986+0000 7fecd34ce640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fecb40a2b80 0x7fecb40a5040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fecc401f000 tx=0x7fecc4020000 comp rx=0 tx=0).stop 2024-09-12T02:47:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.986+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 msgr2=0x7feccc100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.986+0000 7fecd34ce640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc100f90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fecc002a930 tx=0x7fecc0003b90 comp rx=0 tx=0).stop 2024-09-12T02:47:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.987+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 shutdown_connections 2024-09-12T02:47:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.987+0000 7fecd34ce640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fecb40a2b80 0x7fecb40a5040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.987+0000 7fecd34ce640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feccc10c2f0 0x7feccc1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.987+0000 7fecd34ce640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feccc1037a0 0x7feccc100f90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.987+0000 7fecd34ce640 1 --2- 172.21.15.100:0/1357362397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feccc102df0 0x7feccc100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.987+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 >> 172.21.15.100:0/1357362397 conn(0x7feccc0fc7d0 msgr2=0x7feccc0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.988+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 shutdown_connections 2024-09-12T02:47:09.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:08.988+0000 7fecd34ce640 1 -- 172.21.15.100:0/1357362397 wait complete. 2024-09-12T02:47:09.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:08 smithi117 ceph-mon[34898]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 MiB/s wr, 91 op/s 2024-09-12T02:47:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:08 smithi100 ceph-mon[31390]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 MiB/s wr, 91 op/s 2024-09-12T02:47:09.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:08 smithi189 ceph-mon[35196]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 MiB/s wr, 91 op/s 2024-09-12T02:47:09.843 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8dc7cb5b', total seconds elapsed: 22.7 2024-09-12T02:47:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:09 smithi117 ceph-mon[34898]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-09-12T02:47:10.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:09 smithi100 ceph-mon[31390]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-09-12T02:47:10.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:09 smithi189 ceph-mon[35196]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-09-12T02:47:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 480.0 s, 1588.6 tps, lat 244.857 ms stddev 1917.565 2024-09-12T02:47:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:12 smithi117 ceph-mon[34898]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 759 KiB/s wr, 69 op/s 2024-09-12T02:47:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:12 smithi100 ceph-mon[31390]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 759 KiB/s wr, 69 op/s 2024-09-12T02:47:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:12 smithi189 ceph-mon[35196]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 759 KiB/s wr, 69 op/s 2024-09-12T02:47:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:14 smithi117 ceph-mon[34898]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-12T02:47:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:14 smithi100 ceph-mon[31390]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-12T02:47:15.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:14 smithi189 ceph-mon[35196]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-12T02:47:16.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:16 smithi189 ceph-mon[35196]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.4 MiB/s wr, 249 op/s 2024-09-12T02:47:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 485.0 s, 2413.8 tps, lat 41.409 ms stddev 44.139 2024-09-12T02:47:16.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:16 smithi117 ceph-mon[34898]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.4 MiB/s wr, 249 op/s 2024-09-12T02:47:16.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:16 smithi100 ceph-mon[31390]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.4 MiB/s wr, 249 op/s 2024-09-12T02:47:19.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:18 smithi189 ceph-mon[35196]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.0 MiB/s wr, 330 op/s 2024-09-12T02:47:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:18 smithi117 ceph-mon[34898]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.0 MiB/s wr, 330 op/s 2024-09-12T02:47:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:18 smithi100 ceph-mon[31390]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.0 MiB/s wr, 330 op/s 2024-09-12T02:47:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:20 smithi117 ceph-mon[34898]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-09-12T02:47:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:20 smithi100 ceph-mon[31390]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-09-12T02:47:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:20 smithi189 ceph-mon[35196]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-09-12T02:47:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 490.0 s, 3043.8 tps, lat 32.863 ms stddev 37.091 2024-09-12T02:47:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:22 smithi117 ceph-mon[34898]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 8.3 MiB/s wr, 673 op/s 2024-09-12T02:47:23.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:22 smithi100 ceph-mon[31390]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 8.3 MiB/s wr, 673 op/s 2024-09-12T02:47:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:22 smithi189 ceph-mon[35196]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 8.3 MiB/s wr, 673 op/s 2024-09-12T02:47:24.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:24 smithi100 ceph-mon[31390]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-09-12T02:47:25.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:24 smithi117 ceph-mon[34898]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-09-12T02:47:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:24 smithi189 ceph-mon[35196]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-09-12T02:47:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 495.0 s, 3244.2 tps, lat 30.752 ms stddev 33.990 2024-09-12T02:47:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:26 smithi117 ceph-mon[34898]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 790 op/s 2024-09-12T02:47:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:26 smithi100 ceph-mon[31390]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 790 op/s 2024-09-12T02:47:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:26 smithi189 ceph-mon[35196]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 790 op/s 2024-09-12T02:47:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:28 smithi117 ceph-mon[34898]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 798 op/s 2024-09-12T02:47:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:28 smithi100 ceph-mon[31390]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 798 op/s 2024-09-12T02:47:29.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:28 smithi189 ceph-mon[35196]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 798 op/s 2024-09-12T02:47:29.573 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:47:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:30.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3972070550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b010e4d0 msgr2=0x7f10b01108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3972070550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b010e4d0 0x7f10b01108e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009ca0 tx=0x7f10a802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3972070550 shutdown_connections 2024-09-12T02:47:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3972070550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b010e4d0 0x7f10b01108e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3972070550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10b0101360 0x7f10b010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3972070550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b01009b0 0x7f10b0100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3972070550 >> 172.21.15.100:0/3972070550 conn(0x7f10b00fc7d0 msgr2=0x7f10b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3972070550 shutdown_connections 2024-09-12T02:47:30.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.642+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3972070550 wait complete. 2024-09-12T02:47:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.643+0000 7f10b7b5c640 1 Processor -- start 2024-09-12T02:47:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.644+0000 7f10b7b5c640 1 -- start start 2024-09-12T02:47:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b7b5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10b01009b0 0x7f10b019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b7b5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b0101360 0x7f10b019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b7b5c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b010e4d0 0x7f10b019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b7b5c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0114200 con 0x7f10b01009b0 2024-09-12T02:47:30.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b7b5c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0114080 con 0x7f10b0101360 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b7b5c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0114380 con 0x7f10b010e4d0 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b0101360 0x7f10b019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b58f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10b01009b0 0x7f10b019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b58f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10b01009b0 0x7f10b019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47860/0 (socket says 172.21.15.100:47860) 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b0101360 0x7f10b019ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:41414/0 (socket says 172.21.15.100:41414) 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b58f8640 1 -- 172.21.15.100:0/3584816502 learned_addr learned my addr 172.21.15.100:0/3584816502 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.645+0000 7f10b60f9640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b010e4d0 0x7f10b019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b50f7640 1 -- 172.21.15.100:0/3584816502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b010e4d0 msgr2=0x7f10b019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b50f7640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b010e4d0 0x7f10b019efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b50f7640 1 -- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10b01009b0 msgr2=0x7f10b019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b50f7640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10b01009b0 0x7f10b019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b50f7640 1 -- 172.21.15.100:0/3584816502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b019f6b0 con 0x7f10b0101360 2024-09-12T02:47:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b60f9640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b010e4d0 0x7f10b019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b50f7640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b0101360 0x7f10b019ac40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10a000e9f0 tx=0x7f10a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10a6ffd640 1 -- 172.21.15.100:0/3584816502 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a000cd80 con 0x7f10b0101360 2024-09-12T02:47:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10a6ffd640 1 -- 172.21.15.100:0/3584816502 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a00035f0 con 0x7f10b0101360 2024-09-12T02:47:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10a6ffd640 1 -- 172.21.15.100:0/3584816502 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0010690 con 0x7f10b0101360 2024-09-12T02:47:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b019f9a0 con 0x7f10b0101360 2024-09-12T02:47:30.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.646+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b01a7280 con 0x7f10b0101360 2024-09-12T02:47:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 Processor -- start 2024-09-12T02:47:30.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 -- start start 2024-09-12T02:47:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5aba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e7f5a202e0 con 0x55e7f5ac5680 2024-09-12T02:47:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10a6ffd640 1 -- 172.21.15.100:0/3584816502 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f10a0003b30 con 0x7f10b0101360 2024-09-12T02:47:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7f59c7ce0 con 0x55e7f5abadc0 2024-09-12T02:47:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.650+0000 7f10b9f35740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e7f5a1c2a0 con 0x55e7f5aba4a0 2024-09-12T02:47:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.651+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.651+0000 7f10b58f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.651+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47874/0 (socket says 172.21.15.100:47874) 2024-09-12T02:47:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.651+0000 7f10b50f7640 1 -- 172.21.15.100:0/448102464 learned_addr learned my addr 172.21.15.100:0/448102464 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.651+0000 7f10b60f9640 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5aba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.652+0000 7f10a6ffd640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f109c0a2c40 0x7f109c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.652+0000 7f10a6ffd640 1 -- 172.21.15.100:0/3584816502 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f10a00cf350 con 0x7f10b0101360 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.652+0000 7f10b58f8640 1 -- 172.21.15.100:0/448102464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 msgr2=0x55e7f5aba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.652+0000 7f10b58f8640 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5aba880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.652+0000 7f10b58f8640 1 -- 172.21.15.100:0/448102464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5ac5680 msgr2=0x55e7f5ac7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.652+0000 7f10b58f8640 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.652+0000 7f10b58f8640 1 -- 172.21.15.100:0/448102464 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f59ac440 con 0x55e7f5abadc0 2024-09-12T02:47:30.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.653+0000 7f10b60f9640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f109c0a2c40 0x7f109c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.653+0000 7f10b58f8640 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac5140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009c80 tx=0x7f10ac011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffadc962564d765f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.653+0000 7f109bfff640 1 -- 172.21.15.100:0/448102464 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac004230 con 0x55e7f5abadc0 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.653+0000 7f109bfff640 1 -- 172.21.15.100:0/448102464 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10ac0043d0 con 0x55e7f5abadc0 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b60f9640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f109c0a2c40 0x7f109c0a5100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f10a8004af0 tx=0x7f10a802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f109bfff640 1 -- 172.21.15.100:0/448102464 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac004df0 con 0x55e7f5abadc0 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b9f35740 1 -- 172.21.15.100:0/448102464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5abadc0 msgr2=0x55e7f5ac5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b9f35740 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac5140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009c80 tx=0x7f10ac011810 comp rx=0 tx=0).stop 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b9f35740 1 -- 172.21.15.100:0/448102464 shutdown_connections 2024-09-12T02:47:30.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b9f35740 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b9f35740 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac5140 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b9f35740 1 --2- 172.21.15.100:0/448102464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5aba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.654+0000 7f10b9f35740 1 -- 172.21.15.100:0/448102464 >> 172.21.15.100:0/448102464 conn(0x55e7f5ab6a30 msgr2=0x55e7f5ab6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.655+0000 7f10b9f35740 1 -- 172.21.15.100:0/448102464 shutdown_connections 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.655+0000 7f10b9f35740 1 -- 172.21.15.100:0/448102464 wait complete. 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.655+0000 7f10b9f35740 1 -- start start 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.655+0000 7f10b9f35740 1 Processor -- start 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.656+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ac4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.656+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.656+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.656+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.656+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:58974/0 (socket says 172.21.15.100:58974) 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.656+0000 7f10b50f7640 1 -- 172.21.15.100:0/1904088673 learned_addr learned my addr 172.21.15.100:0/1904088673 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.656+0000 7f10b60f9640 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b58f8640 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ac4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e7f5ac82f0 con 0x55e7f5aba4a0 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7f59db050 con 0x55e7f5ac5680 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e7f5ac8470 con 0x55e7f5abadc0 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b50f7640 1 -- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 msgr2=0x55e7f5ac2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b50f7640 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b50f7640 1 -- 172.21.15.100:0/1904088673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5aba4a0 msgr2=0x55e7f5ac4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b50f7640 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ac4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b50f7640 1 -- 172.21.15.100:0/1904088673 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f57913c0 con 0x55e7f5abadc0 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b9f35740 10 client.0 _ll_register_callbacks cb 0x55e7f5a1b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b50f7640 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac2200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f10a009bad0 tx=0x7f10a009b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56dbe3bfa11c338c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10997fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.657+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10ac0043d0 con 0x55e7f5abadc0 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10997fa640 1 -- 172.21.15.100:0/1904088673 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a009fef0 con 0x55e7f5abadc0 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10997fa640 1 -- 172.21.15.100:0/1904088673 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f10a00037a0 con 0x55e7f5abadc0 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10997fa640 1 -- 172.21.15.100:0/1904088673 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f10a00a47b0 con 0x55e7f5abadc0 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 10 client.26182 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55e7f5acaab0 con 0x55e7f5abadc0 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10997fa640 1 -- 172.21.15.100:0/1904088673 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f10a00981b0 con 0x55e7f5abadc0 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 10 client.26182 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 10 client.26182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 20 client.26182 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5acbe60 0x55e7f5ace2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 4 client.26182 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.658+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f10ac0043d0 con 0x55e7f5acbe60 2024-09-12T02:47:30.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.659+0000 7f10b58f8640 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5acbe60 0x55e7f5ace2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.659+0000 7f10b58f8640 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5acbe60 0x55e7f5ace2f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=782ad3eca6d54d04 server_cookie=207b7de5951f7975 in_seq=0 out_seq=0 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.659+0000 7f10997fa640 10 client.26182 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.660+0000 7f10997fa640 1 -- 172.21.15.100:0/1904088673 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f10ac0043d0 con 0x55e7f5acbe60 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.660+0000 7f10997fa640 10 client.26182 handle_command_reply: tid=0 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.660+0000 7f10b9f35740 1 client.26182 shutdown 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.660+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5abadc0 msgr2=0x55e7f5ac2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.660+0000 7f10b9f35740 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac2200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f10a009bad0 tx=0x7f10a009b740 comp rx=0 tx=0).stop 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 shutdown_connections 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5acbe60 0x55e7f5ace2f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5ac2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac2200 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 --2- 172.21.15.100:0/1904088673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ac4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10997fa640 0 client.26182 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:30.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 >> 172.21.15.100:0/1904088673 conn(0x55e7f5ab6a30 msgr2=0x55e7f5ab5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 shutdown_connections 2024-09-12T02:47:30.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 1 -- 172.21.15.100:0/1904088673 wait complete. 2024-09-12T02:47:30.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.661+0000 7f10b9f35740 20 client.26182 trim_cache size 0 max 16384 2024-09-12T02:47:30.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b9f35740 1 Processor -- start 2024-09-12T02:47:30.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b9f35740 1 -- start start 2024-09-12T02:47:30.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5aeffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b50f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47880/0 (socket says 172.21.15.100:47880) 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b58f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.686+0000 7f10b50f7640 1 -- 172.21.15.100:0/2015241014 learned_addr learned my addr 172.21.15.100:0/2015241014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01ade40 con 0x55e7f5abadc0 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01ab710 con 0x55e7f5ac5680 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01a9580 con 0x55e7f5aba4a0 2024-09-12T02:47:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b60f9640 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5aeffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b60f9640 1 -- 172.21.15.100:0/2015241014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 msgr2=0x55e7f5ad99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b60f9640 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b60f9640 1 -- 172.21.15.100:0/2015241014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 msgr2=0x55e7f5ac3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b60f9640 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b60f9640 1 -- 172.21.15.100:0/2015241014 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f5ac4910 con 0x55e7f5ac5680 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b58f8640 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.687+0000 7f10b50f7640 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:30.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.688+0000 7f10b60f9640 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5aeffb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a802f380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a13b475df0c5193 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.688+0000 7f109b7fe640 1 -- 172.21.15.100:0/2015241014 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8045070 con 0x55e7f5ac5680 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.688+0000 7f109b7fe640 1 -- 172.21.15.100:0/2015241014 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8051030 con 0x55e7f5ac5680 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.688+0000 7f109b7fe640 1 -- 172.21.15.100:0/2015241014 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a802f610 con 0x55e7f5ac5680 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.689+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 msgr2=0x55e7f5aeffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.689+0000 7f10b9f35740 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5aeffb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a802f380 comp rx=0 tx=0).stop 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.689+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 shutdown_connections 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.689+0000 7f10b9f35740 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5aeffb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.689+0000 7f10b9f35740 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5ac3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.689+0000 7f10b9f35740 1 --2- 172.21.15.100:0/2015241014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.690+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 >> 172.21.15.100:0/2015241014 conn(0x55e7f5ab6a30 msgr2=0x55e7f5abd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.690+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 shutdown_connections 2024-09-12T02:47:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.690+0000 7f10b9f35740 1 -- 172.21.15.100:0/2015241014 wait complete. 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.691+0000 7f10b9f35740 1 -- start start 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.691+0000 7f10b9f35740 1 Processor -- start 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.691+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.691+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5acf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.691+0000 7f10b9f35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5acfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b9f35740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01a9bd0 con 0x55e7f5abadc0 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:58992/0 (socket says 172.21.15.100:58992) 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 -- 172.21.15.100:0/275011585 learned_addr learned my addr 172.21.15.100:0/275011585 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b50f7640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5acf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01ab040 con 0x55e7f5ac5680 2024-09-12T02:47:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01aa2a0 con 0x55e7f5aba4a0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b60f9640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5acfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b9f35740 10 client.0 _ll_register_callbacks cb 0x7f10a00d28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 -- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 msgr2=0x55e7f5acfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5acfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 -- 172.21.15.100:0/275011585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 msgr2=0x55e7f5acf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5acf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 -- 172.21.15.100:0/275011585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f5ad04f0 con 0x55e7f5aba4a0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b60f9640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5acfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10b58f8640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad43a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55e7f5ab7890 tx=0x7f10ac004800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ddc53dc609b7a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.692+0000 7f10997fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.693+0000 7f10997fa640 1 -- 172.21.15.100:0/275011585 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0196a0 con 0x55e7f5aba4a0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.693+0000 7f10997fa640 1 -- 172.21.15.100:0/275011585 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f10ac01e040 con 0x55e7f5aba4a0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.693+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a8051030 con 0x55e7f5aba4a0 2024-09-12T02:47:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.693+0000 7f10997fa640 1 -- 172.21.15.100:0/275011585 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f10ac039050 con 0x55e7f5aba4a0 2024-09-12T02:47:30.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 10 client.26188 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e7f5b510b0 con 0x55e7f5aba4a0 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10997fa640 1 -- 172.21.15.100:0/275011585 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8051030 con 0x55e7f5aba4a0 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10997fa640 1 -- 172.21.15.100:0/275011585 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f10ac018070 con 0x55e7f5aba4a0 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 10 client.26188 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 10 client.26188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 20 client.26188 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5b51690 0x55e7f5b53a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 4 client.26188 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.695+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e7f5a2d850 con 0x55e7f5b51690 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b50f7640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5b51690 0x55e7f5b53a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b50f7640 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5b51690 0x55e7f5b53a80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1abce9c7663d073f server_cookie=ea226d404bdf16cc in_seq=0 out_seq=0 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10997fa640 10 client.26188 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10997fa640 1 -- 172.21.15.100:0/275011585 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e7f5a2d850 con 0x55e7f5b51690 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10997fa640 10 client.26188 handle_command_reply: tid=0 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 client.26188 shutdown 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 msgr2=0x55e7f5ad43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad43a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55e7f5ab7890 tx=0x7f10ac004800 comp rx=0 tx=0).stop 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 shutdown_connections 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7f5b51690 0x55e7f5b53a80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f5ac5680 0x55e7f5acfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10997fa640 0 client.26188 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f5abadc0 0x55e7f5acf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 --2- 172.21.15.100:0/275011585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7f5aba4a0 0x55e7f5ad43a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.696+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 >> 172.21.15.100:0/275011585 conn(0x55e7f5ab6a30 msgr2=0x55e7f5ab5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.697+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 shutdown_connections 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.697+0000 7f10b9f35740 1 -- 172.21.15.100:0/275011585 wait complete. 2024-09-12T02:47:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.697+0000 7f10b9f35740 20 client.26188 trim_cache size 0 max 16384 2024-09-12T02:47:30.700 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:47:30.700 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:47:30.700 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:47:30.700 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f109c0a2c40 msgr2=0x7f109c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f109c0a2c40 0x7f109c0a5100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f10a8004af0 tx=0x7f10a802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b0101360 msgr2=0x7f10b019ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b0101360 0x7f10b019ac40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10a000e9f0 tx=0x7f10a000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 shutdown_connections 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f109c0a2c40 0x7f109c0a5100 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b010e4d0 0x7f10b019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10b0101360 0x7f10b019ac40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 --2- 172.21.15.100:0/3584816502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10b01009b0 0x7f10b019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 >> 172.21.15.100:0/3584816502 conn(0x7f10b00fc7d0 msgr2=0x7f10b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 shutdown_connections 2024-09-12T02:47:30.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:30.698+0000 7f10b7b5c640 1 -- 172.21.15.100:0/3584816502 wait complete. 2024-09-12T02:47:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:30 smithi117 ceph-mon[34898]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 23 MiB/s wr, 888 op/s 2024-09-12T02:47:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:30 smithi100 ceph-mon[31390]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 23 MiB/s wr, 888 op/s 2024-09-12T02:47:31.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:30 smithi189 ceph-mon[35196]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 23 MiB/s wr, 888 op/s 2024-09-12T02:47:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 500.0 s, 3293.0 tps, lat 30.478 ms stddev 35.187 2024-09-12T02:47:31.990 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:47:31.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:47:32.366 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:32 smithi117 ceph-mon[34898]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 829 op/s 2024-09-12T02:47:33.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:32 smithi100 ceph-mon[31390]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 829 op/s 2024-09-12T02:47:33.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.119+0000 7f898aab7640 1 -- 172.21.15.100:0/363434147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 msgr2=0x7f898410e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.119+0000 7f898aab7640 1 --2- 172.21.15.100:0/363434147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 0x7f898410e450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f897c009be0 tx=0x7f897c02a750 comp rx=0 tx=0).stop 2024-09-12T02:47:33.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.120+0000 7f898aab7640 1 -- 172.21.15.100:0/363434147 shutdown_connections 2024-09-12T02:47:33.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.120+0000 7f898aab7640 1 --2- 172.21.15.100:0/363434147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 0x7f898410e450 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.120+0000 7f898aab7640 1 --2- 172.21.15.100:0/363434147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984103510 0x7f898410ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.120+0000 7f898aab7640 1 --2- 172.21.15.100:0/363434147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102bf0 0x7f8984102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.120+0000 7f898aab7640 1 -- 172.21.15.100:0/363434147 >> 172.21.15.100:0/363434147 conn(0x7f89840fc610 msgr2=0x7f89840fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.120+0000 7f898aab7640 1 -- 172.21.15.100:0/363434147 shutdown_connections 2024-09-12T02:47:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.120+0000 7f898aab7640 1 -- 172.21.15.100:0/363434147 wait complete. 2024-09-12T02:47:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.121+0000 7f898aab7640 1 Processor -- start 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.121+0000 7f898aab7640 1 -- start start 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.121+0000 7f898aab7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102bf0 0x7f898419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f898aab7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984103510 0x7f898419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f898aab7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 0x7f898419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f898aab7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8984113f60 con 0x7f8984103510 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f898aab7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8984113de0 con 0x7f898410bfd0 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f898aab7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89841140e0 con 0x7f8984102bf0 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f8989ab5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102bf0 0x7f898419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f89892b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984103510 0x7f898419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f8989ab5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102bf0 0x7f898419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:59010/0 (socket says 172.21.15.100:59010) 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f8989ab5640 1 -- 172.21.15.100:0/1970837829 learned_addr learned my addr 172.21.15.100:0/1970837829 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:33.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f898a2b6640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 0x7f898419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f89892b4640 1 -- 172.21.15.100:0/1970837829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102bf0 msgr2=0x7f898419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f89892b4640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102bf0 0x7f898419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f89892b4640 1 -- 172.21.15.100:0/1970837829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 msgr2=0x7f898419edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f89892b4640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 0x7f898419edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.122+0000 7f89892b4640 1 -- 172.21.15.100:0/1970837829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898419f490 con 0x7f8984103510 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.123+0000 7f89892b4640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984103510 0x7f898419aa20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f897400e790 tx=0x7f897400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.123+0000 7f897affd640 1 -- 172.21.15.100:0/1970837829 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400eea0 con 0x7f8984103510 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.123+0000 7f897affd640 1 -- 172.21.15.100:0/1970837829 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897400ccc0 con 0x7f8984103510 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.123+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898419f780 con 0x7f8984103510 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.123+0000 7f897affd640 1 -- 172.21.15.100:0/1970837829 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400eea0 con 0x7f8984103510 2024-09-12T02:47:33.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.123+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89841a7060 con 0x7f8984103510 2024-09-12T02:47:33.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.124+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8984102fd0 con 0x7f8984103510 2024-09-12T02:47:33.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.126+0000 7f897affd640 1 -- 172.21.15.100:0/1970837829 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8974010430 con 0x7f8984103510 2024-09-12T02:47:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.126+0000 7f897affd640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f89700a2d80 0x7f89700a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.127+0000 7f897affd640 1 -- 172.21.15.100:0/1970837829 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f89740cefe0 con 0x7f8984103510 2024-09-12T02:47:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.127+0000 7f8989ab5640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f89700a2d80 0x7f89700a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.128+0000 7f8989ab5640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f89700a2d80 0x7f89700a5240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8980009c90 tx=0x7f8980005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.131+0000 7f897affd640 1 -- 172.21.15.100:0/1970837829 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f897409b8c0 con 0x7f8984103510 2024-09-12T02:47:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:32 smithi189 ceph-mon[35196]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 829 op/s 2024-09-12T02:47:33.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.446+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f898419b840 con 0x7f8984103510 2024-09-12T02:47:33.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.447+0000 7f897affd640 1 -- 172.21.15.100:0/1970837829 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f897409fbc0 con 0x7f8984103510 2024-09-12T02:47:33.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:47:33.448 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:47:33.448 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:47:33.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f89700a2d80 msgr2=0x7f89700a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f89700a2d80 0x7f89700a5240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8980009c90 tx=0x7f8980005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984103510 msgr2=0x7f898419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984103510 0x7f898419aa20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f897400e790 tx=0x7f897400ec50 comp rx=0 tx=0).stop 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 shutdown_connections 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f89700a2d80 0x7f89700a5240 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898410bfd0 0x7f898419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8984103510 0x7f898419aa20 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 --2- 172.21.15.100:0/1970837829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8984102bf0 0x7f898419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 >> 172.21.15.100:0/1970837829 conn(0x7f89840fc610 msgr2=0x7f89840fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 shutdown_connections 2024-09-12T02:47:33.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:33.450+0000 7f898aab7640 1 -- 172.21.15.100:0/1970837829 wait complete. 2024-09-12T02:47:34.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:33 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1970837829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:34.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:33 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1970837829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:34.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:47:34.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:33 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1970837829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:34.628 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:35.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:34 smithi100 ceph-mon[31390]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 26 MiB/s wr, 833 op/s 2024-09-12T02:47:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:34 smithi117 ceph-mon[34898]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 26 MiB/s wr, 833 op/s 2024-09-12T02:47:35.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 -- 172.21.15.100:0/2143785951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 msgr2=0x7f290010bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 --2- 172.21.15.100:0/2143785951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 0x7f290010bb60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009900 tx=0x7f28f402a480 comp rx=0 tx=0).stop 2024-09-12T02:47:35.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 -- 172.21.15.100:0/2143785951 shutdown_connections 2024-09-12T02:47:35.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 --2- 172.21.15.100:0/2143785951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 0x7f290010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 --2- 172.21.15.100:0/2143785951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 0x7f290010bb60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 --2- 172.21.15.100:0/2143785951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2900102d50 0x7f2900103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 -- 172.21.15.100:0/2143785951 >> 172.21.15.100:0/2143785951 conn(0x7f29000fc7d0 msgr2=0x7f29000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 -- 172.21.15.100:0/2143785951 shutdown_connections 2024-09-12T02:47:35.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.177+0000 7f2906242640 1 -- 172.21.15.100:0/2143785951 wait complete. 2024-09-12T02:47:35.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 Processor -- start 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 -- start start 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2900102d50 0x7f29001009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 0x7f2900100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 0x7f2900101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2900111fd0 con 0x7f2900103670 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2900111e50 con 0x7f290010c180 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f2906242640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2900112150 con 0x7f2900102d50 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f28feffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 0x7f2900100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2900102d50 0x7f29001009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f28fffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 0x7f2900101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2900102d50 0x7f29001009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33624/0 (socket says 172.21.15.100:33624) 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f28fffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 0x7f2900101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59250/0 (socket says 172.21.15.100:59250) 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1431270997 learned_addr learned my addr 172.21.15.100:0/1431270997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.178+0000 7f28feffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 0x7f2900100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56338/0 (socket says 172.21.15.100:56338) 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fffff640 1 -- 172.21.15.100:0/1431270997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2900102d50 msgr2=0x7f29001009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fffff640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2900102d50 0x7f29001009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fffff640 1 -- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 msgr2=0x7f2900100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fffff640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 0x7f2900100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fffff640 1 -- 172.21.15.100:0/1431270997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29001a68f0 con 0x7f290010c180 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fffff640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 0x7f2900101430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009fd0 tx=0x7f28f800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fcff9640 1 -- 172.21.15.100:0/1431270997 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f800ce20 con 0x7f290010c180 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fcff9640 1 -- 172.21.15.100:0/1431270997 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f8005020 con 0x7f290010c180 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f28fcff9640 1 -- 172.21.15.100:0/1431270997 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8010720 con 0x7f290010c180 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.179+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29001a6be0 con 0x7f290010c180 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.180+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29001a7040 con 0x7f290010c180 2024-09-12T02:47:35.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.182+0000 7f28fcff9640 1 -- 172.21.15.100:0/1431270997 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f28f80108c0 con 0x7f290010c180 2024-09-12T02:47:35.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.182+0000 7f290861b740 1 Processor -- start 2024-09-12T02:47:35.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f290861b740 1 -- start start 2024-09-12T02:47:35.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28fcff9640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28e80a2d10 0x7f28e80a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f290861b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1cfb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f290861b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1cfc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f290861b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d08f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f290861b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1c592f0 con 0x55e6b1d06b80 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f290861b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1c00cf0 con 0x55e6b1cfd350 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f290861b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1c552b0 con 0x55e6b1cfbde0 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28feffd640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28e80a2d10 0x7f28e80a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28feffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1cfc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28feffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1cfc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33638/0 (socket says 172.21.15.100:33638) 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28feffd640 1 -- 172.21.15.100:0/1086487677 learned_addr learned my addr 172.21.15.100:0/1086487677 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1cfb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1086487677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 msgr2=0x55e6b1cfc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1cfc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1086487677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 msgr2=0x55e6b1d08f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:47:35.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28feffd640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28e80a2d10 0x7f28e80a51d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000c00 tx=0x7f28f40040f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.183+0000 7f28fcff9640 1 -- 172.21.15.100:0/1431270997 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f28f80cf310 con 0x7f290010c180 2024-09-12T02:47:35.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.184+0000 7f28fffff640 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d08f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.184+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d08f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.184+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1086487677 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b1be53a0 con 0x55e6b1cfd350 2024-09-12T02:47:35.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.184+0000 7f28fffff640 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d08f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:35.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.184+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1cfb8a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f28f000ac20 tx=0x7f28f000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de81cff4bef3f08c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.185+0000 7f28e5ffb640 1 -- 172.21.15.100:0/1086487677 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0005220 con 0x55e6b1cfd350 2024-09-12T02:47:35.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.185+0000 7f28e5ffb640 1 -- 172.21.15.100:0/1086487677 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f0004c80 con 0x55e6b1cfd350 2024-09-12T02:47:35.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.185+0000 7f28e5ffb640 1 -- 172.21.15.100:0/1086487677 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f00188b0 con 0x55e6b1cfd350 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.186+0000 7f290861b740 1 -- 172.21.15.100:0/1086487677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 msgr2=0x55e6b1cfb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.186+0000 7f290861b740 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1cfb8a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f28f000ac20 tx=0x7f28f000f790 comp rx=0 tx=0).stop 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.186+0000 7f290861b740 1 -- 172.21.15.100:0/1086487677 shutdown_connections 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.186+0000 7f290861b740 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d08f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.186+0000 7f290861b740 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1cfc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.186+0000 7f290861b740 1 --2- 172.21.15.100:0/1086487677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1cfb8a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.187+0000 7f290861b740 1 -- 172.21.15.100:0/1086487677 >> 172.21.15.100:0/1086487677 conn(0x55e6b1cbc310 msgr2=0x55e6b1cf8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.187+0000 7f290861b740 1 -- 172.21.15.100:0/1086487677 shutdown_connections 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.187+0000 7f290861b740 1 -- 172.21.15.100:0/1086487677 wait complete. 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.187+0000 7f290861b740 1 -- start start 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.187+0000 7f290861b740 1 Processor -- start 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f290861b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f290861b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfd350 0x55e6b1d037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f290861b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d03d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f290861b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1d09880 con 0x55e6b1cfd350 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f290861b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1c14060 con 0x55e6b1cfbde0 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f290861b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1d09a00 con 0x55e6b1d06b80 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f290861b740 10 client.0 _ll_register_callbacks cb 0x55e6b19678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28feffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfd350 0x55e6b1d037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28feffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfd350 0x55e6b1d037a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56358/0 (socket says 172.21.15.100:56358) 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28feffd640 1 -- 172.21.15.100:0/1060468321 learned_addr learned my addr 172.21.15.100:0/1060468321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28fffff640 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d03d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 msgr2=0x55e6b1d03d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d03d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1060468321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfd350 msgr2=0x55e6b1d037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfd350 0x55e6b1d037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1060468321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b19ca3c0 con 0x55e6b1cfbde0 2024-09-12T02:47:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.188+0000 7f28feffd640 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfd350 0x55e6b1d037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.189+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d064f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28f001a040 tx=0x7f28f00048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766d4357250cbdde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.189+0000 7f28deffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:47:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.189+0000 7f28deffd640 1 -- 172.21.15.100:0/1060468321 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0027070 con 0x55e6b1cfbde0 2024-09-12T02:47:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.189+0000 7f28deffd640 1 -- 172.21.15.100:0/1060468321 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f28f00185b0 con 0x55e6b1cfbde0 2024-09-12T02:47:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.189+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f0004c80 con 0x55e6b1cfbde0 2024-09-12T02:47:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f28deffd640 1 -- 172.21.15.100:0/1060468321 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28f0031050 con 0x55e6b1cfbde0 2024-09-12T02:47:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 10 client.26261 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e6b1d15290 con 0x55e6b1cfbde0 2024-09-12T02:47:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f28deffd640 1 -- 172.21.15.100:0/1060468321 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f0004c80 con 0x55e6b1cfbde0 2024-09-12T02:47:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f28deffd640 1 -- 172.21.15.100:0/1060468321 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f28f002c6a0 con 0x55e6b1cfbde0 2024-09-12T02:47:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 10 client.26261 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 10 client.26261 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 20 client.26261 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d18ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 4 client.26261 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.190+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6b1c66860 con 0x55e6b1d166f0 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.191+0000 7f28feffd640 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d18ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.191+0000 7f28feffd640 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d18ae0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd544c9b9d956c9d server_cookie=83d69b60ed8d9e2b in_seq=0 out_seq=0 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.191+0000 7f28deffd640 10 client.26261 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f28deffd640 1 -- 172.21.15.100:0/1060468321 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6b1c66860 con 0x55e6b1d166f0 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f28deffd640 10 client.26261 handle_command_reply: tid=0 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 client.26261 shutdown 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfbde0 msgr2=0x55e6b1d064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d064f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28f001a040 tx=0x7f28f00048f0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 shutdown_connections 2024-09-12T02:47:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d18ae0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f28deffd640 0 client.26261 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d03d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfd350 0x55e6b1d037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 --2- 172.21.15.100:0/1060468321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d064f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 >> 172.21.15.100:0/1060468321 conn(0x55e6b1cbc310 msgr2=0x55e6b1cfe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 shutdown_connections 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 1 -- 172.21.15.100:0/1060468321 wait complete. 2024-09-12T02:47:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.192+0000 7f290861b740 20 client.26261 trim_cache size 0 max 16384 2024-09-12T02:47:35.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.210+0000 7f290861b740 1 Processor -- start 2024-09-12T02:47:35.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.210+0000 7f290861b740 1 -- start start 2024-09-12T02:47:35.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.210+0000 7f290861b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d12bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f290861b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1ceec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f290861b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d1e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f290861b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec010e00 con 0x55e6b1d06b80 2024-09-12T02:47:35.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f290861b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec00e6d0 con 0x55e6b1cfd350 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f290861b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec00c520 con 0x55e6b1cfbde0 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d12bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f28fffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d1e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f28feffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1ceec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d12bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33656/0 (socket says 172.21.15.100:33656) 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.211+0000 7f28ff7fe640 1 -- 172.21.15.100:0/1904383735 learned_addr learned my addr 172.21.15.100:0/1904383735 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28fffff640 1 -- 172.21.15.100:0/1904383735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 msgr2=0x55e6b1d12bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28fffff640 1 --2- 172.21.15.100:0/1904383735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d12bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28fffff640 1 -- 172.21.15.100:0/1904383735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 msgr2=0x55e6b1ceec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28fffff640 1 --2- 172.21.15.100:0/1904383735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1ceec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28fffff640 1 -- 172.21.15.100:0/1904383735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b1cfe930 con 0x55e6b1d06b80 2024-09-12T02:47:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28fffff640 1 --2- 172.21.15.100:0/1904383735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d1e0e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55e6b1cfc880 tx=0x7f28f80055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb3d2489096e5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28e57fa640 1 -- 172.21.15.100:0/1904383735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f809c2a0 con 0x55e6b1d06b80 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28e57fa640 1 -- 172.21.15.100:0/1904383735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f809ff10 con 0x55e6b1d06b80 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.212+0000 7f28e57fa640 1 -- 172.21.15.100:0/1904383735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80a45a0 con 0x55e6b1d06b80 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 -- 172.21.15.100:0/1904383735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 msgr2=0x55e6b1d1e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 --2- 172.21.15.100:0/1904383735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d1e0e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55e6b1cfc880 tx=0x7f28f80055e0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 -- 172.21.15.100:0/1904383735 shutdown_connections 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 --2- 172.21.15.100:0/1904383735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1d06b80 0x55e6b1d1e0e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 --2- 172.21.15.100:0/1904383735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1ceec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 --2- 172.21.15.100:0/1904383735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d12bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 -- 172.21.15.100:0/1904383735 >> 172.21.15.100:0/1904383735 conn(0x55e6b1cbc310 msgr2=0x55e6b1cee500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 -- 172.21.15.100:0/1904383735 shutdown_connections 2024-09-12T02:47:35.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.213+0000 7f290861b740 1 -- 172.21.15.100:0/1904383735 wait complete. 2024-09-12T02:47:35.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.214+0000 7f290861b740 1 -- start start 2024-09-12T02:47:35.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.214+0000 7f290861b740 1 Processor -- start 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f290861b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d0f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f290861b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1d00520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f290861b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d00a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f290861b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec00cb90 con 0x55e6b1cfbde0 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f290861b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec00e000 con 0x55e6b1cfd350 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f290861b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec00d260 con 0x55e6b1d06b80 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f290861b740 10 client.0 _ll_register_callbacks cb 0x7f28f80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d00a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d00a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33664/0 (socket says 172.21.15.100:33664) 2024-09-12T02:47:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 -- 172.21.15.100:0/3008280594 learned_addr learned my addr 172.21.15.100:0/3008280594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28feffd640 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1d00520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 -- 172.21.15.100:0/3008280594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 msgr2=0x55e6b1d00520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1d00520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 -- 172.21.15.100:0/3008280594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfbde0 msgr2=0x55e6b1d0f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d0f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.215+0000 7f28fffff640 1 -- 172.21.15.100:0/3008280594 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b1d01290 con 0x55e6b1d06b80 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f28fffff640 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d00a60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28f8004af0 tx=0x7f28f80a4900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e095e3f81eff8631 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f28deffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f28deffd640 1 -- 172.21.15.100:0/3008280594 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80b3030 con 0x55e6b1d06b80 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f28deffd640 1 -- 172.21.15.100:0/3008280594 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f28f809b750 con 0x55e6b1d06b80 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f809ff10 con 0x55e6b1d06b80 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f28deffd640 1 -- 172.21.15.100:0/3008280594 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28f8004b60 con 0x55e6b1d06b80 2024-09-12T02:47:35.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f290861b740 10 client.26209 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e6b1d810f0 con 0x55e6b1d06b80 2024-09-12T02:47:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.216+0000 7f28deffd640 1 -- 172.21.15.100:0/3008280594 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f809ff10 con 0x55e6b1d06b80 2024-09-12T02:47:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f28deffd640 1 -- 172.21.15.100:0/3008280594 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f28f80a1210 con 0x55e6b1d06b80 2024-09-12T02:47:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f290861b740 10 client.26209 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f290861b740 10 client.26209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:47:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f290861b740 20 client.26209 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f290861b740 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d83810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f290861b740 4 client.26209 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:47:35.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6b1c60d70 con 0x55e6b1d166f0 2024-09-12T02:47:35.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d83810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f28deffd640 10 client.26209 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:47:35.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.217+0000 7f28ff7fe640 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d83810 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8be132bcac42b79 server_cookie=e96b0b22bfa7a109 in_seq=0 out_seq=0 2024-09-12T02:47:35.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f28deffd640 1 -- 172.21.15.100:0/3008280594 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6b1c60d70 con 0x55e6b1d166f0 2024-09-12T02:47:35.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f28deffd640 10 client.26209 handle_command_reply: tid=0 2024-09-12T02:47:35.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 client.26209 shutdown 2024-09-12T02:47:35.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 msgr2=0x55e6b1d00a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d00a60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28f8004af0 tx=0x7f28f80a4900 comp rx=0 tx=0).stop 2024-09-12T02:47:35.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 shutdown_connections 2024-09-12T02:47:35.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e6b1d166f0 0x55e6b1d83810 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b1d06b80 0x55e6b1d00a60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6b1cfd350 0x55e6b1d00520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 --2- 172.21.15.100:0/3008280594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b1cfbde0 0x55e6b1d0f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 >> 172.21.15.100:0/3008280594 conn(0x55e6b1cbc310 msgr2=0x55e6b1cfe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f28deffd640 0 client.26209 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 shutdown_connections 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 1 -- 172.21.15.100:0/3008280594 wait complete. 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.218+0000 7f290861b740 20 client.26209 trim_cache size 0 max 16384 2024-09-12T02:47:35.226 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:47:35.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28e80a2d10 msgr2=0x7f28e80a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28e80a2d10 0x7f28e80a51d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000c00 tx=0x7f28f40040f0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 msgr2=0x7f2900101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 0x7f2900101430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009fd0 tx=0x7f28f800ef10 comp rx=0 tx=0).stop 2024-09-12T02:47:35.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 shutdown_connections 2024-09-12T02:47:35.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f28e80a2d10 0x7f28e80a51d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f290010c180 0x7f2900101430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2900103670 0x7f2900100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 --2- 172.21.15.100:0/1431270997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2900102d50 0x7f29001009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.219+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 >> 172.21.15.100:0/1431270997 conn(0x7f29000fc7d0 msgr2=0x7f29000fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.220+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 shutdown_connections 2024-09-12T02:47:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:35.220+0000 7f2906242640 1 -- 172.21.15.100:0/1431270997 wait complete. 2024-09-12T02:47:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:34 smithi189 ceph-mon[35196]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 26 MiB/s wr, 833 op/s 2024-09-12T02:47:35.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:47:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 505.0 s, 2966.6 tps, lat 33.605 ms stddev 36.599 2024-09-12T02:47:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.863+0000 7fcdce6bf640 1 -- 172.21.15.100:0/4240864616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc8109450 msgr2=0x7fcdc8110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.863+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/4240864616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc8109450 0x7fcdc8110250 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009ca0 tx=0x7fcdc002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.863+0000 7fcdce6bf640 1 -- 172.21.15.100:0/4240864616 shutdown_connections 2024-09-12T02:47:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.863+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/4240864616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 0x7fcdc811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.863+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/4240864616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109830 0x7fcdc8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.863+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/4240864616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc8109450 0x7fcdc8110250 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.863+0000 7fcdce6bf640 1 -- 172.21.15.100:0/4240864616 >> 172.21.15.100:0/4240864616 conn(0x7fcdc806e140 msgr2=0x7fcdc806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.864+0000 7fcdce6bf640 1 -- 172.21.15.100:0/4240864616 shutdown_connections 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.864+0000 7fcdce6bf640 1 -- 172.21.15.100:0/4240864616 wait complete. 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.864+0000 7fcdce6bf640 1 Processor -- start 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.864+0000 7fcdce6bf640 1 -- start start 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdce6bf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109450 0x7fcdc81a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdce6bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc8109830 0x7fcdc81a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdce6bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 0x7fcdc81abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdce6bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc8120e30 con 0x7fcdc8109830 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdce6bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc8120cb0 con 0x7fcdc811b140 2024-09-12T02:47:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdce6bf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc8120fb0 con 0x7fcdc8109450 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdccc5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 0x7fcdc81abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.865+0000 7fcdc7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109450 0x7fcdc81a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdccc5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 0x7fcdc81abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59316/0 (socket says 172.21.15.100:59316) 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109450 0x7fcdc81a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33692/0 (socket says 172.21.15.100:33692) 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 -- 172.21.15.100:0/2725067871 learned_addr learned my addr 172.21.15.100:0/2725067871 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 -- 172.21.15.100:0/2725067871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 msgr2=0x7fcdc81abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 0x7fcdc81abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 -- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc8109830 msgr2=0x7fcdc81a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc8109830 0x7fcdc81a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 -- 172.21.15.100:0/2725067871 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc81ac320 con 0x7fcdc8109450 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 0x7fcdc81abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.866+0000 7fcdc7fff640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109450 0x7fcdc81a7370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0005e30 tx=0x7fcdc00039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.867+0000 7fcdc57fa640 1 -- 172.21.15.100:0/2725067871 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0003de0 con 0x7fcdc8109450 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.867+0000 7fcdc57fa640 1 -- 172.21.15.100:0/2725067871 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdc0004520 con 0x7fcdc8109450 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.867+0000 7fcdc57fa640 1 -- 172.21.15.100:0/2725067871 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0030d70 con 0x7fcdc8109450 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.867+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc81ac5b0 con 0x7fcdc8109450 2024-09-12T02:47:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.867+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc81b3ef0 con 0x7fcdc8109450 2024-09-12T02:47:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.871+0000 7fcdd0a98740 1 Processor -- start 2024-09-12T02:47:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.871+0000 7fcdd0a98740 1 -- start start 2024-09-12T02:47:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d55d0 0x555c6c2d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2e0370 0x555c6c2e2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555c6c23b2f0 con 0x555c6c2e0370 2024-09-12T02:47:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555c6c1e2cf0 con 0x555c6c2d6b40 2024-09-12T02:47:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555c6c2372b0 con 0x555c6c2d55d0 2024-09-12T02:47:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdccc5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdccc5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59322/0 (socket says 172.21.15.100:59322) 2024-09-12T02:47:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdccc5c640 1 -- 172.21.15.100:0/3825581388 learned_addr learned my addr 172.21.15.100:0/3825581388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdc57fa640 1 -- 172.21.15.100:0/2725067871 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fcdc00046d0 con 0x7fcdc8109450 2024-09-12T02:47:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.872+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2e0370 0x555c6c2e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.873+0000 7fcdc7fff640 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d55d0 0x555c6c2d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.873+0000 7fcdccc5c640 1 -- 172.21.15.100:0/3825581388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d55d0 msgr2=0x555c6c2d5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.873+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d55d0 0x555c6c2d5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.873+0000 7fcdccc5c640 1 -- 172.21.15.100:0/3825581388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2e0370 msgr2=0x555c6c2e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.873+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2e0370 0x555c6c2e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.873+0000 7fcdccc5c640 1 -- 172.21.15.100:0/3825581388 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6c1c73a0 con 0x555c6c2d6b40 2024-09-12T02:47:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.873+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2d5090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8007cd0 tx=0x7fcdb800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48aa65f6b36fede3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.874+0000 7fcdae7fc640 1 -- 172.21.15.100:0/3825581388 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8015070 con 0x555c6c2d6b40 2024-09-12T02:47:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.874+0000 7fcdae7fc640 1 -- 172.21.15.100:0/3825581388 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb8011920 con 0x555c6c2d6b40 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.874+0000 7fcdae7fc640 1 -- 172.21.15.100:0/3825581388 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8010a30 con 0x555c6c2d6b40 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.874+0000 7fcdc57fa640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdb00a2cd0 0x7fcdb00a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.874+0000 7fcdc57fa640 1 -- 172.21.15.100:0/2725067871 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcdc00f04e0 con 0x7fcdc8109450 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.875+0000 7fcdc7fff640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdb00a2cd0 0x7fcdb00a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.875+0000 7fcdd0a98740 1 -- 172.21.15.100:0/3825581388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 msgr2=0x555c6c2d5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.875+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2d5090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8007cd0 tx=0x7fcdb800f730 comp rx=0 tx=0).stop 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.875+0000 7fcdd0a98740 1 -- 172.21.15.100:0/3825581388 shutdown_connections 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.875+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2e0370 0x555c6c2e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.875+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d55d0 0x555c6c2d5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.875+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/3825581388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2d5090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.876+0000 7fcdd0a98740 1 -- 172.21.15.100:0/3825581388 >> 172.21.15.100:0/3825581388 conn(0x555c6c29e310 msgr2=0x555c6c2d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.876+0000 7fcdd0a98740 1 -- 172.21.15.100:0/3825581388 shutdown_connections 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.876+0000 7fcdd0a98740 1 -- 172.21.15.100:0/3825581388 wait complete. 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.876+0000 7fcdc7fff640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdb00a2cd0 0x7fcdb00a5190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00b96a0 tx=0x7fcdc002a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.876+0000 7fcdd0a98740 1 -- start start 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.876+0000 7fcdd0a98740 1 Processor -- start 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2dd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2dd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555c6c2e3070 con 0x555c6c2d55d0 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555c6c1f6060 con 0x555c6c2d6b40 2024-09-12T02:47:36.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555c6c2e31f0 con 0x555c6c2e0370 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdd0a98740 10 client.0 _ll_register_callbacks cb 0x555c6bf498c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2dd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2dd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59330/0 (socket says 172.21.15.100:59330) 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdc77fe640 1 -- 172.21.15.100:0/468623557 learned_addr learned my addr 172.21.15.100:0/468623557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.877+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcdc77fe640 1 -- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 msgr2=0x555c6c2dd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2dd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcdc77fe640 1 -- 172.21.15.100:0/468623557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 msgr2=0x555c6c2dfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcdc77fe640 1 -- 172.21.15.100:0/468623557 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6bfac3c0 con 0x555c6c2d6b40 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2dd0d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00e270 tx=0x7fcdbc00e730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=808c0cc853085936 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcda77fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcda77fe640 1 -- 172.21.15.100:0/468623557 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc017070 con 0x555c6c2d6b40 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcda77fe640 1 -- 172.21.15.100:0/468623557 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcdbc013680 con 0x555c6c2d6b40 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.878+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdb8011920 con 0x555c6c2d6b40 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcda77fe640 1 -- 172.21.15.100:0/468623557 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcdbc023050 con 0x555c6c2d6b40 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 10 client.26279 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555c6c2eec40 con 0x555c6c2d6b40 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcda77fe640 1 -- 172.21.15.100:0/468623557 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb8011920 con 0x555c6c2d6b40 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcda77fe640 1 -- 172.21.15.100:0/468623557 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcdbc0129c0 con 0x555c6c2d6b40 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 10 client.26279 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 10 client.26279 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 20 client.26279 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:36.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c2f2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 4 client.26279 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:36.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.879+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c6c248860 con 0x555c6c2f0050 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.880+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c2f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.883+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c2f2490 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81b1719eca7143e4 server_cookie=979b4422c6c2022c in_seq=0 out_seq=0 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.883+0000 7fcda77fe640 10 client.26279 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.883+0000 7fcda77fe640 1 -- 172.21.15.100:0/468623557 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c6c248860 con 0x555c6c2f0050 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcda77fe640 10 client.26279 handle_command_reply: tid=0 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 client.26279 shutdown 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 msgr2=0x555c6c2dd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2dd0d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00e270 tx=0x7fcdbc00e730 comp rx=0 tx=0).stop 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 shutdown_connections 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c2f2490 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2dd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcda77fe640 0 client.26279 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2dd0d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/468623557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 >> 172.21.15.100:0/468623557 conn(0x555c6c29e310 msgr2=0x555c6c2d7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 shutdown_connections 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.884+0000 7fcdd0a98740 1 -- 172.21.15.100:0/468623557 wait complete. 2024-09-12T02:47:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.885+0000 7fcdd0a98740 20 client.26279 trim_cache size 0 max 16384 2024-09-12T02:47:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.908+0000 7fcdd0a98740 1 Processor -- start 2024-09-12T02:47:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdd0a98740 1 -- start start 2024-09-12T02:47:36.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc81bed40 con 0x555c6c2d55d0 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc81bc610 con 0x555c6c2d6b40 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc81ba480 con 0x555c6c2e0370 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdccc5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdccc5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56434/0 (socket says 172.21.15.100:56434) 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdccc5c640 1 -- 172.21.15.100:0/2569878675 learned_addr learned my addr 172.21.15.100:0/2569878675 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.909+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdccc5c640 1 -- 172.21.15.100:0/2569878675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 msgr2=0x555c6c2f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2f7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdccc5c640 1 -- 172.21.15.100:0/2569878675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 msgr2=0x555c6c2dc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdccc5c640 1 -- 172.21.15.100:0/2569878675 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6c2d8120 con 0x555c6c2e0370 2024-09-12T02:47:36.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2f82a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800f770 tx=0x7fcdb801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=947c7ac81ed239aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdadffb640 1 -- 172.21.15.100:0/2569878675 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8015040 con 0x555c6c2e0370 2024-09-12T02:47:36.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdadffb640 1 -- 172.21.15.100:0/2569878675 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb8005020 con 0x555c6c2e0370 2024-09-12T02:47:36.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.910+0000 7fcdadffb640 1 -- 172.21.15.100:0/2569878675 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8004940 con 0x555c6c2e0370 2024-09-12T02:47:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.911+0000 7fcdd0a98740 1 -- 172.21.15.100:0/2569878675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 msgr2=0x555c6c2f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.911+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2f82a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800f770 tx=0x7fcdb801c040 comp rx=0 tx=0).stop 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.912+0000 7fcdd0a98740 1 -- 172.21.15.100:0/2569878675 shutdown_connections 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.912+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2e0370 0x555c6c2f82a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.912+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2d6b40 0x555c6c2f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.912+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/2569878675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2dc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.912+0000 7fcdd0a98740 1 -- 172.21.15.100:0/2569878675 >> 172.21.15.100:0/2569878675 conn(0x555c6c29e310 msgr2=0x555c6c2db9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.912+0000 7fcdd0a98740 1 -- 172.21.15.100:0/2569878675 shutdown_connections 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.912+0000 7fcdd0a98740 1 -- 172.21.15.100:0/2569878675 wait complete. 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 -- start start 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 Processor -- start 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d6b40 0x555c6c2e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2e0370 0x555c6c2e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc81baad0 con 0x555c6c2d55d0 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc81bbf40 con 0x555c6c2e0370 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.913+0000 7fcdd0a98740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc81bb1a0 con 0x555c6c2d6b40 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d6b40 0x555c6c2e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d6b40 0x555c6c2e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33750/0 (socket says 172.21.15.100:33750) 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 -- 172.21.15.100:0/1437669148 learned_addr learned my addr 172.21.15.100:0/1437669148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdd0a98740 10 client.0 _ll_register_callbacks cb 0x7fcdbc0093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2e0370 0x555c6c2e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 -- 172.21.15.100:0/1437669148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2e0370 msgr2=0x555c6c2e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2e0370 0x555c6c2e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 -- 172.21.15.100:0/1437669148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 msgr2=0x555c6c2e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 -- 172.21.15.100:0/1437669148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6c2e4c80 con 0x555c6c2d6b40 2024-09-12T02:47:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcdc77fe640 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d6b40 0x555c6c2e3f40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x555c6c2de710 tx=0x7fcdbc005c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b909bb05f786ecba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcda77fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:47:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcda77fe640 1 -- 172.21.15.100:0/1437669148 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc017070 con 0x555c6c2d6b40 2024-09-12T02:47:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.914+0000 7fcda77fe640 1 -- 172.21.15.100:0/1437669148 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcdbc004220 con 0x555c6c2d6b40 2024-09-12T02:47:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.915+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdb8005020 con 0x555c6c2d6b40 2024-09-12T02:47:36.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.916+0000 7fcda77fe640 1 -- 172.21.15.100:0/1437669148 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcdbc00ec30 con 0x555c6c2d6b40 2024-09-12T02:47:36.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.916+0000 7fcdd0a98740 10 client.26224 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:36.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.916+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555c6c35ad40 con 0x555c6c2d6b40 2024-09-12T02:47:36.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcda77fe640 1 -- 172.21.15.100:0/1437669148 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdbc004460 con 0x555c6c2d6b40 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcda77fe640 1 -- 172.21.15.100:0/1437669148 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcdbc003890 con 0x555c6c2d6b40 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcdd0a98740 10 client.26224 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcdd0a98740 10 client.26224 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcdd0a98740 20 client.26224 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c35d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcdd0a98740 4 client.26224 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcdb8005020 con 0x555c6c2f0050 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.917+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c35d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.918+0000 7fcdccc5c640 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c35d4c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7afbf0d27943e13 server_cookie=ae7a226feef00489 in_seq=0 out_seq=0 2024-09-12T02:47:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.918+0000 7fcda77fe640 10 client.26224 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:47:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcda77fe640 1 -- 172.21.15.100:0/1437669148 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcdb8005020 con 0x555c6c2f0050 2024-09-12T02:47:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcda77fe640 10 client.26224 handle_command_reply: tid=0 2024-09-12T02:47:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 client.26224 shutdown 2024-09-12T02:47:36.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d6b40 msgr2=0x555c6c2e3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d6b40 0x555c6c2e3f40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x555c6c2de710 tx=0x7fcdbc005c10 comp rx=0 tx=0).stop 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 shutdown_connections 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555c6c2f0050 0x555c6c35d4c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c6c2e0370 0x555c6c2e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c6c2d6b40 0x555c6c2e3f40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 --2- 172.21.15.100:0/1437669148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c6c2d55d0 0x555c6c2e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 >> 172.21.15.100:0/1437669148 conn(0x555c6c29e310 msgr2=0x555c6c2d7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcda77fe640 0 client.26224 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 shutdown_connections 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.920+0000 7fcdd0a98740 1 -- 172.21.15.100:0/1437669148 wait complete. 2024-09-12T02:47:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.921+0000 7fcdd0a98740 20 client.26224 trim_cache size 0 max 16384 2024-09-12T02:47:36.923 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:47:36.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.921+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdb00a2cd0 msgr2=0x7fcdb00a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.921+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdb00a2cd0 0x7fcdb00a5190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00b96a0 tx=0x7fcdc002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.921+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109450 msgr2=0x7fcdc81a7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.921+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109450 0x7fcdc81a7370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0005e30 tx=0x7fcdc00039f0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.922+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 shutdown_connections 2024-09-12T02:47:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.922+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcdb00a2cd0 0x7fcdb00a5190 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.922+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdc811b140 0x7fcdc81abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.922+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc8109830 0x7fcdc81a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.922+0000 7fcdce6bf640 1 --2- 172.21.15.100:0/2725067871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdc8109450 0x7fcdc81a7370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.922+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 >> 172.21.15.100:0/2725067871 conn(0x7fcdc806e140 msgr2=0x7fcdc811be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.922+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 shutdown_connections 2024-09-12T02:47:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:36.923+0000 7fcdce6bf640 1 -- 172.21.15.100:0/2725067871 wait complete. 2024-09-12T02:47:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:36 smithi117 ceph-mon[34898]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 777 op/s 2024-09-12T02:47:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:36 smithi100 ceph-mon[31390]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 777 op/s 2024-09-12T02:47:37.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:36 smithi189 ceph-mon[35196]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 MiB/s wr, 777 op/s 2024-09-12T02:47:37.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:47:38.004 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 -- 172.21.15.100:0/1323645984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac1081f0 msgr2=0x7fbeac108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 --2- 172.21.15.100:0/1323645984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac1081f0 0x7fbeac108610 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009930 tx=0x7fbea002a420 comp rx=0 tx=0).stop 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 -- 172.21.15.100:0/1323645984 shutdown_connections 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 --2- 172.21.15.100:0/1323645984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac108b50 0x7fbeac115070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 --2- 172.21.15.100:0/1323645984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac1081f0 0x7fbeac108610 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 --2- 172.21.15.100:0/1323645984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac10e230 0x7fbeac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 -- 172.21.15.100:0/1323645984 >> 172.21.15.100:0/1323645984 conn(0x7fbeac077bb0 msgr2=0x7fbeac079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 -- 172.21.15.100:0/1323645984 shutdown_connections 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.555+0000 7fbeb4144640 1 -- 172.21.15.100:0/1323645984 wait complete. 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.556+0000 7fbeb4144640 1 Processor -- start 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.557+0000 7fbeb4144640 1 -- start start 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.557+0000 7fbeb4144640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac1081f0 0x7fbeac1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.557+0000 7fbeb4144640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac108b50 0x7fbeac1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.557+0000 7fbeb4144640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac10e230 0x7fbeac19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.557+0000 7fbeb4144640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac118530 con 0x7fbeac10e230 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.557+0000 7fbeb4144640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac1183b0 con 0x7fbeac108b50 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.557+0000 7fbeb4144640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac1186b0 con 0x7fbeac1081f0 2024-09-12T02:47:38.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb16df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac108b50 0x7fbeac1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac1081f0 0x7fbeac1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac1081f0 0x7fbeac1a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33760/0 (socket says 172.21.15.100:33760) 2024-09-12T02:47:38.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/4033837513 learned_addr learned my addr 172.21.15.100:0/4033837513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:38.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/4033837513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac108b50 msgr2=0x7fbeac1a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac108b50 0x7fbeac1a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac10e230 msgr2=0x7fbeac19e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac10e230 0x7fbeac19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/4033837513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac19efb0 con 0x7fbeac1081f0 2024-09-12T02:47:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.558+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac1081f0 0x7fbeac1a46c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d50 tx=0x7fbea400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.559+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4033837513 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4003b70 con 0x7fbeac1081f0 2024-09-12T02:47:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.559+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4033837513 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbea4003d10 con 0x7fbeac1081f0 2024-09-12T02:47:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.559+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac19f2a0 con 0x7fbeac1081f0 2024-09-12T02:47:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.559+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac1ab590 con 0x7fbeac1081f0 2024-09-12T02:47:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.559+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4033837513 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4010a20 con 0x7fbeac1081f0 2024-09-12T02:47:38.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.562+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4033837513 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fbea4010bc0 con 0x7fbeac1081f0 2024-09-12T02:47:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.564+0000 7fbeaaffd640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbe940a2cd0 0x7fbe940a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.565+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4033837513 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbea40d06f0 con 0x7fbeac1081f0 2024-09-12T02:47:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.565+0000 7fbeb651d740 1 Processor -- start 2024-09-12T02:47:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.565+0000 7fbeb16df640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbe940a2cd0 0x7fbe940a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.565+0000 7fbeb651d740 1 -- start start 2024-09-12T02:47:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db244090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db2445d0 0x5639db244a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db251760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb651d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5639db1aa2f0 con 0x5639db2445d0 2024-09-12T02:47:38.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb651d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5639db151cf0 con 0x5639db245b40 2024-09-12T02:47:38.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb651d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5639db1a62b0 con 0x5639db24f370 2024-09-12T02:47:38.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb26e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db251760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb26e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db251760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33762/0 (socket says 172.21.15.100:33762) 2024-09-12T02:47:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb26e1640 1 -- 172.21.15.100:0/2340677264 learned_addr learned my addr 172.21.15.100:0/2340677264 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb1ee0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db244090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb16df640 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db2445d0 0x5639db244a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/2340677264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 msgr2=0x5639db251760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db251760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/2340677264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db2445d0 msgr2=0x5639db244a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db2445d0 0x5639db244a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.566+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/2340677264 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639db1363a0 con 0x5639db245b40 2024-09-12T02:47:38.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.567+0000 7fbeb16df640 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db2445d0 0x5639db244a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:38.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.567+0000 7fbeb16df640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbe940a2cd0 0x7fbe940a5190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009900 tx=0x7fbea00314d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.567+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db244090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbea40ce180 tx=0x7fbea4098a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=995f05f5f58703f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.567+0000 7fbe93fff640 1 -- 172.21.15.100:0/2340677264 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea409ca20 con 0x5639db245b40 2024-09-12T02:47:38.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.567+0000 7fbe93fff640 1 -- 172.21.15.100:0/2340677264 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbea40b8020 con 0x5639db245b40 2024-09-12T02:47:38.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.568+0000 7fbe93fff640 1 -- 172.21.15.100:0/2340677264 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea409c840 con 0x5639db245b40 2024-09-12T02:47:38.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.568+0000 7fbeb651d740 1 -- 172.21.15.100:0/2340677264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 msgr2=0x5639db244090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.568+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db244090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbea40ce180 tx=0x7fbea4098a60 comp rx=0 tx=0).stop 2024-09-12T02:47:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 -- 172.21.15.100:0/2340677264 shutdown_connections 2024-09-12T02:47:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db251760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db2445d0 0x5639db244a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2340677264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db244090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 -- 172.21.15.100:0/2340677264 >> 172.21.15.100:0/2340677264 conn(0x5639db20d310 msgr2=0x5639db240c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 -- 172.21.15.100:0/2340677264 shutdown_connections 2024-09-12T02:47:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 -- 172.21.15.100:0/2340677264 wait complete. 2024-09-12T02:47:38.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 -- start start 2024-09-12T02:47:38.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.569+0000 7fbeb651d740 1 Processor -- start 2024-09-12T02:47:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db24ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db24c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db24f370 0x5639db24c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb651d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5639db2520c0 con 0x5639db245b40 2024-09-12T02:47:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb651d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5639db165060 con 0x5639db24f370 2024-09-12T02:47:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb651d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5639db252240 con 0x5639db2445d0 2024-09-12T02:47:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb651d740 10 client.0 _ll_register_callbacks cb 0x5639daeb88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db24f370 0x5639db24c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db24f370 0x5639db24c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59382/0 (socket says 172.21.15.100:59382) 2024-09-12T02:47:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 -- 172.21.15.100:0/2425848411 learned_addr learned my addr 172.21.15.100:0/2425848411 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db24ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb16df640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db24c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 -- 172.21.15.100:0/2425848411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 msgr2=0x5639db24ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db24ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 -- 172.21.15.100:0/2425848411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 msgr2=0x5639db24c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db24c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb26e1640 1 -- 172.21.15.100:0/2425848411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639daf1b3c0 con 0x5639db24f370 2024-09-12T02:47:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.570+0000 7fbeb16df640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db24c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbeb26e1640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db24f370 0x5639db24c5d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0116f0 tx=0x7fbe9c011bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2782cb6e59e8c39f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbe917fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:47:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbe917fa640 1 -- 172.21.15.100:0/2425848411 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c01e060 con 0x5639db24f370 2024-09-12T02:47:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbea40b8020 con 0x5639db24f370 2024-09-12T02:47:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbe917fa640 1 -- 172.21.15.100:0/2425848411 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbe9c00fd30 con 0x5639db24f370 2024-09-12T02:47:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbe917fa640 1 -- 172.21.15.100:0/2425848411 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe9c019430 con 0x5639db24f370 2024-09-12T02:47:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbeb651d740 10 client.26297 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5639db25db90 con 0x5639db24f370 2024-09-12T02:47:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbe917fa640 1 -- 172.21.15.100:0/2425848411 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe9c019ab0 con 0x5639db24f370 2024-09-12T02:47:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.571+0000 7fbe917fa640 1 -- 172.21.15.100:0/2425848411 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbe9c024900 con 0x5639db24f370 2024-09-12T02:47:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb651d740 10 client.26297 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb651d740 10 client.26297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb651d740 20 client.26297 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db261430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb651d740 4 client.26297 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:38.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbea40b8020 con 0x5639db25f040 2024-09-12T02:47:38.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db261430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbe917fa640 10 client.26297 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:38.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.572+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db261430 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc121d404239204 server_cookie=36319d410dd072ad in_seq=0 out_seq=0 2024-09-12T02:47:38.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbe917fa640 1 -- 172.21.15.100:0/2425848411 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fbea40b8020 con 0x5639db25f040 2024-09-12T02:47:38.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbe917fa640 10 client.26297 handle_command_reply: tid=0 2024-09-12T02:47:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 client.26297 shutdown 2024-09-12T02:47:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db24f370 msgr2=0x5639db24c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db24f370 0x5639db24c5d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0116f0 tx=0x7fbe9c011bb0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 shutdown_connections 2024-09-12T02:47:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db261430 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbe917fa640 0 client.26297 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db24f370 0x5639db24c5d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db24c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 --2- 172.21.15.100:0/2425848411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db24ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 >> 172.21.15.100:0/2425848411 conn(0x5639db20d310 msgr2=0x5639db2469c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 shutdown_connections 2024-09-12T02:47:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.574+0000 7fbeb651d740 1 -- 172.21.15.100:0/2425848411 wait complete. 2024-09-12T02:47:38.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.575+0000 7fbeb651d740 20 client.26297 trim_cache size 0 max 16384 2024-09-12T02:47:38.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.598+0000 7fbeb651d740 1 Processor -- start 2024-09-12T02:47:38.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.598+0000 7fbeb651d740 1 -- start start 2024-09-12T02:47:38.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.599+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db240e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.599+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db25b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.599+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db24f370 0x5639db266d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.599+0000 7fbeb1ee0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db240e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.599+0000 7fbeb1ee0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db240e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33778/0 (socket says 172.21.15.100:33778) 2024-09-12T02:47:38.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/523204296 learned_addr learned my addr 172.21.15.100:0/523204296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:38.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98010d40 con 0x5639db24f370 2024-09-12T02:47:38.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb16df640 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db25b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb26e1640 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db24f370 0x5639db266d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9800e610 con 0x5639db245b40 2024-09-12T02:47:38.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9800c460 con 0x5639db2445d0 2024-09-12T02:47:38.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/523204296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 msgr2=0x5639db25b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db25b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/523204296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db24f370 msgr2=0x5639db266d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db24f370 0x5639db266d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/523204296 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639db24cbb0 con 0x5639db2445d0 2024-09-12T02:47:38.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.600+0000 7fbeb26e1640 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db24f370 0x5639db266d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:38.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.601+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db240e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbea40a5620 tx=0x7fbea4003f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=208f1e9626063e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.601+0000 7fbe937fe640 1 -- 172.21.15.100:0/523204296 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea409c840 con 0x5639db2445d0 2024-09-12T02:47:38.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.601+0000 7fbe937fe640 1 -- 172.21.15.100:0/523204296 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbea40af030 con 0x5639db2445d0 2024-09-12T02:47:38.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.601+0000 7fbe937fe640 1 -- 172.21.15.100:0/523204296 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea409ca20 con 0x5639db2445d0 2024-09-12T02:47:38.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.602+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 msgr2=0x5639db240e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.602+0000 7fbeb651d740 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db240e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbea40a5620 tx=0x7fbea4003f70 comp rx=0 tx=0).stop 2024-09-12T02:47:38.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.602+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 shutdown_connections 2024-09-12T02:47:38.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.602+0000 7fbeb651d740 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db24f370 0x5639db266d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.602+0000 7fbeb651d740 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db245b40 0x5639db25b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.602+0000 7fbeb651d740 1 --2- 172.21.15.100:0/523204296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db2445d0 0x5639db240e10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.602+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 >> 172.21.15.100:0/523204296 conn(0x5639db20d310 msgr2=0x5639db240700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.603+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 shutdown_connections 2024-09-12T02:47:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.604+0000 7fbeb651d740 1 -- 172.21.15.100:0/523204296 wait complete. 2024-09-12T02:47:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.604+0000 7fbeb651d740 1 -- start start 2024-09-12T02:47:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.604+0000 7fbeb651d740 1 Processor -- start 2024-09-12T02:47:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db2445d0 0x5639db257500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db257a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb651d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db2544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb651d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9800cad0 con 0x5639db245b40 2024-09-12T02:47:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db2445d0 0x5639db257500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db2445d0 0x5639db257500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59396/0 (socket says 172.21.15.100:59396) 2024-09-12T02:47:38.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/1120254718 learned_addr learned my addr 172.21.15.100:0/1120254718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:38.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9800df40 con 0x5639db2445d0 2024-09-12T02:47:38.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9800d1a0 con 0x5639db24f370 2024-09-12T02:47:38.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb651d740 10 client.0 _ll_register_callbacks cb 0x7fbe9c009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:38.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb26e1640 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db2544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb16df640 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db257a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/1120254718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 msgr2=0x5639db2544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db2544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/1120254718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 msgr2=0x5639db257a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db257a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.605+0000 7fbeb1ee0640 1 -- 172.21.15.100:0/1120254718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639db241960 con 0x5639db2445d0 2024-09-12T02:47:38.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.607+0000 7fbeb1ee0640 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db2445d0 0x5639db257500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbea409cbe0 tx=0x7fbea4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92878900364b3d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.607+0000 7fbe917fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:47:38.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.607+0000 7fbe917fa640 1 -- 172.21.15.100:0/1120254718 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4004820 con 0x5639db2445d0 2024-09-12T02:47:38.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.607+0000 7fbe917fa640 1 -- 172.21.15.100:0/1120254718 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbea409c330 con 0x5639db2445d0 2024-09-12T02:47:38.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbea40af030 con 0x5639db2445d0 2024-09-12T02:47:38.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbe917fa640 1 -- 172.21.15.100:0/1120254718 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbea4083050 con 0x5639db2445d0 2024-09-12T02:47:38.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 10 client.26303 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:38.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5639db2ca180 con 0x5639db2445d0 2024-09-12T02:47:38.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbe917fa640 1 -- 172.21.15.100:0/1120254718 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbea40af030 con 0x5639db2445d0 2024-09-12T02:47:38.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbe917fa640 1 -- 172.21.15.100:0/1120254718 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbea4098c30 con 0x5639db2445d0 2024-09-12T02:47:38.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 10 client.26303 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:38.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 10 client.26303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:38.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 20 client.26303 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db2cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 4 client.26303 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:47:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.608+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5639db1b7860 con 0x5639db25f040 2024-09-12T02:47:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.609+0000 7fbeb16df640 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db2cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.609+0000 7fbeb16df640 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db2cc360 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6acbd6832de0247 server_cookie=98d79efc84b192cf in_seq=0 out_seq=0 2024-09-12T02:47:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.609+0000 7fbe917fa640 10 client.26303 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.610+0000 7fbe917fa640 1 -- 172.21.15.100:0/1120254718 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5639db1b7860 con 0x5639db25f040 2024-09-12T02:47:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.610+0000 7fbe917fa640 10 client.26303 handle_command_reply: tid=0 2024-09-12T02:47:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.610+0000 7fbeb651d740 1 client.26303 shutdown 2024-09-12T02:47:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.610+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db2445d0 msgr2=0x5639db257500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.610+0000 7fbeb651d740 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db2445d0 0x5639db257500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbea409cbe0 tx=0x7fbea4009c00 comp rx=0 tx=0).stop 2024-09-12T02:47:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 shutdown_connections 2024-09-12T02:47:38.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5639db25f040 0x5639db2cc360 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639db24f370 0x5639db2544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639db245b40 0x5639db257a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbe917fa640 0 client.26303 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:38.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 --2- 172.21.15.100:0/1120254718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5639db2445d0 0x5639db257500 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 >> 172.21.15.100:0/1120254718 conn(0x5639db20d310 msgr2=0x5639db24d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 shutdown_connections 2024-09-12T02:47:38.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 1 -- 172.21.15.100:0/1120254718 wait complete. 2024-09-12T02:47:38.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.611+0000 7fbeb651d740 20 client.26303 trim_cache size 0 max 16384 2024-09-12T02:47:38.623 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:47:38.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbe940a2cd0 msgr2=0x7fbe940a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbe940a2cd0 0x7fbe940a5190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009900 tx=0x7fbea00314d0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac1081f0 msgr2=0x7fbeac1a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac1081f0 0x7fbeac1a46c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d50 tx=0x7fbea400c6a0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 shutdown_connections 2024-09-12T02:47:38.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbe940a2cd0 0x7fbe940a5190 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac10e230 0x7fbeac19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac108b50 0x7fbeac1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 --2- 172.21.15.100:0/4033837513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeac1081f0 0x7fbeac1a46c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 >> 172.21.15.100:0/4033837513 conn(0x7fbeac077bb0 msgr2=0x7fbeac079430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 shutdown_connections 2024-09-12T02:47:38.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:38.612+0000 7fbeb4144640 1 -- 172.21.15.100:0/4033837513 wait complete. 2024-09-12T02:47:39.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:38 smithi189 ceph-mon[35196]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 758 op/s 2024-09-12T02:47:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:38 smithi117 ceph-mon[34898]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 758 op/s 2024-09-12T02:47:39.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:38 smithi100 ceph-mon[31390]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 758 op/s 2024-09-12T02:47:40.368 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:47:40.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:47:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:40.977 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:40 smithi100 ceph-mon[31390]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 22 MiB/s wr, 808 op/s 2024-09-12T02:47:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:40 smithi117 ceph-mon[34898]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 22 MiB/s wr, 808 op/s 2024-09-12T02:47:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:40 smithi189 ceph-mon[35196]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 22 MiB/s wr, 808 op/s 2024-09-12T02:47:41.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 510.0 s, 3001.6 tps, lat 30.604 ms stddev 38.061 2024-09-12T02:47:41.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 -- 172.21.15.100:0/2007812513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360101de0 msgr2=0x7fc3601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 --2- 172.21.15.100:0/2007812513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360101de0 0x7fc3601021c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc350009ca0 tx=0x7fc35002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 -- 172.21.15.100:0/2007812513 shutdown_connections 2024-09-12T02:47:41.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 --2- 172.21.15.100:0/2007812513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc360106f10 0x7fc36010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 --2- 172.21.15.100:0/2007812513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc360102790 0x7fc3601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 --2- 172.21.15.100:0/2007812513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360101de0 0x7fc3601021c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 -- 172.21.15.100:0/2007812513 >> 172.21.15.100:0/2007812513 conn(0x7fc3600fd880 msgr2=0x7fc3600ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:41.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 -- 172.21.15.100:0/2007812513 shutdown_connections 2024-09-12T02:47:41.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.456+0000 7fc364fc4640 1 -- 172.21.15.100:0/2007812513 wait complete. 2024-09-12T02:47:41.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.458+0000 7fc364fc4640 1 Processor -- start 2024-09-12T02:47:41.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.458+0000 7fc364fc4640 1 -- start start 2024-09-12T02:47:41.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.459+0000 7fc364fc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc360101de0 0x7fc3601983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.459+0000 7fc364fc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc360102790 0x7fc360198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.459+0000 7fc364fc4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360106f10 0x7fc36019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.459+0000 7fc364fc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc360111f70 con 0x7fc360101de0 2024-09-12T02:47:41.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.459+0000 7fc364fc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc360111df0 con 0x7fc360102790 2024-09-12T02:47:41.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.459+0000 7fc364fc4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601120f0 con 0x7fc360106f10 2024-09-12T02:47:41.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.460+0000 7fc35ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360106f10 0x7fc36019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.460+0000 7fc35ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360106f10 0x7fc36019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33802/0 (socket says 172.21.15.100:33802) 2024-09-12T02:47:41.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.460+0000 7fc35ed9d640 1 -- 172.21.15.100:0/3180263945 learned_addr learned my addr 172.21.15.100:0/3180263945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:41.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.460+0000 7fc357fff640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc360102790 0x7fc360198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.460+0000 7fc35e59c640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc360101de0 0x7fc3601983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc35e59c640 1 -- 172.21.15.100:0/3180263945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360106f10 msgr2=0x7fc36019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc35e59c640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360106f10 0x7fc36019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc35e59c640 1 -- 172.21.15.100:0/3180263945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc360102790 msgr2=0x7fc360198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc35e59c640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc360102790 0x7fc360198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc35e59c640 1 -- 172.21.15.100:0/3180263945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36019d380 con 0x7fc360101de0 2024-09-12T02:47:41.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc35e59c640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc360101de0 0x7fc3601983d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc350000f80 tx=0x7fc3500319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:41.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc3577fe640 1 -- 172.21.15.100:0/3180263945 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35002fa20 con 0x7fc360101de0 2024-09-12T02:47:41.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.461+0000 7fc3577fe640 1 -- 172.21.15.100:0/3180263945 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc35002f380 con 0x7fc360101de0 2024-09-12T02:47:41.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.462+0000 7fc3577fe640 1 -- 172.21.15.100:0/3180263945 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500466e0 con 0x7fc360101de0 2024-09-12T02:47:41.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.462+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36019d610 con 0x7fc360101de0 2024-09-12T02:47:41.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.462+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc360074420 con 0x7fc360101de0 2024-09-12T02:47:41.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.466+0000 7fc3577fe640 1 -- 172.21.15.100:0/3180263945 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fc3500305c0 con 0x7fc360101de0 2024-09-12T02:47:41.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.466+0000 7fc36739d740 1 Processor -- start 2024-09-12T02:47:41.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.467+0000 7fc3577fe640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc34c0a2c00 0x7fc34c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.467+0000 7fc3577fe640 1 -- 172.21.15.100:0/3180263945 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc3500f0230 con 0x7fc360101de0 2024-09-12T02:47:41.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.467+0000 7fc35ed9d640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc34c0a2c00 0x7fc34c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.467+0000 7fc36739d740 1 -- start start 2024-09-12T02:47:41.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.467+0000 7fc36739d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7474f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.467+0000 7fc36739d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7475480 0x558ed747f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc36739d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed7482130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc36739d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ed73da280 con 0x558ed747fd40 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc36739d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558ed7381b10 con 0x558ed7474b60 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc36739d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ed73d6240 con 0x558ed7475480 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7475480 0x558ed747f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7475480 0x558ed747f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33818/0 (socket says 172.21.15.100:33818) 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 -- 172.21.15.100:0/536918018 learned_addr learned my addr 172.21.15.100:0/536918018 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc35e59c640 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7474f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc35ed9d640 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed7482130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 -- 172.21.15.100:0/536918018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 msgr2=0x558ed7474f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7474f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 -- 172.21.15.100:0/536918018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 msgr2=0x558ed7482130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed7482130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 -- 172.21.15.100:0/536918018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed738e1f0 con 0x558ed7475480 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc35ed9d640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc34c0a2c00 0x7fc34c0a50c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc358009c50 tx=0x7fc358005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:41.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.468+0000 7fc357fff640 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7475480 0x558ed747f800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc348009c30 tx=0x7fc3480117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f2d01500ad2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:41.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.469+0000 7fc354ff9640 1 -- 172.21.15.100:0/536918018 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348012450 con 0x558ed7475480 2024-09-12T02:47:41.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.469+0000 7fc354ff9640 1 -- 172.21.15.100:0/536918018 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc348012ad0 con 0x558ed7475480 2024-09-12T02:47:41.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.469+0000 7fc354ff9640 1 -- 172.21.15.100:0/536918018 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34800fbf0 con 0x558ed7475480 2024-09-12T02:47:41.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.469+0000 7fc36739d740 1 -- 172.21.15.100:0/536918018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7475480 msgr2=0x558ed747f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.469+0000 7fc36739d740 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7475480 0x558ed747f800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc348009c30 tx=0x7fc3480117b0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 -- 172.21.15.100:0/536918018 shutdown_connections 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed7482130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7475480 0x558ed747f800 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 --2- 172.21.15.100:0/536918018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7474f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 -- 172.21.15.100:0/536918018 >> 172.21.15.100:0/536918018 conn(0x558ed74710f0 msgr2=0x558ed74714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 -- 172.21.15.100:0/536918018 shutdown_connections 2024-09-12T02:47:41.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 -- 172.21.15.100:0/536918018 wait complete. 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 -- start start 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.470+0000 7fc36739d740 1 Processor -- start 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc36739d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc36739d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7475480 0x558ed747d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc36739d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed747d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc36739d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ed7482910 con 0x558ed747fd40 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc36739d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558ed7394f10 con 0x558ed7475480 2024-09-12T02:47:41.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc36739d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ed7482a90 con 0x558ed7474b60 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc36739d740 10 client.0 _ll_register_callbacks cb 0x558ed735da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc357fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7475480 0x558ed747d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc357fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7475480 0x558ed747d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59426/0 (socket says 172.21.15.100:59426) 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc357fff640 1 -- 172.21.15.100:0/392475724 learned_addr learned my addr 172.21.15.100:0/392475724 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.471+0000 7fc35e59c640 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc35ed9d640 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed747d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc357fff640 1 -- 172.21.15.100:0/392475724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 msgr2=0x558ed747cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:41.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc357fff640 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc357fff640 1 -- 172.21.15.100:0/392475724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 msgr2=0x558ed747d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc357fff640 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed747d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc357fff640 1 -- 172.21.15.100:0/392475724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed714b6a0 con 0x558ed7475480 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc357fff640 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7475480 0x558ed747d110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc34800f4f0 tx=0x7fc348012eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bbef2e75b7f5d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.472+0000 7fc345ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.473+0000 7fc345ffb640 1 -- 172.21.15.100:0/392475724 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348028070 con 0x558ed7475480 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.473+0000 7fc345ffb640 1 -- 172.21.15.100:0/392475724 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc348012860 con 0x558ed7475480 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.473+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc348012ad0 con 0x558ed7475480 2024-09-12T02:47:41.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.473+0000 7fc345ffb640 1 -- 172.21.15.100:0/392475724 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc348034050 con 0x558ed7475480 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.473+0000 7fc36739d740 10 client.26315 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.473+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ed749f4d0 con 0x558ed7475480 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc345ffb640 1 -- 172.21.15.100:0/392475724 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc348009810 con 0x558ed7475480 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc345ffb640 1 -- 172.21.15.100:0/392475724 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc3480046c0 con 0x558ed7475480 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc36739d740 10 client.26315 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc36739d740 10 client.26315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc36739d740 20 client.26315 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:41.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc36739d740 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed74a0880 0x558ed74a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc36739d740 4 client.26315 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc348012ad0 con 0x558ed74a0880 2024-09-12T02:47:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.474+0000 7fc35e59c640 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed74a0880 0x558ed74a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.475+0000 7fc345ffb640 10 client.26315 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.475+0000 7fc35e59c640 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed74a0880 0x558ed74a2c70 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7142342f9e0e779 server_cookie=8095a81ec04c83c1 in_seq=0 out_seq=0 2024-09-12T02:47:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc345ffb640 1 -- 172.21.15.100:0/392475724 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc348012ad0 con 0x558ed74a0880 2024-09-12T02:47:41.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc345ffb640 10 client.26315 handle_command_reply: tid=0 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 client.26315 shutdown 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7475480 msgr2=0x558ed747d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7475480 0x558ed747d110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc34800f4f0 tx=0x7fc348012eb0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 shutdown_connections 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed74a0880 0x558ed74a2c70 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed747fd40 0x558ed747d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7475480 0x558ed747d110 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 --2- 172.21.15.100:0/392475724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 >> 172.21.15.100:0/392475724 conn(0x558ed74710f0 msgr2=0x558ed7476dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc345ffb640 0 client.26315 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 shutdown_connections 2024-09-12T02:47:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 1 -- 172.21.15.100:0/392475724 wait complete. 2024-09-12T02:47:41.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.476+0000 7fc36739d740 20 client.26315 trim_cache size 0 max 16384 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.499+0000 7fc36739d740 1 Processor -- start 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc36739d740 1 -- start start 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc36739d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc36739d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed74775c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc36739d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed747fd40 0x558ed747d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc36739d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601a9790 con 0x558ed7475480 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc36739d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc360072110 con 0x558ed747fd40 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc36739d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc36006ff60 con 0x558ed7474b60 2024-09-12T02:47:41.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33844/0 (socket says 172.21.15.100:33844) 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc35e59c640 1 -- 172.21.15.100:0/346360188 learned_addr learned my addr 172.21.15.100:0/346360188 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.500+0000 7fc35ed9d640 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed747fd40 0x558ed747d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc35e59c640 1 -- 172.21.15.100:0/346360188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed747fd40 msgr2=0x558ed747d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc35e59c640 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed747fd40 0x558ed747d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc35e59c640 1 -- 172.21.15.100:0/346360188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 msgr2=0x558ed74775c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc357fff640 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed74775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc35e59c640 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed74775c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc35e59c640 1 -- 172.21.15.100:0/346360188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed74752b0 con 0x558ed7474b60 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc357fff640 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed74775c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:41.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc35e59c640 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747edf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc350031f80 tx=0x7fc3500edb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d08ecc815bf0c85a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:41.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc347fff640 1 -- 172.21.15.100:0/346360188 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500d9020 con 0x558ed7474b60 2024-09-12T02:47:41.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc347fff640 1 -- 172.21.15.100:0/346360188 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3500ef040 con 0x558ed7474b60 2024-09-12T02:47:41.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.501+0000 7fc347fff640 1 -- 172.21.15.100:0/346360188 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500b9090 con 0x558ed7474b60 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.502+0000 7fc36739d740 1 -- 172.21.15.100:0/346360188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 msgr2=0x558ed747edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.502+0000 7fc36739d740 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747edf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc350031f80 tx=0x7fc3500edb90 comp rx=0 tx=0).stop 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.503+0000 7fc36739d740 1 -- 172.21.15.100:0/346360188 shutdown_connections 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.503+0000 7fc36739d740 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed747fd40 0x558ed747d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.503+0000 7fc36739d740 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed74775c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.503+0000 7fc36739d740 1 --2- 172.21.15.100:0/346360188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed7474b60 0x558ed747edf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.503+0000 7fc36739d740 1 -- 172.21.15.100:0/346360188 >> 172.21.15.100:0/346360188 conn(0x558ed74710f0 msgr2=0x558ed7470270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.503+0000 7fc36739d740 1 -- 172.21.15.100:0/346360188 shutdown_connections 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.503+0000 7fc36739d740 1 -- 172.21.15.100:0/346360188 wait complete. 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.504+0000 7fc36739d740 1 -- start start 2024-09-12T02:47:41.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.504+0000 7fc36739d740 1 Processor -- start 2024-09-12T02:47:41.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.504+0000 7fc36739d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7479ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc36739d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed747a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc36739d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed747fd40 0x558ed747a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc36739d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3600705d0 con 0x558ed7475480 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7479ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc36739d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc360071a40 con 0x558ed7474b60 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7479ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59458/0 (socket says 172.21.15.100:59458) 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 -- 172.21.15.100:0/2539715509 learned_addr learned my addr 172.21.15.100:0/2539715509 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc360070ca0 con 0x558ed747fd40 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc36739d740 10 client.0 _ll_register_callbacks cb 0x7fc350009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 -- 172.21.15.100:0/2539715509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed747fd40 msgr2=0x558ed747a550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed747fd40 0x558ed747a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 -- 172.21.15.100:0/2539715509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 msgr2=0x558ed747a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed747a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.505+0000 7fc35e59c640 1 -- 172.21.15.100:0/2539715509 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed7512ab0 con 0x558ed7474b60 2024-09-12T02:47:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.506+0000 7fc35e59c640 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7479ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc350030fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=388bb9fad88ff0db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.508+0000 7fc345ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:47:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.508+0000 7fc345ffb640 1 -- 172.21.15.100:0/2539715509 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500d9050 con 0x558ed7474b60 2024-09-12T02:47:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.508+0000 7fc345ffb640 1 -- 172.21.15.100:0/2539715509 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc3500bad20 con 0x558ed7474b60 2024-09-12T02:47:41.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.508+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3500ef040 con 0x558ed7474b60 2024-09-12T02:47:41.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.514+0000 7fc345ffb640 1 -- 172.21.15.100:0/2539715509 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc3500bd120 con 0x558ed7474b60 2024-09-12T02:47:41.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.514+0000 7fc36739d740 10 client.26321 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:41.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.514+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ed7513c40 con 0x558ed7474b60 2024-09-12T02:47:41.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc345ffb640 1 -- 172.21.15.100:0/2539715509 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc350036040 con 0x558ed7474b60 2024-09-12T02:47:41.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc345ffb640 1 -- 172.21.15.100:0/2539715509 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc348009d20 con 0x558ed7474b60 2024-09-12T02:47:41.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc36739d740 10 client.26321 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc36739d740 10 client.26321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc36739d740 20 client.26321 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc36739d740 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed75142c0 0x558ed75166d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc36739d740 4 client.26321 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:47:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.516+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fc3500ef040 con 0x558ed75142c0 2024-09-12T02:47:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.517+0000 7fc357fff640 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed75142c0 0x558ed75166d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.522+0000 7fc357fff640 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed75142c0 0x558ed75166d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=555199526b0ce776 server_cookie=dd491e7ee1c1412f in_seq=0 out_seq=0 2024-09-12T02:47:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.522+0000 7fc345ffb640 10 client.26321 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:41.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.523+0000 7fc345ffb640 1 -- 172.21.15.100:0/2539715509 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fc3500ef040 con 0x558ed75142c0 2024-09-12T02:47:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.523+0000 7fc345ffb640 10 client.26321 handle_command_reply: tid=0 2024-09-12T02:47:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.524+0000 7fc36739d740 1 client.26321 shutdown 2024-09-12T02:47:41.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 msgr2=0x558ed7479ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7479ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc350030fc0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 shutdown_connections 2024-09-12T02:47:41.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558ed75142c0 0x558ed75166d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ed747fd40 0x558ed747a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ed7475480 0x558ed747a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 --2- 172.21.15.100:0/2539715509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558ed7474b60 0x558ed7479ad0 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc350030fc0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 >> 172.21.15.100:0/2539715509 conn(0x558ed74710f0 msgr2=0x558ed746fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:41.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.525+0000 7fc345ffb640 0 client.26321 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:41.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.526+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 shutdown_connections 2024-09-12T02:47:41.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.526+0000 7fc36739d740 1 -- 172.21.15.100:0/2539715509 wait complete. 2024-09-12T02:47:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.526+0000 7fc36739d740 20 client.26321 trim_cache size 0 max 16384 2024-09-12T02:47:41.527 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:47:41.527 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:47:41.527 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "a0427fbe-935d-4e91-b2aa-7b632c9bdfb2", 2024-09-12T02:47:41.527 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:47:41.528 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc34c0a2c00 msgr2=0x7fc34c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc34c0a2c00 0x7fc34c0a50c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc358009c50 tx=0x7fc358005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc360101de0 msgr2=0x7fc3601983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc360101de0 0x7fc3601983d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc350000f80 tx=0x7fc3500319f0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 shutdown_connections 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc34c0a2c00 0x7fc34c0a50c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc360106f10 0x7fc36019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc360102790 0x7fc360198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 --2- 172.21.15.100:0/3180263945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc360101de0 0x7fc3601983d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.528+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 >> 172.21.15.100:0/3180263945 conn(0x7fc3600fd880 msgr2=0x7fc3600feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:41.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.529+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 shutdown_connections 2024-09-12T02:47:41.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:41.529+0000 7fc364fc4640 1 -- 172.21.15.100:0/3180263945 wait complete. 2024-09-12T02:47:42.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:41 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:47:42.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:41 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:42.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:41 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:47:42.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:41 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:47:42.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:41 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:42.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:41 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:47:42.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:41 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:47:42.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:41 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:42.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:41 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:47:42.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:47:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:42 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:47:43.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:42 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:43.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:42 smithi117 ceph-mon[34898]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.06k op/s 2024-09-12T02:47:43.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:42 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:43.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:42 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:47:43.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:42 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:43.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:42 smithi100 ceph-mon[31390]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.06k op/s 2024-09-12T02:47:43.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:42 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:43.225 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:42 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:47:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:42 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:43.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:42 smithi189 ceph-mon[35196]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.06k op/s 2024-09-12T02:47:43.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:42 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:47:44.026 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:43 smithi100 ceph-mon[31390]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 37 MiB/s wr, 1.35k op/s 2024-09-12T02:47:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.035+0000 7f150a24b640 1 -- 172.21.15.100:0/2253821034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504102d90 msgr2=0x7f1504103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.035+0000 7f150a24b640 1 --2- 172.21.15.100:0/2253821034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504102d90 0x7f1504103170 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009930 tx=0x7f14f4032c30 comp rx=0 tx=0).stop 2024-09-12T02:47:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.035+0000 7f150a24b640 1 -- 172.21.15.100:0/2253821034 shutdown_connections 2024-09-12T02:47:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.035+0000 7f150a24b640 1 --2- 172.21.15.100:0/2253821034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1504108290 0x7f150410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.035+0000 7f150a24b640 1 --2- 172.21.15.100:0/2253821034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1504103740 0x7f1504107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.035+0000 7f150a24b640 1 --2- 172.21.15.100:0/2253821034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504102d90 0x7f1504103170 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.035+0000 7f150a24b640 1 -- 172.21.15.100:0/2253821034 >> 172.21.15.100:0/2253821034 conn(0x7f15040fc7d0 msgr2=0x7f15040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.036+0000 7f150a24b640 1 -- 172.21.15.100:0/2253821034 shutdown_connections 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.036+0000 7f150a24b640 1 -- 172.21.15.100:0/2253821034 wait complete. 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.036+0000 7f150a24b640 1 Processor -- start 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f150a24b640 1 -- start start 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f150a24b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1504102d90 0x7f1504196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f150a24b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1504103740 0x7f15041968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f150a24b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504108290 0x7f150419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f150a24b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f150410fe80 con 0x7f1504108290 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f150a24b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f150410fd00 con 0x7f1504103740 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f150a24b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1504110000 con 0x7f1504102d90 2024-09-12T02:47:44.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f1503fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504108290 0x7f150419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f1503fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504108290 0x7f150419ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56570/0 (socket says 172.21.15.100:56570) 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f1503fff640 1 -- 172.21.15.100:0/20314591 learned_addr learned my addr 172.21.15.100:0/20314591 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f15037fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1504102d90 0x7f1504196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.037+0000 7f1502ffd640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1504103740 0x7f15041968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.038+0000 7f1503fff640 1 -- 172.21.15.100:0/20314591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1504102d90 msgr2=0x7f1504196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.038+0000 7f1503fff640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1504102d90 0x7f1504196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.038+0000 7f1503fff640 1 -- 172.21.15.100:0/20314591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1504103740 msgr2=0x7f15041968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.038+0000 7f1503fff640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1504103740 0x7f15041968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.038+0000 7f1503fff640 1 -- 172.21.15.100:0/20314591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150419b310 con 0x7f1504108290 2024-09-12T02:47:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.038+0000 7f1503fff640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504108290 0x7f150419ac30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00db00 tx=0x7f14fc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.039+0000 7f1500ff9640 1 -- 172.21.15.100:0/20314591 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc015070 con 0x7f1504108290 2024-09-12T02:47:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.039+0000 7f1500ff9640 1 -- 172.21.15.100:0/20314591 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14fc005020 con 0x7f1504108290 2024-09-12T02:47:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.039+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150419b600 con 0x7f1504108290 2024-09-12T02:47:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.039+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15041a2ee0 con 0x7f1504108290 2024-09-12T02:47:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.039+0000 7f1500ff9640 1 -- 172.21.15.100:0/20314591 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00f620 con 0x7f1504108290 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.043+0000 7f150c624740 1 Processor -- start 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.043+0000 7f1500ff9640 1 -- 172.21.15.100:0/20314591 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f14fc00f7c0 con 0x7f1504108290 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f150c624740 1 -- start start 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f150c624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609202124a0 0x560920212880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f150c624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560920212dc0 0x56092021d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f150c624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f150c624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5609201782e0 con 0x560920212dc0 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f150c624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56092011fce0 con 0x5609202124a0 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f1502ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609202124a0 0x560920212880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f1502ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609202124a0 0x560920212880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59488/0 (socket says 172.21.15.100:59488) 2024-09-12T02:47:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686920251 learned_addr learned my addr 172.21.15.100:0/3686920251 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.044+0000 7f150c624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609201742a0 con 0x56092021d680 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f15037fe640 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560920212dc0 0x56092021d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686920251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 msgr2=0x56092021fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686920251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560920212dc0 msgr2=0x56092021d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560920212dc0 0x56092021d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f1502ffd640 1 -- 172.21.15.100:0/3686920251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560920104440 con 0x5609202124a0 2024-09-12T02:47:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.045+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609202124a0 0x560920212880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x56092020fdb0 tx=0x7f14f8005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff82e6c5d812f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.046+0000 7f14e9ffb640 1 -- 172.21.15.100:0/3686920251 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8004030 con 0x5609202124a0 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.046+0000 7f14e9ffb640 1 -- 172.21.15.100:0/3686920251 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f80041d0 con 0x5609202124a0 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.046+0000 7f14e9ffb640 1 -- 172.21.15.100:0/3686920251 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f800f7f0 con 0x5609202124a0 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.046+0000 7f1500ff9640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f14ec0a2cd0 0x7f14ec0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.046+0000 7f15037fe640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f14ec0a2cd0 0x7f14ec0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.046+0000 7f1500ff9640 1 -- 172.21.15.100:0/20314591 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f14fc0ceeb0 con 0x7f1504108290 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.047+0000 7f150c624740 1 -- 172.21.15.100:0/3686920251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609202124a0 msgr2=0x560920212880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.047+0000 7f150c624740 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609202124a0 0x560920212880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x56092020fdb0 tx=0x7f14f8005850 comp rx=0 tx=0).stop 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f15037fe640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f14ec0a2cd0 0x7f14ec0a5190 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005ab0 tx=0x7f14f4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 -- 172.21.15.100:0/3686920251 shutdown_connections 2024-09-12T02:47:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560920212dc0 0x56092021d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 --2- 172.21.15.100:0/3686920251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5609202124a0 0x560920212880 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 -- 172.21.15.100:0/3686920251 >> 172.21.15.100:0/3686920251 conn(0x56092020ea30 msgr2=0x56092020ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 -- 172.21.15.100:0/3686920251 shutdown_connections 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 -- 172.21.15.100:0/3686920251 wait complete. 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.048+0000 7f150c624740 1 -- start start 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 1 Processor -- start 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x56092021cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x56092021a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560920220250 con 0x5609202124a0 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560920133050 con 0x560920212dc0 2024-09-12T02:47:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609202203d0 con 0x56092021d680 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f150c624740 10 client.0 _ll_register_callbacks cb 0x560920173160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f15037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x56092021cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f1502ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x56092021a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f1502ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x56092021a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:59496/0 (socket says 172.21.15.100:59496) 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f1502ffd640 1 -- 172.21.15.100:0/3053965779 learned_addr learned my addr 172.21.15.100:0/3053965779 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f1503fff640 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.049+0000 7f15037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x56092021cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56594/0 (socket says 172.21.15.100:56594) 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f1502ffd640 1 -- 172.21.15.100:0/3053965779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 msgr2=0x56092021a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f1502ffd640 1 -- 172.21.15.100:0/3053965779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 msgr2=0x56092021cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x56092021cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f1502ffd640 1 -- 172.21.15.100:0/3053965779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56091fee93c0 con 0x560920212dc0 2024-09-12T02:47:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x56092021a290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009720 tx=0x7f14f80131b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4093f05a5eebd8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f14e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3053965779 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f80035f0 con 0x560920212dc0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14f80041d0 con 0x560920212dc0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3053965779 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f14f8003790 con 0x560920212dc0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3053965779 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f14f8003990 con 0x560920212dc0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f150c624740 10 client.26333 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56092022bc20 con 0x560920212dc0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.050+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3053965779 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f80041d0 con 0x560920212dc0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3053965779 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f14f801f5a0 con 0x560920212dc0 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f150c624740 10 client.26333 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f150c624740 10 client.26333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f150c624740 20 client.26333 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f150c624740 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56092022d030 0x56092022f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f150c624740 4 client.26333 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:44.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560920185850 con 0x56092022d030 2024-09-12T02:47:44.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f15037fe640 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56092022d030 0x56092022f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f14e2ffd640 10 client.26333 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:44.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.051+0000 7f15037fe640 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56092022d030 0x56092022f420 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c38d6a39e5c1ef server_cookie=2b0bee220c4eeb48 in_seq=0 out_seq=0 2024-09-12T02:47:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.052+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3053965779 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560920185850 con 0x56092022d030 2024-09-12T02:47:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.052+0000 7f14e2ffd640 10 client.26333 handle_command_reply: tid=0 2024-09-12T02:47:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.052+0000 7f150c624740 1 client.26333 shutdown 2024-09-12T02:47:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.052+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 msgr2=0x56092021a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.052+0000 7f150c624740 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x56092021a290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009720 tx=0x7f14f80131b0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.052+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 shutdown_connections 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.052+0000 7f150c624740 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56092022d030 0x56092022f420 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f14e2ffd640 0 client.26333 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f150c624740 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x56092021a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f150c624740 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x56092021a290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f150c624740 1 --2- 172.21.15.100:0/3053965779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x56092021cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 >> 172.21.15.100:0/3053965779 conn(0x56092020ea30 msgr2=0x560920214760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 shutdown_connections 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f150c624740 1 -- 172.21.15.100:0/3053965779 wait complete. 2024-09-12T02:47:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.053+0000 7f150c624740 20 client.26333 trim_cache size 0 max 16384 2024-09-12T02:47:44.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 Processor -- start 2024-09-12T02:47:44.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 -- start start 2024-09-12T02:47:44.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609202124a0 0x56092021baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920234b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56092021d680 0x5609202350a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15041adc50 con 0x56092021d680 2024-09-12T02:47:44.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15041ab520 con 0x560920212dc0 2024-09-12T02:47:44.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f150c624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15041a9370 con 0x5609202124a0 2024-09-12T02:47:44.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f15037fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609202124a0 0x56092021baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f15037fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609202124a0 0x56092021baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:33880/0 (socket says 172.21.15.100:33880) 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.081+0000 7f15037fe640 1 -- 172.21.15.100:0/1890362658 learned_addr learned my addr 172.21.15.100:0/1890362658 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f1502ffd640 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920234b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f1503fff640 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56092021d680 0x5609202350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f15037fe640 1 -- 172.21.15.100:0/1890362658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 msgr2=0x560920234b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f15037fe640 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920234b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f15037fe640 1 -- 172.21.15.100:0/1890362658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56092021d680 msgr2=0x5609202350a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f15037fe640 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56092021d680 0x5609202350a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f15037fe640 1 -- 172.21.15.100:0/1890362658 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56092021c9a0 con 0x5609202124a0 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f1502ffd640 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920234b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.082+0000 7f1503fff640 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56092021d680 0x5609202350a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.083+0000 7f15037fe640 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609202124a0 0x56092021baf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009930 tx=0x7f14f404b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12f698f5abc6974 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.083+0000 7f14e97fa640 1 -- 172.21.15.100:0/1890362658 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4033c40 con 0x5609202124a0 2024-09-12T02:47:44.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.083+0000 7f14e97fa640 1 -- 172.21.15.100:0/1890362658 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560920185850 con 0x5609202124a0 2024-09-12T02:47:44.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.083+0000 7f14e97fa640 1 -- 172.21.15.100:0/1890362658 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f40051b0 con 0x5609202124a0 2024-09-12T02:47:44.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.084+0000 7f150c624740 1 -- 172.21.15.100:0/1890362658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609202124a0 msgr2=0x56092021baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.084+0000 7f150c624740 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609202124a0 0x56092021baf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009930 tx=0x7f14f404b000 comp rx=0 tx=0).stop 2024-09-12T02:47:44.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.085+0000 7f150c624740 1 -- 172.21.15.100:0/1890362658 shutdown_connections 2024-09-12T02:47:44.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.085+0000 7f150c624740 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56092021d680 0x5609202350a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.085+0000 7f150c624740 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920234b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.085+0000 7f150c624740 1 --2- 172.21.15.100:0/1890362658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609202124a0 0x56092021baf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.085+0000 7f150c624740 1 -- 172.21.15.100:0/1890362658 >> 172.21.15.100:0/1890362658 conn(0x56092020ea30 msgr2=0x56092020db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.092+0000 7f150c624740 1 -- 172.21.15.100:0/1890362658 shutdown_connections 2024-09-12T02:47:44.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.094+0000 7f150c624740 1 -- 172.21.15.100:0/1890362658 wait complete. 2024-09-12T02:47:44.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.094+0000 7f150c624740 1 -- start start 2024-09-12T02:47:44.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.095+0000 7f150c624740 1 Processor -- start 2024-09-12T02:47:44.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.098+0000 7f150c624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x560920223560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.098+0000 7f150c624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920223aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.098+0000 7f150c624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x560920223fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.098+0000 7f150c624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15041a99e0 con 0x5609202124a0 2024-09-12T02:47:44.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.098+0000 7f150c624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15041aae50 con 0x560920212dc0 2024-09-12T02:47:44.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.098+0000 7f150c624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15041aa0b0 con 0x56092021d680 2024-09-12T02:47:44.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.098+0000 7f150c624740 10 client.0 _ll_register_callbacks cb 0x7f14f8013510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:44.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.100+0000 7f15037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x560920223560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.100+0000 7f15037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x560920223560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56606/0 (socket says 172.21.15.100:56606) 2024-09-12T02:47:44.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.100+0000 7f15037fe640 1 -- 172.21.15.100:0/3714969491 learned_addr learned my addr 172.21.15.100:0/3714969491 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:47:44.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.101+0000 7f1503fff640 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x560920223fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.102+0000 7f15037fe640 1 -- 172.21.15.100:0/3714969491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 msgr2=0x560920223fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.102+0000 7f15037fe640 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x560920223fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.102+0000 7f15037fe640 1 -- 172.21.15.100:0/3714969491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 msgr2=0x560920223aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:47:44.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.102+0000 7f15037fe640 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920223aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.102+0000 7f15037fe640 1 -- 172.21.15.100:0/3714969491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56092021d350 con 0x5609202124a0 2024-09-12T02:47:44.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.102+0000 7f15037fe640 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x560920223560 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f14f40338d0 tx=0x7f14f4004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bc5f34ed2e6bed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.102+0000 7f14e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:47:44.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.103+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3714969491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f40049d0 con 0x5609202124a0 2024-09-12T02:47:44.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.103+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3714969491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f14f4004f50 con 0x5609202124a0 2024-09-12T02:47:44.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.105+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560920185850 con 0x5609202124a0 2024-09-12T02:47:44.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.107+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3714969491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f14f4005150 con 0x5609202124a0 2024-09-12T02:47:44.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.107+0000 7f150c624740 10 client.16983 fetch_fsmap learned FSMap version 27 2024-09-12T02:47:44.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.107+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560920297d90 con 0x5609202124a0 2024-09-12T02:47:44.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.108+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3714969491 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560920185850 con 0x5609202124a0 2024-09-12T02:47:44.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.108+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3714969491 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f14f403b440 con 0x5609202124a0 2024-09-12T02:47:44.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.109+0000 7f150c624740 10 client.16983 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:47:44.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.109+0000 7f150c624740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:47:44.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.109+0000 7f150c624740 20 client.16983 populate_metadata read hostname 'smithi100' 2024-09-12T02:47:44.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.109+0000 7f150c624740 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560920298350 0x56092029a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.109+0000 7f150c624740 4 client.16983 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:47:44.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.109+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56092017fd60 con 0x560920298350 2024-09-12T02:47:44.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.109+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560920298350 0x56092029a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f1502ffd640 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560920298350 0x56092029a740 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9deda30b4122715d server_cookie=3ca817738c97a367 in_seq=0 out_seq=0 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f14e2ffd640 10 client.16983 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f14e2ffd640 1 -- 172.21.15.100:0/3714969491 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56092017fd60 con 0x560920298350 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f14e2ffd640 10 client.16983 handle_command_reply: tid=0 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 client.16983 shutdown 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 msgr2=0x560920223560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x560920223560 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f14f40338d0 tx=0x7f14f4004d80 comp rx=0 tx=0).stop 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 shutdown_connections 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560920298350 0x56092029a740 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56092021d680 0x560920223fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560920212dc0 0x560920223aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.110+0000 7f150c624740 1 --2- 172.21.15.100:0/3714969491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609202124a0 0x560920223560 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.111+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 >> 172.21.15.100:0/3714969491 conn(0x56092020ea30 msgr2=0x560920219b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.111+0000 7f14e2ffd640 0 client.16983 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.111+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 shutdown_connections 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.111+0000 7f150c624740 1 -- 172.21.15.100:0/3714969491 wait complete. 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.112+0000 7f150c624740 20 client.16983 trim_cache size 0 max 16384 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:47:44.113 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout: "a0427fbe-935d-4e91-b2aa-7b632c9bdfb2": { 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "a0427fbe-935d-4e91-b2aa-7b632c9bdfb2", 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:47:44.114 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f14ec0a2cd0 msgr2=0x7f14ec0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f14ec0a2cd0 0x7f14ec0a5190 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005ab0 tx=0x7f14f4005fd0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504108290 msgr2=0x7f150419ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504108290 0x7f150419ac30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00db00 tx=0x7f14fc00b260 comp rx=0 tx=0).stop 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 shutdown_connections 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f14ec0a2cd0 0x7f14ec0a5190 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1504108290 0x7f150419ac30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1504103740 0x7f15041968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 --2- 172.21.15.100:0/20314591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1504102d90 0x7f1504196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.113+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 >> 172.21.15.100:0/20314591 conn(0x7f15040fc7d0 msgr2=0x7f1504105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.114+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 shutdown_connections 2024-09-12T02:47:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:47:44.114+0000 7f150a24b640 1 -- 172.21.15.100:0/20314591 wait complete. 2024-09-12T02:47:44.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:43 smithi189 ceph-mon[35196]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 37 MiB/s wr, 1.35k op/s 2024-09-12T02:47:44.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:43 smithi117 ceph-mon[34898]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 37 MiB/s wr, 1.35k op/s 2024-09-12T02:47:44.823 INFO:tasks.cephfs.filesystem:scrub status for tag:a0427fbe-935d-4e91-b2aa-7b632c9bdfb2 - {'path': '/', 'tag': 'a0427fbe-935d-4e91-b2aa-7b632c9bdfb2', 'options': 'recursive,force'} 2024-09-12T02:47:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 515.0 s, 3043.4 tps, lat 35.568 ms stddev 60.873 2024-09-12T02:47:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:46 smithi117 ceph-mon[34898]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 40 MiB/s wr, 1.44k op/s 2024-09-12T02:47:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:46 smithi100 ceph-mon[31390]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 40 MiB/s wr, 1.44k op/s 2024-09-12T02:47:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:46 smithi189 ceph-mon[35196]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 40 MiB/s wr, 1.44k op/s 2024-09-12T02:47:49.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:48 smithi117 ceph-mon[34898]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 43 MiB/s wr, 1.57k op/s 2024-09-12T02:47:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:48 smithi100 ceph-mon[31390]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 43 MiB/s wr, 1.57k op/s 2024-09-12T02:47:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:48 smithi189 ceph-mon[35196]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 43 MiB/s wr, 1.57k op/s 2024-09-12T02:47:50.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:49 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:47:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:49 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:47:50.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:49 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:47:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:50 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:47:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:50 smithi117 ceph-mon[34898]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-09-12T02:47:51.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:50 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:47:51.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:50 smithi100 ceph-mon[31390]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-09-12T02:47:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:50 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:47:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:50 smithi189 ceph-mon[35196]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-09-12T02:47:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 520.0 s, 2975.2 tps, lat 33.504 ms stddev 36.614 2024-09-12T02:47:53.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:52 smithi117 ceph-mon[34898]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 42 MiB/s wr, 1.58k op/s 2024-09-12T02:47:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:52 smithi100 ceph-mon[31390]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 42 MiB/s wr, 1.58k op/s 2024-09-12T02:47:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:52 smithi189 ceph-mon[35196]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 42 MiB/s wr, 1.58k op/s 2024-09-12T02:47:55.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:54 smithi117 ceph-mon[34898]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 1.31k op/s 2024-09-12T02:47:55.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:54 smithi100 ceph-mon[31390]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 1.31k op/s 2024-09-12T02:47:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:54 smithi189 ceph-mon[35196]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 1.31k op/s 2024-09-12T02:47:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 525.0 s, 3277.8 tps, lat 30.680 ms stddev 35.341 2024-09-12T02:47:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:56 smithi117 ceph-mon[34898]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 21 MiB/s wr, 928 op/s 2024-09-12T02:47:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:56 smithi100 ceph-mon[31390]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 21 MiB/s wr, 928 op/s 2024-09-12T02:47:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:56 smithi189 ceph-mon[35196]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 21 MiB/s wr, 928 op/s 2024-09-12T02:47:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:47:58 smithi117 ceph-mon[34898]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 809 op/s 2024-09-12T02:47:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:47:58 smithi100 ceph-mon[31390]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 809 op/s 2024-09-12T02:47:59.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:47:58 smithi189 ceph-mon[35196]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 809 op/s 2024-09-12T02:48:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:00 smithi117 ceph-mon[34898]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 13 MiB/s wr, 805 op/s 2024-09-12T02:48:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:00 smithi100 ceph-mon[31390]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 13 MiB/s wr, 805 op/s 2024-09-12T02:48:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:00 smithi189 ceph-mon[35196]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 13 MiB/s wr, 805 op/s 2024-09-12T02:48:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 530.0 s, 2947.6 tps, lat 33.850 ms stddev 37.771 2024-09-12T02:48:03.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:02 smithi117 ceph-mon[34898]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 732 op/s 2024-09-12T02:48:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:02 smithi100 ceph-mon[31390]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 732 op/s 2024-09-12T02:48:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:02 smithi189 ceph-mon[35196]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 732 op/s 2024-09-12T02:48:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:04 smithi117 ceph-mon[34898]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 764 op/s 2024-09-12T02:48:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:04 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:48:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:04 smithi100 ceph-mon[31390]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 764 op/s 2024-09-12T02:48:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:04 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:48:05.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:04 smithi189 ceph-mon[35196]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 764 op/s 2024-09-12T02:48:05.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:04 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:48:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 535.0 s, 2878.2 tps, lat 34.637 ms stddev 38.548 2024-09-12T02:48:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:06 smithi117 ceph-mon[34898]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.1 MiB/s wr, 680 op/s 2024-09-12T02:48:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:06 smithi100 ceph-mon[31390]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.1 MiB/s wr, 680 op/s 2024-09-12T02:48:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:06 smithi189 ceph-mon[35196]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.1 MiB/s wr, 680 op/s 2024-09-12T02:48:09.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:08 smithi189 ceph-mon[35196]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.4 MiB/s wr, 726 op/s 2024-09-12T02:48:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:08 smithi117 ceph-mon[34898]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.4 MiB/s wr, 726 op/s 2024-09-12T02:48:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:08 smithi100 ceph-mon[31390]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.4 MiB/s wr, 726 op/s 2024-09-12T02:48:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:10 smithi117 ceph-mon[34898]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 10 MiB/s wr, 782 op/s 2024-09-12T02:48:11.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:10 smithi100 ceph-mon[31390]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 10 MiB/s wr, 782 op/s 2024-09-12T02:48:11.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:10 smithi189 ceph-mon[35196]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 10 MiB/s wr, 782 op/s 2024-09-12T02:48:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 540.0 s, 2742.2 tps, lat 36.663 ms stddev 42.309 2024-09-12T02:48:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:12 smithi117 ceph-mon[34898]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 750 op/s 2024-09-12T02:48:13.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:12 smithi100 ceph-mon[31390]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 750 op/s 2024-09-12T02:48:13.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:12 smithi189 ceph-mon[35196]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 750 op/s 2024-09-12T02:48:14.824 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:48:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:14 smithi117 ceph-mon[34898]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-09-12T02:48:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:14 smithi100 ceph-mon[31390]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-09-12T02:48:15.206 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:15.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:14 smithi189 ceph-mon[35196]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-09-12T02:48:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 -- 172.21.15.100:0/767198717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 msgr2=0x7fad1410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 --2- 172.21.15.100:0/767198717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410ec30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009cd0 tx=0x7fad0c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 -- 172.21.15.100:0/767198717 shutdown_connections 2024-09-12T02:48:15.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 --2- 172.21.15.100:0/767198717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410ec30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 --2- 172.21.15.100:0/767198717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14103740 0x7fad14107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 --2- 172.21.15.100:0/767198717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad14102d90 0x7fad14103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 -- 172.21.15.100:0/767198717 >> 172.21.15.100:0/767198717 conn(0x7fad140fc7d0 msgr2=0x7fad140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 -- 172.21.15.100:0/767198717 shutdown_connections 2024-09-12T02:48:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.768+0000 7fad19d66640 1 -- 172.21.15.100:0/767198717 wait complete. 2024-09-12T02:48:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 Processor -- start 2024-09-12T02:48:15.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 -- start start 2024-09-12T02:48:15.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14102d90 0x7fad141a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad14103740 0x7fad141a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad14112090 con 0x7fad14108290 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad14111f10 con 0x7fad14103740 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad19d66640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad14112210 con 0x7fad14102d90 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad13fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad13fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57450/0 (socket says 172.21.15.100:57450) 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad13fff640 1 -- 172.21.15.100:0/456918345 learned_addr learned my addr 172.21.15.100:0/456918345 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.769+0000 7fad137fe640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14102d90 0x7fad141a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad12ffd640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad14103740 0x7fad141a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad13fff640 1 -- 172.21.15.100:0/456918345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14102d90 msgr2=0x7fad141a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad13fff640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14102d90 0x7fad141a3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad13fff640 1 -- 172.21.15.100:0/456918345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad14103740 msgr2=0x7fad141a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad13fff640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad14103740 0x7fad141a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad13fff640 1 -- 172.21.15.100:0/456918345 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1410e4e0 con 0x7fad14108290 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad137fe640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14102d90 0x7fad141a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad12ffd640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad14103740 0x7fad141a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad13fff640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410dd90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fad0c003ba0 tx=0x7fad0c003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad10ff9640 1 -- 172.21.15.100:0/456918345 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c004240 con 0x7fad14108290 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad10ff9640 1 -- 172.21.15.100:0/456918345 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad0c031d50 con 0x7fad14108290 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1410e770 con 0x7fad14108290 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad10ff9640 1 -- 172.21.15.100:0/456918345 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c03a400 con 0x7fad14108290 2024-09-12T02:48:15.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.770+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad141ab670 con 0x7fad14108290 2024-09-12T02:48:15.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.774+0000 7fad1c13f740 1 Processor -- start 2024-09-12T02:48:15.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad10ff9640 1 -- 172.21.15.100:0/456918345 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fad0c0043e0 con 0x7fad14108290 2024-09-12T02:48:15.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad1c13f740 1 -- start start 2024-09-12T02:48:15.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f34b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f356140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f358a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad1c13f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56318f2b12e0 con 0x56318f356680 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad1c13f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56318f258ce0 con 0x56318f34bdc0 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad1c13f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56318f2ad2a0 con 0x56318f34b4a0 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f34b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f34b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35258/0 (socket says 172.21.15.100:35258) 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad12ffd640 1 -- 172.21.15.100:0/454964502 learned_addr learned my addr 172.21.15.100:0/454964502 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.775+0000 7fad137fe640 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f356140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad12ffd640 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f358a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad10ff9640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7facfc0a2bc0 0x7facfc0a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad12ffd640 1 -- 172.21.15.100:0/454964502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 msgr2=0x56318f356140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad12ffd640 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f356140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad12ffd640 1 -- 172.21.15.100:0/454964502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 msgr2=0x56318f358a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad12ffd640 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f358a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad12ffd640 1 -- 172.21.15.100:0/454964502 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318f23d440 con 0x56318f34b4a0 2024-09-12T02:48:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad13fff640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7facfc0a2bc0 0x7facfc0a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad12ffd640 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f34b880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fad08009fd0 tx=0x7fad080096f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2241cd8e9335fd21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad10ff9640 1 -- 172.21.15.100:0/456918345 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fad0c02e030 con 0x7fad14108290 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7fad13fff640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7facfc0a2bc0 0x7facfc0a5080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0f0370 tx=0x7fad0c0e75a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.776+0000 7facf9ffb640 1 -- 172.21.15.100:0/454964502 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08004230 con 0x56318f34b4a0 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7facf9ffb640 1 -- 172.21.15.100:0/454964502 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad080043d0 con 0x56318f34b4a0 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7facf9ffb640 1 -- 172.21.15.100:0/454964502 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08010ac0 con 0x56318f34b4a0 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 -- 172.21.15.100:0/454964502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 msgr2=0x56318f34b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f34b880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fad08009fd0 tx=0x7fad080096f0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 -- 172.21.15.100:0/454964502 shutdown_connections 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f358a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f356140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 --2- 172.21.15.100:0/454964502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f34b880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 -- 172.21.15.100:0/454964502 >> 172.21.15.100:0/454964502 conn(0x56318f347a30 msgr2=0x56318f347e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.777+0000 7fad1c13f740 1 -- 172.21.15.100:0/454964502 shutdown_connections 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.778+0000 7fad1c13f740 1 -- 172.21.15.100:0/454964502 wait complete. 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.778+0000 7fad1c13f740 1 -- start start 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.778+0000 7fad1c13f740 1 Processor -- start 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f356090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f353340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f353950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad1c13f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56318f359250 con 0x56318f356680 2024-09-12T02:48:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad1c13f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56318f26c050 con 0x56318f34bdc0 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad1c13f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56318f3593d0 con 0x56318f34b4a0 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad1c13f740 10 client.0 _ll_register_callbacks cb 0x56318f2ac160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f356090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f356090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35266/0 (socket says 172.21.15.100:35266) 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 -- 172.21.15.100:0/2835891620 learned_addr learned my addr 172.21.15.100:0/2835891620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f353950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad137fe640 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f353340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 -- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 msgr2=0x56318f353340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f353340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 -- 172.21.15.100:0/2835891620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 msgr2=0x56318f353950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f353950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.779+0000 7fad12ffd640 1 -- 172.21.15.100:0/2835891620 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56318f0223c0 con 0x56318f34b4a0 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.781+0000 7fad12ffd640 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f356090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad08013fd0 tx=0x7fad08010660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58177e087c4a28ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.781+0000 7facf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.782+0000 7facf2ffd640 1 -- 172.21.15.100:0/2835891620 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08027040 con 0x56318f34b4a0 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.782+0000 7facf2ffd640 1 -- 172.21.15.100:0/2835891620 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fad08005480 con 0x56318f34b4a0 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.782+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad080043d0 con 0x56318f34b4a0 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.782+0000 7facf2ffd640 1 -- 172.21.15.100:0/2835891620 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad08034050 con 0x56318f34b4a0 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.782+0000 7fad1c13f740 10 client.26287 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.782+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56318f364d10 con 0x56318f34b4a0 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7facf2ffd640 1 -- 172.21.15.100:0/2835891620 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad08010d40 con 0x56318f34b4a0 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7facf2ffd640 1 -- 172.21.15.100:0/2835891620 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fad08003a70 con 0x56318f34b4a0 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad1c13f740 10 client.26287 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad1c13f740 10 client.26287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad1c13f740 20 client.26287 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f366060 0x56318f368450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad1c13f740 4 client.26287 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fad080043d0 con 0x56318f366060 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad137fe640 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f366060 0x56318f368450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7facf2ffd640 10 client.26287 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.783+0000 7fad137fe640 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f366060 0x56318f368450 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=992e92909c78f996 server_cookie=bc5ac38ce4507c27 in_seq=0 out_seq=0 2024-09-12T02:48:15.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.784+0000 7facf2ffd640 1 -- 172.21.15.100:0/2835891620 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fad080043d0 con 0x56318f366060 2024-09-12T02:48:15.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.784+0000 7facf2ffd640 10 client.26287 handle_command_reply: tid=0 2024-09-12T02:48:15.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.784+0000 7fad1c13f740 1 client.26287 shutdown 2024-09-12T02:48:15.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 msgr2=0x56318f356090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f356090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad08013fd0 tx=0x7fad08010660 comp rx=0 tx=0).stop 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 shutdown_connections 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f366060 0x56318f368450 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f353950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f353340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2835891620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f356090 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 >> 172.21.15.100:0/2835891620 conn(0x56318f347a30 msgr2=0x56318f34d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7facf2ffd640 0 client.26287 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 shutdown_connections 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 1 -- 172.21.15.100:0/2835891620 wait complete. 2024-09-12T02:48:15.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.785+0000 7fad1c13f740 20 client.26287 trim_cache size 0 max 16384 2024-09-12T02:48:15.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.808+0000 7fad1c13f740 1 Processor -- start 2024-09-12T02:48:15.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.808+0000 7fad1c13f740 1 -- start start 2024-09-12T02:48:15.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.808+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f3624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.808+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f36db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f36e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad1c13f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b6470 con 0x56318f356680 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad1c13f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b3d40 con 0x56318f34bdc0 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad1c13f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b1bb0 con 0x56318f34b4a0 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f3624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad137fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f36db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad137fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f36db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34450/0 (socket says 172.21.15.100:34450) 2024-09-12T02:48:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad137fe640 1 -- 172.21.15.100:0/1558178236 learned_addr learned my addr 172.21.15.100:0/1558178236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.809+0000 7fad12ffd640 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f36e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.810+0000 7fad137fe640 1 -- 172.21.15.100:0/1558178236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 msgr2=0x56318f3624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.810+0000 7fad137fe640 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f3624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.810+0000 7fad137fe640 1 -- 172.21.15.100:0/1558178236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 msgr2=0x56318f36e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.810+0000 7fad137fe640 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f36e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.810+0000 7fad137fe640 1 -- 172.21.15.100:0/1558178236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318f34bbf0 con 0x56318f34bdc0 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.810+0000 7fad137fe640 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f36db40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x56318f352bd0 tx=0x7fad0400a2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e43a5d0f56814f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.810+0000 7facf97fa640 1 -- 172.21.15.100:0/1558178236 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04004020 con 0x56318f34bdc0 2024-09-12T02:48:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.811+0000 7facf97fa640 1 -- 172.21.15.100:0/1558178236 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad0400fe30 con 0x56318f34bdc0 2024-09-12T02:48:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.811+0000 7facf97fa640 1 -- 172.21.15.100:0/1558178236 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040047a0 con 0x56318f34bdc0 2024-09-12T02:48:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.812+0000 7fad1c13f740 1 -- 172.21.15.100:0/1558178236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 msgr2=0x56318f36db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.812+0000 7fad1c13f740 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f36db40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x56318f352bd0 tx=0x7fad0400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.812+0000 7fad1c13f740 1 -- 172.21.15.100:0/1558178236 shutdown_connections 2024-09-12T02:48:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.812+0000 7fad1c13f740 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f356680 0x56318f36e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.812+0000 7fad1c13f740 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f34bdc0 0x56318f36db40 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x56318f352bd0 tx=0x7fad0400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.812+0000 7fad1c13f740 1 --2- 172.21.15.100:0/1558178236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f3624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.812+0000 7fad1c13f740 1 -- 172.21.15.100:0/1558178236 >> 172.21.15.100:0/1558178236 conn(0x56318f347a30 msgr2=0x56318f352430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.813+0000 7fad1c13f740 1 -- 172.21.15.100:0/1558178236 shutdown_connections 2024-09-12T02:48:15.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.819+0000 7fad1c13f740 1 -- 172.21.15.100:0/1558178236 wait complete. 2024-09-12T02:48:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.820+0000 7fad1c13f740 1 -- start start 2024-09-12T02:48:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.820+0000 7fad1c13f740 1 Processor -- start 2024-09-12T02:48:15.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f35eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f356680 0x56318f35bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad1c13f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f35c2e0 0x56318f35c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f35eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f35eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35288/0 (socket says 172.21.15.100:35288) 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad12ffd640 1 -- 172.21.15.100:0/2683539866 learned_addr learned my addr 172.21.15.100:0/2683539866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b2200 con 0x56318f35c2e0 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b3670 con 0x56318f356680 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad137fe640 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f356680 0x56318f35bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b28d0 con 0x56318f34b4a0 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.821+0000 7fad12ffd640 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f35c2e0 0x56318f35c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.822+0000 7fad1c13f740 10 client.0 _ll_register_callbacks cb 0x7fad0400a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:15.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.822+0000 7fad137fe640 1 -- 172.21.15.100:0/2683539866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 msgr2=0x56318f35eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.822+0000 7fad137fe640 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f35eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.822+0000 7fad137fe640 1 -- 172.21.15.100:0/2683539866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f35c2e0 msgr2=0x56318f35c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.822+0000 7fad137fe640 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f35c2e0 0x56318f35c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.822+0000 7fad137fe640 1 -- 172.21.15.100:0/2683539866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56318f353cc0 con 0x56318f356680 2024-09-12T02:48:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.822+0000 7fad137fe640 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f356680 0x56318f35bda0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56318f348a90 tx=0x7fad04005020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f502a3012c5727b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.824+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad0400fe30 con 0x56318f356680 2024-09-12T02:48:15.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.824+0000 7facf2ffd640 10 client.26348 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:48:15.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.828+0000 7facf2ffd640 1 -- 172.21.15.100:0/2683539866 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04035060 con 0x56318f356680 2024-09-12T02:48:15.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.828+0000 7facf2ffd640 1 -- 172.21.15.100:0/2683539866 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fad0400fb50 con 0x56318f356680 2024-09-12T02:48:15.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.833+0000 7facf2ffd640 1 -- 172.21.15.100:0/2683539866 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad040056c0 con 0x56318f356680 2024-09-12T02:48:15.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.833+0000 7fad1c13f740 10 client.26348 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:15.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.833+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=27}) -- 0x56318f3d0980 con 0x56318f356680 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.837+0000 7facf2ffd640 1 -- 172.21.15.100:0/2683539866 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fad04004020 con 0x56318f356680 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.837+0000 7fad1c13f740 10 client.26348 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.837+0000 7fad1c13f740 10 client.26348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.837+0000 7fad1c13f740 20 client.26348 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.837+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f3d0ea0 0x56318f3d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.837+0000 7fad1c13f740 4 client.26348 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.837+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56318f2be850 con 0x56318f3d0ea0 2024-09-12T02:48:15.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.838+0000 7fad12ffd640 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f3d0ea0 0x56318f3d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.843+0000 7facf2ffd640 10 client.26348 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:15.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.843+0000 7fad12ffd640 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f3d0ea0 0x56318f3d32c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b202ee0ff4adc469 server_cookie=1f4e8cb2beb4a682 in_seq=0 out_seq=0 2024-09-12T02:48:15.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.844+0000 7facf2ffd640 1 -- 172.21.15.100:0/2683539866 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56318f2be850 con 0x56318f3d0ea0 2024-09-12T02:48:15.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.844+0000 7facf2ffd640 10 client.26348 handle_command_reply: tid=0 2024-09-12T02:48:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.844+0000 7fad1c13f740 1 client.26348 shutdown 2024-09-12T02:48:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f356680 msgr2=0x56318f35bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f356680 0x56318f35bda0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56318f348a90 tx=0x7fad04005020 comp rx=0 tx=0).stop 2024-09-12T02:48:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 shutdown_connections 2024-09-12T02:48:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56318f3d0ea0 0x56318f3d32c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56318f35c2e0 0x56318f35c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7facf2ffd640 0 client.26348 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56318f356680 0x56318f35bda0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 --2- 172.21.15.100:0/2683539866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56318f34b4a0 0x56318f35eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.845+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 >> 172.21.15.100:0/2683539866 conn(0x56318f347a30 msgr2=0x56318f346350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.850+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 shutdown_connections 2024-09-12T02:48:15.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.851+0000 7fad1c13f740 1 -- 172.21.15.100:0/2683539866 wait complete. 2024-09-12T02:48:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.854+0000 7fad1c13f740 20 client.26348 trim_cache size 0 max 16384 2024-09-12T02:48:15.856 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:48:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:48:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:48:15.856 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:48:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.857+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7facfc0a2bc0 msgr2=0x7facfc0a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.857+0000 7fad19d66640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7facfc0a2bc0 0x7facfc0a5080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0f0370 tx=0x7fad0c0e75a0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.857+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 msgr2=0x7fad1410dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.857+0000 7fad19d66640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410dd90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fad0c003ba0 tx=0x7fad0c003bd0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 shutdown_connections 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7facfc0a2bc0 0x7facfc0a5080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14108290 0x7fad1410dd90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad14103740 0x7fad141a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 --2- 172.21.15.100:0/456918345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14102d90 0x7fad141a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 >> 172.21.15.100:0/456918345 conn(0x7fad140fc7d0 msgr2=0x7fad140fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 shutdown_connections 2024-09-12T02:48:15.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:15.858+0000 7fad19d66640 1 -- 172.21.15.100:0/456918345 wait complete. 2024-09-12T02:48:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 545.0 s, 3414.2 tps, lat 28.988 ms stddev 32.812 2024-09-12T02:48:16.804 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:48:16.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:48:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:16 smithi117 ceph-mon[34898]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 686 op/s 2024-09-12T02:48:17.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:16 smithi100 ceph-mon[31390]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 686 op/s 2024-09-12T02:48:17.200 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:16 smithi189 ceph-mon[35196]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 686 op/s 2024-09-12T02:48:17.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.744+0000 7f58b23e8640 1 -- 172.21.15.100:0/888682267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 msgr2=0x7f58ac110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.744+0000 7f58b23e8640 1 --2- 172.21.15.100:0/888682267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 0x7f58ac110250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009ca0 tx=0x7f58a402a8d0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.749+0000 7f58b23e8640 1 -- 172.21.15.100:0/888682267 shutdown_connections 2024-09-12T02:48:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.749+0000 7f58b23e8640 1 --2- 172.21.15.100:0/888682267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac11b140 0x7f58ac11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.749+0000 7f58b23e8640 1 --2- 172.21.15.100:0/888682267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f58ac109830 0x7f58ac109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.749+0000 7f58b23e8640 1 --2- 172.21.15.100:0/888682267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 0x7f58ac110250 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.749+0000 7f58b23e8640 1 -- 172.21.15.100:0/888682267 >> 172.21.15.100:0/888682267 conn(0x7f58ac06e140 msgr2=0x7f58ac06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.754+0000 7f58b23e8640 1 -- 172.21.15.100:0/888682267 shutdown_connections 2024-09-12T02:48:17.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.755+0000 7f58b23e8640 1 -- 172.21.15.100:0/888682267 wait complete. 2024-09-12T02:48:17.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.755+0000 7f58b23e8640 1 Processor -- start 2024-09-12T02:48:17.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.758+0000 7f58b23e8640 1 -- start start 2024-09-12T02:48:17.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.759+0000 7f58b23e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 0x7f58ac11a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.759+0000 7f58b23e8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f58ac109830 0x7f58ac114930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.759+0000 7f58b23e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac11b140 0x7f58ac114e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.759+0000 7f58b23e8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac111350 con 0x7f58ac11b140 2024-09-12T02:48:17.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.759+0000 7f58b23e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1111d0 con 0x7f58ac109450 2024-09-12T02:48:17.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.759+0000 7f58b23e8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1114d0 con 0x7f58ac109830 2024-09-12T02:48:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.762+0000 7f58b0985640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac11b140 0x7f58ac114e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.762+0000 7f58b0985640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac11b140 0x7f58ac114e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57490/0 (socket says 172.21.15.100:57490) 2024-09-12T02:48:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.762+0000 7f58b0985640 1 -- 172.21.15.100:0/229937594 learned_addr learned my addr 172.21.15.100:0/229937594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.762+0000 7f58abfff640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 0x7f58ac11a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.762+0000 7f58ab7fe640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f58ac109830 0x7f58ac114930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.763+0000 7f58abfff640 1 -- 172.21.15.100:0/229937594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f58ac109830 msgr2=0x7f58ac114930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.763+0000 7f58abfff640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f58ac109830 0x7f58ac114930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.763+0000 7f58abfff640 1 -- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac11b140 msgr2=0x7f58ac114e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.763+0000 7f58abfff640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac11b140 0x7f58ac114e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.763+0000 7f58abfff640 1 -- 172.21.15.100:0/229937594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac1155c0 con 0x7f58ac109450 2024-09-12T02:48:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.764+0000 7f58abfff640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 0x7f58ac11a8b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009bf0 tx=0x7f58a4003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.766+0000 7f58a97fa640 1 -- 172.21.15.100:0/229937594 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4031660 con 0x7f58ac109450 2024-09-12T02:48:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.766+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac1bc130 con 0x7f58ac109450 2024-09-12T02:48:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.766+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac1bc580 con 0x7f58ac109450 2024-09-12T02:48:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.766+0000 7f58a97fa640 1 -- 172.21.15.100:0/229937594 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a4031800 con 0x7f58ac109450 2024-09-12T02:48:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.766+0000 7f58a97fa640 1 -- 172.21.15.100:0/229937594 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a402fa10 con 0x7f58ac109450 2024-09-12T02:48:17.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.769+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ac073b00 con 0x7f58ac109450 2024-09-12T02:48:17.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.771+0000 7f58a97fa640 1 -- 172.21.15.100:0/229937594 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f58a402fbb0 con 0x7f58ac109450 2024-09-12T02:48:17.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.772+0000 7f58a97fa640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f58940a2d90 0x7f58940a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.772+0000 7f58a97fa640 1 -- 172.21.15.100:0/229937594 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f58a40f04f0 con 0x7f58ac109450 2024-09-12T02:48:17.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.772+0000 7f58ab7fe640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f58940a2d90 0x7f58940a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.773+0000 7f58ab7fe640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f58940a2d90 0x7f58940a5250 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f58ac1160f0 tx=0x7f589c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:17.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:17.779+0000 7f58a97fa640 1 -- 172.21.15.100:0/229937594 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58a40bd3e0 con 0x7f58ac109450 2024-09-12T02:48:18.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.084+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58ac10d5c0 con 0x7f58ac109450 2024-09-12T02:48:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.085+0000 7f58a97fa640 1 -- 172.21.15.100:0/229937594 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f58a40bcce0 con 0x7f58ac109450 2024-09-12T02:48:18.085 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:48:18.086 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:48:18.086 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:48:18.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.088+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f58940a2d90 msgr2=0x7f58940a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:18.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.088+0000 7f58b23e8640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f58940a2d90 0x7f58940a5250 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f58ac1160f0 tx=0x7f589c009110 comp rx=0 tx=0).stop 2024-09-12T02:48:18.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.088+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 msgr2=0x7f58ac11a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:18.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.088+0000 7f58b23e8640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 0x7f58ac11a8b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009bf0 tx=0x7f58a4003f10 comp rx=0 tx=0).stop 2024-09-12T02:48:18.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 shutdown_connections 2024-09-12T02:48:18.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f58940a2d90 0x7f58940a5250 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:18.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac11b140 0x7f58ac114e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:18.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f58ac109830 0x7f58ac114930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:18.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 --2- 172.21.15.100:0/229937594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58ac109450 0x7f58ac11a8b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:18.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 >> 172.21.15.100:0/229937594 conn(0x7f58ac06e140 msgr2=0x7f58ac0722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:18.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 shutdown_connections 2024-09-12T02:48:18.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:18.089+0000 7f58b23e8640 1 -- 172.21.15.100:0/229937594 wait complete. 2024-09-12T02:48:18.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:48:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:18 smithi117 ceph-mon[34898]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 MiB/s wr, 727 op/s 2024-09-12T02:48:19.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:18 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/229937594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:18 smithi100 ceph-mon[31390]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 MiB/s wr, 727 op/s 2024-09-12T02:48:19.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:18 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/229937594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:18 smithi189 ceph-mon[35196]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 MiB/s wr, 727 op/s 2024-09-12T02:48:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:18 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/229937594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:19.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 -- 172.21.15.100:0/3823074696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 msgr2=0x7f93bc105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 --2- 172.21.15.100:0/3823074696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc105980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009cd0 tx=0x7f93b402a910 comp rx=0 tx=0).stop 2024-09-12T02:48:19.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 -- 172.21.15.100:0/3823074696 shutdown_connections 2024-09-12T02:48:19.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 --2- 172.21.15.100:0/3823074696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93bc105ec0 0x7f93bc106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 --2- 172.21.15.100:0/3823074696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc105980 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 --2- 172.21.15.100:0/3823074696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 0x7f93bc100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 -- 172.21.15.100:0/3823074696 >> 172.21.15.100:0/3823074696 conn(0x7f93bc0fc7d0 msgr2=0x7f93bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 -- 172.21.15.100:0/3823074696 shutdown_connections 2024-09-12T02:48:19.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 -- 172.21.15.100:0/3823074696 wait complete. 2024-09-12T02:48:19.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.797+0000 7f93c35fd640 1 Processor -- start 2024-09-12T02:48:19.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c35fd640 1 -- start start 2024-09-12T02:48:19.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c35fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 0x7f93bc1a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c35fd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc1a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c35fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93bc105ec0 0x7f93bc19e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c35fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc118660 con 0x7f93bc1008c0 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c35fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1184e0 con 0x7f93bc105ec0 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c35fd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1187e0 con 0x7f93bc1011e0 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c1399640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 0x7f93bc1a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc1a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc1a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35326/0 (socket says 172.21.15.100:35326) 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c1399640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 0x7f93bc1a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57510/0 (socket says 172.21.15.100:57510) 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 -- 172.21.15.100:0/386424103 learned_addr learned my addr 172.21.15.100:0/386424103 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c1b9a640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93bc105ec0 0x7f93bc19e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 -- 172.21.15.100:0/386424103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93bc105ec0 msgr2=0x7f93bc19e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93bc105ec0 0x7f93bc19e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 -- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 msgr2=0x7f93bc1a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 0x7f93bc1a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c0b98640 1 -- 172.21.15.100:0/386424103 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc19f0c0 con 0x7f93bc1011e0 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.798+0000 7f93c1399640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 0x7f93bc1a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.799+0000 7f93c0b98640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc1a4d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009ca0 tx=0x7f93b4031850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.799+0000 7f93b27fc640 1 -- 172.21.15.100:0/386424103 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4003b70 con 0x7f93bc1011e0 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.799+0000 7f93b27fc640 1 -- 172.21.15.100:0/386424103 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b4003d10 con 0x7f93bc1011e0 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.799+0000 7f93b27fc640 1 -- 172.21.15.100:0/386424103 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b402fbb0 con 0x7f93bc1011e0 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.799+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc19f350 con 0x7f93bc1011e0 2024-09-12T02:48:19.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.800+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc1ab6a0 con 0x7f93bc1011e0 2024-09-12T02:48:19.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.803+0000 7f93b27fc640 1 -- 172.21.15.100:0/386424103 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f93b402fd50 con 0x7f93bc1011e0 2024-09-12T02:48:19.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.805+0000 7f93b27fc640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f93a80a2cd0 0x7f93a80a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.805+0000 7f93b27fc640 1 -- 172.21.15.100:0/386424103 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f93b40f0400 con 0x7f93bc1011e0 2024-09-12T02:48:19.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.806+0000 7f93c1399640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f93a80a2cd0 0x7f93a80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.806+0000 7f93c1399640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f93a80a2cd0 0x7f93a80a5190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f93bc19fad0 tx=0x7f93b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 Processor -- start 2024-09-12T02:48:19.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 -- start start 2024-09-12T02:48:19.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdeb40 0x557b75cdd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75cdda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75ce8370 0x557b75cea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557b75c432f0 con 0x557b75ce8370 2024-09-12T02:48:19.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557b75beacf0 con 0x557b75cdd5d0 2024-09-12T02:48:19.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.807+0000 7f93c59d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557b75c3f2b0 con 0x557b75cdeb40 2024-09-12T02:48:19.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.808+0000 7f93c1b9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75ce8370 0x557b75cea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.808+0000 7f93c1b9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75ce8370 0x557b75cea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57524/0 (socket says 172.21.15.100:57524) 2024-09-12T02:48:19.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.808+0000 7f93c1b9a640 1 -- 172.21.15.100:0/229692991 learned_addr learned my addr 172.21.15.100:0/229692991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:19.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.808+0000 7f93c0b98640 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75cdda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.808+0000 7f93c1399640 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdeb40 0x557b75cdd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.809+0000 7f93c0b98640 1 -- 172.21.15.100:0/229692991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdeb40 msgr2=0x557b75cdd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:19.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.809+0000 7f93c0b98640 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdeb40 0x557b75cdd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.809+0000 7f93c0b98640 1 -- 172.21.15.100:0/229692991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75ce8370 msgr2=0x557b75cea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:19.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.809+0000 7f93c0b98640 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75ce8370 0x557b75cea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.809+0000 7f93c0b98640 1 -- 172.21.15.100:0/229692991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b75bcf3a0 con 0x557b75cdd5d0 2024-09-12T02:48:19.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.809+0000 7f93c0b98640 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75cdda10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005e30 tx=0x7f93b402f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e25462c49b17c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.809+0000 7f93a77fe640 1 -- 172.21.15.100:0/229692991 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b40d2070 con 0x557b75cdd5d0 2024-09-12T02:48:19.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.810+0000 7f93a77fe640 1 -- 172.21.15.100:0/229692991 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b40d5e50 con 0x557b75cdd5d0 2024-09-12T02:48:19.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.810+0000 7f93a77fe640 1 -- 172.21.15.100:0/229692991 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b40c5430 con 0x557b75cdd5d0 2024-09-12T02:48:19.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.811+0000 7f93c59d6740 1 -- 172.21.15.100:0/229692991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 msgr2=0x557b75cdda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.811+0000 7f93c59d6740 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75cdda10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005e30 tx=0x7f93b402f6b0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 -- 172.21.15.100:0/229692991 shutdown_connections 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75ce8370 0x557b75cea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75cdda10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 --2- 172.21.15.100:0/229692991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdeb40 0x557b75cdd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 -- 172.21.15.100:0/229692991 >> 172.21.15.100:0/229692991 conn(0x557b75ca6310 msgr2=0x557b75cd9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 -- 172.21.15.100:0/229692991 shutdown_connections 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 -- 172.21.15.100:0/229692991 wait complete. 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 -- start start 2024-09-12T02:48:19.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.812+0000 7f93c59d6740 1 Processor -- start 2024-09-12T02:48:19.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75ce8370 0x557b75ce5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c59d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557b75ceae30 con 0x557b75cdeb40 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c59d6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557b75bfe060 con 0x557b75ce8370 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c59d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557b75ceafb0 con 0x557b75cdd5d0 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c59d6740 10 client.0 _ll_register_callbacks cb 0x557b759518c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c1399640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c1399640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35350/0 (socket says 172.21.15.100:35350) 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.813+0000 7f93c1399640 1 -- 172.21.15.100:0/1915601283 learned_addr learned my addr 172.21.15.100:0/1915601283 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c0b98640 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c1399640 1 -- 172.21.15.100:0/1915601283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75ce8370 msgr2=0x557b75ce5810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c1399640 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75ce8370 0x557b75ce5810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c1399640 1 -- 172.21.15.100:0/1915601283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 msgr2=0x557b75ce5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c1399640 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c1399640 1 -- 172.21.15.100:0/1915601283 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b759b43c0 con 0x557b75cdd5d0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c0b98640 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93c1399640 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93b8003830 tx=0x7f93b8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bf408f0951e5767 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.814+0000 7f93a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.815+0000 7f93a4ff9640 1 -- 172.21.15.100:0/1915601283 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b802b060 con 0x557b75cdd5d0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.815+0000 7f93a4ff9640 1 -- 172.21.15.100:0/1915601283 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f93b800f690 con 0x557b75cdd5d0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.815+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b40d5e50 con 0x557b75cdd5d0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.815+0000 7f93a4ff9640 1 -- 172.21.15.100:0/1915601283 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f93b800f8d0 con 0x557b75cdd5d0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.815+0000 7f93c59d6740 10 client.26308 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.815+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b75cf68a0 con 0x557b75cdd5d0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.815+0000 7f93a4ff9640 1 -- 172.21.15.100:0/1915601283 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b40d5e50 con 0x557b75cdd5d0 2024-09-12T02:48:19.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93a4ff9640 1 -- 172.21.15.100:0/1915601283 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f93b801db50 con 0x557b75cdd5d0 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c59d6740 10 client.26308 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c59d6740 10 client.26308 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c59d6740 20 client.26308 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c59d6740 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75cf7d60 0x557b75cfa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c59d6740 4 client.26308 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b75c50860 con 0x557b75cf7d60 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c0b98640 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75cf7d60 0x557b75cfa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93a4ff9640 10 client.26308 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:48:19.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.816+0000 7f93c0b98640 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75cf7d60 0x557b75cfa150 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c8fa22a01822627 server_cookie=f1328f7d980e7c52 in_seq=0 out_seq=0 2024-09-12T02:48:19.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.817+0000 7f93a4ff9640 1 -- 172.21.15.100:0/1915601283 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b75c50860 con 0x557b75cf7d60 2024-09-12T02:48:19.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.817+0000 7f93a4ff9640 10 client.26308 handle_command_reply: tid=0 2024-09-12T02:48:19.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.817+0000 7f93c59d6740 1 client.26308 shutdown 2024-09-12T02:48:19.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.817+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdd5d0 msgr2=0x557b75ce7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.817+0000 7f93c59d6740 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93b8003830 tx=0x7f93b8004730 comp rx=0 tx=0).stop 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 shutdown_connections 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75cf7d60 0x557b75cfa150 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75ce8370 0x557b75ce5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 --2- 172.21.15.100:0/1915601283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 >> 172.21.15.100:0/1915601283 conn(0x557b75ca6310 msgr2=0x557b75cdf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93a4ff9640 0 client.26308 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 shutdown_connections 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 1 -- 172.21.15.100:0/1915601283 wait complete. 2024-09-12T02:48:19.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.818+0000 7f93c59d6740 20 client.26308 trim_cache size 0 max 16384 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 Processor -- start 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 -- start start 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 0x557b75ce0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c1399640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c1399640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34498/0 (socket says 172.21.15.100:34498) 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c1399640 1 -- 172.21.15.100:0/2897378016 learned_addr learned my addr 172.21.15.100:0/2897378016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1b6610 con 0x557b75cdeb40 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 -- 172.21.15.100:0/2897378016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1b3ee0 con 0x557b75cdd5d0 2024-09-12T02:48:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.842+0000 7f93c59d6740 1 -- 172.21.15.100:0/2897378016 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1b1d30 con 0x557b75ce8370 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c0b98640 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c1399640 1 -- 172.21.15.100:0/2897378016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 msgr2=0x557b75ce0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c1399640 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 0x557b75ce0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c1399640 1 -- 172.21.15.100:0/2897378016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 msgr2=0x557b75ce0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c1399640 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c1399640 1 -- 172.21.15.100:0/2897378016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b75ce5b80 con 0x557b75cdd5d0 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c0b98640 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.843+0000 7f93c1399640 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93b80263e0 tx=0x7f93b8009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f4f792457f765e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.846+0000 7f93a6ffd640 1 -- 172.21.15.100:0/2897378016 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b803e070 con 0x557b75cdd5d0 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.846+0000 7f93a6ffd640 1 -- 172.21.15.100:0/2897378016 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b80035f0 con 0x557b75cdd5d0 2024-09-12T02:48:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.846+0000 7f93a6ffd640 1 -- 172.21.15.100:0/2897378016 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b801d420 con 0x557b75cdd5d0 2024-09-12T02:48:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.847+0000 7f93c59d6740 1 -- 172.21.15.100:0/2897378016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 msgr2=0x557b75ce7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.847+0000 7f93c59d6740 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93b80263e0 tx=0x7f93b8009240 comp rx=0 tx=0).stop 2024-09-12T02:48:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.848+0000 7f93c59d6740 1 -- 172.21.15.100:0/2897378016 shutdown_connections 2024-09-12T02:48:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.848+0000 7f93c59d6740 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 0x557b75ce0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.848+0000 7f93c59d6740 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdeb40 0x557b75ce0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.848+0000 7f93c59d6740 1 --2- 172.21.15.100:0/2897378016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdd5d0 0x557b75ce7dd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.848+0000 7f93c59d6740 1 -- 172.21.15.100:0/2897378016 >> 172.21.15.100:0/2897378016 conn(0x557b75ca6310 msgr2=0x557b75cd4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.851+0000 7f93c59d6740 1 -- 172.21.15.100:0/2897378016 shutdown_connections 2024-09-12T02:48:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.852+0000 7f93c59d6740 1 -- 172.21.15.100:0/2897378016 wait complete. 2024-09-12T02:48:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.852+0000 7f93c59d6740 1 -- start start 2024-09-12T02:48:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.852+0000 7f93c59d6740 1 Processor -- start 2024-09-12T02:48:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.853+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdd5d0 0x557b75cf0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.853+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdeb40 0x557b75cf0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.853+0000 7f93c59d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 0x557b75ceb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.853+0000 7f93c59d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1b23a0 con 0x557b75cdd5d0 2024-09-12T02:48:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.854+0000 7f93c59d6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1b3810 con 0x557b75cdeb40 2024-09-12T02:48:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.854+0000 7f93c59d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1b2a70 con 0x557b75ce8370 2024-09-12T02:48:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.854+0000 7f93c59d6740 10 client.0 _ll_register_callbacks cb 0x7f93b8004100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:19.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.854+0000 7f93c1399640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdd5d0 0x557b75cf0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.854+0000 7f93c1399640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdd5d0 0x557b75cf0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57560/0 (socket says 172.21.15.100:57560) 2024-09-12T02:48:19.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.854+0000 7f93c1399640 1 -- 172.21.15.100:0/284293806 learned_addr learned my addr 172.21.15.100:0/284293806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:19.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.855+0000 7f93c1399640 1 -- 172.21.15.100:0/284293806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 msgr2=0x557b75ceb9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:48:19.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.855+0000 7f93c1399640 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 0x557b75ceb9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.855+0000 7f93c1399640 1 -- 172.21.15.100:0/284293806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdeb40 msgr2=0x557b75cf0980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:48:19.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.855+0000 7f93c1399640 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdeb40 0x557b75cf0980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.855+0000 7f93c1399640 1 -- 172.21.15.100:0/284293806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b75cec1f0 con 0x557b75cdd5d0 2024-09-12T02:48:19.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.856+0000 7f93c1399640 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdd5d0 0x557b75cf0440 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f93b803c040 tx=0x7f93b80265c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7d7f6008769aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.856+0000 7f93a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.856+0000 7f93a4ff9640 1 -- 172.21.15.100:0/284293806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b803e070 con 0x557b75cdd5d0 2024-09-12T02:48:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.856+0000 7f93a4ff9640 1 -- 172.21.15.100:0/284293806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f93b8009040 con 0x557b75cdd5d0 2024-09-12T02:48:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.857+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b80035f0 con 0x557b75cdd5d0 2024-09-12T02:48:19.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.858+0000 7f93a4ff9640 1 -- 172.21.15.100:0/284293806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f93b8005250 con 0x557b75cdd5d0 2024-09-12T02:48:19.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.858+0000 7f93c59d6740 10 client.17022 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.858+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b75d73660 con 0x557b75cdd5d0 2024-09-12T02:48:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93a4ff9640 1 -- 172.21.15.100:0/284293806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b80035f0 con 0x557b75cdd5d0 2024-09-12T02:48:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93a4ff9640 1 -- 172.21.15.100:0/284293806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f93b801d420 con 0x557b75cdd5d0 2024-09-12T02:48:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93c59d6740 10 client.17022 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93c59d6740 10 client.17022 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:48:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93c59d6740 20 client.17022 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93c59d6740 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75d73c70 0x557b75d76090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93c59d6740 4 client.17022 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:48:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.859+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b75c4ad70 con 0x557b75d73c70 2024-09-12T02:48:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.860+0000 7f93c0b98640 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75d73c70 0x557b75d76090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.860+0000 7f93a4ff9640 10 client.17022 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:48:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.860+0000 7f93c0b98640 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75d73c70 0x557b75d76090 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8cbf59cc9a45f687 server_cookie=192cb1aba5d6bb32 in_seq=0 out_seq=0 2024-09-12T02:48:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.861+0000 7f93a4ff9640 1 -- 172.21.15.100:0/284293806 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b75c4ad70 con 0x557b75d73c70 2024-09-12T02:48:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.861+0000 7f93a4ff9640 10 client.17022 handle_command_reply: tid=0 2024-09-12T02:48:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.861+0000 7f93c59d6740 1 client.17022 shutdown 2024-09-12T02:48:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.861+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdd5d0 msgr2=0x557b75cf0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.861+0000 7f93c59d6740 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdd5d0 0x557b75cf0440 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f93b803c040 tx=0x7f93b80265c0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 shutdown_connections 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x557b75d73c70 0x557b75d76090 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b75ce8370 0x557b75ceb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b75cdeb40 0x557b75cf0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 --2- 172.21.15.100:0/284293806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b75cdd5d0 0x557b75cf0440 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 >> 172.21.15.100:0/284293806 conn(0x557b75ca6310 msgr2=0x557b75cf2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93a4ff9640 0 client.17022 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 shutdown_connections 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 1 -- 172.21.15.100:0/284293806 wait complete. 2024-09-12T02:48:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.863+0000 7f93c59d6740 20 client.17022 trim_cache size 0 max 16384 2024-09-12T02:48:19.865 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:48:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f93a80a2cd0 msgr2=0x7f93a80a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f93a80a2cd0 0x7f93a80a5190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f93bc19fad0 tx=0x7f93b8005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 msgr2=0x7f93bc1a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc1a4d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009ca0 tx=0x7f93b4031850 comp rx=0 tx=0).stop 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 shutdown_connections 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f93a80a2cd0 0x7f93a80a5190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93bc105ec0 0x7f93bc19e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93bc1011e0 0x7f93bc1a4d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 --2- 172.21.15.100:0/386424103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc1008c0 0x7f93bc1a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 >> 172.21.15.100:0/386424103 conn(0x7f93bc0fc7d0 msgr2=0x7f93bc103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 shutdown_connections 2024-09-12T02:48:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:19.864+0000 7f93c35fd640 1 -- 172.21.15.100:0/386424103 wait complete. 2024-09-12T02:48:20.602 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:48:20.965 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:20 smithi100 ceph-mon[31390]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 835 op/s 2024-09-12T02:48:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:20 smithi117 ceph-mon[34898]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 835 op/s 2024-09-12T02:48:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:20 smithi189 ceph-mon[35196]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 835 op/s 2024-09-12T02:48:21.299 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 550.0 s, 3219.8 tps, lat 31.290 ms stddev 35.738 2024-09-12T02:48:21.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 -- 172.21.15.100:0/2440116967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c114ab0 msgr2=0x7f389c116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 --2- 172.21.15.100:0/2440116967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c114ab0 0x7f389c116ea0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3894009ca0 tx=0x7f389402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 -- 172.21.15.100:0/2440116967 shutdown_connections 2024-09-12T02:48:21.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 --2- 172.21.15.100:0/2440116967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c114ab0 0x7f389c116ea0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 --2- 172.21.15.100:0/2440116967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c109ba0 0x7f389c114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 --2- 172.21.15.100:0/2440116967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389c1091f0 0x7f389c1095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 -- 172.21.15.100:0/2440116967 >> 172.21.15.100:0/2440116967 conn(0x7f389c06e2d0 msgr2=0x7f389c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 -- 172.21.15.100:0/2440116967 shutdown_connections 2024-09-12T02:48:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.501+0000 7f38a179c640 1 -- 172.21.15.100:0/2440116967 wait complete. 2024-09-12T02:48:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 Processor -- start 2024-09-12T02:48:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 -- start start 2024-09-12T02:48:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c1091f0 0x7f389c10a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389c109ba0 0x7f389c10a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c114ab0 0x7f389c10ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f389c11a760 con 0x7f389c1091f0 2024-09-12T02:48:21.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f389c11a5e0 con 0x7f389c114ab0 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f38a179c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f389c11a8e0 con 0x7f389c109ba0 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.502+0000 7f389affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c1091f0 0x7f389c10a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c1091f0 0x7f389c10a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57572/0 (socket says 172.21.15.100:57572) 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 -- 172.21.15.100:0/1619986519 learned_addr learned my addr 172.21.15.100:0/1619986519 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f3893fff640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389c109ba0 0x7f389c10a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389b7fe640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c114ab0 0x7f389c10ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 -- 172.21.15.100:0/1619986519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389c109ba0 msgr2=0x7f389c10a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389c109ba0 0x7f389c10a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 -- 172.21.15.100:0/1619986519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c114ab0 msgr2=0x7f389c10ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c114ab0 0x7f389c10ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 -- 172.21.15.100:0/1619986519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c1aef30 con 0x7f389c1091f0 2024-09-12T02:48:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.503+0000 7f389affd640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c1091f0 0x7f389c10a3d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f388c00e9f0 tx=0x7f388c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.504+0000 7f3898ff9640 1 -- 172.21.15.100:0/1619986519 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c00cd80 con 0x7f389c1091f0 2024-09-12T02:48:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.504+0000 7f3898ff9640 1 -- 172.21.15.100:0/1619986519 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c005500 con 0x7f389c1091f0 2024-09-12T02:48:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.504+0000 7f3898ff9640 1 -- 172.21.15.100:0/1619986519 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c010690 con 0x7f389c1091f0 2024-09-12T02:48:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.504+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c1af220 con 0x7f389c1091f0 2024-09-12T02:48:21.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.504+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c1af6b0 con 0x7f389c1091f0 2024-09-12T02:48:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.508+0000 7f38a3b75740 1 Processor -- start 2024-09-12T02:48:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.508+0000 7f38a3b75740 1 -- start start 2024-09-12T02:48:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.508+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.509+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab197de0 0x55a8ab198220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.509+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab1adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.509+0000 7f38a3b75740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a8ab0f52f0 con 0x55a8ab193690 2024-09-12T02:48:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.509+0000 7f38a3b75740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a8ab09ccf0 con 0x55a8ab199350 2024-09-12T02:48:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.509+0000 7f38a3b75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a8ab0f12b0 con 0x55a8ab197de0 2024-09-12T02:48:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.510+0000 7f3893fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab1adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.510+0000 7f3893fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab1adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57588/0 (socket says 172.21.15.100:57588) 2024-09-12T02:48:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.510+0000 7f3893fff640 1 -- 172.21.15.100:0/3694671718 learned_addr learned my addr 172.21.15.100:0/3694671718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.511+0000 7f389affd640 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab197de0 0x55a8ab198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.511+0000 7f3893fff640 1 -- 172.21.15.100:0/3694671718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab197de0 msgr2=0x55a8ab198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.511+0000 7f3893fff640 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab197de0 0x55a8ab198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.511+0000 7f3893fff640 1 -- 172.21.15.100:0/3694671718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 msgr2=0x55a8ab1978a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:48:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.511+0000 7f3893fff640 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab1978a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.511+0000 7f3893fff640 1 -- 172.21.15.100:0/3694671718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ab0813a0 con 0x55a8ab193690 2024-09-12T02:48:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.512+0000 7f3893fff640 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab1adb40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3884009c10 tx=0x7f3884033820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a4308f904fd0db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.514+0000 7f38917fa640 1 -- 172.21.15.100:0/3694671718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884004250 con 0x55a8ab193690 2024-09-12T02:48:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.514+0000 7f38917fa640 1 -- 172.21.15.100:0/3694671718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38840043f0 con 0x55a8ab193690 2024-09-12T02:48:21.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.514+0000 7f38917fa640 1 -- 172.21.15.100:0/3694671718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388403b880 con 0x55a8ab193690 2024-09-12T02:48:21.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.517+0000 7f3898ff9640 1 -- 172.21.15.100:0/1619986519 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f388c0046c0 con 0x7f389c1091f0 2024-09-12T02:48:21.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.518+0000 7f3898ff9640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38880a2d50 0x7f38880a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.519+0000 7f3898ff9640 1 -- 172.21.15.100:0/1619986519 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f388c0d2730 con 0x7f389c1091f0 2024-09-12T02:48:21.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.520+0000 7f38a3b75740 1 -- 172.21.15.100:0/3694671718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 msgr2=0x55a8ab1adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.520+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab1adb40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3884009c10 tx=0x7f3884033820 comp rx=0 tx=0).stop 2024-09-12T02:48:21.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.524+0000 7f38a3b75740 1 -- 172.21.15.100:0/3694671718 shutdown_connections 2024-09-12T02:48:21.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.524+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab1adb40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.524+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab197de0 0x55a8ab198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.524+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3694671718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.524+0000 7f38a3b75740 1 -- 172.21.15.100:0/3694671718 >> 172.21.15.100:0/3694671718 conn(0x55a8ab158310 msgr2=0x55a8ab194470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:21.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.524+0000 7f389b7fe640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38880a2d50 0x7f38880a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.528+0000 7f38a3b75740 1 -- 172.21.15.100:0/3694671718 shutdown_connections 2024-09-12T02:48:21.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.529+0000 7f389b7fe640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38880a2d50 0x7f38880a5210 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3894005fa0 tx=0x7f3894005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.529+0000 7f38a3b75740 1 -- 172.21.15.100:0/3694671718 wait complete. 2024-09-12T02:48:21.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.529+0000 7f38a3b75740 1 -- start start 2024-09-12T02:48:21.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.529+0000 7f38a3b75740 1 Processor -- start 2024-09-12T02:48:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab193690 0x55a8ab19b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab19b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f38a3b75740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a8ab19ab80 con 0x55a8ab197de0 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f38a3b75740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a8ab0b0060 con 0x55a8ab199350 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f38a3b75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a8ab19ad00 con 0x55a8ab193690 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f3893fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f3893fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab19b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57594/0 (socket says 172.21.15.100:57594) 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f3893fff640 1 -- 172.21.15.100:0/2948615967 learned_addr learned my addr 172.21.15.100:0/2948615967 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.532+0000 7f38a3b75740 10 client.0 _ll_register_callbacks cb 0x55a8aae038c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.533+0000 7f389affd640 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab193690 0x55a8ab19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.534+0000 7f389b7fe640 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.536+0000 7f389b7fe640 1 -- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab193690 msgr2=0x55a8ab19b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.536+0000 7f389b7fe640 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab193690 0x55a8ab19b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.536+0000 7f389b7fe640 1 -- 172.21.15.100:0/2948615967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 msgr2=0x55a8ab19b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.536+0000 7f389b7fe640 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab19b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.536+0000 7f389b7fe640 1 -- 172.21.15.100:0/2948615967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8aae663c0 con 0x55a8ab199350 2024-09-12T02:48:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.538+0000 7f389b7fe640 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab19bab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3894009bf0 tx=0x7f389402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f916f92ac22ebf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.538+0000 7f38827fc640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:48:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.539+0000 7f38827fc640 1 -- 172.21.15.100:0/2948615967 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389402f7d0 con 0x55a8ab199350 2024-09-12T02:48:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.539+0000 7f38827fc640 1 -- 172.21.15.100:0/2948615967 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f389402f970 con 0x55a8ab199350 2024-09-12T02:48:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.539+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38840043f0 con 0x55a8ab199350 2024-09-12T02:48:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.541+0000 7f38827fc640 1 -- 172.21.15.100:0/2948615967 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f389402fb70 con 0x55a8ab199350 2024-09-12T02:48:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.542+0000 7f38a3b75740 10 client.26372 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.542+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8ab1a8b00 con 0x55a8ab199350 2024-09-12T02:48:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.545+0000 7f38827fc640 1 -- 172.21.15.100:0/2948615967 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38840043f0 con 0x55a8ab199350 2024-09-12T02:48:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.545+0000 7f38827fc640 1 -- 172.21.15.100:0/2948615967 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3894051640 con 0x55a8ab199350 2024-09-12T02:48:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.546+0000 7f38a3b75740 10 client.26372 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.546+0000 7f38a3b75740 10 client.26372 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:48:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.546+0000 7f38a3b75740 20 client.26372 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.546+0000 7f38a3b75740 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab1a9f90 0x55a8ab1ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.546+0000 7f38a3b75740 4 client.26372 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.546+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8ab102860 con 0x55a8ab1a9f90 2024-09-12T02:48:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.547+0000 7f389affd640 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab1a9f90 0x55a8ab1ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.548+0000 7f389affd640 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab1a9f90 0x55a8ab1ac3f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c88bfd4a1b177397 server_cookie=596f1c6235a5fe4f in_seq=0 out_seq=0 2024-09-12T02:48:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.548+0000 7f38827fc640 10 client.26372 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:48:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.554+0000 7f38827fc640 1 -- 172.21.15.100:0/2948615967 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8ab102860 con 0x55a8ab1a9f90 2024-09-12T02:48:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.554+0000 7f38827fc640 10 client.26372 handle_command_reply: tid=0 2024-09-12T02:48:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.554+0000 7f38a3b75740 1 client.26372 shutdown 2024-09-12T02:48:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.557+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 msgr2=0x55a8ab19bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.557+0000 7f38a3b75740 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab19bab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3894009bf0 tx=0x7f389402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 shutdown_connections 2024-09-12T02:48:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38a3b75740 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab1a9f90 0x55a8ab1ac3f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38a3b75740 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab199350 0x55a8ab19bab0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38a3b75740 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab19b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38a3b75740 1 --2- 172.21.15.100:0/2948615967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab193690 0x55a8ab19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 >> 172.21.15.100:0/2948615967 conn(0x55a8ab158310 msgr2=0x55a8ab19a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38827fc640 0 client.26372 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:48:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.559+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 shutdown_connections 2024-09-12T02:48:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.560+0000 7f38a3b75740 1 -- 172.21.15.100:0/2948615967 wait complete. 2024-09-12T02:48:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.560+0000 7f38a3b75740 20 client.26372 trim_cache size 0 max 16384 2024-09-12T02:48:21.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 Processor -- start 2024-09-12T02:48:21.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 -- start start 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab197de0 0x55a8ab1a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab1a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f387c010e50 con 0x55a8ab193690 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f387c00e720 con 0x55a8ab197de0 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.581+0000 7f38a3b75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f387c00c570 con 0x55a8ab199350 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57598/0 (socket says 172.21.15.100:57598) 2024-09-12T02:48:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 -- 172.21.15.100:0/3618014538 learned_addr learned my addr 172.21.15.100:0/3618014538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f3893fff640 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab197de0 0x55a8ab1a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389b7fe640 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab1a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 -- 172.21.15.100:0/3618014538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 msgr2=0x55a8ab1a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab1a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 -- 172.21.15.100:0/3618014538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab197de0 msgr2=0x55a8ab1a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab197de0 0x55a8ab1a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 -- 172.21.15.100:0/3618014538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ab1a5ee0 con 0x55a8ab193690 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f3893fff640 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab197de0 0x55a8ab1a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f389affd640 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab19b6c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f388c09b8d0 tx=0x7f388c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d6887859d981b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f3890ff9640 1 -- 172.21.15.100:0/3618014538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0b7030 con 0x55a8ab193690 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f3890ff9640 1 -- 172.21.15.100:0/3618014538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c09f600 con 0x55a8ab193690 2024-09-12T02:48:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.582+0000 7f3890ff9640 1 -- 172.21.15.100:0/3618014538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c09b570 con 0x55a8ab193690 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 -- 172.21.15.100:0/3618014538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 msgr2=0x55a8ab19b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab19b6c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f388c09b8d0 tx=0x7f388c021000 comp rx=0 tx=0).stop 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 -- 172.21.15.100:0/3618014538 shutdown_connections 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab1a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab197de0 0x55a8ab1a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3618014538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab193690 0x55a8ab19b6c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 -- 172.21.15.100:0/3618014538 >> 172.21.15.100:0/3618014538 conn(0x55a8ab158310 msgr2=0x55a8ab19afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 -- 172.21.15.100:0/3618014538 shutdown_connections 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.583+0000 7f38a3b75740 1 -- 172.21.15.100:0/3618014538 wait complete. 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 -- start start 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 Processor -- start 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab193690 0x55a8ab1a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab1a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab212ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f387c00cbe0 con 0x55a8ab197de0 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f387c00e050 con 0x55a8ab193690 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f387c00d2b0 con 0x55a8ab199350 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.584+0000 7f38a3b75740 10 client.0 _ll_register_callbacks cb 0x7f388c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab212ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab212ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35422/0 (socket says 172.21.15.100:35422) 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 -- 172.21.15.100:0/3060139127 learned_addr learned my addr 172.21.15.100:0/3060139127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389affd640 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab193690 0x55a8ab1a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 -- 172.21.15.100:0/3060139127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab193690 msgr2=0x55a8ab1a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab193690 0x55a8ab1a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 -- 172.21.15.100:0/3060139127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 msgr2=0x55a8ab1a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab1a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 -- 172.21.15.100:0/3060139127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ab213220 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f389b7fe640 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab212ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3894051a60 tx=0x7f3894052e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6aea0142aa6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f38827fc640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.585+0000 7f38827fc640 1 -- 172.21.15.100:0/3060139127 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894004d40 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.586+0000 7f38827fc640 1 -- 172.21.15.100:0/3060139127 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f389402f5d0 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.586+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f388c09f600 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.586+0000 7f38827fc640 1 -- 172.21.15.100:0/3060139127 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f389402f7d0 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.586+0000 7f38a3b75740 10 client.26323 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.586+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8ab2144c0 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38827fc640 1 -- 172.21.15.100:0/3060139127 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c09f600 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38827fc640 1 -- 172.21.15.100:0/3060139127 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3894004040 con 0x55a8ab199350 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38a3b75740 10 client.26323 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38a3b75740 10 client.26323 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38a3b75740 20 client.26323 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab214ba0 0x55a8ab216fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38a3b75740 4 client.26323 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:48:21.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8ab0fcd70 con 0x55a8ab214ba0 2024-09-12T02:48:21.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.587+0000 7f389affd640 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab214ba0 0x55a8ab216fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.589+0000 7f38827fc640 10 client.26323 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.589+0000 7f389affd640 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab214ba0 0x55a8ab216fe0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=745cdeab28cb9e08 server_cookie=f5adc2146e8e6591 in_seq=0 out_seq=0 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.589+0000 7f38827fc640 1 -- 172.21.15.100:0/3060139127 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8ab0fcd70 con 0x55a8ab214ba0 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.589+0000 7f38827fc640 10 client.26323 handle_command_reply: tid=0 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.589+0000 7f38a3b75740 1 client.26323 shutdown 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.589+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 msgr2=0x55a8ab212ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.589+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab212ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3894051a60 tx=0x7f3894052e90 comp rx=0 tx=0).stop 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 shutdown_connections 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55a8ab214ba0 0x55a8ab216fe0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8ab199350 0x55a8ab212ce0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8ab197de0 0x55a8ab1a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 --2- 172.21.15.100:0/3060139127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8ab193690 0x55a8ab1a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 >> 172.21.15.100:0/3060139127 conn(0x55a8ab158310 msgr2=0x55a8ab19a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:21.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38827fc640 0 client.26323 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:48:21.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 shutdown_connections 2024-09-12T02:48:21.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 1 -- 172.21.15.100:0/3060139127 wait complete. 2024-09-12T02:48:21.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.590+0000 7f38a3b75740 20 client.26323 trim_cache size 0 max 16384 2024-09-12T02:48:21.597 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38880a2d50 msgr2=0x7f38880a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38880a2d50 0x7f38880a5210 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3894005fa0 tx=0x7f3894005ef0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c1091f0 msgr2=0x7f389c10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c1091f0 0x7f389c10a3d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f388c00e9f0 tx=0x7f388c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 shutdown_connections 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38880a2d50 0x7f38880a5210 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c114ab0 0x7f389c10ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389c109ba0 0x7f389c10a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 --2- 172.21.15.100:0/1619986519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f389c1091f0 0x7f389c10a3d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 >> 172.21.15.100:0/1619986519 conn(0x7f389c06e2d0 msgr2=0x7f389c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 shutdown_connections 2024-09-12T02:48:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:21.592+0000 7f38a179c640 1 -- 172.21.15.100:0/1619986519 wait complete. 2024-09-12T02:48:21.901 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-12T02:48:21.902 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.55 2024-09-12T02:48:21.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:48:22.552 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:48:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:23.065 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:22 smithi100 ceph-mon[31390]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-12T02:48:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:22 smithi117 ceph-mon[34898]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-12T02:48:23.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.173+0000 7f2c075a6640 1 -- 172.21.15.100:0/2872276711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c00102d30 msgr2=0x7f2c00103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.173+0000 7f2c075a6640 1 --2- 172.21.15.100:0/2872276711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c00102d30 0x7f2c00103110 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009930 tx=0x7f2bfc02a420 comp rx=0 tx=0).stop 2024-09-12T02:48:23.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.175+0000 7f2c075a6640 1 -- 172.21.15.100:0/2872276711 shutdown_connections 2024-09-12T02:48:23.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.175+0000 7f2c075a6640 1 --2- 172.21.15.100:0/2872276711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c001082a0 0x7f2c0010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.175+0000 7f2c075a6640 1 --2- 172.21.15.100:0/2872276711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c001036e0 0x7f2c00107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.175+0000 7f2c075a6640 1 --2- 172.21.15.100:0/2872276711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c00102d30 0x7f2c00103110 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.175+0000 7f2c075a6640 1 -- 172.21.15.100:0/2872276711 >> 172.21.15.100:0/2872276711 conn(0x7f2c000fc7d0 msgr2=0x7f2c000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.177+0000 7f2c075a6640 1 -- 172.21.15.100:0/2872276711 shutdown_connections 2024-09-12T02:48:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.177+0000 7f2c075a6640 1 -- 172.21.15.100:0/2872276711 wait complete. 2024-09-12T02:48:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.178+0000 7f2c075a6640 1 Processor -- start 2024-09-12T02:48:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.178+0000 7f2c075a6640 1 -- start start 2024-09-12T02:48:23.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c075a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102d30 0x7f2c00100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c075a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c001036e0 0x7f2c00100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c075a6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c001082a0 0x7f2c00101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c075a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001120f0 con 0x7f2c001036e0 2024-09-12T02:48:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c075a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00111f70 con 0x7f2c00102d30 2024-09-12T02:48:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c075a6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00112270 con 0x7f2c001082a0 2024-09-12T02:48:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c05342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102d30 0x7f2c00100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c05342640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102d30 0x7f2c00100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34586/0 (socket says 172.21.15.100:34586) 2024-09-12T02:48:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c05342640 1 -- 172.21.15.100:0/246559923 learned_addr learned my addr 172.21.15.100:0/246559923 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.179+0000 7f2c05b43640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c001082a0 0x7f2c00101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c05b43640 1 -- 172.21.15.100:0/246559923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102d30 msgr2=0x7f2c00100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c05b43640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102d30 0x7f2c00100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c05b43640 1 -- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c001036e0 msgr2=0x7f2c00100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c05b43640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c001036e0 0x7f2c00100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c05b43640 1 -- 172.21.15.100:0/246559923 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c001a6b30 con 0x7f2c001082a0 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c05b43640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c001082a0 0x7f2c00101410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009fd0 tx=0x7f2bf800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2bf67fc640 1 -- 172.21.15.100:0/246559923 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800ce20 con 0x7f2c001082a0 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2bf67fc640 1 -- 172.21.15.100:0/246559923 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bf8005020 con 0x7f2c001082a0 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c001a6e20 con 0x7f2c001082a0 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2bf67fc640 1 -- 172.21.15.100:0/246559923 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8010720 con 0x7f2c001082a0 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.180+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c001a7380 con 0x7f2c001082a0 2024-09-12T02:48:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.182+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0006a850 con 0x7f2c001082a0 2024-09-12T02:48:23.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.183+0000 7f2bf67fc640 1 -- 172.21.15.100:0/246559923 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2bf8005540 con 0x7f2c001082a0 2024-09-12T02:48:23.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.183+0000 7f2bf67fc640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2bec0a2c00 0x7f2bec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.184+0000 7f2bf67fc640 1 -- 172.21.15.100:0/246559923 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2bf80cf5c0 con 0x7f2c001082a0 2024-09-12T02:48:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.184+0000 7f2c05342640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2bec0a2c00 0x7f2bec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.185+0000 7f2c05342640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2bec0a2c00 0x7f2bec0a50c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0096c0 tx=0x7f2bfc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.188+0000 7f2bf67fc640 1 -- 172.21.15.100:0/246559923 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bf809c510 con 0x7f2c001082a0 2024-09-12T02:48:23.238 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:22 smithi189 ceph-mon[35196]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-12T02:48:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.520+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c00103110 con 0x7f2c001082a0 2024-09-12T02:48:23.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.521+0000 7f2bf67fc640 1 -- 172.21.15.100:0/246559923 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f2bf809be10 con 0x7f2c001082a0 2024-09-12T02:48:23.522 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:48:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:48:23.522 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:48:23.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2bec0a2c00 msgr2=0x7f2bec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2bec0a2c00 0x7f2bec0a50c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0096c0 tx=0x7f2bfc031400 comp rx=0 tx=0).stop 2024-09-12T02:48:23.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c001082a0 msgr2=0x7f2c00101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c001082a0 0x7f2c00101410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009fd0 tx=0x7f2bf800ef10 comp rx=0 tx=0).stop 2024-09-12T02:48:23.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 shutdown_connections 2024-09-12T02:48:23.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2bec0a2c00 0x7f2bec0a50c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c001082a0 0x7f2c00101410 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c001036e0 0x7f2c00100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 --2- 172.21.15.100:0/246559923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102d30 0x7f2c00100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.523+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 >> 172.21.15.100:0/246559923 conn(0x7f2c000fc7d0 msgr2=0x7f2c00106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.524+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 shutdown_connections 2024-09-12T02:48:23.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.524+0000 7f2c075a6640 1 -- 172.21.15.100:0/246559923 wait complete. 2024-09-12T02:48:23.947 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:23 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/246559923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:23.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.949+0000 7f130958c640 1 -- 172.21.15.100:0/2801950298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304100a70 msgr2=0x7f1304100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.949+0000 7f130958c640 1 --2- 172.21.15.100:0/2801950298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304100a70 0x7f1304100ed0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009930 tx=0x7f12ec02a420 comp rx=0 tx=0).stop 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.950+0000 7f130958c640 1 -- 172.21.15.100:0/2801950298 shutdown_connections 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.950+0000 7f130958c640 1 --2- 172.21.15.100:0/2801950298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1304101410 0x7f130410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.950+0000 7f130958c640 1 --2- 172.21.15.100:0/2801950298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304100a70 0x7f1304100ed0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.950+0000 7f130958c640 1 --2- 172.21.15.100:0/2801950298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1304106a70 0x7f1304106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.950+0000 7f130958c640 1 -- 172.21.15.100:0/2801950298 >> 172.21.15.100:0/2801950298 conn(0x7f13040fc7d0 msgr2=0x7f13040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.950+0000 7f130958c640 1 -- 172.21.15.100:0/2801950298 shutdown_connections 2024-09-12T02:48:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.950+0000 7f130958c640 1 -- 172.21.15.100:0/2801950298 wait complete. 2024-09-12T02:48:23.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 Processor -- start 2024-09-12T02:48:23.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 -- start start 2024-09-12T02:48:23.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1304100a70 0x7f130419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304101410 0x7f130419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1304106a70 0x7f130419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1304110ee0 con 0x7f1304101410 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1304110d60 con 0x7f1304100a70 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f130958c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1304111060 con 0x7f1304106a70 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304101410 0x7f130419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f1302ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1304100a70 0x7f130419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304101410 0x7f130419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57634/0 (socket says 172.21.15.100:57634) 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f12fbfff640 1 -- 172.21.15.100:0/870852110 learned_addr learned my addr 172.21.15.100:0/870852110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.951+0000 7f13037fe640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1304106a70 0x7f130419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1302ffd640 1 -- 172.21.15.100:0/870852110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1304106a70 msgr2=0x7f130419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1302ffd640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1304106a70 0x7f130419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1302ffd640 1 -- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304101410 msgr2=0x7f130419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1302ffd640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304101410 0x7f130419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1302ffd640 1 -- 172.21.15.100:0/870852110 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130419f4c0 con 0x7f1304100a70 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f13037fe640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1304106a70 0x7f130419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1302ffd640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1304100a70 0x7f130419a510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12f400b3f0 tx=0x7f12f400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1300ff9640 1 -- 172.21.15.100:0/870852110 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4015020 con 0x7f1304100a70 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1300ff9640 1 -- 172.21.15.100:0/870852110 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12f4011d10 con 0x7f1304100a70 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130419f7b0 con 0x7f1304100a70 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f1300ff9640 1 -- 172.21.15.100:0/870852110 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f400f2e0 con 0x7f1304100a70 2024-09-12T02:48:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.952+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13041a7090 con 0x7f1304100a70 2024-09-12T02:48:23.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 Processor -- start 2024-09-12T02:48:23.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f1300ff9640 1 -- 172.21.15.100:0/870852110 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f12f4018020 con 0x7f1304100a70 2024-09-12T02:48:23.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 -- start start 2024-09-12T02:48:23.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823cbb40 0x5559823ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823d5370 0x5559823d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5559823302f0 con 0x5559823ca5d0 2024-09-12T02:48:23.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5559822d7cf0 con 0x5559823d5370 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f130b965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55598232c2b0 con 0x5559823cbb40 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823d5370 0x5559823d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.956+0000 7f13037fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823cbb40 0x5559823ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823d5370 0x5559823d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34622/0 (socket says 172.21.15.100:34622) 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f13037fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823cbb40 0x5559823ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35458/0 (socket says 172.21.15.100:35458) 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 -- 172.21.15.100:0/2236633399 learned_addr learned my addr 172.21.15.100:0/2236633399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f1302ffd640 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 -- 172.21.15.100:0/2236633399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823cbb40 msgr2=0x5559823ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823cbb40 0x5559823ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 -- 172.21.15.100:0/2236633399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 msgr2=0x5559823caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 -- 172.21.15.100:0/2236633399 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559822bc3a0 con 0x5559823d5370 2024-09-12T02:48:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f1300ff9640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12f00a2c00 0x7f12f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823d5370 0x5559823d7760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f12ec005eb0 tx=0x7f12ec000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56f4a66e540fe12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f13037fe640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12f00a2c00 0x7f12f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12f97fa640 1 -- 172.21.15.100:0/2236633399 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec040070 con 0x5559823d5370 2024-09-12T02:48:23.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12f97fa640 1 -- 172.21.15.100:0/2236633399 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12ec003ad0 con 0x5559823d5370 2024-09-12T02:48:23.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f12f97fa640 1 -- 172.21.15.100:0/2236633399 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec035040 con 0x5559823d5370 2024-09-12T02:48:23.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.957+0000 7f1300ff9640 1 -- 172.21.15.100:0/870852110 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f12f40ce830 con 0x7f1304100a70 2024-09-12T02:48:23.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 -- 172.21.15.100:0/2236633399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823d5370 msgr2=0x5559823d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823d5370 0x5559823d7760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f12ec005eb0 tx=0x7f12ec000bc0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f13037fe640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12f00a2c00 0x7f12f00a50c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005fd0 tx=0x7f12fc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 -- 172.21.15.100:0/2236633399 shutdown_connections 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823d5370 0x5559823d7760 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 --2- 172.21.15.100:0/2236633399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823cbb40 0x5559823ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 -- 172.21.15.100:0/2236633399 >> 172.21.15.100:0/2236633399 conn(0x555982393310 msgr2=0x5559823c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 -- 172.21.15.100:0/2236633399 shutdown_connections 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.958+0000 7f130b965740 1 -- 172.21.15.100:0/2236633399 wait complete. 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 -- start start 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 Processor -- start 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823d4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5559823d8010 con 0x5559823d5370 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5559822eb060 con 0x5559823cbb40 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5559823d8190 con 0x5559823ca5d0 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.959+0000 7f130b965740 10 client.0 _ll_register_callbacks cb 0x55598203e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57654/0 (socket says 172.21.15.100:57654) 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 -- 172.21.15.100:0/2197918460 learned_addr learned my addr 172.21.15.100:0/2197918460 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f1302ffd640 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823d4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 -- 172.21.15.100:0/2197918460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 msgr2=0x5559823d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823d4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 -- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 msgr2=0x5559823d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.960+0000 7f13037fe640 1 -- 172.21.15.100:0/2197918460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559820a13c0 con 0x5559823d5370 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.961+0000 7f13037fe640 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d2530 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f12fc010bb0 tx=0x7f12fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b19d7836ec1ea25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.961+0000 7f12ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.961+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2197918460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc02c060 con 0x5559823d5370 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.961+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2197918460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f12fc017030 con 0x5559823d5370 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.961+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12ec003ad0 con 0x5559823d5370 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.961+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2197918460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f12fc01fe00 con 0x5559823d5370 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 10 client.17052 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5559823ec330 con 0x5559823d5370 2024-09-12T02:48:23.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2197918460 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12fc0278f0 con 0x5559823d5370 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2197918460 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f12fc0327f0 con 0x5559823d5370 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 10 client.17052 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 20 client.17052 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5559823ed7f0 0x5559823efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 4 client.17052 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.962+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f12ec003ad0 con 0x5559823ed7f0 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.963+0000 7f1302ffd640 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5559823ed7f0 0x5559823efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.963+0000 7f12ea7fc640 10 client.17052 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:23.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.963+0000 7f1302ffd640 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5559823ed7f0 0x5559823efbe0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99396b0aac61fae5 server_cookie=8c16343d5b28ed84 in_seq=0 out_seq=0 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2197918460 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f12ec003ad0 con 0x5559823ed7f0 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f12ea7fc640 10 client.17052 handle_command_reply: tid=0 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 client.17052 shutdown 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 msgr2=0x5559823d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d2530 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f12fc010bb0 tx=0x7f12fc004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 shutdown_connections 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5559823ed7f0 0x5559823efbe0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d2530 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 --2- 172.21.15.100:0/2197918460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823d4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 >> 172.21.15.100:0/2197918460 conn(0x555982393310 msgr2=0x5559823cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f12ea7fc640 0 client.17052 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:23.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 shutdown_connections 2024-09-12T02:48:23.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 1 -- 172.21.15.100:0/2197918460 wait complete. 2024-09-12T02:48:23.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.964+0000 7f130b965740 20 client.17052 trim_cache size 0 max 16384 2024-09-12T02:48:23.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.980+0000 7f130b965740 1 Processor -- start 2024-09-12T02:48:23.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.980+0000 7f130b965740 1 -- start start 2024-09-12T02:48:23.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f130b965740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f130b965740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823f5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f130b965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823d5370 0x5559823f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f130b965740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13041ade20 con 0x5559823ca5d0 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f130b965740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f13041ab6f0 con 0x5559823cbb40 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f130b965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13041a9580 con 0x5559823d5370 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823f5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:34642/0 (socket says 172.21.15.100:34642) 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 -- 172.21.15.100:0/1702163020 learned_addr learned my addr 172.21.15.100:0/1702163020 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f1302ffd640 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f13037fe640 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823d5370 0x5559823f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 -- 172.21.15.100:0/1702163020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823d5370 msgr2=0x5559823f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823d5370 0x5559823f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 -- 172.21.15.100:0/1702163020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 msgr2=0x5559823e12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823e12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 -- 172.21.15.100:0/1702163020 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559823d48b0 con 0x5559823cbb40 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f1302ffd640 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.981+0000 7f12fbfff640 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823f5490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00b230 tx=0x7f12ec005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cec066cc38518d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.982+0000 7f12f8ff9640 1 -- 172.21.15.100:0/1702163020 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec040070 con 0x5559823cbb40 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.982+0000 7f12f8ff9640 1 -- 172.21.15.100:0/1702163020 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12ec005520 con 0x5559823cbb40 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.982+0000 7f12f8ff9640 1 -- 172.21.15.100:0/1702163020 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec035040 con 0x5559823cbb40 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.982+0000 7f130b965740 1 -- 172.21.15.100:0/1702163020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 msgr2=0x5559823f5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.982+0000 7f130b965740 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823f5490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00b230 tx=0x7f12ec005fd0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 -- 172.21.15.100:0/1702163020 shutdown_connections 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823d5370 0x5559823f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823f5490 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 --2- 172.21.15.100:0/1702163020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823ca5d0 0x5559823e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 -- 172.21.15.100:0/1702163020 >> 172.21.15.100:0/1702163020 conn(0x555982393310 msgr2=0x5559823d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 -- 172.21.15.100:0/1702163020 shutdown_connections 2024-09-12T02:48:23.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 -- 172.21.15.100:0/1702163020 wait complete. 2024-09-12T02:48:23.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 -- start start 2024-09-12T02:48:23.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.983+0000 7f130b965740 1 Processor -- start 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f130b965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823ddbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f130b965740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f130b965740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f130b965740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13041a9bd0 con 0x5559823d5370 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f130b965740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f13041ab020 con 0x5559823cbb40 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f130b965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13041aa280 con 0x5559823ca5d0 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f130b965740 10 client.0 _ll_register_callbacks cb 0x7f12fc009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823ddbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823ddbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35472/0 (socket says 172.21.15.100:35472) 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 -- 172.21.15.100:0/2861954901 learned_addr learned my addr 172.21.15.100:0/2861954901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f13037fe640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 -- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 msgr2=0x5559823d8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 -- 172.21.15.100:0/2861954901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 msgr2=0x5559823d9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f1302ffd640 1 -- 172.21.15.100:0/2861954901 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559823d9c80 con 0x5559823ca5d0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.984+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f1302ffd640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823ddbc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f12f40cc690 tx=0x7f12f40bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862a341c60dfb941 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f12ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2861954901 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f40a3cf0 con 0x5559823ca5d0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2861954901 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f12f4099380 con 0x5559823ca5d0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12ec005520 con 0x5559823ca5d0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2861954901 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f12f40b4020 con 0x5559823ca5d0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f130b965740 10 client.26344 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.985+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555982458490 con 0x5559823ca5d0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2861954901 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12ec005520 con 0x5559823ca5d0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2861954901 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f12f40cece0 con 0x5559823ca5d0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f130b965740 10 client.26344 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f130b965740 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f130b965740 20 client.26344 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f130b965740 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555982458b60 0x55598245af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f130b965740 4 client.26344 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55598233d860 con 0x555982458b60 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555982458b60 0x55598245af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.986+0000 7f12ea7fc640 10 client.26344 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f12fbfff640 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555982458b60 0x55598245af50 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a4c435be0a187a server_cookie=d1b4351455443d05 in_seq=0 out_seq=0 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f12ea7fc640 1 -- 172.21.15.100:0/2861954901 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55598233d860 con 0x555982458b60 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f12ea7fc640 10 client.26344 handle_command_reply: tid=0 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 client.26344 shutdown 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 msgr2=0x5559823ddbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823ddbc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f12f40cc690 tx=0x7f12f40bb040 comp rx=0 tx=0).stop 2024-09-12T02:48:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 shutdown_connections 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555982458b60 0x55598245af50 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559823d5370 0x5559823d9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5559823cbb40 0x5559823d8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f12ea7fc640 0 client.26344 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 --2- 172.21.15.100:0/2861954901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559823ca5d0 0x5559823ddbc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 >> 172.21.15.100:0/2861954901 conn(0x555982393310 msgr2=0x5559823cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 shutdown_connections 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 1 -- 172.21.15.100:0/2861954901 wait complete. 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.987+0000 7f130b965740 20 client.26344 trim_cache size 0 max 16384 2024-09-12T02:48:23.995 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:48:23.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12f00a2c00 msgr2=0x7f12f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12f00a2c00 0x7f12f00a50c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005fd0 tx=0x7f12fc009500 comp rx=0 tx=0).stop 2024-09-12T02:48:23.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1304100a70 msgr2=0x7f130419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1304100a70 0x7f130419a510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12f400b3f0 tx=0x7f12f400b8b0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 shutdown_connections 2024-09-12T02:48:23.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f12f00a2c00 0x7f12f00a50c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1304106a70 0x7f130419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1304101410 0x7f130419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 --2- 172.21.15.100:0/870852110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1304100a70 0x7f130419a510 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 >> 172.21.15.100:0/870852110 conn(0x7f13040fc7d0 msgr2=0x7f130406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 shutdown_connections 2024-09-12T02:48:23.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:23.991+0000 7f130958c640 1 -- 172.21.15.100:0/870852110 wait complete. 2024-09-12T02:48:24.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:23 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/246559923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:24.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:23 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/246559923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:24.707 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0' 2024-09-12T02:48:24.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0 2024-09-12T02:48:24.972 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:24 smithi100 ceph-mon[31390]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 791 op/s 2024-09-12T02:48:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:24 smithi189 ceph-mon[35196]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 791 op/s 2024-09-12T02:48:25.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:24 smithi117 ceph-mon[34898]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 791 op/s 2024-09-12T02:48:25.594 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:25.974 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:25 smithi100 ceph-mon[31390]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 697 op/s 2024-09-12T02:48:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.087+0000 7ff7fd2db640 1 -- 172.21.15.100:0/3823768545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 msgr2=0x7ff7f810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.087+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/3823768545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f810d0e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009ca0 tx=0x7ff7f002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.088+0000 7ff7fd2db640 1 -- 172.21.15.100:0/3823768545 shutdown_connections 2024-09-12T02:48:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.088+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/3823768545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f810d0e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.088+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/3823768545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8100de0 0x7ff7f8104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.088+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/3823768545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f8100430 0x7ff7f8100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.088+0000 7ff7fd2db640 1 -- 172.21.15.100:0/3823768545 >> 172.21.15.100:0/3823768545 conn(0x7ff7f8077230 msgr2=0x7ff7f80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.088+0000 7ff7fd2db640 1 -- 172.21.15.100:0/3823768545 shutdown_connections 2024-09-12T02:48:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.088+0000 7ff7fd2db640 1 -- 172.21.15.100:0/3823768545 wait complete. 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 Processor -- start 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 -- start start 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8100430 0x7ff7f8107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f8100de0 0x7ff7f81076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f8107c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f810fd40 con 0x7ff7f8105560 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f810fbc0 con 0x7ff7f8100de0 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.089+0000 7ff7fd2db640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f810fec0 con 0x7ff7f8100430 2024-09-12T02:48:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f8107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f8107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40606/0 (socket says 172.21.15.100:40606) 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2431595451 learned_addr learned my addr 172.21.15.100:0/2431595451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8100430 0x7ff7f8107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f8100de0 0x7ff7f81076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2431595451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8100430 msgr2=0x7ff7f8107180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8100430 0x7ff7f8107180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2431595451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f8100de0 msgr2=0x7ff7f81076c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f8100de0 0x7ff7f81076c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2431595451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f81a6880 con 0x7ff7f8105560 2024-09-12T02:48:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8100430 0x7ff7f8107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f8107c00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0030da0 tx=0x7ff7f0030dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7effff640 1 -- 172.21.15.100:0/2431595451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0003c30 con 0x7ff7f8105560 2024-09-12T02:48:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f81a6b10 con 0x7ff7f8105560 2024-09-12T02:48:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7effff640 1 -- 172.21.15.100:0/2431595451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f0003dd0 con 0x7ff7f8105560 2024-09-12T02:48:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.090+0000 7ff7effff640 1 -- 172.21.15.100:0/2431595451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004840 con 0x7ff7f8105560 2024-09-12T02:48:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.091+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f81a70a0 con 0x7ff7f8105560 2024-09-12T02:48:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.094+0000 7ff7effff640 1 -- 172.21.15.100:0/2431595451 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ff7f0031450 con 0x7ff7f8105560 2024-09-12T02:48:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.094+0000 7ff7ff6b4740 1 Processor -- start 2024-09-12T02:48:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.094+0000 7ff7effff640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff7e40a2b80 0x7ff7e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.094+0000 7ff7ff6b4740 1 -- start start 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.094+0000 7ff7effff640 1 -- 172.21.15.100:0/2431595451 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff7f00f0240 con 0x7ff7f8105560 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff7e40a2b80 0x7ff7e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba7930ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793194f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba7931be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ba79273160 con 0x55ba79319a30 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ba7921a720 con 0x55ba7930f170 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba7926f120 con 0x55ba7930e850 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba7931be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba7931be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40608/0 (socket says 172.21.15.100:40608) 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 -- 172.21.15.100:0/3493931236 learned_addr learned my addr 172.21.15.100:0/3493931236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba7930ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff7e40a2b80 0x7ff7e40a5040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8108c10 tx=0x7ff7e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 -- 172.21.15.100:0/3493931236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 msgr2=0x55ba7930ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba7930ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 -- 172.21.15.100:0/3493931236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 msgr2=0x55ba793194f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793194f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f77fe640 1 -- 172.21.15.100:0/3493931236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba78fe4ba0 con 0x55ba79319a30 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.095+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793194f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.096+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba7931be20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00bc790 tx=0x7ff7f00bc5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f3f37b621f4dab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.096+0000 7ff7ed7fa640 1 -- 172.21.15.100:0/3493931236 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00bca90 con 0x55ba79319a30 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.096+0000 7ff7ed7fa640 1 -- 172.21.15.100:0/3493931236 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f0036040 con 0x55ba79319a30 2024-09-12T02:48:26.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.096+0000 7ff7ed7fa640 1 -- 172.21.15.100:0/3493931236 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00b9100 con 0x55ba79319a30 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/3493931236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 msgr2=0x55ba7931be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba7931be20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00bc790 tx=0x7ff7f00bc5d0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/3493931236 shutdown_connections 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba7931be20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793194f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/3493931236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba7930ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/3493931236 >> 172.21.15.100:0/3493931236 conn(0x55ba7930ade0 msgr2=0x55ba7930b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/3493931236 shutdown_connections 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/3493931236 wait complete. 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 -- start start 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.097+0000 7ff7ff6b4740 1 Processor -- start 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.098+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930e850 0x55ba793168c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.098+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930f170 0x55ba79316e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba79317340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ba79273160 con 0x55ba7930f170 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba79317340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba79317340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:56146/0 (socket says 172.21.15.100:56146) 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f77fe640 1 -- 172.21.15.100:0/4280819964 learned_addr learned my addr 172.21.15.100:0/4280819964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ba791fb900 con 0x55ba7930e850 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba7931c3c0 con 0x55ba79319a30 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7ff6b4740 10 client.0 _ll_register_callbacks cb 0x55ba791f9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930e850 0x55ba793168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f77fe640 1 -- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930e850 msgr2=0x55ba793168c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930e850 0x55ba793168c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f77fe640 1 -- 172.21.15.100:0/4280819964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930f170 msgr2=0x55ba79316e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.099+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930f170 0x55ba79316e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.100+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930f170 0x55ba79316e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.100+0000 7ff7f77fe640 1 -- 172.21.15.100:0/4280819964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba7923bc50 con 0x55ba79319a30 2024-09-12T02:48:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.100+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930e850 0x55ba793168c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:26.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.100+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930f170 0x55ba79316e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.114+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba79317340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00c51d0 tx=0x7ff7f00c5700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fad032710a13699 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.114+0000 7ff7de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:48:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.119+0000 7ff7de7fc640 1 -- 172.21.15.100:0/4280819964 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00bca90 con 0x55ba79319a30 2024-09-12T02:48:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.119+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7f0036040 con 0x55ba79319a30 2024-09-12T02:48:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.119+0000 7ff7de7fc640 1 -- 172.21.15.100:0/4280819964 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff7f0031740 con 0x55ba79319a30 2024-09-12T02:48:26.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.120+0000 7ff7de7fc640 1 -- 172.21.15.100:0/4280819964 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7f00c0e40 con 0x55ba79319a30 2024-09-12T02:48:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.120+0000 7ff7ff6b4740 10 client.26356 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:26.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.120+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ba793305e0 con 0x55ba79319a30 2024-09-12T02:48:26.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.122+0000 7ff7de7fc640 1 -- 172.21.15.100:0/4280819964 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f00b9100 con 0x55ba79319a30 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.122+0000 7ff7de7fc640 1 -- 172.21.15.100:0/4280819964 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff7f00c5380 con 0x55ba79319a30 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.123+0000 7ff7ff6b4740 10 client.26356 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.123+0000 7ff7ff6b4740 10 client.26356 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.123+0000 7ff7ff6b4740 20 client.26356 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.123+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba79333c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.123+0000 7ff7ff6b4740 4 client.26356 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.123+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff7f0036040 con 0x55ba793317b0 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.124+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba79333c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.124+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba79333c10 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2737b278d6a8a56 server_cookie=791cb73fb4147cfa in_seq=0 out_seq=0 2024-09-12T02:48:26.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.124+0000 7ff7de7fc640 10 client.26356 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:26.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.126+0000 7ff7de7fc640 1 -- 172.21.15.100:0/4280819964 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff7f0036040 con 0x55ba793317b0 2024-09-12T02:48:26.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.126+0000 7ff7de7fc640 10 client.26356 handle_command_reply: tid=0 2024-09-12T02:48:26.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.126+0000 7ff7ff6b4740 1 client.26356 shutdown 2024-09-12T02:48:26.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 msgr2=0x55ba79317340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba79317340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00c51d0 tx=0x7ff7f00c5700 comp rx=0 tx=0).stop 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 shutdown_connections 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba79333c10 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba79317340 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930f170 0x55ba79316e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7de7fc640 0 client.26356 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/4280819964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930e850 0x55ba793168c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 >> 172.21.15.100:0/4280819964 conn(0x55ba7930ade0 msgr2=0x55ba79310ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 shutdown_connections 2024-09-12T02:48:26.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.129+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/4280819964 wait complete. 2024-09-12T02:48:26.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.130+0000 7ff7ff6b4740 20 client.26356 trim_cache size 0 max 16384 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 Processor -- start 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 -- start start 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930e850 0x55ba79317190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba793394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81adcf0 con 0x55ba7930e850 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81ab5c0 con 0x55ba7930f170 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81a9410 con 0x55ba79319a30 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7f6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930e850 0x55ba79317190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7f6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930e850 0x55ba79317190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40624/0 (socket says 172.21.15.100:40624) 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7f6ffd640 1 -- 172.21.15.100:0/241179516 learned_addr learned my addr 172.21.15.100:0/241179516 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.158+0000 7ff7f67fc640 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba793394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7f6ffd640 1 -- 172.21.15.100:0/241179516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 msgr2=0x55ba793394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba793394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7f6ffd640 1 -- 172.21.15.100:0/241179516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 msgr2=0x55ba793109b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793109b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7f6ffd640 1 -- 172.21.15.100:0/241179516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba7930efa0 con 0x55ba7930e850 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930e850 0x55ba79317190 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0004360 tx=0x7ff7e0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e496ac2330480c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7ecff9640 1 -- 172.21.15.100:0/241179516 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0027070 con 0x55ba7930e850 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7ecff9640 1 -- 172.21.15.100:0/241179516 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e0004450 con 0x55ba7930e850 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.159+0000 7ff7ecff9640 1 -- 172.21.15.100:0/241179516 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e001bb40 con 0x55ba7930e850 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.160+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/241179516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930e850 msgr2=0x55ba79317190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.160+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930e850 0x55ba79317190 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0004360 tx=0x7ff7e0005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.160+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/241179516 shutdown_connections 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.160+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba79319a30 0x55ba793394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.160+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba793109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.160+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/241179516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba7930e850 0x55ba79317190 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.160+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/241179516 >> 172.21.15.100:0/241179516 conn(0x55ba7930ade0 msgr2=0x55ba793102a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.161+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/241179516 shutdown_connections 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.161+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/241179516 wait complete. 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.161+0000 7ff7ff6b4740 1 -- start start 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.161+0000 7ff7ff6b4740 1 Processor -- start 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.161+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba79313ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.161+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba79314010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.161+0000 7ff7ff6b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba79314550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81a9a80 con 0x55ba79319a30 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81aaef0 con 0x55ba7930f170 2024-09-12T02:48:26.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7ff6b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81aa150 con 0x55ba7930e850 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7ff6b4740 10 client.0 _ll_register_callbacks cb 0x7ff7f00bd250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba79314550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba79313ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba79314010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba79314550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40636/0 (socket says 172.21.15.100:40636) 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba79313ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:56156/0 (socket says 172.21.15.100:56156) 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba79314010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:57214/0 (socket says 172.21.15.100:57214) 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2969565147 learned_addr learned my addr 172.21.15.100:0/2969565147 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2969565147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 msgr2=0x55ba79313ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba79313ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2969565147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 msgr2=0x55ba79314010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba79314010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 -- 172.21.15.100:0/2969565147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba7939b6b0 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7f77fe640 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba79314550 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b8ef0 tx=0x7ff7f00bd300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad3889a600ee61b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7de7fc640 1 -- 172.21.15.100:0/2969565147 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00bc3f0 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7de7fc640 1 -- 172.21.15.100:0/2969565147 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff7f00db2b0 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7e0004450 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7de7fc640 1 -- 172.21.15.100:0/2969565147 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7f00db4b0 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.162+0000 7ff7ff6b4740 10 client.17073 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ba7939b6b0 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7de7fc640 1 -- 172.21.15.100:0/2969565147 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f0036070 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7de7fc640 1 -- 172.21.15.100:0/2969565147 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff7f00bb950 con 0x55ba79319a30 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7ff6b4740 10 client.17073 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7ff6b4740 10 client.17073 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7ff6b4740 20 client.17073 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba7939ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7ff6b4740 4 client.17073 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}] 2024-09-12T02:48:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}) -- 0x7ff7e0004450 con 0x55ba793317b0 2024-09-12T02:48:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba7939ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.163+0000 7ff7de7fc640 10 client.17073 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:26.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.164+0000 7ff7f6ffd640 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba7939ed70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67226f016ec38cf8 server_cookie=c084d964a1a89a84 in_seq=0 out_seq=0 2024-09-12T02:48:26.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:25 smithi189 ceph-mon[35196]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 697 op/s 2024-09-12T02:48:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 555.0 s, 1992.4 tps, lat 48.937 ms stddev 57.912 2024-09-12T02:48:26.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:25 smithi117 ceph-mon[34898]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 697 op/s 2024-09-12T02:48:26.456 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:48:26.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:48:26.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.506+0000 7ff7de7fc640 1 -- 172.21.15.100:0/2969565147 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7ff7e0004450 con 0x55ba793317b0 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.506+0000 7ff7de7fc640 10 client.17073 handle_command_reply: tid=0 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 client.17073 shutdown 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 msgr2=0x55ba79314550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba79314550 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b8ef0 tx=0x7ff7f00bd300 comp rx=0 tx=0).stop 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 shutdown_connections 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55ba793317b0 0x55ba7939ed70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba79319a30 0x55ba79314550 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ba7930f170 0x55ba79314010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 --2- 172.21.15.100:0/2969565147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba7930e850 0x55ba79313ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 >> 172.21.15.100:0/2969565147 conn(0x55ba7930ade0 msgr2=0x55ba7932d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7de7fc640 0 client.17073 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 shutdown_connections 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 1 -- 172.21.15.100:0/2969565147 wait complete. 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.507+0000 7ff7ff6b4740 20 client.17073 trim_cache size 0 max 16384 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 38, 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stdout: "c9c41e9f": { 2024-09-12T02:48:26.510 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 38, 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 142.6, 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:48:26.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:26.512 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:26.512 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:26.512 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:26.512 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:26.512 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:48:26.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff7e40a2b80 msgr2=0x7ff7e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff7e40a2b80 0x7ff7e40a5040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8108c10 tx=0x7ff7e800b390 comp rx=0 tx=0).stop 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 msgr2=0x7ff7f8107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f8107c00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0030da0 tx=0x7ff7f0030dd0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 shutdown_connections 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ff7e40a2b80 0x7ff7e40a5040 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7f8105560 0x7ff7f8107c00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f8100de0 0x7ff7f81076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 --2- 172.21.15.100:0/2431595451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8100430 0x7ff7f8107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 >> 172.21.15.100:0/2431595451 conn(0x7ff7f8077230 msgr2=0x7ff7f8103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 shutdown_connections 2024-09-12T02:48:26.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:26.508+0000 7ff7fd2db640 1 -- 172.21.15.100:0/2431595451 wait complete. 2024-09-12T02:48:28.192 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c9c41e9f', quiesce took 6.3 seconds. Will release after: 16.25 2024-09-12T02:48:28.201 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.638+0000 7f6e4a844640 1 -- 172.21.15.100:0/3157402617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44102790 msgr2=0x7f6e441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.638+0000 7f6e4a844640 1 --2- 172.21.15.100:0/3157402617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44102790 0x7f6e441067e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009900 tx=0x7f6e2c02a410 comp rx=0 tx=0).stop 2024-09-12T02:48:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- 172.21.15.100:0/3157402617 shutdown_connections 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 --2- 172.21.15.100:0/3157402617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e44106f10 0x7f6e4410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 --2- 172.21.15.100:0/3157402617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44102790 0x7f6e441067e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 --2- 172.21.15.100:0/3157402617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e44101de0 0x7f6e441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- 172.21.15.100:0/3157402617 >> 172.21.15.100:0/3157402617 conn(0x7f6e440fd8c0 msgr2=0x7f6e440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- 172.21.15.100:0/3157402617 shutdown_connections 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- 172.21.15.100:0/3157402617 wait complete. 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 Processor -- start 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- start start 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e44101de0 0x7f6e440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e44102790 0x7f6e44074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44106f10 0x7f6e44074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44111f70 con 0x7f6e44106f10 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44111df0 con 0x7f6e44101de0 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e4a844640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441120f0 con 0x7f6e44102790 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e48de1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44106f10 0x7f6e44074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.639+0000 7f6e48de1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44106f10 0x7f6e44074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40648/0 (socket says 172.21.15.100:40648) 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e48de1640 1 -- 172.21.15.100:0/872023441 learned_addr learned my addr 172.21.15.100:0/872023441 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e43fff640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e44101de0 0x7f6e440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e44102790 0x7f6e44074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e48de1640 1 -- 172.21.15.100:0/872023441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e44102790 msgr2=0x7f6e44074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e48de1640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e44102790 0x7f6e44074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e48de1640 1 -- 172.21.15.100:0/872023441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e44101de0 msgr2=0x7f6e440744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e48de1640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e44101de0 0x7f6e440744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e48de1640 1 -- 172.21.15.100:0/872023441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e441a6870 con 0x7f6e44106f10 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e48de1640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44106f10 0x7f6e44074f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00cce0 tx=0x7f6e3c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e41ffb640 1 -- 172.21.15.100:0/872023441 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00f450 con 0x7f6e44106f10 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e441a6b60 con 0x7f6e44106f10 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e41ffb640 1 -- 172.21.15.100:0/872023441 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e3c00fad0 con 0x7f6e44106f10 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e41ffb640 1 -- 172.21.15.100:0/872023441 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c018c10 con 0x7f6e44106f10 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.640+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e441a7070 con 0x7f6e44106f10 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.642+0000 7f6e41ffb640 1 -- 172.21.15.100:0/872023441 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6e3c00f5f0 con 0x7f6e44106f10 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 Processor -- start 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 -- start start 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaeeb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaeee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e9aae46280 con 0x55e9aaee1480 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e9aadedb10 con 0x55e9aaee0b60 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9aae42240 con 0x55e9aaeebd40 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaeeb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaeeb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40660/0 (socket says 172.21.15.100:40660) 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 -- 172.21.15.100:0/4183896337 learned_addr learned my addr 172.21.15.100:0/4183896337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e41ffb640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6e300a2b80 0x7f6e300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaeee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 -- 172.21.15.100:0/4183896337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 msgr2=0x55e9aaeee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaeee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 -- 172.21.15.100:0/4183896337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 msgr2=0x55e9aaee0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e43fff640 1 -- 172.21.15.100:0/4183896337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9aadfa1f0 con 0x55e9aaee1480 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaeee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e48de1640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6e300a2b80 0x7f6e300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.643+0000 7f6e41ffb640 1 -- 172.21.15.100:0/872023441 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6e3c0cf620 con 0x7f6e44106f10 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.644+0000 7f6e43fff640 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaeeb800 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400bd10 tx=0x7f6e340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb7e2abfa27f811 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.644+0000 7f6e3a7fc640 1 -- 172.21.15.100:0/4183896337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34004030 con 0x55e9aaee1480 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.644+0000 7f6e48de1640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6e300a2b80 0x7f6e300a5040 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0a45b0 tx=0x7f6e3c01baf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.644+0000 7f6e3a7fc640 1 -- 172.21.15.100:0/4183896337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e340041d0 con 0x55e9aaee1480 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.644+0000 7f6e3a7fc640 1 -- 172.21.15.100:0/4183896337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34011820 con 0x55e9aaee1480 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.644+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/4183896337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 msgr2=0x55e9aaeeb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.644+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaeeb800 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400bd10 tx=0x7f6e340107a0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/4183896337 shutdown_connections 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaeee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaeeb800 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/4183896337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/4183896337 >> 172.21.15.100:0/4183896337 conn(0x55e9aaedd0f0 msgr2=0x55e9aaedd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/4183896337 shutdown_connections 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/4183896337 wait complete. 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- start start 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 Processor -- start 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaee90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaeebd40 0x55e9aaee9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e9aaeee910 con 0x55e9aaeebd40 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e9aae00f10 con 0x55e9aaee0b60 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9aaeeea90 con 0x55e9aaee1480 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.645+0000 7f6e4cc1d740 10 client.0 _ll_register_callbacks cb 0x55e9aadc9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaeebd40 0x55e9aaee9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaeebd40 0x55e9aaee9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40674/0 (socket says 172.21.15.100:40674) 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 -- 172.21.15.100:0/892117292 learned_addr learned my addr 172.21.15.100:0/892117292 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e43fff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaee90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 -- 172.21.15.100:0/892117292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 msgr2=0x55e9aaee90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaee90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 -- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 msgr2=0x55e9aaee8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 -- 172.21.15.100:0/892117292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9aabb76a0 con 0x55e9aaeebd40 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e43fff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaee90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaeebd40 0x55e9aaee9620 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c031550 tx=0x7f6e2c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac8908d3ff34310 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e237fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e237fe640 1 -- 172.21.15.100:0/892117292 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c035070 con 0x55e9aaeebd40 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e237fe640 1 -- 172.21.15.100:0/892117292 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6e2c0035f0 con 0x55e9aaeebd40 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e340041d0 con 0x55e9aaeebd40 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e237fe640 1 -- 172.21.15.100:0/892117292 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e2c0037f0 con 0x55e9aaeebd40 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e4cc1d740 10 client.17085 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.646+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e9aaefa410 con 0x55e9aaeebd40 2024-09-12T02:48:28.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e237fe640 1 -- 172.21.15.100:0/892117292 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e340041d0 con 0x55e9aaeebd40 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e237fe640 1 -- 172.21.15.100:0/892117292 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6e2c03d830 con 0x55e9aaeebd40 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e4cc1d740 10 client.17085 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e4cc1d740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e4cc1d740 20 client.17085 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaefb820 0x55e9aaefdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e4cc1d740 4 client.17085 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9aae537f0 con 0x55e9aaefb820 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e43fff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaefb820 0x55e9aaefdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e237fe640 10 client.17085 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.647+0000 7f6e43fff640 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaefb820 0x55e9aaefdca0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a98f3bfd4f1c893f server_cookie=3e919163937af663 in_seq=0 out_seq=0 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.648+0000 7f6e237fe640 1 -- 172.21.15.100:0/892117292 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9aae537f0 con 0x55e9aaefb820 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.648+0000 7f6e237fe640 10 client.17085 handle_command_reply: tid=0 2024-09-12T02:48:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.648+0000 7f6e4cc1d740 1 client.17085 shutdown 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.648+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaeebd40 msgr2=0x55e9aaee9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.648+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaeebd40 0x55e9aaee9620 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c031550 tx=0x7f6e2c009260 comp rx=0 tx=0).stop 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 shutdown_connections 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaefb820 0x55e9aaefdca0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaeebd40 0x55e9aaee9620 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaee90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e237fe640 0 client.17085 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/892117292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 >> 172.21.15.100:0/892117292 conn(0x55e9aaedd0f0 msgr2=0x55e9aaedc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 shutdown_connections 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/892117292 wait complete. 2024-09-12T02:48:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.649+0000 7f6e4cc1d740 20 client.17085 trim_cache size 0 max 16384 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 Processor -- start 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 -- start start 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaf03570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaf03ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441b1fc0 con 0x55e9aaee1480 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441af890 con 0x55e9aaee0b60 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441ad6e0 con 0x55e9aaeebd40 2024-09-12T02:48:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaf03570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaf03570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40684/0 (socket says 172.21.15.100:40684) 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 -- 172.21.15.100:0/2890963743 learned_addr learned my addr 172.21.15.100:0/2890963743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaf03ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 -- 172.21.15.100:0/2890963743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 msgr2=0x55e9aaf03ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaf03ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 -- 172.21.15.100:0/2890963743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 msgr2=0x55e9aaee2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 -- 172.21.15.100:0/2890963743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9aaedcf20 con 0x55e9aaee1480 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaf03ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.666+0000 7f6e43fff640 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaf03570 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c00 tx=0x7f6e3400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a26246d93abf338 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e39ffb640 1 -- 172.21.15.100:0/2890963743 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34005240 con 0x55e9aaee1480 2024-09-12T02:48:28.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e39ffb640 1 -- 172.21.15.100:0/2890963743 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e340053e0 con 0x55e9aaee1480 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e39ffb640 1 -- 172.21.15.100:0/2890963743 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e340277f0 con 0x55e9aaee1480 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/2890963743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 msgr2=0x55e9aaf03570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaf03570 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c00 tx=0x7f6e3400bc50 comp rx=0 tx=0).stop 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/2890963743 shutdown_connections 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaeebd40 0x55e9aaf03ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee1480 0x55e9aaf03570 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/2890963743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaee0b60 0x55e9aaee2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/2890963743 >> 172.21.15.100:0/2890963743 conn(0x55e9aaedd0f0 msgr2=0x55e9aaee2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/2890963743 shutdown_connections 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.667+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/2890963743 wait complete. 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 -- start start 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 Processor -- start 2024-09-12T02:48:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee0b60 0x55e9aaef0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaef0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaeebd40 0x55e9aaf5f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441add50 con 0x55e9aaee0b60 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441af1c0 con 0x55e9aaeebd40 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441ae420 con 0x55e9aaee1480 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e4cc1d740 10 client.0 _ll_register_callbacks cb 0x7f6e2c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee0b60 0x55e9aaef0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee0b60 0x55e9aaef0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40688/0 (socket says 172.21.15.100:40688) 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.668+0000 7f6e3bfff640 1 -- 172.21.15.100:0/1992050970 learned_addr learned my addr 172.21.15.100:0/1992050970 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaeebd40 0x55e9aaf5f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e43fff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaef0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e3bfff640 1 -- 172.21.15.100:0/1992050970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 msgr2=0x55e9aaef0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaef0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e3bfff640 1 -- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaeebd40 msgr2=0x55e9aaf5f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaeebd40 0x55e9aaf5f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e3bfff640 1 -- 172.21.15.100:0/1992050970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9aaf5fb40 con 0x55e9aaee0b60 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e43fff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaef0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e3bfff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee0b60 0x55e9aaef0350 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c001eb0 tx=0x7f6e2c032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf849689d55f873e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e237fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e237fe640 1 -- 172.21.15.100:0/1992050970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c05b060 con 0x55e9aaee0b60 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e237fe640 1 -- 172.21.15.100:0/1992050970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6e2c003da0 con 0x55e9aaee0b60 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e340053e0 con 0x55e9aaee0b60 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e237fe640 1 -- 172.21.15.100:0/1992050970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e2c035040 con 0x55e9aaee0b60 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e4cc1d740 10 client.17091 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e9aaf66f30 con 0x55e9aaee0b60 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.669+0000 7f6e237fe640 1 -- 172.21.15.100:0/1992050970 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e340053e0 con 0x55e9aaee0b60 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e237fe640 1 -- 172.21.15.100:0/1992050970 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6e2c0046c0 con 0x55e9aaee0b60 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e4cc1d740 10 client.17091 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e4cc1d740 10 client.17091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e4cc1d740 20 client.17091 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaf67530 0x55e9aaf69950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e4cc1d740 4 client.17091 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e9aae4dd00 con 0x55e9aaf67530 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e43fff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaf67530 0x55e9aaf69950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e237fe640 10 client.17091 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.670+0000 7f6e43fff640 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaf67530 0x55e9aaf69950 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c8fc51c7373aa0 server_cookie=158e1043ed63d76b in_seq=0 out_seq=0 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e237fe640 1 -- 172.21.15.100:0/1992050970 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e9aae4dd00 con 0x55e9aaf67530 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e237fe640 10 client.17091 handle_command_reply: tid=0 2024-09-12T02:48:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 client.17091 shutdown 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee0b60 msgr2=0x55e9aaef0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee0b60 0x55e9aaef0350 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c001eb0 tx=0x7f6e2c032e20 comp rx=0 tx=0).stop 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 shutdown_connections 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e9aaf67530 0x55e9aaf69950 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9aaeebd40 0x55e9aaf5f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9aaee1480 0x55e9aaef0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.671+0000 7f6e4cc1d740 1 --2- 172.21.15.100:0/1992050970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9aaee0b60 0x55e9aaef0350 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 >> 172.21.15.100:0/1992050970 conn(0x55e9aaedd0f0 msgr2=0x55e9aaee2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e237fe640 0 client.17091 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 shutdown_connections 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4cc1d740 1 -- 172.21.15.100:0/1992050970 wait complete. 2024-09-12T02:48:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4cc1d740 20 client.17091 trim_cache size 0 max 16384 2024-09-12T02:48:28.681 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:48:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:48:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "ba1bd072-c3af-44b4-8426-ef3c37e8dc57", 2024-09-12T02:48:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:48:28.681 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6e300a2b80 msgr2=0x7f6e300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6e300a2b80 0x7f6e300a5040 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0a45b0 tx=0x7f6e3c01baf0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44106f10 msgr2=0x7f6e44074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44106f10 0x7f6e44074f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00cce0 tx=0x7f6e3c00a620 comp rx=0 tx=0).stop 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 shutdown_connections 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6e300a2b80 0x7f6e300a5040 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e44106f10 0x7f6e44074f70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e44102790 0x7f6e44074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 --2- 172.21.15.100:0/872023441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e44101de0 0x7f6e440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 >> 172.21.15.100:0/872023441 conn(0x7f6e440fd8c0 msgr2=0x7f6e440fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 shutdown_connections 2024-09-12T02:48:28.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:28.672+0000 7f6e4a844640 1 -- 172.21.15.100:0/872023441 wait complete. 2024-09-12T02:48:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:28 smithi117 ceph-mon[34898]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-09-12T02:48:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:28 smithi100 ceph-mon[31390]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-09-12T02:48:29.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:28 smithi189 ceph-mon[35196]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-09-12T02:48:29.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:48:29.697 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:30.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:29 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:48:30.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:29 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:29 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:48:30.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:29 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:48:30.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:29 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:29 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:29 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:48:30.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:29 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:29 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:48:30.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:29 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:48:30.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:29 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:29 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 -- 172.21.15.100:0/217352637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 msgr2=0x7f3f8810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 --2- 172.21.15.100:0/217352637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8810ea90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009ca0 tx=0x7f3f8002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 -- 172.21.15.100:0/217352637 shutdown_connections 2024-09-12T02:48:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 --2- 172.21.15.100:0/217352637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8810ea90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 --2- 172.21.15.100:0/217352637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f88102790 0x7f3f881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 --2- 172.21.15.100:0/217352637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f88101de0 0x7f3f881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 -- 172.21.15.100:0/217352637 >> 172.21.15.100:0/217352637 conn(0x7f3f880fd8c0 msgr2=0x7f3f880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 -- 172.21.15.100:0/217352637 shutdown_connections 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.165+0000 7f3f8e484640 1 -- 172.21.15.100:0/217352637 wait complete. 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 Processor -- start 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 -- start start 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f88101de0 0x7f3f881983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f88102790 0x7f3f881988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f88111f70 con 0x7f3f88106f10 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f88111df0 con 0x7f3f88101de0 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8e484640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881120f0 con 0x7f3f88102790 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8ca21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8ca21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40710/0 (socket says 172.21.15.100:40710) 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3194287262 learned_addr learned my addr 172.21.15.100:0/3194287262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f88102790 0x7f3f881988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.166+0000 7f3f87fff640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f88101de0 0x7f3f881983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3194287262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f88102790 msgr2=0x7f3f881988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f88102790 0x7f3f881988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3194287262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f88101de0 msgr2=0x7f3f881983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f88101de0 0x7f3f881983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3194287262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8819d360 con 0x7f3f88106f10 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8819cc80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3f80031a20 tx=0x7f3f80031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f857fa640 1 -- 172.21.15.100:0/3194287262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80003c30 con 0x7f3f88106f10 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f857fa640 1 -- 172.21.15.100:0/3194287262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f80003dd0 con 0x7f3f88106f10 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8819d5f0 con 0x7f3f88106f10 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f857fa640 1 -- 172.21.15.100:0/3194287262 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8002fcf0 con 0x7f3f88106f10 2024-09-12T02:48:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.167+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f881a4f30 con 0x7f3f88106f10 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.169+0000 7f3f857fa640 1 -- 172.21.15.100:0/3194287262 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3f80004050 con 0x7f3f88106f10 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 Processor -- start 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 -- start start 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cc1d0 0x5585847d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f857fa640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f740a2b80 0x7f3f740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847d6a90 0x5585847d8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55858472d2e0 con 0x5585847cc1d0 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5585846d4ce0 con 0x5585847d6a90 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f9085d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5585847292a0 con 0x5585847cb8b0 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f740a2b80 0x7f3f740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cc1d0 0x5585847d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cc1d0 0x5585847d6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40714/0 (socket says 172.21.15.100:40714) 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 -- 172.21.15.100:0/2614902087 learned_addr learned my addr 172.21.15.100:0/2614902087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847d6a90 0x5585847d8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f877fe640 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f857fa640 1 -- 172.21.15.100:0/3194287262 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3f800f0350 con 0x7f3f88106f10 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 -- 172.21.15.100:0/2614902087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 msgr2=0x5585847cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 -- 172.21.15.100:0/2614902087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847d6a90 msgr2=0x5585847d8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847d6a90 0x5585847d8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.170+0000 7f3f87fff640 1 -- 172.21.15.100:0/2614902087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585846b9440 con 0x5585847cc1d0 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f87fff640 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cc1d0 0x5585847d6550 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800bcd0 tx=0x7f3f780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc28013a9c34fe5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f740a2b80 0x7f3f740a5040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3f881088e0 tx=0x7f3f7000ba50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f7e7fc640 1 -- 172.21.15.100:0/2614902087 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7801c680 con 0x5585847cc1d0 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f7e7fc640 1 -- 172.21.15.100:0/2614902087 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f7801cd00 con 0x5585847cc1d0 2024-09-12T02:48:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f7e7fc640 1 -- 172.21.15.100:0/2614902087 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78011b10 con 0x5585847cc1d0 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 -- 172.21.15.100:0/2614902087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cc1d0 msgr2=0x5585847d6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cc1d0 0x5585847d6550 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800bcd0 tx=0x7f3f780107a0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 -- 172.21.15.100:0/2614902087 shutdown_connections 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847d6a90 0x5585847d8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cc1d0 0x5585847d6550 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2614902087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 -- 172.21.15.100:0/2614902087 >> 172.21.15.100:0/2614902087 conn(0x5585847c7e40 msgr2=0x5585847c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 -- 172.21.15.100:0/2614902087 shutdown_connections 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.171+0000 7f3f9085d740 1 -- 172.21.15.100:0/2614902087 wait complete. 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 -- start start 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 Processor -- start 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5585847d9660 con 0x5585847d6a90 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5585846e8050 con 0x5585847cc1d0 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5585847d97e0 con 0x5585847cb8b0 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f9085d740 10 client.0 _ll_register_callbacks cb 0x558584728160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f8ca21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f8ca21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847d3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40718/0 (socket says 172.21.15.100:40718) 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.172+0000 7f3f8ca21640 1 -- 172.21.15.100:0/2005059359 learned_addr learned my addr 172.21.15.100:0/2005059359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f87fff640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f877fe640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f8ca21640 1 -- 172.21.15.100:0/2005059359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 msgr2=0x5585847d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847d6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f8ca21640 1 -- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 msgr2=0x5585847d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f8ca21640 1 -- 172.21.15.100:0/2005059359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55858449e3c0 con 0x5585847d6a90 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f87fff640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847d6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f877fe640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847d3c90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3f80005e30 tx=0x7f3f800b8f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a891c82f53afc64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f677fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f677fe640 1 -- 172.21.15.100:0/2005059359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f800bad10 con 0x5585847d6a90 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f677fe640 1 -- 172.21.15.100:0/2005059359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3f800043c0 con 0x5585847d6a90 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f7801cd00 con 0x5585847d6a90 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f677fe640 1 -- 172.21.15.100:0/2005059359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3f800baab0 con 0x5585847d6a90 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f9085d740 10 client.17103 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585847d9660 con 0x5585847d6a90 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.173+0000 7f3f677fe640 1 -- 172.21.15.100:0/2005059359 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f7801cd00 con 0x5585847d6a90 2024-09-12T02:48:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f677fe640 1 -- 172.21.15.100:0/2005059359 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3f800ba220 con 0x5585847d6a90 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f9085d740 10 client.17103 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f9085d740 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f9085d740 20 client.17103 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585847e6510 0x5585847e8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f9085d740 4 client.17103 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55858473a850 con 0x5585847e6510 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f87fff640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585847e6510 0x5585847e8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f677fe640 10 client.17103 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.174+0000 7f3f87fff640 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585847e6510 0x5585847e8990 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c0261b310b7077 server_cookie=999aca759c5b5137 in_seq=0 out_seq=0 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f677fe640 1 -- 172.21.15.100:0/2005059359 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55858473a850 con 0x5585847e6510 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f677fe640 10 client.17103 handle_command_reply: tid=0 2024-09-12T02:48:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 client.17103 shutdown 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 msgr2=0x5585847d3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847d3c90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3f80005e30 tx=0x7f3f800b8f30 comp rx=0 tx=0).stop 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 shutdown_connections 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585847e6510 0x5585847e8990 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847d3c90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 --2- 172.21.15.100:0/2005059359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cb8b0 0x5585847d6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 >> 172.21.15.100:0/2005059359 conn(0x5585847c7e40 msgr2=0x5585847c2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f677fe640 0 client.17103 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 shutdown_connections 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 1 -- 172.21.15.100:0/2005059359 wait complete. 2024-09-12T02:48:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.175+0000 7f3f9085d740 20 client.17103 trim_cache size 0 max 16384 2024-09-12T02:48:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 Processor -- start 2024-09-12T02:48:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 -- start start 2024-09-12T02:48:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cb8b0 0x5585847e28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cc1d0 0x5585847d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881adc70 con 0x5585847d6a90 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881ab540 con 0x5585847cb8b0 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.192+0000 7f3f9085d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881a9390 con 0x5585847cc1d0 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40728/0 (socket says 172.21.15.100:40728) 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3052236926 learned_addr learned my addr 172.21.15.100:0/3052236926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cc1d0 0x5585847d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f87fff640 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cb8b0 0x5585847e28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3052236926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cc1d0 msgr2=0x5585847d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cc1d0 0x5585847d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3052236926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cb8b0 msgr2=0x5585847e28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cb8b0 0x5585847e28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 -- 172.21.15.100:0/3052236926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585847d26a0 con 0x5585847d6a90 2024-09-12T02:48:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847ceb00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3f800b95a0 tx=0x7f3f8002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dcaa0de4ceae3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f7dffb640 1 -- 172.21.15.100:0/3052236926 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f800bc710 con 0x5585847d6a90 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f7dffb640 1 -- 172.21.15.100:0/3052236926 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f80036070 con 0x5585847d6a90 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.193+0000 7f3f7dffb640 1 -- 172.21.15.100:0/3052236926 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f800c57b0 con 0x5585847d6a90 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 -- 172.21.15.100:0/3052236926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 msgr2=0x5585847ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847ceb00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3f800b95a0 tx=0x7f3f8002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 -- 172.21.15.100:0/3052236926 shutdown_connections 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847d6a90 0x5585847ceb00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847cc1d0 0x5585847d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3052236926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cb8b0 0x5585847e28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 -- 172.21.15.100:0/3052236926 >> 172.21.15.100:0/3052236926 conn(0x5585847c7e40 msgr2=0x5585847ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 -- 172.21.15.100:0/3052236926 shutdown_connections 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 -- 172.21.15.100:0/3052236926 wait complete. 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 -- start start 2024-09-12T02:48:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.194+0000 7f3f9085d740 1 Processor -- start 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cb8b0 0x5585847df2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847d6a90 0x5585847dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881a9a00 con 0x5585847cb8b0 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881aae70 con 0x5585847cc1d0 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881aa0d0 con 0x5585847d6a90 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 10 client.0 _ll_register_callbacks cb 0x7f3f80005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cb8b0 0x5585847df2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cb8b0 0x5585847df2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40740/0 (socket says 172.21.15.100:40740) 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 -- 172.21.15.100:0/3428609122 learned_addr learned my addr 172.21.15.100:0/3428609122 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f8ca21640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847d6a90 0x5585847dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 -- 172.21.15.100:0/3428609122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847d6a90 msgr2=0x5585847dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847d6a90 0x5585847dae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 -- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 msgr2=0x5585847da670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847da670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 -- 172.21.15.100:0/3428609122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585847cc000 con 0x5585847cb8b0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847da670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f87fff640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cb8b0 0x5585847df2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800ba60 tx=0x7f3f7800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86cebc8ec27c3a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f677fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f677fe640 1 -- 172.21.15.100:0/3428609122 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7802d020 con 0x5585847cb8b0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f677fe640 1 -- 172.21.15.100:0/3428609122 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3f78005240 con 0x5585847cb8b0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.195+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f80036070 con 0x5585847cb8b0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f677fe640 1 -- 172.21.15.100:0/3428609122 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3f78038050 con 0x5585847cb8b0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 10 client.17109 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558584851230 con 0x5585847cb8b0 2024-09-12T02:48:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f677fe640 1 -- 172.21.15.100:0/3428609122 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f80036070 con 0x5585847cb8b0 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f677fe640 1 -- 172.21.15.100:0/3428609122 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3f78004660 con 0x5585847cb8b0 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 10 client.17109 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 10 client.17109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 20 client.17109 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585848516d0 0x558584853ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 4 client.17109 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558584734d60 con 0x5585848516d0 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.196+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585848516d0 0x558584853ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f877fe640 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585848516d0 0x558584853ac0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9538db72babdacda server_cookie=b52a458dffd28c11 in_seq=0 out_seq=0 2024-09-12T02:48:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f677fe640 10 client.17109 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f677fe640 1 -- 172.21.15.100:0/3428609122 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558584734d60 con 0x5585848516d0 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f677fe640 10 client.17109 handle_command_reply: tid=0 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 client.17109 shutdown 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cb8b0 msgr2=0x5585847df2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cb8b0 0x5585847df2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800ba60 tx=0x7f3f7800bc20 comp rx=0 tx=0).stop 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 shutdown_connections 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5585848516d0 0x558584853ac0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585847d6a90 0x5585847dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5585847cc1d0 0x5585847da670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f677fe640 0 client.17109 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 --2- 172.21.15.100:0/3428609122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5585847cb8b0 0x5585847df2f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 >> 172.21.15.100:0/3428609122 conn(0x5585847c7e40 msgr2=0x5585847d4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 shutdown_connections 2024-09-12T02:48:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 1 -- 172.21.15.100:0/3428609122 wait complete. 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.197+0000 7f3f9085d740 20 client.17109 trim_cache size 0 max 16384 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout: "ba1bd072-c3af-44b4-8426-ef3c37e8dc57": { 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "ba1bd072-c3af-44b4-8426-ef3c37e8dc57", 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:48:30.207 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:30.208 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:30.208 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:48:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f740a2b80 msgr2=0x7f3f740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f740a2b80 0x7f3f740a5040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3f881088e0 tx=0x7f3f7000ba50 comp rx=0 tx=0).stop 2024-09-12T02:48:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 msgr2=0x7f3f8819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8819cc80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3f80031a20 tx=0x7f3f80031a50 comp rx=0 tx=0).stop 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 shutdown_connections 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3f740a2b80 0x7f3f740a5040 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f88106f10 0x7f3f8819cc80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f88102790 0x7f3f881988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 --2- 172.21.15.100:0/3194287262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f88101de0 0x7f3f881983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 >> 172.21.15.100:0/3194287262 conn(0x7f3f880fd8c0 msgr2=0x7f3f880fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 shutdown_connections 2024-09-12T02:48:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:30.198+0000 7f3f8e484640 1 -- 172.21.15.100:0/3194287262 wait complete. 2024-09-12T02:48:30.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:29 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:48:30.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:29 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:29 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:48:30.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:29 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:48:30.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:29 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:30.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:29 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:48:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:30 smithi117 ceph-mon[34898]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 9.9 MiB/s wr, 728 op/s 2024-09-12T02:48:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:30 smithi100 ceph-mon[31390]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 9.9 MiB/s wr, 728 op/s 2024-09-12T02:48:31.181 INFO:tasks.cephfs.filesystem:scrub status for tag:ba1bd072-c3af-44b4-8426-ef3c37e8dc57 - {'path': '/', 'tag': 'ba1bd072-c3af-44b4-8426-ef3c37e8dc57', 'options': 'recursive,force'} 2024-09-12T02:48:31.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:30 smithi189 ceph-mon[35196]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 9.9 MiB/s wr, 728 op/s 2024-09-12T02:48:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:48:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:32 smithi117 ceph-mon[34898]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.6 MiB/s wr, 543 op/s 2024-09-12T02:48:33.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:32 smithi100 ceph-mon[31390]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.6 MiB/s wr, 543 op/s 2024-09-12T02:48:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:32 smithi189 ceph-mon[35196]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.6 MiB/s wr, 543 op/s 2024-09-12T02:48:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:34 smithi117 ceph-mon[34898]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 386 op/s 2024-09-12T02:48:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:34 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:48:35.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:34 smithi100 ceph-mon[31390]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 386 op/s 2024-09-12T02:48:35.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:34 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:48:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:34 smithi189 ceph-mon[35196]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 386 op/s 2024-09-12T02:48:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:34 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:48:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:48:36.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:36 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:48:36.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:36 smithi117 ceph-mon[34898]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.2 MiB/s wr, 274 op/s 2024-09-12T02:48:36.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:36 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:48:36.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:36 smithi100 ceph-mon[31390]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.2 MiB/s wr, 274 op/s 2024-09-12T02:48:36.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:36 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:48:36.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:36 smithi189 ceph-mon[35196]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.2 MiB/s wr, 274 op/s 2024-09-12T02:48:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:38 smithi117 ceph-mon[34898]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.8 MiB/s wr, 436 op/s 2024-09-12T02:48:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:38 smithi100 ceph-mon[31390]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.8 MiB/s wr, 436 op/s 2024-09-12T02:48:39.217 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:38 smithi189 ceph-mon[35196]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.8 MiB/s wr, 436 op/s 2024-09-12T02:48:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:40 smithi117 ceph-mon[34898]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 550 op/s 2024-09-12T02:48:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:40 smithi100 ceph-mon[31390]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 550 op/s 2024-09-12T02:48:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:40 smithi189 ceph-mon[35196]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 550 op/s 2024-09-12T02:48:41.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:48:43.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:42 smithi117 ceph-mon[34898]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 484 op/s 2024-09-12T02:48:43.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:42 smithi100 ceph-mon[31390]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 484 op/s 2024-09-12T02:48:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:42 smithi189 ceph-mon[35196]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 484 op/s 2024-09-12T02:48:44.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:48:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:45.098 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:44 smithi117 ceph-mon[34898]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 16 MiB/s wr, 473 op/s 2024-09-12T02:48:45.125 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:44 smithi100 ceph-mon[31390]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 16 MiB/s wr, 473 op/s 2024-09-12T02:48:45.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.227+0000 7f5db8fc8640 1 -- 172.21.15.100:0/4129914520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4101470 msgr2=0x7f5db4101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.227+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/4129914520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4101470 0x7f5db4101850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009900 tx=0x7f5da402a410 comp rx=0 tx=0).stop 2024-09-12T02:48:45.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 -- 172.21.15.100:0/4129914520 shutdown_connections 2024-09-12T02:48:45.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/4129914520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5db4105de0 0x7f5db410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/4129914520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4101e20 0x7f5db41056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/4129914520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4101470 0x7f5db4101850 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 -- 172.21.15.100:0/4129914520 >> 172.21.15.100:0/4129914520 conn(0x7f5db4077230 msgr2=0x7f5db40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 -- 172.21.15.100:0/4129914520 shutdown_connections 2024-09-12T02:48:45.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 -- 172.21.15.100:0/4129914520 wait complete. 2024-09-12T02:48:45.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 Processor -- start 2024-09-12T02:48:45.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.228+0000 7f5db8fc8640 1 -- start start 2024-09-12T02:48:45.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db8fc8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5db4101470 0x7f5db419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db8fc8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4101e20 0x7f5db419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db8fc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4105de0 0x7f5db419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db8fc8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4110e40 con 0x7f5db4105de0 2024-09-12T02:48:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db8fc8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4110cc0 con 0x7f5db4101470 2024-09-12T02:48:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db8fc8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4110fc0 con 0x7f5db4101e20 2024-09-12T02:48:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4105de0 0x7f5db419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4105de0 0x7f5db419ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47172/0 (socket says 172.21.15.100:47172) 2024-09-12T02:48:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 -- 172.21.15.100:0/2027378081 learned_addr learned my addr 172.21.15.100:0/2027378081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db259c640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5db4101470 0x7f5db419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5dabfff640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4101e20 0x7f5db419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 -- 172.21.15.100:0/2027378081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4101e20 msgr2=0x7f5db419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4101e20 0x7f5db419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 -- 172.21.15.100:0/2027378081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5db4101470 msgr2=0x7f5db419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5db4101470 0x7f5db419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 -- 172.21.15.100:0/2027378081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db419f560 con 0x7f5db4105de0 2024-09-12T02:48:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.229+0000 7f5db2d9d640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4105de0 0x7f5db419ee80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00cce0 tx=0x7f5dac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.230+0000 7f5dab7fe640 1 -- 172.21.15.100:0/2027378081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00f450 con 0x7f5db4105de0 2024-09-12T02:48:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.230+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db419f850 con 0x7f5db4105de0 2024-09-12T02:48:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.230+0000 7f5dab7fe640 1 -- 172.21.15.100:0/2027378081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dac00fad0 con 0x7f5db4105de0 2024-09-12T02:48:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.230+0000 7f5dab7fe640 1 -- 172.21.15.100:0/2027378081 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac018c10 con 0x7f5db4105de0 2024-09-12T02:48:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.230+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db41a7130 con 0x7f5db4105de0 2024-09-12T02:48:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.231+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db4101850 con 0x7f5db4105de0 2024-09-12T02:48:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.233+0000 7f5dab7fe640 1 -- 172.21.15.100:0/2027378081 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f5dac00f5f0 con 0x7f5db4105de0 2024-09-12T02:48:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.233+0000 7f5dab7fe640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5da00a2b80 0x7f5da00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.234+0000 7f5db259c640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5da00a2b80 0x7f5da00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.234+0000 7f5dab7fe640 1 -- 172.21.15.100:0/2027378081 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5dac0cf750 con 0x7f5db4105de0 2024-09-12T02:48:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.234+0000 7f5db259c640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5da00a2b80 0x7f5da00a5040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009230 tx=0x7f5da40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.236+0000 7f5dab7fe640 1 -- 172.21.15.100:0/2027378081 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5dac014030 con 0x7f5db4105de0 2024-09-12T02:48:45.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:44 smithi189 ceph-mon[35196]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 16 MiB/s wr, 473 op/s 2024-09-12T02:48:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.444+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5db419b910 con 0x7f5db4105de0 2024-09-12T02:48:45.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.445+0000 7f5dab7fe640 1 -- 172.21.15.100:0/2027378081 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f5db419b910 con 0x7f5db4105de0 2024-09-12T02:48:45.446 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:48:45.447 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:48:45.447 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:48:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5da00a2b80 msgr2=0x7f5da00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5da00a2b80 0x7f5da00a5040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009230 tx=0x7f5da40058d0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4105de0 msgr2=0x7f5db419ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4105de0 0x7f5db419ee80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00cce0 tx=0x7f5dac00a620 comp rx=0 tx=0).stop 2024-09-12T02:48:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 shutdown_connections 2024-09-12T02:48:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5da00a2b80 0x7f5da00a5040 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5db4105de0 0x7f5db419ee80 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4101e20 0x7f5db419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 --2- 172.21.15.100:0/2027378081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5db4101470 0x7f5db419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 >> 172.21.15.100:0/2027378081 conn(0x7f5db4077230 msgr2=0x7f5db4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 shutdown_connections 2024-09-12T02:48:45.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:45.447+0000 7f5db8fc8640 1 -- 172.21.15.100:0/2027378081 wait complete. 2024-09-12T02:48:46.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:45 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2027378081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:46.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:45 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2027378081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:46.219 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id c9c41e9f --release --await' 2024-09-12T02:48:46.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id c9c41e9f --release --await 2024-09-12T02:48:46.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:45 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2027378081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:48:46.470 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:46.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:46 smithi100 ceph-mon[31390]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 467 op/s 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 -- 172.21.15.100:0/2835664999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102570 msgr2=0x7f3c8c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2835664999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102570 0x7f3c8c1029b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009900 tx=0x7f3c8002a480 comp rx=0 tx=0).stop 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 -- 172.21.15.100:0/2835664999 shutdown_connections 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2835664999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c8c102ef0 0x7f3c8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2835664999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102570 0x7f3c8c1029b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2835664999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8c100e20 0x7f3c8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 -- 172.21.15.100:0/2835664999 >> 172.21.15.100:0/2835664999 conn(0x7f3c8c0fc7d0 msgr2=0x7f3c8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 -- 172.21.15.100:0/2835664999 shutdown_connections 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 -- 172.21.15.100:0/2835664999 wait complete. 2024-09-12T02:48:46.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.960+0000 7f3c91a68640 1 Processor -- start 2024-09-12T02:48:46.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c91a68640 1 -- start start 2024-09-12T02:48:46.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c91a68640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c8c100e20 0x7f3c8c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c91a68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8c102570 0x7f3c8c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c91a68640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102ef0 0x7f3c8c1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c91a68640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c110f80 con 0x7f3c8c102ef0 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c91a68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c110e00 con 0x7f3c8c102570 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c91a68640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c111100 con 0x7f3c8c100e20 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102ef0 0x7f3c8c1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102ef0 0x7f3c8c1a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47188/0 (socket says 172.21.15.100:47188) 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2018114100 learned_addr learned my addr 172.21.15.100:0/2018114100 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8affd640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8c102570 0x7f3c8c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c8c100e20 0x7f3c8c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2018114100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c8c100e20 msgr2=0x7f3c8c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c8c100e20 0x7f3c8c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2018114100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8c102570 msgr2=0x7f3c8c199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8c102570 0x7f3c8c199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2018114100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8c1a48d0 con 0x7f3c8c102ef0 2024-09-12T02:48:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.961+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c8c100e20 0x7f3c8c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.962+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102ef0 0x7f3c8c1a4390 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400cad0 tx=0x7f3c8400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.962+0000 7f3c88ff9640 1 -- 172.21.15.100:0/2018114100 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400ae20 con 0x7f3c8c102ef0 2024-09-12T02:48:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.962+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8c1a4aa0 con 0x7f3c8c102ef0 2024-09-12T02:48:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.962+0000 7f3c88ff9640 1 -- 172.21.15.100:0/2018114100 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c84005020 con 0x7f3c8c102ef0 2024-09-12T02:48:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.962+0000 7f3c88ff9640 1 -- 172.21.15.100:0/2018114100 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400f6b0 con 0x7f3c8c102ef0 2024-09-12T02:48:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.962+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8c1a5000 con 0x7f3c8c102ef0 2024-09-12T02:48:46.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.964+0000 7f3c88ff9640 1 -- 172.21.15.100:0/2018114100 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3c840051d0 con 0x7f3c8c102ef0 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.964+0000 7f3c93e41740 1 Processor -- start 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.964+0000 7f3c93e41740 1 -- start start 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c88ff9640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3c740a2c00 0x7f3c740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee254440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 0x55e7ee25ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee261630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c93e41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e7ee1b9620 con 0x55e7ee25f240 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c93e41740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7ee160e50 con 0x55e7ee254980 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c93e41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e7ee1b55e0 con 0x55e7ee254060 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8affd640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3c740a2c00 0x7f3c740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee261630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c88ff9640 1 -- 172.21.15.100:0/2018114100 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3c840cf2a0 con 0x7f3c8c102ef0 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee261630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47194/0 (socket says 172.21.15.100:47194) 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2877543516 learned_addr learned my addr 172.21.15.100:0/2877543516 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee254440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2877543516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 msgr2=0x55e7ee254440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee254440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2877543516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 msgr2=0x55e7ee25ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 0x55e7ee25ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 -- 172.21.15.100:0/2877543516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7ee151d40 con 0x55e7ee25f240 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee254440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8affd640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3c740a2c00 0x7f3c740a50c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009230 tx=0x7f3c80004140 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.965+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee261630 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ccd90 tx=0x7f3c8409b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661682a1875c1825 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c71ffb640 1 -- 172.21.15.100:0/2877543516 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8401d040 con 0x55e7ee25f240 2024-09-12T02:48:46.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c71ffb640 1 -- 172.21.15.100:0/2877543516 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8409c1f0 con 0x55e7ee25f240 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c71ffb640 1 -- 172.21.15.100:0/2877543516 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84099df0 con 0x55e7ee25f240 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 -- 172.21.15.100:0/2877543516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 msgr2=0x55e7ee261630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee261630 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ccd90 tx=0x7f3c8409b510 comp rx=0 tx=0).stop 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 -- 172.21.15.100:0/2877543516 shutdown_connections 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee261630 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 0x55e7ee25ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 --2- 172.21.15.100:0/2877543516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee254440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 -- 172.21.15.100:0/2877543516 >> 172.21.15.100:0/2877543516 conn(0x55e7ee2505f0 msgr2=0x55e7ee2509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 -- 172.21.15.100:0/2877543516 shutdown_connections 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.966+0000 7f3c93e41740 1 -- 172.21.15.100:0/2877543516 wait complete. 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 -- start start 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 Processor -- start 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254060 0x55e7ee25c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254980 0x55e7ee25c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee25f240 0x55e7ee25cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e7ee261e10 con 0x55e7ee254060 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7ee141f10 con 0x55e7ee25f240 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e7ee261f90 con 0x55e7ee254980 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c93e41740 10 client.0 _ll_register_callbacks cb 0x55e7ee165db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c8b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254060 0x55e7ee25c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c8b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254060 0x55e7ee25c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47202/0 (socket says 172.21.15.100:47202) 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c8b7fe640 1 -- 172.21.15.100:0/532944241 learned_addr learned my addr 172.21.15.100:0/532944241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.967+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee25f240 0x55e7ee25cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c8affd640 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254980 0x55e7ee25c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c8b7fe640 1 -- 172.21.15.100:0/532944241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254980 msgr2=0x55e7ee25c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254980 0x55e7ee25c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c8b7fe640 1 -- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee25f240 msgr2=0x55e7ee25cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee25f240 0x55e7ee25cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c8b7fe640 1 -- 172.21.15.100:0/532944241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7edec8580 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254060 0x55e7ee25c060 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00bfc0 tx=0x7f3c7c011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b49539f8933d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c6affd640 1 -- 172.21.15.100:0/532944241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c012710 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c6affd640 1 -- 172.21.15.100:0/532944241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3c7c0128b0 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c8409c1f0 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c6affd640 1 -- 172.21.15.100:0/532944241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3c7c012ab0 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c93e41740 10 client.17127 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e7edf92960 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c6affd640 1 -- 172.21.15.100:0/532944241 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8409c1f0 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.968+0000 7f3c6affd640 1 -- 172.21.15.100:0/532944241 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3c7c024050 con 0x55e7ee254060 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c93e41740 10 client.17127 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:46.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c93e41740 10 client.17127 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:48:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c93e41740 20 client.17127 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c93e41740 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee26ec90 0x55e7ee2710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c93e41740 4 client.17127 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7ee1c6b90 con 0x55e7ee26ec90 2024-09-12T02:48:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c8affd640 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee26ec90 0x55e7ee2710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c6affd640 10 client.17127 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:46.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.969+0000 7f3c8affd640 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee26ec90 0x55e7ee2710c0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bef0d3586dce254 server_cookie=3bd4bc0227b460e5 in_seq=0 out_seq=0 2024-09-12T02:48:46.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c6affd640 1 -- 172.21.15.100:0/532944241 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7ee1c6b90 con 0x55e7ee26ec90 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c6affd640 10 client.17127 handle_command_reply: tid=0 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 client.17127 shutdown 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254060 msgr2=0x55e7ee25c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254060 0x55e7ee25c060 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00bfc0 tx=0x7f3c7c011870 comp rx=0 tx=0).stop 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 shutdown_connections 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee26ec90 0x55e7ee2710c0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee25f240 0x55e7ee25cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254980 0x55e7ee25c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 --2- 172.21.15.100:0/532944241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254060 0x55e7ee25c060 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 >> 172.21.15.100:0/532944241 conn(0x55e7ee2505f0 msgr2=0x55e7ee256320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c6affd640 0 client.17127 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 shutdown_connections 2024-09-12T02:48:46.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 1 -- 172.21.15.100:0/532944241 wait complete. 2024-09-12T02:48:46.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.970+0000 7f3c93e41740 20 client.17127 trim_cache size 0 max 16384 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 Processor -- start 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 -- start start 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee276990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 0x55e7ee276ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee2592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c1aff40 con 0x55e7ee25f240 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c1ad810 con 0x55e7ee254980 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.987+0000 7f3c93e41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c1ab660 con 0x55e7ee254060 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee2592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee2592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47214/0 (socket says 172.21.15.100:47214) 2024-09-12T02:48:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 -- 172.21.15.100:0/760891959 learned_addr learned my addr 172.21.15.100:0/760891959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8affd640 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 0x55e7ee276ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee276990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 -- 172.21.15.100:0/760891959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 msgr2=0x55e7ee276990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee276990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 -- 172.21.15.100:0/760891959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 msgr2=0x55e7ee276ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 0x55e7ee276ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 -- 172.21.15.100:0/760891959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7ee250420 con 0x55e7ee25f240 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee2592e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400a6e0 tx=0x7f3c84079260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802d94f16066afaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c717fa640 1 -- 172.21.15.100:0/760891959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8401d040 con 0x55e7ee25f240 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c717fa640 1 -- 172.21.15.100:0/760891959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8409baf0 con 0x55e7ee25f240 2024-09-12T02:48:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.988+0000 7f3c717fa640 1 -- 172.21.15.100:0/760891959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8407a960 con 0x55e7ee25f240 2024-09-12T02:48:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 -- 172.21.15.100:0/760891959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 msgr2=0x55e7ee2592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee2592e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400a6e0 tx=0x7f3c84079260 comp rx=0 tx=0).stop 2024-09-12T02:48:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 -- 172.21.15.100:0/760891959 shutdown_connections 2024-09-12T02:48:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee25f240 0x55e7ee2592e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254980 0x55e7ee276ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 --2- 172.21.15.100:0/760891959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee254060 0x55e7ee276990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 -- 172.21.15.100:0/760891959 >> 172.21.15.100:0/760891959 conn(0x55e7ee2505f0 msgr2=0x55e7ee25d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 -- 172.21.15.100:0/760891959 shutdown_connections 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 -- 172.21.15.100:0/760891959 wait complete. 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.989+0000 7f3c93e41740 1 -- start start 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 1 Processor -- start 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254060 0x55e7ee2d53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254980 0x55e7ee2671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee25f240 0x55e7ee267970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c1abcd0 con 0x55e7ee254980 2024-09-12T02:48:46.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c1ad140 con 0x55e7ee254060 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c1ac3a0 con 0x55e7ee25f240 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c93e41740 10 client.0 _ll_register_callbacks cb 0x7f3c7c00ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254980 0x55e7ee2671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254060 0x55e7ee2d53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254980 0x55e7ee2671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47220/0 (socket says 172.21.15.100:47220) 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8affd640 1 -- 172.21.15.100:0/648911749 learned_addr learned my addr 172.21.15.100:0/648911749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8bfff640 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee25f240 0x55e7ee267970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8b7fe640 1 -- 172.21.15.100:0/648911749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee25f240 msgr2=0x55e7ee267970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee25f240 0x55e7ee267970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8b7fe640 1 -- 172.21.15.100:0/648911749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254980 msgr2=0x55e7ee2671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254980 0x55e7ee2671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8b7fe640 1 -- 172.21.15.100:0/648911749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7ee259190 con 0x55e7ee254060 2024-09-12T02:48:46.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.990+0000 7f3c8affd640 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254980 0x55e7ee2671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c8b7fe640 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254060 0x55e7ee2d53f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c025460 tx=0x7f3c7c011eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a93f4b28525469 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c6affd640 1 -- 172.21.15.100:0/648911749 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c02b070 con 0x55e7ee254060 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c8409baf0 con 0x55e7ee254060 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c6affd640 1 -- 172.21.15.100:0/648911749 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3c7c004030 con 0x55e7ee254060 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c6affd640 1 -- 172.21.15.100:0/648911749 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3c7c004250 con 0x55e7ee254060 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 10 client.26462 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e7ee2de130 con 0x55e7ee254060 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c6affd640 1 -- 172.21.15.100:0/648911749 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8409baf0 con 0x55e7ee254060 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c6affd640 1 -- 172.21.15.100:0/648911749 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3c7c024050 con 0x55e7ee254060 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 10 client.26462 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 10 client.26462 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:48:46.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 20 client.26462 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:46.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee2de830 0x55e7ee2e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 4 client.26462 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c9c41e9f", "release": true, "await": true}] 2024-09-12T02:48:46.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.991+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c9c41e9f", "release": true, "await": true}) -- 0x55e7ee1c10a0 con 0x55e7ee2de830 2024-09-12T02:48:46.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.992+0000 7f3c8affd640 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee2de830 0x55e7ee2e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.992+0000 7f3c8affd640 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee2de830 0x55e7ee2e0c50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8965d6b2d477c0c server_cookie=c95ba0e417d48cf0 in_seq=0 out_seq=0 2024-09-12T02:48:46.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:46.992+0000 7f3c6affd640 10 client.26462 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.048+0000 7f3c6affd640 1 -- 172.21.15.100:0/648911749 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e7ee1c10a0 con 0x55e7ee2de830 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.048+0000 7f3c6affd640 10 client.26462 handle_command_reply: tid=0 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 client.26462 shutdown 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254060 msgr2=0x55e7ee2d53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254060 0x55e7ee2d53f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c025460 tx=0x7f3c7c011eb0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 shutdown_connections 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55e7ee2de830 0x55e7ee2e0c50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e7ee25f240 0x55e7ee267970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7ee254980 0x55e7ee2671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 --2- 172.21.15.100:0/648911749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7ee254060 0x55e7ee2d53f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 >> 172.21.15.100:0/648911749 conn(0x55e7ee2505f0 msgr2=0x55e7ee255ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c6affd640 0 client.26462 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 shutdown_connections 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 1 -- 172.21.15.100:0/648911749 wait complete. 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.049+0000 7f3c93e41740 20 client.26462 trim_cache size 0 max 16384 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 40, 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:48:47.051 INFO:teuthology.orchestra.run.smithi100.stdout: "c9c41e9f": { 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 40, 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 142.6, 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:48:47.052 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:48:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3c740a2c00 msgr2=0x7f3c740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3c740a2c00 0x7f3c740a50c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009230 tx=0x7f3c80004140 comp rx=0 tx=0).stop 2024-09-12T02:48:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102ef0 msgr2=0x7f3c8c1a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102ef0 0x7f3c8c1a4390 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400cad0 tx=0x7f3c8400cf90 comp rx=0 tx=0).stop 2024-09-12T02:48:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 shutdown_connections 2024-09-12T02:48:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3c740a2c00 0x7f3c740a50c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c8c102ef0 0x7f3c8c1a4390 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c8c102570 0x7f3c8c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 --2- 172.21.15.100:0/2018114100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c8c100e20 0x7f3c8c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 >> 172.21.15.100:0/2018114100 conn(0x7f3c8c0fc7d0 msgr2=0x7f3c8c1068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 shutdown_connections 2024-09-12T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:47.050+0000 7f3c91a68640 1 -- 172.21.15.100:0/2018114100 wait complete. 2024-09-12T02:48:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:46 smithi117 ceph-mon[34898]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 467 op/s 2024-09-12T02:48:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:46 smithi189 ceph-mon[35196]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 467 op/s 2024-09-12T02:48:47.978 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c9c41e9f', total seconds elapsed: 26.1 2024-09-12T02:48:47.978 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.55 2024-09-12T02:48:47.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:48:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 -- 172.21.15.100:0/351741674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90100100 msgr2=0x7f9b90100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 --2- 172.21.15.100:0/351741674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90100100 0x7f9b90100560 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009900 tx=0x7f9b8002a410 comp rx=0 tx=0).stop 2024-09-12T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 -- 172.21.15.100:0/351741674 shutdown_connections 2024-09-12T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 --2- 172.21.15.100:0/351741674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b90100aa0 0x7f9b9010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 --2- 172.21.15.100:0/351741674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90100100 0x7f9b90100560 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 --2- 172.21.15.100:0/351741674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b90106b80 0x7f9b90106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 -- 172.21.15.100:0/351741674 >> 172.21.15.100:0/351741674 conn(0x7f9b90077230 msgr2=0x7f9b900fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 -- 172.21.15.100:0/351741674 shutdown_connections 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 -- 172.21.15.100:0/351741674 wait complete. 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 Processor -- start 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.864+0000 7f9b975c5640 1 -- start start 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b975c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b90100100 0x7f9b901012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b975c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b90100aa0 0x7f9b90101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b975c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90106b80 0x7f9b90101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b975c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901120a0 con 0x7f9b90106b80 2024-09-12T02:48:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b975c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90111f20 con 0x7f9b90100100 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b975c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90112220 con 0x7f9b90100aa0 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90106b80 0x7f9b90101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90106b80 0x7f9b90101d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47244/0 (socket says 172.21.15.100:47244) 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 -- 172.21.15.100:0/3008581006 learned_addr learned my addr 172.21.15.100:0/3008581006 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b94b60640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b90100aa0 0x7f9b90101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95361640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b90100100 0x7f9b901012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 -- 172.21.15.100:0/3008581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b90100aa0 msgr2=0x7f9b90101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b90100aa0 0x7f9b90101820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 -- 172.21.15.100:0/3008581006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b90100100 msgr2=0x7f9b901012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b90100100 0x7f9b901012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 -- 172.21.15.100:0/3008581006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b901a69c0 con 0x7f9b90106b80 2024-09-12T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b95b62640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90106b80 0x7f9b90101d60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800e970 tx=0x7f9b8800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.865+0000 7f9b867fc640 1 -- 172.21.15.100:0/3008581006 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800ccc0 con 0x7f9b90106b80 2024-09-12T02:48:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.866+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b901a6cb0 con 0x7f9b90106b80 2024-09-12T02:48:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.866+0000 7f9b867fc640 1 -- 172.21.15.100:0/3008581006 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b88005500 con 0x7f9b90106b80 2024-09-12T02:48:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.866+0000 7f9b867fc640 1 -- 172.21.15.100:0/3008581006 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88010690 con 0x7f9b90106b80 2024-09-12T02:48:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.866+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b901a71c0 con 0x7f9b90106b80 2024-09-12T02:48:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.867+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b90100560 con 0x7f9b90106b80 2024-09-12T02:48:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.869+0000 7f9b867fc640 1 -- 172.21.15.100:0/3008581006 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9b880046c0 con 0x7f9b90106b80 2024-09-12T02:48:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.870+0000 7f9b867fc640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b7c0a2bc0 0x7f9b7c0a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.870+0000 7f9b95361640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b7c0a2bc0 0x7f9b7c0a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.870+0000 7f9b867fc640 1 -- 172.21.15.100:0/3008581006 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9b880cf650 con 0x7f9b90106b80 2024-09-12T02:48:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.871+0000 7f9b95361640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b7c0a2bc0 0x7f9b7c0a5080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c005fd0 tx=0x7f9b8c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:48.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:48.876+0000 7f9b867fc640 1 -- 172.21.15.100:0/3008581006 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b880541b0 con 0x7f9b90106b80 2024-09-12T02:48:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:48 smithi117 ceph-mon[34898]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 462 op/s 2024-09-12T02:48:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:48 smithi100 ceph-mon[31390]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 462 op/s 2024-09-12T02:48:49.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.196+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b9010a050 con 0x7f9b90106b80 2024-09-12T02:48:49.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.197+0000 7f9b867fc640 1 -- 172.21.15.100:0/3008581006 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f9b8809c5a0 con 0x7f9b90106b80 2024-09-12T02:48:49.197 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:48:49.198 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:48:49.198 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:48:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b7c0a2bc0 msgr2=0x7f9b7c0a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b7c0a2bc0 0x7f9b7c0a5080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c005fd0 tx=0x7f9b8c009500 comp rx=0 tx=0).stop 2024-09-12T02:48:49.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90106b80 msgr2=0x7f9b90101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90106b80 0x7f9b90101d60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800e970 tx=0x7f9b8800ee30 comp rx=0 tx=0).stop 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 shutdown_connections 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9b7c0a2bc0 0x7f9b7c0a5080 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b90106b80 0x7f9b90101d60 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b90100aa0 0x7f9b90101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 --2- 172.21.15.100:0/3008581006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b90100100 0x7f9b901012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 >> 172.21.15.100:0/3008581006 conn(0x7f9b90077230 msgr2=0x7f9b90104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 shutdown_connections 2024-09-12T02:48:49.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:49.200+0000 7f9b975c5640 1 -- 172.21.15.100:0/3008581006 wait complete. 2024-09-12T02:48:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:48 smithi189 ceph-mon[35196]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 462 op/s 2024-09-12T02:48:49.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:49 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3008581006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:49.943 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0' 2024-09-12T02:48:49.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0 2024-09-12T02:48:50.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:49 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3008581006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:50.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:49 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3008581006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:50.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.910+0000 7f53650d1640 1 -- 172.21.15.100:0/1439417039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360101430 msgr2=0x7f536010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.910+0000 7f53650d1640 1 --2- 172.21.15.100:0/1439417039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360101430 0x7f536010d960 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5358009cd0 tx=0x7f535802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.910+0000 7f53650d1640 1 -- 172.21.15.100:0/1439417039 shutdown_connections 2024-09-12T02:48:50.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.910+0000 7f53650d1640 1 --2- 172.21.15.100:0/1439417039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360101430 0x7f536010d960 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.910+0000 7f53650d1640 1 --2- 172.21.15.100:0/1439417039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5360100a90 0x7f5360100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.910+0000 7f53650d1640 1 --2- 172.21.15.100:0/1439417039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5360106a90 0x7f5360106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.910+0000 7f53650d1640 1 -- 172.21.15.100:0/1439417039 >> 172.21.15.100:0/1439417039 conn(0x7f53600fc7d0 msgr2=0x7f53600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.911+0000 7f53650d1640 1 -- 172.21.15.100:0/1439417039 shutdown_connections 2024-09-12T02:48:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.911+0000 7f53650d1640 1 -- 172.21.15.100:0/1439417039 wait complete. 2024-09-12T02:48:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.912+0000 7f53650d1640 1 Processor -- start 2024-09-12T02:48:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.912+0000 7f53650d1640 1 -- start start 2024-09-12T02:48:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f53650d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360100a90 0x7f53601983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f53650d1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5360101430 0x7f5360198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f53650d1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5360106a90 0x7f536019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f53650d1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5360110e90 con 0x7f5360100a90 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f53650d1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5360110d10 con 0x7f5360101430 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f53650d1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5360111010 con 0x7f5360106a90 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360100a90 0x7f53601983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360100a90 0x7f53601983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47254/0 (socket says 172.21.15.100:47254) 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535ed9d640 1 -- 172.21.15.100:0/4065816444 learned_addr learned my addr 172.21.15.100:0/4065816444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535f59e640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5360106a90 0x7f536019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535e59c640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5360101430 0x7f5360198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535f59e640 1 -- 172.21.15.100:0/4065816444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5360101430 msgr2=0x7f5360198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535f59e640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5360101430 0x7f5360198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535f59e640 1 -- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360100a90 msgr2=0x7f53601983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535f59e640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360100a90 0x7f53601983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535f59e640 1 -- 172.21.15.100:0/4065816444 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536019d380 con 0x7f5360106a90 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535ed9d640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360100a90 0x7f53601983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535e59c640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5360101430 0x7f5360198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.913+0000 7f535f59e640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5360106a90 0x7f536019cca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f535802ae00 tx=0x7f5358031df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.914+0000 7f5347fff640 1 -- 172.21.15.100:0/4065816444 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358003d80 con 0x7f5360106a90 2024-09-12T02:48:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.914+0000 7f5347fff640 1 -- 172.21.15.100:0/4065816444 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535803fcf0 con 0x7f5360106a90 2024-09-12T02:48:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.914+0000 7f5347fff640 1 -- 172.21.15.100:0/4065816444 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580305a0 con 0x7f5360106a90 2024-09-12T02:48:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.914+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536019d610 con 0x7f5360106a90 2024-09-12T02:48:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.914+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5360102590 con 0x7f5360106a90 2024-09-12T02:48:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.918+0000 7f5347fff640 1 -- 172.21.15.100:0/4065816444 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f5358004040 con 0x7f5360106a90 2024-09-12T02:48:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.919+0000 7f5347fff640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53480a2b80 0x7f53480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.919+0000 7f5347fff640 1 -- 172.21.15.100:0/4065816444 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f535802e030 con 0x7f5360106a90 2024-09-12T02:48:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.919+0000 7f535ed9d640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53480a2b80 0x7f53480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.919+0000 7f53674aa740 1 Processor -- start 2024-09-12T02:48:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.919+0000 7f53674aa740 1 -- start start 2024-09-12T02:48:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f53674aa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b53c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f53674aa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b5e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f53674aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b60e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f53674aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55abd5ab8160 con 0x55abd5b5ea30 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f53674aa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55abd5a5f720 con 0x55abd5b54170 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f53674aa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abd5ab4120 con 0x55abd5b53850 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b5e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b5e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:47936/0 (socket says 172.21.15.100:47936) 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 -- 172.21.15.100:0/2499968291 learned_addr learned my addr 172.21.15.100:0/2499968291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535f59e640 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b60e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535ed9d640 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b53c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 -- 172.21.15.100:0/2499968291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 msgr2=0x55abd5b53c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b53c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 -- 172.21.15.100:0/2499968291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 msgr2=0x55abd5b60e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b60e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 -- 172.21.15.100:0/2499968291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abd5829ba0 con 0x55abd5b54170 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.920+0000 7f535e59c640 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b5e4f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f53540114f0 tx=0x7f53540119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9adec540c357b231 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.921+0000 7f535ed9d640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53480a2b80 0x7f53480a5040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5350011dd0 tx=0x7f53500118c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.921+0000 7f53457fa640 1 -- 172.21.15.100:0/2499968291 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535401e070 con 0x55abd5b54170 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.921+0000 7f53457fa640 1 -- 172.21.15.100:0/2499968291 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53540035f0 con 0x55abd5b54170 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.921+0000 7f53457fa640 1 -- 172.21.15.100:0/2499968291 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535400f7e0 con 0x55abd5b54170 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.921+0000 7f53674aa740 1 -- 172.21.15.100:0/2499968291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 msgr2=0x55abd5b5e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.921+0000 7f53674aa740 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b5e4f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f53540114f0 tx=0x7f53540119b0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 -- 172.21.15.100:0/2499968291 shutdown_connections 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b60e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b5e4f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 --2- 172.21.15.100:0/2499968291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b53c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 -- 172.21.15.100:0/2499968291 >> 172.21.15.100:0/2499968291 conn(0x55abd5b4fde0 msgr2=0x55abd5b501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 -- 172.21.15.100:0/2499968291 shutdown_connections 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 -- 172.21.15.100:0/2499968291 wait complete. 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 -- start start 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.922+0000 7f53674aa740 1 Processor -- start 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b53850 0x55abd5b5b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b54170 0x55abd5b5be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b5c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55abd5b61600 con 0x55abd5b53850 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55abd5a40900 con 0x55abd5b5ea30 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abd5b61780 con 0x55abd5b54170 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 10 client.0 _ll_register_callbacks cb 0x55abd5a3e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b53850 0x55abd5b5b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b5c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b53850 0x55abd5b5b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47272/0 (socket says 172.21.15.100:47272) 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535ed9d640 1 -- 172.21.15.100:0/1046277531 learned_addr learned my addr 172.21.15.100:0/1046277531 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535e59c640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b54170 0x55abd5b5be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535f59e640 1 -- 172.21.15.100:0/1046277531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b54170 msgr2=0x55abd5b5be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535f59e640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b54170 0x55abd5b5be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535f59e640 1 -- 172.21.15.100:0/1046277531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b53850 msgr2=0x55abd5b5b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535f59e640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b53850 0x55abd5b5b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535f59e640 1 -- 172.21.15.100:0/1046277531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abd5a80c50 con 0x55abd5b5ea30 2024-09-12T02:48:50.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535ed9d640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b53850 0x55abd5b5b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535e59c640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b54170 0x55abd5b5be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f535f59e640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b5c340 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55abd5b51160 tx=0x7f53580c11a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d4fbf5687f85b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f5342ff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f5342ff5640 1 -- 172.21.15.100:0/1046277531 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580c0950 con 0x55abd5b5ea30 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53540035f0 con 0x55abd5b5ea30 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.923+0000 7f5342ff5640 1 -- 172.21.15.100:0/1046277531 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f535803f810 con 0x55abd5b5ea30 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f5342ff5640 1 -- 172.21.15.100:0/1046277531 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53580c1300 con 0x55abd5b5ea30 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 10 client.26480 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abd5b6d240 con 0x55abd5b5ea30 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f5342ff5640 1 -- 172.21.15.100:0/1046277531 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53540035f0 con 0x55abd5b5ea30 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f5342ff5640 1 -- 172.21.15.100:0/1046277531 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5358052070 con 0x55abd5b5ea30 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 10 client.26480 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 10 client.26480 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:48:50.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 20 client.26480 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:50.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5b6e8d0 0x55abd5b70d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 4 client.26480 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:50.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abd5ac5890 con 0x55abd5b6e8d0 2024-09-12T02:48:50.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.924+0000 7f535ed9d640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5b6e8d0 0x55abd5b70d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.925+0000 7f535ed9d640 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5b6e8d0 0x55abd5b70d20 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abdb8c9b866cf4ec server_cookie=1c970c6b8f053a33 in_seq=0 out_seq=0 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.925+0000 7f5342ff5640 10 client.26480 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.925+0000 7f5342ff5640 1 -- 172.21.15.100:0/1046277531 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55abd5ac5890 con 0x55abd5b6e8d0 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.925+0000 7f5342ff5640 10 client.26480 handle_command_reply: tid=0 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.925+0000 7f53674aa740 1 client.26480 shutdown 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 msgr2=0x55abd5b5c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b5c340 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55abd5b51160 tx=0x7f53580c11a0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 shutdown_connections 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5b6e8d0 0x55abd5b70d20 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b5c340 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b54170 0x55abd5b5be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 --2- 172.21.15.100:0/1046277531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b53850 0x55abd5b5b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 >> 172.21.15.100:0/1046277531 conn(0x55abd5b4fde0 msgr2=0x55abd5b55ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.926+0000 7f5342ff5640 0 client.26480 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.928+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 shutdown_connections 2024-09-12T02:48:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.928+0000 7f53674aa740 1 -- 172.21.15.100:0/1046277531 wait complete. 2024-09-12T02:48:50.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.928+0000 7f53674aa740 20 client.26480 trim_cache size 0 max 16384 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 Processor -- start 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 -- start start 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b54170 0x55abd5b76590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b76ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53601adae0 con 0x55abd5b54170 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53601ab3b0 con 0x55abd5b5ea30 2024-09-12T02:48:50.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f53674aa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53601a9200 con 0x55abd5b53850 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f535e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b54170 0x55abd5b76590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:49042/0 (socket says 172.21.15.100:49042) 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f535ed9d640 1 -- 172.21.15.100:0/3018220035 learned_addr learned my addr 172.21.15.100:0/3018220035 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.950+0000 7f535f59e640 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b76ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f535ed9d640 1 -- 172.21.15.100:0/3018220035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 msgr2=0x55abd5b76ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f535ed9d640 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b76ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f535ed9d640 1 -- 172.21.15.100:0/3018220035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b54170 msgr2=0x55abd5b76590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f535ed9d640 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b54170 0x55abd5b76590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f535ed9d640 1 -- 172.21.15.100:0/3018220035 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abd5b5a870 con 0x55abd5b53850 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f535e59c640 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b54170 0x55abd5b76590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f535ed9d640 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b562b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55abd5b71500 tx=0x7f5350021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca3ea632855177b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f5344ff9640 1 -- 172.21.15.100:0/3018220035 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535001a030 con 0x55abd5b53850 2024-09-12T02:48:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f5344ff9640 1 -- 172.21.15.100:0/3018220035 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535001b040 con 0x55abd5b53850 2024-09-12T02:48:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.951+0000 7f5344ff9640 1 -- 172.21.15.100:0/3018220035 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5350004920 con 0x55abd5b53850 2024-09-12T02:48:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 -- 172.21.15.100:0/3018220035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 msgr2=0x55abd5b562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b562b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55abd5b71500 tx=0x7f5350021000 comp rx=0 tx=0).stop 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 -- 172.21.15.100:0/3018220035 shutdown_connections 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b5ea30 0x55abd5b76ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b54170 0x55abd5b76590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 --2- 172.21.15.100:0/3018220035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b562b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 -- 172.21.15.100:0/3018220035 >> 172.21.15.100:0/3018220035 conn(0x55abd5b4fde0 msgr2=0x55abd5b5d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 -- 172.21.15.100:0/3018220035 shutdown_connections 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 -- 172.21.15.100:0/3018220035 wait complete. 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.952+0000 7f53674aa740 1 -- start start 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 1 Processor -- start 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b62d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b63270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53601a9870 con 0x55abd5b5ea30 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53601aace0 con 0x55abd5b54170 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53601a9f40 con 0x55abd5b53850 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f53674aa740 10 client.0 _ll_register_callbacks cb 0x7f535803fea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535f59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b63270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b627f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:49052/0 (socket says 172.21.15.100:49052) 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 -- 172.21.15.100:0/908825727 learned_addr learned my addr 172.21.15.100:0/908825727 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535e59c640 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b62d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 -- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 msgr2=0x55abd5b62d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b62d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 -- 172.21.15.100:0/908825727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 msgr2=0x55abd5b63270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b63270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.953+0000 7f535ed9d640 1 -- 172.21.15.100:0/908825727 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abd5bd8630 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f535f59e640 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b63270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f535ed9d640 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b627f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5350011720 tx=0x7f535001f540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a611528cde47590 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f5342ff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f5342ff5640 1 -- 172.21.15.100:0/908825727 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5350005050 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f5342ff5640 1 -- 172.21.15.100:0/908825727 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5350027040 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f535001b040 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f5342ff5640 1 -- 172.21.15.100:0/908825727 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53500051f0 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f53674aa740 10 client.26428 fetch_fsmap learned FSMap version 27 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.954+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abd5bd98f0 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f5342ff5640 1 -- 172.21.15.100:0/908825727 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535001b040 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f5342ff5640 1 -- 172.21.15.100:0/908825727 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f53500214c0 con 0x55abd5b53850 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f53674aa740 10 client.26428 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:48:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f53674aa740 10 client.26428 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:48:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f53674aa740 20 client.26428 populate_metadata read hostname 'smithi100' 2024-09-12T02:48:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f53674aa740 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5bda010 0x55abd5bdc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f53674aa740 4 client.26428 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}] 2024-09-12T02:48:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}) -- 0x55abd5b4b410 con 0x55abd5bda010 2024-09-12T02:48:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.955+0000 7f535e59c640 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5bda010 0x55abd5bdc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.956+0000 7f535e59c640 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5bda010 0x55abd5bdc400 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9abe9d0cc5797708 server_cookie=5f8c3dd662300c1c in_seq=0 out_seq=0 2024-09-12T02:48:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:50.956+0000 7f5342ff5640 10 client.26428 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:50 smithi117 ceph-mon[34898]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.9 MiB/s wr, 329 op/s 2024-09-12T02:48:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:50 smithi100 ceph-mon[31390]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.9 MiB/s wr, 329 op/s 2024-09-12T02:48:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f5342ff5640 1 -- 172.21.15.100:0/908825727 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55abd5b4b410 con 0x55abd5bda010 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f5342ff5640 10 client.26428 handle_command_reply: tid=0 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 client.26428 shutdown 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 msgr2=0x55abd5b627f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b627f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5350011720 tx=0x7f535001f540 comp rx=0 tx=0).stop 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 shutdown_connections 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abd5bda010 0x55abd5bdc400 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abd5b5ea30 0x55abd5b63270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abd5b54170 0x55abd5b62d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 --2- 172.21.15.100:0/908825727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abd5b53850 0x55abd5b627f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f5342ff5640 0 client.26428 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:48:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 >> 172.21.15.100:0/908825727 conn(0x55abd5b4fde0 msgr2=0x55abd5b5b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 shutdown_connections 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 1 -- 172.21.15.100:0/908825727 wait complete. 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.218+0000 7f53674aa740 20 client.26428 trim_cache size 0 max 16384 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 42, 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bf958867": { 2024-09-12T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 42, 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 142.6, 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53480a2b80 msgr2=0x7f53480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53480a2b80 0x7f53480a5040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5350011dd0 tx=0x7f53500118c0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5360106a90 msgr2=0x7f536019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5360106a90 0x7f536019cca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f535802ae00 tx=0x7f5358031df0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 shutdown_connections 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53480a2b80 0x7f53480a5040 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5360106a90 0x7f536019cca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5360101430 0x7f5360198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 --2- 172.21.15.100:0/4065816444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5360100a90 0x7f53601983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 >> 172.21.15.100:0/4065816444 conn(0x7f53600fc7d0 msgr2=0x7f536006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 shutdown_connections 2024-09-12T02:48:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:48:51.219+0000 7f53650d1640 1 -- 172.21.15.100:0/4065816444 wait complete. 2024-09-12T02:48:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:50 smithi189 ceph-mon[35196]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.9 MiB/s wr, 329 op/s 2024-09-12T02:48:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 580.0 s, 1546.8 tps, lat 320.951 ms stddev 2364.529 2024-09-12T02:48:51.969 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bf958867', quiesce took 4.0 seconds. Will release after: 18.55 2024-09-12T02:48:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:52 smithi117 ceph-mon[34898]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.7 MiB/s wr, 149 op/s 2024-09-12T02:48:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:52 smithi100 ceph-mon[31390]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.7 MiB/s wr, 149 op/s 2024-09-12T02:48:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:52 smithi189 ceph-mon[35196]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.7 MiB/s wr, 149 op/s 2024-09-12T02:48:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:54 smithi117 ceph-mon[34898]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.0 MiB/s wr, 208 op/s 2024-09-12T02:48:55.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:54 smithi100 ceph-mon[31390]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.0 MiB/s wr, 208 op/s 2024-09-12T02:48:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:54 smithi189 ceph-mon[35196]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.0 MiB/s wr, 208 op/s 2024-09-12T02:48:56.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:48:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:56 smithi117 ceph-mon[34898]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-09-12T02:48:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:56 smithi100 ceph-mon[31390]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-09-12T02:48:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:56 smithi189 ceph-mon[35196]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-09-12T02:48:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:48:58 smithi117 ceph-mon[34898]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-12T02:48:59.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:48:58 smithi100 ceph-mon[31390]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-12T02:48:59.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:48:58 smithi189 ceph-mon[35196]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-12T02:49:01.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:00 smithi117 ceph-mon[34898]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 222 op/s 2024-09-12T02:49:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:00 smithi100 ceph-mon[31390]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 222 op/s 2024-09-12T02:49:01.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:49:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:00 smithi189 ceph-mon[35196]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 222 op/s 2024-09-12T02:49:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:49:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 -- 172.21.15.100:0/3480266233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c102db0 msgr2=0x7f736c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 --2- 172.21.15.100:0/3480266233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c102db0 0x7f736c103190 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7368009930 tx=0x7f736802a440 comp rx=0 tx=0).stop 2024-09-12T02:49:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 -- 172.21.15.100:0/3480266233 shutdown_connections 2024-09-12T02:49:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 --2- 172.21.15.100:0/3480266233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c1082e0 0x7f736c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 --2- 172.21.15.100:0/3480266233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c103760 0x7f736c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 --2- 172.21.15.100:0/3480266233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c102db0 0x7f736c103190 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 -- 172.21.15.100:0/3480266233 >> 172.21.15.100:0/3480266233 conn(0x7f736c0fc7d0 msgr2=0x7f736c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 -- 172.21.15.100:0/3480266233 shutdown_connections 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 -- 172.21.15.100:0/3480266233 wait complete. 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 Processor -- start 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.935+0000 7f7373b8f640 1 -- start start 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7373b8f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102db0 0x7f736c100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7373b8f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c103760 0x7f736c100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7373b8f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c1082e0 0x7f736c101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7373b8f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1120f0 con 0x7f736c103760 2024-09-12T02:49:01.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7373b8f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f736c111f70 con 0x7f736c1082e0 2024-09-12T02:49:01.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7373b8f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f736c112270 con 0x7f736c102db0 2024-09-12T02:49:01.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c103760 0x7f736c100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c103760 0x7f736c100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60878/0 (socket says 172.21.15.100:60878) 2024-09-12T02:49:01.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 -- 172.21.15.100:0/93723954 learned_addr learned my addr 172.21.15.100:0/93723954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:01.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737212c640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c1082e0 0x7f736c101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737192b640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102db0 0x7f736c100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 -- 172.21.15.100:0/93723954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102db0 msgr2=0x7f736c100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102db0 0x7f736c100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 -- 172.21.15.100:0/93723954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c1082e0 msgr2=0x7f736c101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c1082e0 0x7f736c101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 -- 172.21.15.100:0/93723954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c1a6a80 con 0x7f736c103760 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f737112a640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c103760 0x7f736c100f50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f735c006fd0 tx=0x7f735c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7362ffd640 1 -- 172.21.15.100:0/93723954 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c011830 con 0x7f736c103760 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.936+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c1a6d70 con 0x7f736c103760 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.937+0000 7f7362ffd640 1 -- 172.21.15.100:0/93723954 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735c016070 con 0x7f736c103760 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.937+0000 7f7362ffd640 1 -- 172.21.15.100:0/93723954 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00f2e0 con 0x7f736c103760 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.937+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c1a7250 con 0x7f736c103760 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7362ffd640 1 -- 172.21.15.100:0/93723954 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f735c01b460 con 0x7f736c103760 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 Processor -- start 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 -- start start 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8923880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b892e680 0x5633b8930a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5633b88892e0 con 0x5633b8923dc0 2024-09-12T02:49:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5633b8830ce0 con 0x5633b89234a0 2024-09-12T02:49:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.939+0000 7f7375f68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5633b88852a0 con 0x5633b892e680 2024-09-12T02:49:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60888/0 (socket says 172.21.15.100:60888) 2024-09-12T02:49:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 -- 172.21.15.100:0/1597754177 learned_addr learned my addr 172.21.15.100:0/1597754177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f7362ffd640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73580a2b80 0x7f73580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737212c640 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8923880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f7362ffd640 1 -- 172.21.15.100:0/93723954 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f735c0ce6e0 con 0x7f736c103760 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737212c640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73580a2b80 0x7f73580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737112a640 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b892e680 0x5633b8930a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 -- 172.21.15.100:0/1597754177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b892e680 msgr2=0x5633b8930a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b892e680 0x5633b8930a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 -- 172.21.15.100:0/1597754177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 msgr2=0x5633b8923880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8923880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 -- 172.21.15.100:0/1597754177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b8815440 con 0x5633b8923dc0 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737112a640 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b892e680 0x5633b8930a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737192b640 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892e140 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f736802a960 tx=0x7f7368004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439137ca5787ca4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f737212c640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73580a2b80 0x7f73580a5040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7364007310 tx=0x7f7364004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f7357fff640 1 -- 172.21.15.100:0/1597754177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368035030 con 0x5633b8923dc0 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f7357fff640 1 -- 172.21.15.100:0/1597754177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7368040070 con 0x5633b8923dc0 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.940+0000 7f7357fff640 1 -- 172.21.15.100:0/1597754177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368031c60 con 0x5633b8923dc0 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 -- 172.21.15.100:0/1597754177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 msgr2=0x5633b892e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892e140 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f736802a960 tx=0x7f7368004200 comp rx=0 tx=0).stop 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 -- 172.21.15.100:0/1597754177 shutdown_connections 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b892e680 0x5633b8930a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892e140 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 --2- 172.21.15.100:0/1597754177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8923880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 -- 172.21.15.100:0/1597754177 >> 172.21.15.100:0/1597754177 conn(0x5633b891fa30 msgr2=0x5633b891fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 -- 172.21.15.100:0/1597754177 shutdown_connections 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.941+0000 7f7375f68740 1 -- 172.21.15.100:0/1597754177 wait complete. 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 -- start start 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 Processor -- start 2024-09-12T02:49:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b89234a0 0x5633b892df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b892e680 0x5633b892b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5633b8931250 con 0x5633b8923dc0 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5633b8844050 con 0x5633b892e680 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5633b89313d0 con 0x5633b89234a0 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f7375f68740 10 client.0 _ll_register_callbacks cb 0x5633b8884160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f737112a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f737112a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60894/0 (socket says 172.21.15.100:60894) 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f737112a640 1 -- 172.21.15.100:0/786978279 learned_addr learned my addr 172.21.15.100:0/786978279 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f737192b640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b89234a0 0x5633b892df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.942+0000 7f737212c640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b892e680 0x5633b892b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f737112a640 1 -- 172.21.15.100:0/786978279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b89234a0 msgr2=0x5633b892df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f737112a640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b89234a0 0x5633b892df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f737112a640 1 -- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b892e680 msgr2=0x5633b892b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f737112a640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b892e680 0x5633b892b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f737112a640 1 -- 172.21.15.100:0/786978279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b85fa3c0 con 0x5633b8923dc0 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f737212c640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b892e680 0x5633b892b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f737112a640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892b200 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f735c09ae60 tx=0x7f735c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b37ff8545f2f3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f73557fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f73557fa640 1 -- 172.21.15.100:0/786978279 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c09f280 con 0x5633b8923dc0 2024-09-12T02:49:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f73557fa640 1 -- 172.21.15.100:0/786978279 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f735c097540 con 0x5633b8923dc0 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7368040070 con 0x5633b8923dc0 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f73557fa640 1 -- 172.21.15.100:0/786978279 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f735c0a3b40 con 0x5633b8923dc0 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f7375f68740 10 client.17166 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5633b893cb40 con 0x5633b8923dc0 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f73557fa640 1 -- 172.21.15.100:0/786978279 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7368040070 con 0x5633b8923dc0 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f73557fa640 1 -- 172.21.15.100:0/786978279 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f735c099d90 con 0x5633b8923dc0 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f7375f68740 10 client.17166 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f7375f68740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.943+0000 7f7375f68740 20 client.17166 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.944+0000 7f7375f68740 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b893e050 0x5633b8940460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.944+0000 7f7375f68740 4 client.17166 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.944+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633b8896850 con 0x5633b893e050 2024-09-12T02:49:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.944+0000 7f737192b640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b893e050 0x5633b8940460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.944+0000 7f73557fa640 10 client.17166 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.944+0000 7f737192b640 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b893e050 0x5633b8940460 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed773a99a7774296 server_cookie=2563ac6d500c4828 in_seq=0 out_seq=0 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.945+0000 7f73557fa640 1 -- 172.21.15.100:0/786978279 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633b8896850 con 0x5633b893e050 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.945+0000 7f73557fa640 10 client.17166 handle_command_reply: tid=0 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.945+0000 7f7375f68740 1 client.17166 shutdown 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 msgr2=0x5633b892b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892b200 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f735c09ae60 tx=0x7f735c0108e0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 shutdown_connections 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b893e050 0x5633b8940460 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f73557fa640 0 client.17166 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b892e680 0x5633b892b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b8923dc0 0x5633b892b200 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 --2- 172.21.15.100:0/786978279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b89234a0 0x5633b892df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 >> 172.21.15.100:0/786978279 conn(0x5633b891fa30 msgr2=0x5633b8925760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 shutdown_connections 2024-09-12T02:49:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 1 -- 172.21.15.100:0/786978279 wait complete. 2024-09-12T02:49:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.946+0000 7f7375f68740 20 client.17166 trim_cache size 0 max 16384 2024-09-12T02:49:01.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 Processor -- start 2024-09-12T02:49:01.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 -- start start 2024-09-12T02:49:01.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b891fa30 0x5633b892d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8945d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8946270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1b2010 con 0x5633b891fa30 2024-09-12T02:49:01.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1af8e0 con 0x5633b89234a0 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f7375f68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1ad730 con 0x5633b8923dc0 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b891fa30 0x5633b892d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b891fa30 0x5633b892d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60908/0 (socket says 172.21.15.100:60908) 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 -- 172.21.15.100:0/566591768 learned_addr learned my addr 172.21.15.100:0/566591768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737212c640 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8946270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737112a640 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8945d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 -- 172.21.15.100:0/566591768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 msgr2=0x5633b8946270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8946270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 -- 172.21.15.100:0/566591768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 msgr2=0x5633b8945d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8945d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 -- 172.21.15.100:0/566591768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b891f860 con 0x5633b891fa30 2024-09-12T02:49:01.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737112a640 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8945d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:01.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.963+0000 7f737192b640 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b891fa30 0x5633b892d170 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f736802a960 tx=0x7f7368005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9fe83bfa12313 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:01.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f73577fe640 1 -- 172.21.15.100:0/566591768 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368054070 con 0x5633b891fa30 2024-09-12T02:49:01.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f73577fe640 1 -- 172.21.15.100:0/566591768 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7368040070 con 0x5633b891fa30 2024-09-12T02:49:01.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f73577fe640 1 -- 172.21.15.100:0/566591768 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368035040 con 0x5633b891fa30 2024-09-12T02:49:01.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 -- 172.21.15.100:0/566591768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b891fa30 msgr2=0x5633b892d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b891fa30 0x5633b892d170 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f736802a960 tx=0x7f7368005c00 comp rx=0 tx=0).stop 2024-09-12T02:49:01.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 -- 172.21.15.100:0/566591768 shutdown_connections 2024-09-12T02:49:01.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8946270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b89234a0 0x5633b8945d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 --2- 172.21.15.100:0/566591768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b891fa30 0x5633b892d170 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 -- 172.21.15.100:0/566591768 >> 172.21.15.100:0/566591768 conn(0x5633b892b8a0 msgr2=0x5633b892ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 -- 172.21.15.100:0/566591768 shutdown_connections 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.964+0000 7f7375f68740 1 -- 172.21.15.100:0/566591768 wait complete. 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 -- start start 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 Processor -- start 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b891fa30 0x5633b8936e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b89234a0 0x5633b8934190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8934710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1adda0 con 0x5633b89234a0 2024-09-12T02:49:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1af210 con 0x5633b891fa30 2024-09-12T02:49:01.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1ae470 con 0x5633b8923dc0 2024-09-12T02:49:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f7375f68740 10 client.0 _ll_register_callbacks cb 0x7f735c09aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f737112a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b89234a0 0x5633b8934190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f737112a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b89234a0 0x5633b8934190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60924/0 (socket says 172.21.15.100:60924) 2024-09-12T02:49:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f737112a640 1 -- 172.21.15.100:0/1411086154 learned_addr learned my addr 172.21.15.100:0/1411086154 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.965+0000 7f737192b640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b891fa30 0x5633b8936e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737212c640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8934710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737112a640 1 -- 172.21.15.100:0/1411086154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 msgr2=0x5633b8934710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737112a640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8934710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737112a640 1 -- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b891fa30 msgr2=0x5633b8936e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737112a640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b891fa30 0x5633b8936e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737112a640 1 -- 172.21.15.100:0/1411086154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b8934f40 con 0x5633b89234a0 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737212c640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8934710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f737112a640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b89234a0 0x5633b8934190 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f735c009fd0 tx=0x7f735c010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab844b5cc6d0db5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f73557fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f73557fa640 1 -- 172.21.15.100:0/1411086154 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c07d020 con 0x5633b89234a0 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f73557fa640 1 -- 172.21.15.100:0/1411086154 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f735c0a06e0 con 0x5633b89234a0 2024-09-12T02:49:01.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7368040070 con 0x5633b89234a0 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f73557fa640 1 -- 172.21.15.100:0/1411086154 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f735c099fa0 con 0x5633b89234a0 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f7375f68740 10 client.17172 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5633b89a8d30 con 0x5633b89234a0 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f73557fa640 1 -- 172.21.15.100:0/1411086154 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7368040070 con 0x5633b89234a0 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.966+0000 7f73557fa640 1 -- 172.21.15.100:0/1411086154 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f735c096c20 con 0x5633b89234a0 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 10 client.17172 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 20 client.17172 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b892e680 0x5633b89ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 4 client.17172 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5633b8890d60 con 0x5633b892e680 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f737192b640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b892e680 0x5633b89ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f737192b640 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b892e680 0x5633b89ab540 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8afb06f2a14874e server_cookie=4839798c49d11726 in_seq=0 out_seq=0 2024-09-12T02:49:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f73557fa640 10 client.17172 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f73557fa640 1 -- 172.21.15.100:0/1411086154 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5633b8890d60 con 0x5633b892e680 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f73557fa640 10 client.17172 handle_command_reply: tid=0 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 1 client.17172 shutdown 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b89234a0 msgr2=0x5633b8934190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.967+0000 7f7375f68740 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b89234a0 0x5633b8934190 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f735c009fd0 tx=0x7f735c010f20 comp rx=0 tx=0).stop 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 shutdown_connections 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5633b892e680 0x5633b89ab540 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633b8923dc0 0x5633b8934710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633b89234a0 0x5633b8934190 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 --2- 172.21.15.100:0/1411086154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5633b891fa30 0x5633b8936e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f73557fa640 0 client.17172 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 >> 172.21.15.100:0/1411086154 conn(0x5633b892b8a0 msgr2=0x5633b892d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 shutdown_connections 2024-09-12T02:49:01.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 1 -- 172.21.15.100:0/1411086154 wait complete. 2024-09-12T02:49:01.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7375f68740 20 client.17172 trim_cache size 0 max 16384 2024-09-12T02:49:01.976 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:49:01.976 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:49:01.976 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:49:01.976 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:49:01.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73580a2b80 msgr2=0x7f73580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73580a2b80 0x7f73580a5040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7364007310 tx=0x7f7364004ab0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c103760 msgr2=0x7f736c100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c103760 0x7f736c100f50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f735c006fd0 tx=0x7f735c00b8e0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 shutdown_connections 2024-09-12T02:49:01.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73580a2b80 0x7f73580a5040 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f736c1082e0 0x7f736c101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f736c103760 0x7f736c100f50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 --2- 172.21.15.100:0/93723954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102db0 0x7f736c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 >> 172.21.15.100:0/93723954 conn(0x7f736c0fc7d0 msgr2=0x7f736c105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:01.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 shutdown_connections 2024-09-12T02:49:01.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:01.968+0000 7f7373b8f640 1 -- 172.21.15.100:0/93723954 wait complete. 2024-09-12T02:49:02.843 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:02 smithi100 ceph-mon[31390]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 MiB/s wr, 252 op/s 2024-09-12T02:49:02.871 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:49:02.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:49:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:02 smithi117 ceph-mon[34898]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 MiB/s wr, 252 op/s 2024-09-12T02:49:03.118 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:02 smithi189 ceph-mon[35196]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 MiB/s wr, 252 op/s 2024-09-12T02:49:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 -- 172.21.15.100:0/760833421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee30100ca0 msgr2=0x7fee30106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 --2- 172.21.15.100:0/760833421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee30100ca0 0x7fee30106840 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009930 tx=0x7fee2c02a420 comp rx=0 tx=0).stop 2024-09-12T02:49:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 -- 172.21.15.100:0/760833421 shutdown_connections 2024-09-12T02:49:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 --2- 172.21.15.100:0/760833421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee30106f50 0x7fee3010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 --2- 172.21.15.100:0/760833421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee30100ca0 0x7fee30106840 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 --2- 172.21.15.100:0/760833421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee301002f0 0x7fee301006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 -- 172.21.15.100:0/760833421 >> 172.21.15.100:0/760833421 conn(0x7fee30077210 msgr2=0x7fee300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 -- 172.21.15.100:0/760833421 shutdown_connections 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 -- 172.21.15.100:0/760833421 wait complete. 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 Processor -- start 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 -- start start 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.602+0000 7fee387e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee301002f0 0x7fee30101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee387e0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30100ca0 0x7fee301017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee387e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee30106f50 0x7fee30101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee387e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fee30111fa0 con 0x7fee301002f0 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee387e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee30111e20 con 0x7fee30106f50 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee387e0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee30112120 con 0x7fee30100ca0 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee301002f0 0x7fee30101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee301002f0 0x7fee30101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60936/0 (socket says 172.21.15.100:60936) 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 -- 172.21.15.100:0/1093815481 learned_addr learned my addr 172.21.15.100:0/1093815481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee36d7d640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee30106f50 0x7fee30101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee35d7b640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30100ca0 0x7fee301017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 -- 172.21.15.100:0/1093815481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30100ca0 msgr2=0x7fee301017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30100ca0 0x7fee301017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 -- 172.21.15.100:0/1093815481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee30106f50 msgr2=0x7fee30101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee30106f50 0x7fee30101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 -- 172.21.15.100:0/1093815481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee301a69e0 con 0x7fee301002f0 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee35d7b640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30100ca0 0x7fee301017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee3657c640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee301002f0 0x7fee30101270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c970 tx=0x7fee2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee277fe640 1 -- 172.21.15.100:0/1093815481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20007bb0 con 0x7fee301002f0 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee277fe640 1 -- 172.21.15.100:0/1093815481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee20007d50 con 0x7fee301002f0 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee277fe640 1 -- 172.21.15.100:0/1093815481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2000f450 con 0x7fee301002f0 2024-09-12T02:49:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee301a6cd0 con 0x7fee301002f0 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.603+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee301a71c0 con 0x7fee301002f0 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.604+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee301006d0 con 0x7fee301002f0 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.606+0000 7fee277fe640 1 -- 172.21.15.100:0/1093815481 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fee20004fe0 con 0x7fee301002f0 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.606+0000 7fee277fe640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fee1c0a2b80 0x7fee1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.606+0000 7fee277fe640 1 -- 172.21.15.100:0/1093815481 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fee200cf280 con 0x7fee301002f0 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.606+0000 7fee35d7b640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fee1c0a2b80 0x7fee1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.607+0000 7fee35d7b640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fee1c0a2b80 0x7fee1c0a5040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fee2c000c00 tx=0x7fee2c032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.609+0000 7fee277fe640 1 -- 172.21.15.100:0/1093815481 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee20014030 con 0x7fee301002f0 2024-09-12T02:49:03.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.810+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee301027a0 con 0x7fee301002f0 2024-09-12T02:49:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.810+0000 7fee277fe640 1 -- 172.21.15.100:0/1093815481 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fee301027a0 con 0x7fee301002f0 2024-09-12T02:49:03.812 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:49:03.812 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:49:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:49:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fee1c0a2b80 msgr2=0x7fee1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fee1c0a2b80 0x7fee1c0a5040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fee2c000c00 tx=0x7fee2c032c70 comp rx=0 tx=0).stop 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee301002f0 msgr2=0x7fee30101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee301002f0 0x7fee30101270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c970 tx=0x7fee2000ce30 comp rx=0 tx=0).stop 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 shutdown_connections 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fee1c0a2b80 0x7fee1c0a5040 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee30106f50 0x7fee30101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30100ca0 0x7fee301017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 --2- 172.21.15.100:0/1093815481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee301002f0 0x7fee30101270 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 >> 172.21.15.100:0/1093815481 conn(0x7fee30077210 msgr2=0x7fee30105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 shutdown_connections 2024-09-12T02:49:03.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:03.813+0000 7fee387e0640 1 -- 172.21.15.100:0/1093815481 wait complete. 2024-09-12T02:49:04.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:03 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1093815481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:04.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:03 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1093815481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:04.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:03 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1093815481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:04.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:49:04.732 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:04 smithi117 ceph-mon[34898]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.2 MiB/s wr, 263 op/s 2024-09-12T02:49:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:04 smithi100 ceph-mon[31390]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.2 MiB/s wr, 263 op/s 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 -- 172.21.15.100:0/2877974185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9260102d40 msgr2=0x7f9260103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 --2- 172.21.15.100:0/2877974185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9260102d40 0x7f9260103120 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9250009900 tx=0x7f925002a480 comp rx=0 tx=0).stop 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 -- 172.21.15.100:0/2877974185 shutdown_connections 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 --2- 172.21.15.100:0/2877974185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926010c170 0x7f926010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 --2- 172.21.15.100:0/2877974185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9260103660 0x7f926010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 --2- 172.21.15.100:0/2877974185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9260102d40 0x7f9260103120 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 -- 172.21.15.100:0/2877974185 >> 172.21.15.100:0/2877974185 conn(0x7f92600fc7a0 msgr2=0x7f92600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 -- 172.21.15.100:0/2877974185 shutdown_connections 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.228+0000 7f9265270640 1 -- 172.21.15.100:0/2877974185 wait complete. 2024-09-12T02:49:05.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 Processor -- start 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 -- start start 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260102d40 0x7f92601984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9260103660 0x7f9260198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f926010c170 0x7f926019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9260111f70 con 0x7f926010c170 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9260111df0 con 0x7f9260102d40 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.229+0000 7f9265270640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92601120f0 con 0x7f9260103660 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f926010c170 0x7f926019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260102d40 0x7f92601984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260102d40 0x7f92601984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:37868/0 (socket says 172.21.15.100:37868) 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f926010c170 0x7f926019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44760/0 (socket says 172.21.15.100:44760) 2024-09-12T02:49:05.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 -- 172.21.15.100:0/126910265 learned_addr learned my addr 172.21.15.100:0/126910265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925e7fc640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9260103660 0x7f9260198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 -- 172.21.15.100:0/126910265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9260103660 msgr2=0x7f9260198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9260103660 0x7f9260198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 -- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f926010c170 msgr2=0x7f926019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f926010c170 0x7f926019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 -- 172.21.15.100:0/126910265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926019d480 con 0x7f9260102d40 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925f7fe640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f926010c170 0x7f926019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f925effd640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260102d40 0x7f92601984d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9250006010 tx=0x7f9250004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f9247fff640 1 -- 172.21.15.100:0/126910265 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925003f030 con 0x7f9260102d40 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926019d710 con 0x7f9260102d40 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92601a5050 con 0x7f9260102d40 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f9247fff640 1 -- 172.21.15.100:0/126910265 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9250004440 con 0x7f9260102d40 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.230+0000 7f9247fff640 1 -- 172.21.15.100:0/126910265 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250049060 con 0x7f9260102d40 2024-09-12T02:49:05.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 Processor -- start 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9247fff640 1 -- 172.21.15.100:0/126910265 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9250042030 con 0x7f9260102d40 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 -- start start 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db050090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db050a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db05d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f3dafb62f0 con 0x55f3db05b370 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f3daf5dcf0 con 0x55f3db051b40 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9267649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f3dafb22b0 con 0x55f3db0505d0 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db050090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:37872/0 (socket says 172.21.15.100:37872) 2024-09-12T02:49:05.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db05d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 -- 172.21.15.100:0/3019038700 learned_addr learned my addr 172.21.15.100:0/3019038700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925effd640 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db050a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f9247fff640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f92480a2b80 0x7f92480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 -- 172.21.15.100:0/3019038700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 msgr2=0x55f3db050a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db050a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 -- 172.21.15.100:0/3019038700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 msgr2=0x55f3db05d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db05d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925f7fe640 1 -- 172.21.15.100:0/3019038700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3daf423a0 con 0x55f3db051b40 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.233+0000 7f925effd640 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db050a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.234+0000 7f9247fff640 1 -- 172.21.15.100:0/126910265 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f92500eedd0 con 0x7f9260102d40 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.234+0000 7f925f7fe640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f92480a2b80 0x7f92480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.234+0000 7f925f7fe640 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db050090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9258011790 tx=0x7f9258011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4929dc61920a33c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.234+0000 7f92457fa640 1 -- 172.21.15.100:0/3019038700 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925800f9a0 con 0x55f3db051b40 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.234+0000 7f92457fa640 1 -- 172.21.15.100:0/3019038700 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f925800fc80 con 0x55f3db051b40 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.234+0000 7f92457fa640 1 -- 172.21.15.100:0/3019038700 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925801cbc0 con 0x55f3db051b40 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- 172.21.15.100:0/3019038700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 msgr2=0x55f3db050090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f925f7fe640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f92480a2b80 0x7f92480a5040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9258020000 tx=0x7f9258021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db050090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9258011790 tx=0x7f9258011c50 comp rx=0 tx=0).stop 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- 172.21.15.100:0/3019038700 shutdown_connections 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db05d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db050a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 --2- 172.21.15.100:0/3019038700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db050090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- 172.21.15.100:0/3019038700 >> 172.21.15.100:0/3019038700 conn(0x55f3db019310 msgr2=0x55f3db04cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- 172.21.15.100:0/3019038700 shutdown_connections 2024-09-12T02:49:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- 172.21.15.100:0/3019038700 wait complete. 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- start start 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 Processor -- start 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db05ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db057f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db0584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f3db05e070 con 0x55f3db051b40 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f3daf71060 con 0x55f3db0505d0 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f3db05e1f0 con 0x55f3db05b370 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f9267649740 10 client.0 _ll_register_callbacks cb 0x55f3dacc48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db057f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f925effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db05ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db057f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44772/0 (socket says 172.21.15.100:44772) 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.235+0000 7f925e7fc640 1 -- 172.21.15.100:0/737740102 learned_addr learned my addr 172.21.15.100:0/737740102 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925f7fe640 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db0584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925effd640 1 -- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 msgr2=0x55f3db0584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925effd640 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db0584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925effd640 1 -- 172.21.15.100:0/737740102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 msgr2=0x55f3db057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925effd640 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db057f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925effd640 1 -- 172.21.15.100:0/737740102 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3dad273c0 con 0x55f3db0505d0 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925e7fc640 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db057f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f925effd640 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db05ace0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f92500ec910 tx=0x7f92500bb5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e945186bc97bd2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f9242ff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f9242ff5640 1 -- 172.21.15.100:0/737740102 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250035070 con 0x55f3db0505d0 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f925800fc80 con 0x55f3db0505d0 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f9242ff5640 1 -- 172.21.15.100:0/737740102 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f92500b7e00 con 0x55f3db0505d0 2024-09-12T02:49:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f9242ff5640 1 -- 172.21.15.100:0/737740102 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f92500bfa90 con 0x55f3db0505d0 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f9267649740 10 client.26516 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.236+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3db069ae0 con 0x55f3db0505d0 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9242ff5640 1 -- 172.21.15.100:0/737740102 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f925800fc80 con 0x55f3db0505d0 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9242ff5640 1 -- 172.21.15.100:0/737740102 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9250031bd0 con 0x55f3db0505d0 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9267649740 10 client.26516 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9267649740 10 client.26516 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9267649740 20 client.26516 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9267649740 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db06ae30 0x55f3db06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9267649740 4 client.26516 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3dafc3860 con 0x55f3db06ae30 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f925e7fc640 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db06ae30 0x55f3db06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f9242ff5640 10 client.26516 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.237+0000 7f925e7fc640 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db06ae30 0x55f3db06d280 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a70657b886bd48f server_cookie=a397a659e3f8975d in_seq=0 out_seq=0 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.238+0000 7f9242ff5640 1 -- 172.21.15.100:0/737740102 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3dafc3860 con 0x55f3db06ae30 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.238+0000 7f9242ff5640 10 client.26516 handle_command_reply: tid=0 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.238+0000 7f9267649740 1 client.26516 shutdown 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 msgr2=0x55f3db05ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db05ace0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f92500ec910 tx=0x7f92500bb5e0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 shutdown_connections 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db06ae30 0x55f3db06d280 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db0584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db057f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 --2- 172.21.15.100:0/737740102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db05ace0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 >> 172.21.15.100:0/737740102 conn(0x55f3db019310 msgr2=0x55f3db052960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:05.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9242ff5640 0 client.26516 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:05.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 shutdown_connections 2024-09-12T02:49:05.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 1 -- 172.21.15.100:0/737740102 wait complete. 2024-09-12T02:49:05.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.239+0000 7f9267649740 20 client.26516 trim_cache size 0 max 16384 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.252+0000 7f9267649740 1 Processor -- start 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f9267649740 1 -- start start 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f9267649740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db04ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f9267649740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db067370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f9267649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db057850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f9267649740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92601afee0 con 0x55f3db051b40 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f9267649740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f92601ad7b0 con 0x55f3db0505d0 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f9267649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92601ab600 con 0x55f3db05b370 2024-09-12T02:49:05.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db067370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44778/0 (socket says 172.21.15.100:44778) 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 -- 172.21.15.100:0/1529655513 learned_addr learned my addr 172.21.15.100:0/1529655513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925effd640 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db04ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925f7fe640 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db057850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 -- 172.21.15.100:0/1529655513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 msgr2=0x55f3db057850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db057850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 -- 172.21.15.100:0/1529655513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 msgr2=0x55f3db04ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db04ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 -- 172.21.15.100:0/1529655513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3db056f40 con 0x55f3db051b40 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925effd640 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db04ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.253+0000 7f925e7fc640 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db067370 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9254009460 tx=0x7f9254005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116c062ed0642a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9244ff9640 1 -- 172.21.15.100:0/1529655513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254022070 con 0x55f3db051b40 2024-09-12T02:49:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9244ff9640 1 -- 172.21.15.100:0/1529655513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9254012420 con 0x55f3db051b40 2024-09-12T02:49:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9244ff9640 1 -- 172.21.15.100:0/1529655513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254004d90 con 0x55f3db051b40 2024-09-12T02:49:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 -- 172.21.15.100:0/1529655513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 msgr2=0x55f3db067370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db067370 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9254009460 tx=0x7f9254005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 -- 172.21.15.100:0/1529655513 shutdown_connections 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db05b370 0x55f3db057850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db051b40 0x55f3db067370 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 --2- 172.21.15.100:0/1529655513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db0505d0 0x55f3db04ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 -- 172.21.15.100:0/1529655513 >> 172.21.15.100:0/1529655513 conn(0x55f3db019310 msgr2=0x55f3db04c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.254+0000 7f9267649740 1 -- 172.21.15.100:0/1529655513 shutdown_connections 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 -- 172.21.15.100:0/1529655513 wait complete. 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 -- start start 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 Processor -- start 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db063870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db063db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db054b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92601abc70 con 0x55f3db05b370 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f92601ad0e0 con 0x55f3db051b40 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92601ac340 con 0x55f3db0505d0 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f9267649740 10 client.0 _ll_register_callbacks cb 0x7f9250005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f925effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db063870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db054b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f925effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db063870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38964/0 (socket says 172.21.15.100:38964) 2024-09-12T02:49:05.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db063db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:37882/0 (socket says 172.21.15.100:37882) 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.255+0000 7f925effd640 1 -- 172.21.15.100:0/2655499238 learned_addr learned my addr 172.21.15.100:0/2655499238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f925effd640 1 -- 172.21.15.100:0/2655499238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 msgr2=0x55f3db063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f925effd640 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db063db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f925effd640 1 -- 172.21.15.100:0/2655499238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 msgr2=0x55f3db054b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f925effd640 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db054b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f925effd640 1 -- 172.21.15.100:0/2655499238 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3db0553c0 con 0x55f3db0505d0 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f925effd640 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db063870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92500ecc30 tx=0x7f92500a62c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=444ac04b7e0384f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f9242ff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f9242ff5640 1 -- 172.21.15.100:0/2655499238 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250035040 con 0x55f3db0505d0 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f9242ff5640 1 -- 172.21.15.100:0/2655499238 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f92500babe0 con 0x55f3db0505d0 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.256+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9254012420 con 0x55f3db0505d0 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9242ff5640 1 -- 172.21.15.100:0/2655499238 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f92500c4350 con 0x55f3db0505d0 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 10 client.26452 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3db0553c0 con 0x55f3db0505d0 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9242ff5640 1 -- 172.21.15.100:0/2655499238 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92500bae00 con 0x55f3db0505d0 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9242ff5640 1 -- 172.21.15.100:0/2655499238 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9250075060 con 0x55f3db0505d0 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 10 client.26452 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 10 client.26452 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 20 client.26452 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db0d5c60 0x55f3db0d8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 4 client.26452 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.257+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9254012420 con 0x55f3db0d5c60 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f925e7fc640 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db0d5c60 0x55f3db0d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f925e7fc640 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db0d5c60 0x55f3db0d8080 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f496d846644a64e7 server_cookie=87c5d3bcfa8b4272 in_seq=0 out_seq=0 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f9242ff5640 10 client.26452 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f9242ff5640 1 -- 172.21.15.100:0/2655499238 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9254012420 con 0x55f3db0d5c60 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f9242ff5640 10 client.26452 handle_command_reply: tid=0 2024-09-12T02:49:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f9267649740 1 client.26452 shutdown 2024-09-12T02:49:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:04 smithi189 ceph-mon[35196]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.2 MiB/s wr, 263 op/s 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 msgr2=0x55f3db063870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.258+0000 7f9267649740 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db063870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92500ecc30 tx=0x7f92500a62c0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 shutdown_connections 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55f3db0d5c60 0x55f3db0d8080 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f3db05b370 0x55f3db054b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3db051b40 0x55f3db063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9242ff5640 0 client.26452 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 --2- 172.21.15.100:0/2655499238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f3db0505d0 0x55f3db063870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 >> 172.21.15.100:0/2655499238 conn(0x55f3db019310 msgr2=0x55f3db0597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 shutdown_connections 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 1 -- 172.21.15.100:0/2655499238 wait complete. 2024-09-12T02:49:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9267649740 20 client.26452 trim_cache size 0 max 16384 2024-09-12T02:49:05.266 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f92480a2b80 msgr2=0x7f92480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9265270640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f92480a2b80 0x7f92480a5040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9258020000 tx=0x7f9258021000 comp rx=0 tx=0).stop 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260102d40 msgr2=0x7f92601984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9265270640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260102d40 0x7f92601984d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9250006010 tx=0x7f9250004040 comp rx=0 tx=0).stop 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 shutdown_connections 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.259+0000 7f9265270640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f92480a2b80 0x7f92480a5040 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.260+0000 7f9265270640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f926010c170 0x7f926019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.260+0000 7f9265270640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9260103660 0x7f9260198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.260+0000 7f9265270640 1 --2- 172.21.15.100:0/126910265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260102d40 0x7f92601984d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:05.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.260+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 >> 172.21.15.100:0/126910265 conn(0x7f92600fc7a0 msgr2=0x7f92600fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:05.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.260+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 shutdown_connections 2024-09-12T02:49:05.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:05.260+0000 7f9265270640 1 -- 172.21.15.100:0/126910265 wait complete. 2024-09-12T02:49:05.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:49:05.968 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:05 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:06.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:05 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:06.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:05 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:49:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:06 smithi100 ceph-mon[31390]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.6 MiB/s wr, 217 op/s 2024-09-12T02:49:07.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:06 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 -- 172.21.15.100:0/2799981116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 msgr2=0x7f40e410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 --2- 172.21.15.100:0/2799981116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e410ec40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009930 tx=0x7f40dc02a420 comp rx=0 tx=0).stop 2024-09-12T02:49:07.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 -- 172.21.15.100:0/2799981116 shutdown_connections 2024-09-12T02:49:07.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 --2- 172.21.15.100:0/2799981116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e410ec40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 --2- 172.21.15.100:0/2799981116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e41036e0 0x7f40e4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 --2- 172.21.15.100:0/2799981116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e4102d30 0x7f40e4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 -- 172.21.15.100:0/2799981116 >> 172.21.15.100:0/2799981116 conn(0x7f40e40fc7d0 msgr2=0x7f40e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 -- 172.21.15.100:0/2799981116 shutdown_connections 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 -- 172.21.15.100:0/2799981116 wait complete. 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 Processor -- start 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.238+0000 7f40e9a22640 1 -- start start 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e9a22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e4102d30 0x7f40e41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e9a22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e41036e0 0x7f40e4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e9a22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e9a22640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41120a0 con 0x7f40e41082a0 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e9a22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4111f20 con 0x7f40e41036e0 2024-09-12T02:49:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e9a22640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4112220 con 0x7f40e4102d30 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e419cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44814/0 (socket says 172.21.15.100:44814) 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 -- 172.21.15.100:0/3831063723 learned_addr learned my addr 172.21.15.100:0/3831063723 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e27fc640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e41036e0 0x7f40e4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e4102d30 0x7f40e41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 -- 172.21.15.100:0/3831063723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e4102d30 msgr2=0x7f40e41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e4102d30 0x7f40e41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 -- 172.21.15.100:0/3831063723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e41036e0 msgr2=0x7f40e4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e41036e0 0x7f40e4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 -- 172.21.15.100:0/3831063723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e419d470 con 0x7f40e41082a0 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e4102d30 0x7f40e41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.239+0000 7f40e37fe640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e419cd90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005ab0 tx=0x7f40dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.240+0000 7f40e8a20640 1 -- 172.21.15.100:0/3831063723 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc03f030 con 0x7f40e41082a0 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.240+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e419d700 con 0x7f40e41082a0 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.240+0000 7f40e8a20640 1 -- 172.21.15.100:0/3831063723 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40dc003ce0 con 0x7f40e41082a0 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.240+0000 7f40e8a20640 1 -- 172.21.15.100:0/3831063723 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc035070 con 0x7f40e41082a0 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.240+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41a5040 con 0x7f40e41082a0 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40e8a20640 1 -- 172.21.15.100:0/3831063723 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f40dc042030 con 0x7f40e41082a0 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 Processor -- start 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 -- start start 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39abc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39abca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39ac9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd39a222f0 con 0x55cd39abc5d0 2024-09-12T02:49:07.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cd399c9cf0 con 0x55cd39ac7370 2024-09-12T02:49:07.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.242+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cd39a1e2b0 con 0x55cd39abdb40 2024-09-12T02:49:07.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39abca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39abca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44822/0 (socket says 172.21.15.100:44822) 2024-09-12T02:49:07.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 -- 172.21.15.100:0/2569374870 learned_addr learned my addr 172.21.15.100:0/2569374870 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:07.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e27fc640 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39ac9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e27fc640 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39abc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 -- 172.21.15.100:0/2569374870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 msgr2=0x55cd39abc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39abc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 -- 172.21.15.100:0/2569374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 msgr2=0x55cd39ac9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39ac9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 -- 172.21.15.100:0/2569374870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd399ae3a0 con 0x55cd39abc5d0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e27fc640 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39ac9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e8a20640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40d00a2b80 0x7f40d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e27fc640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40d00a2b80 0x7f40d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39abca10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f40d400af40 tx=0x7f40d400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4501b7f9d56191 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40e8a20640 1 -- 172.21.15.100:0/3831063723 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f40dc0ef9d0 con 0x7f40e41082a0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40d9ffb640 1 -- 172.21.15.100:0/2569374870 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4004d20 con 0x55cd39abc5d0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40d9ffb640 1 -- 172.21.15.100:0/2569374870 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d4011b30 con 0x55cd39abc5d0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.243+0000 7f40d9ffb640 1 -- 172.21.15.100:0/2569374870 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4005760 con 0x55cd39abc5d0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2569374870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 msgr2=0x55cd39abca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40e27fc640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40d00a2b80 0x7f40d00a5040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55cd39abd070 tx=0x7f40cc00a680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39abca10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f40d400af40 tx=0x7f40d400f7f0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2569374870 shutdown_connections 2024-09-12T02:49:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39ac9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39abca10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2569374870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39abc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2569374870 >> 172.21.15.100:0/2569374870 conn(0x55cd39a85310 msgr2=0x55cd39ab8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2569374870 shutdown_connections 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2569374870 wait complete. 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.244+0000 7f40ebdfb740 1 -- start start 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 1 Processor -- start 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abdb40 0x55cd39ac4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39ac7370 0x55cd39ac47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd39aca070 con 0x55cd39abdb40 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cd399dd060 con 0x55cd39abc5d0 2024-09-12T02:49:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cd39aca1f0 con 0x55cd39ac7370 2024-09-12T02:49:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40ebdfb740 10 client.0 _ll_register_callbacks cb 0x55cd397308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abdb40 0x55cd39ac4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abdb40 0x55cd39ac4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44826/0 (socket says 172.21.15.100:44826) 2024-09-12T02:49:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 -- 172.21.15.100:0/364101573 learned_addr learned my addr 172.21.15.100:0/364101573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e37fe640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39ac7370 0x55cd39ac47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 -- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39ac7370 msgr2=0x55cd39ac47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39ac7370 0x55cd39ac47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 -- 172.21.15.100:0/364101573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 msgr2=0x55cd39ac6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e27fc640 1 -- 172.21.15.100:0/364101573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd397933c0 con 0x55cd39abdb40 2024-09-12T02:49:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.245+0000 7f40e37fe640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39ac7370 0x55cd39ac47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40e27fc640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abdb40 0x55cd39ac4060 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f40cc01fb80 tx=0x7f40cc00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4731776264653999 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40c2ffd640 1 -- 172.21.15.100:0/364101573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc02e060 con 0x55cd39abdb40 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40c2ffd640 1 -- 172.21.15.100:0/364101573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f40cc01dab0 con 0x55cd39abdb40 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d4011b30 con 0x55cd39abdb40 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40c2ffd640 1 -- 172.21.15.100:0/364101573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f40cc01dcb0 con 0x55cd39abdb40 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 10 client.17208 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd39ad5bc0 con 0x55cd39abdb40 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40c2ffd640 1 -- 172.21.15.100:0/364101573 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d4011b30 con 0x55cd39abdb40 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40c2ffd640 1 -- 172.21.15.100:0/364101573 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f40cc0343f0 con 0x55cd39abdb40 2024-09-12T02:49:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 10 client.17208 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 10 client.17208 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 20 client.17208 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39ad7080 0x55cd39ad94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 4 client.17208 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.246+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd39a2f860 con 0x55cd39ad7080 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.247+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39ad7080 0x55cd39ad94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.247+0000 7f40c2ffd640 10 client.17208 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.247+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39ad7080 0x55cd39ad94c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f0cb14b986595e2 server_cookie=f8ebdbc4a5a7276a in_seq=0 out_seq=0 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40c2ffd640 1 -- 172.21.15.100:0/364101573 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd39a2f860 con 0x55cd39ad7080 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40c2ffd640 10 client.17208 handle_command_reply: tid=0 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 client.17208 shutdown 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abdb40 msgr2=0x55cd39ac4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abdb40 0x55cd39ac4060 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f40cc01fb80 tx=0x7f40cc00a2d0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 shutdown_connections 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39ad7080 0x55cd39ad94c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39ac7370 0x55cd39ac47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abdb40 0x55cd39ac4060 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/364101573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40c2ffd640 0 client.17208 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 >> 172.21.15.100:0/364101573 conn(0x55cd39a85310 msgr2=0x55cd39abe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 shutdown_connections 2024-09-12T02:49:07.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 1 -- 172.21.15.100:0/364101573 wait complete. 2024-09-12T02:49:07.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.248+0000 7f40ebdfb740 20 client.17208 trim_cache size 0 max 16384 2024-09-12T02:49:07.269 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:06 smithi189 ceph-mon[35196]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.6 MiB/s wr, 217 op/s 2024-09-12T02:49:07.269 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.270 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.270 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.270 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:06 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 Processor -- start 2024-09-12T02:49:07.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 -- start start 2024-09-12T02:49:07.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39ab8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39aded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41afec0 con 0x55cd39abc5d0 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41ad790 con 0x55cd39ac7370 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41ab5e0 con 0x55cd39abdb40 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39ab8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39ab8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44828/0 (socket says 172.21.15.100:44828) 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 -- 172.21.15.100:0/3388590710 learned_addr learned my addr 172.21.15.100:0/3388590710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 -- 172.21.15.100:0/3388590710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 msgr2=0x55cd39ac3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e27fc640 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e37fe640 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39aded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 -- 172.21.15.100:0/3388590710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 msgr2=0x55cd39aded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39aded90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.261+0000 7f40e2ffd640 1 -- 172.21.15.100:0/3388590710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd39ac3030 con 0x55cd39abc5d0 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39ab8e10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x55cd39ab9ac0 tx=0x7f40d400a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fdf48cfd8e837e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40d97fa640 1 -- 172.21.15.100:0/3388590710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4003b70 con 0x55cd39abc5d0 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40d97fa640 1 -- 172.21.15.100:0/3388590710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d4011b30 con 0x55cd39abc5d0 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40d97fa640 1 -- 172.21.15.100:0/3388590710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4005310 con 0x55cd39abc5d0 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 -- 172.21.15.100:0/3388590710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 msgr2=0x55cd39ab8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39ab8e10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x55cd39ab9ac0 tx=0x7f40d400a830 comp rx=0 tx=0).stop 2024-09-12T02:49:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 -- 172.21.15.100:0/3388590710 shutdown_connections 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39ac7370 0x55cd39aded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/3388590710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39abc5d0 0x55cd39ab8e10 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 -- 172.21.15.100:0/3388590710 >> 172.21.15.100:0/3388590710 conn(0x55cd39a85310 msgr2=0x55cd39ab8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 -- 172.21.15.100:0/3388590710 shutdown_connections 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.262+0000 7f40ebdfb740 1 -- 172.21.15.100:0/3388590710 wait complete. 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 -- start start 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 Processor -- start 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39ac7370 0x55cd39ac1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41abc50 con 0x55cd39ac7370 2024-09-12T02:49:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41ad0c0 con 0x55cd39abc5d0 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41ac320 con 0x55cd39abdb40 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40ebdfb740 10 client.0 _ll_register_callbacks cb 0x7f40cc005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39ac7370 0x55cd39ac1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39ac7370 0x55cd39ac1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44838/0 (socket says 172.21.15.100:44838) 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40e37fe640 1 -- 172.21.15.100:0/2564578912 learned_addr learned my addr 172.21.15.100:0/2564578912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.263+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e27fc640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e37fe640 1 -- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 msgr2=0x55cd39ac1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e37fe640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e37fe640 1 -- 172.21.15.100:0/2564578912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 msgr2=0x55cd39ac10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e37fe640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e37fe640 1 -- 172.21.15.100:0/2564578912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd39b40db0 con 0x55cd39ac7370 2024-09-12T02:49:07.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e27fc640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40e37fe640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39ac7370 0x55cd39ac1b50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0bbec0 tx=0x7f40dc0bc050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03a1818ab224289 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40c2ffd640 1 -- 172.21.15.100:0/2564578912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc049040 con 0x55cd39ac7370 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40c2ffd640 1 -- 172.21.15.100:0/2564578912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f40dc003800 con 0x55cd39ac7370 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d4011b30 con 0x55cd39ac7370 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40c2ffd640 1 -- 172.21.15.100:0/2564578912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f40dc0bc8c0 con 0x55cd39ac7370 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40ebdfb740 10 client.17214 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd39b42140 con 0x55cd39ac7370 2024-09-12T02:49:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40c2ffd640 1 -- 172.21.15.100:0/2564578912 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d4011b30 con 0x55cd39ac7370 2024-09-12T02:49:07.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.264+0000 7f40c2ffd640 1 -- 172.21.15.100:0/2564578912 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f40dc0b8830 con 0x55cd39ac7370 2024-09-12T02:49:07.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40ebdfb740 10 client.17214 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:07.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40ebdfb740 10 client.17214 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:49:07.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40ebdfb740 20 client.17214 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39b42860 0x55cd39b44c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40ebdfb740 4 client.17214 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd39a29d70 con 0x55cd39b42860 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39b42860 0x55cd39b44c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40c2ffd640 10 client.17214 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40e2ffd640 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39b42860 0x55cd39b44c50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb4302448b8b1649 server_cookie=170f2d6b6ea38a2 in_seq=0 out_seq=0 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40c2ffd640 1 -- 172.21.15.100:0/2564578912 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd39a29d70 con 0x55cd39b42860 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40c2ffd640 10 client.17214 handle_command_reply: tid=0 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.265+0000 7f40ebdfb740 1 client.17214 shutdown 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39ac7370 msgr2=0x55cd39ac1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39ac7370 0x55cd39ac1b50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0bbec0 tx=0x7f40dc0bc050 comp rx=0 tx=0).stop 2024-09-12T02:49:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 shutdown_connections 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55cd39b42860 0x55cd39b44c50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd39ac7370 0x55cd39ac1b50 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cd39abdb40 0x55cd39ac1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 --2- 172.21.15.100:0/2564578912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cd39abc5d0 0x55cd39ac10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 >> 172.21.15.100:0/2564578912 conn(0x55cd39a85310 msgr2=0x55cd39ac58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40c2ffd640 0 client.17214 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 shutdown_connections 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 1 -- 172.21.15.100:0/2564578912 wait complete. 2024-09-12T02:49:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40ebdfb740 20 client.17214 trim_cache size 0 max 16384 2024-09-12T02:49:07.284 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:49:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40d00a2b80 msgr2=0x7f40d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40d00a2b80 0x7f40d00a5040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55cd39abd070 tx=0x7f40cc00a680 comp rx=0 tx=0).stop 2024-09-12T02:49:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 msgr2=0x7f40e419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e419cd90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005ab0 tx=0x7f40dc0042f0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 shutdown_connections 2024-09-12T02:49:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40d00a2b80 0x7f40d00a5040 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e41082a0 0x7f40e419cd90 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e41036e0 0x7f40e4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 --2- 172.21.15.100:0/3831063723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e4102d30 0x7f40e41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 >> 172.21.15.100:0/3831063723 conn(0x7f40e40fc7d0 msgr2=0x7f40e4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.266+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 shutdown_connections 2024-09-12T02:49:07.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:07.267+0000 7f40e9a22640 1 -- 172.21.15.100:0/3831063723 wait complete. 2024-09-12T02:49:07.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:06 smithi117 ceph-mon[34898]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.6 MiB/s wr, 217 op/s 2024-09-12T02:49:07.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:07.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:06 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:08.026 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:49:08.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:07 smithi189 ceph-mon[35196]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.4 MiB/s wr, 205 op/s 2024-09-12T02:49:08.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:07 smithi117 ceph-mon[34898]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.4 MiB/s wr, 205 op/s 2024-09-12T02:49:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:07 smithi100 ceph-mon[31390]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.4 MiB/s wr, 205 op/s 2024-09-12T02:49:08.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 -- 172.21.15.100:0/3555737570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38101de0 msgr2=0x7f9c381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/3555737570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38101de0 0x7f9c381021c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009900 tx=0x7f9c3002a410 comp rx=0 tx=0).stop 2024-09-12T02:49:08.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 -- 172.21.15.100:0/3555737570 shutdown_connections 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/3555737570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c38106f10 0x7f9c3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/3555737570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38102790 0x7f9c381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/3555737570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38101de0 0x7f9c381021c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 -- 172.21.15.100:0/3555737570 >> 172.21.15.100:0/3555737570 conn(0x7f9c380fd8c0 msgr2=0x7f9c380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 -- 172.21.15.100:0/3555737570 shutdown_connections 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.817+0000 7f9c3d40e640 1 -- 172.21.15.100:0/3555737570 wait complete. 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 Processor -- start 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 -- start start 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c38101de0 0x7f9c38198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38102790 0x7f9c38198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38106f10 0x7f9c3819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38111f70 con 0x7f9c38106f10 2024-09-12T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38111df0 con 0x7f9c38102790 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c3d40e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381120f0 con 0x7f9c38101de0 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38106f10 0x7f9c3819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38106f10 0x7f9c3819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44850/0 (socket says 172.21.15.100:44850) 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c377fe640 1 -- 172.21.15.100:0/1904291177 learned_addr learned my addr 172.21.15.100:0/1904291177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c38101de0 0x7f9c38198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.818+0000 7f9c367fc640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38102790 0x7f9c38198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c377fe640 1 -- 172.21.15.100:0/1904291177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c38101de0 msgr2=0x7f9c38198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c377fe640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c38101de0 0x7f9c38198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c377fe640 1 -- 172.21.15.100:0/1904291177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38102790 msgr2=0x7f9c38198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c377fe640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38102790 0x7f9c38198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c377fe640 1 -- 172.21.15.100:0/1904291177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3819d3e0 con 0x7f9c38106f10 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c377fe640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38106f10 0x7f9c3819cd00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800d750 tx=0x7f9c2800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c2ffff640 1 -- 172.21.15.100:0/1904291177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28017070 con 0x7f9c38106f10 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3819d6d0 con 0x7f9c38106f10 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c2ffff640 1 -- 172.21.15.100:0/1904291177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c28005500 con 0x7f9c38106f10 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c2ffff640 1 -- 172.21.15.100:0/1904291177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28004d90 con 0x7f9c38106f10 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.819+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c381a4fb0 con 0x7f9c38106f10 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.821+0000 7f9c2ffff640 1 -- 172.21.15.100:0/1904291177 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9c28005020 con 0x7f9c38106f10 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 Processor -- start 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 -- start start 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c2ffff640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c240a2b80 0x7f9c240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c367fc640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c240a2b80 0x7f9c240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c2ffff640 1 -- 172.21.15.100:0/1904291177 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9c280ce940 con 0x7f9c38106f10 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ac2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46acf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560d46a282f0 con 0x560d46ac3b40 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560d469cfcf0 con 0x560d46ac25d0 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560d46a242b0 con 0x560d46acd370 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44860/0 (socket says 172.21.15.100:44860) 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c36ffd640 1 -- 172.21.15.100:0/573386868 learned_addr learned my addr 172.21.15.100:0/573386868 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c367fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ac2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.822+0000 7f9c377fe640 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46acf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c36ffd640 1 -- 172.21.15.100:0/573386868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 msgr2=0x560d46acf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46acf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c36ffd640 1 -- 172.21.15.100:0/573386868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 msgr2=0x560d46ac2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ac2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c367fc640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c240a2b80 0x7f9c240a5040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9c380fdce0 tx=0x7f9c20004410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c36ffd640 1 -- 172.21.15.100:0/573386868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d469b43a0 con 0x560d46ac3b40 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac2090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009900 tx=0x7f9c30005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad80ca848edf16f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c2d7fa640 1 -- 172.21.15.100:0/573386868 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30040070 con 0x560d46ac3b40 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c2d7fa640 1 -- 172.21.15.100:0/573386868 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30031970 con 0x560d46ac3b40 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.823+0000 7f9c2d7fa640 1 -- 172.21.15.100:0/573386868 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30035040 con 0x560d46ac3b40 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/573386868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 msgr2=0x560d46ac2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac2090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009900 tx=0x7f9c30005e80 comp rx=0 tx=0).stop 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/573386868 shutdown_connections 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46acf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ac2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/573386868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac2090 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/573386868 >> 172.21.15.100:0/573386868 conn(0x560d46a8b310 msgr2=0x560d46abec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/573386868 shutdown_connections 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/573386868 wait complete. 2024-09-12T02:49:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 -- start start 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.824+0000 7f9c3f7e7740 1 Processor -- start 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46accca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46acd370 0x560d46aca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560d46ad0010 con 0x560d46ac3b40 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560d469e3060 con 0x560d46acd370 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560d46ad0190 con 0x560d46ac25d0 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 10 client.0 _ll_register_callbacks cb 0x560d467368c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46acd370 0x560d46aca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44866/0 (socket says 172.21.15.100:44866) 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46accca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 -- 172.21.15.100:0/2823236195 learned_addr learned my addr 172.21.15.100:0/2823236195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 -- 172.21.15.100:0/2823236195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 msgr2=0x560d46accca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46accca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 -- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46acd370 msgr2=0x560d46aca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46acd370 0x560d46aca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 -- 172.21.15.100:0/2823236195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d467993c0 con 0x560d46ac3b40 2024-09-12T02:49:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c377fe640 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46acd370 0x560d46aca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c367fc640 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac9fa0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9c20014210 tx=0x7f9c2001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca618c046ae082f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2823236195 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20011850 con 0x560d46ac3b40 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2823236195 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9c200119f0 con 0x560d46ac3b40 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.825+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c30031970 con 0x560d46ac3b40 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2823236195 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c20030050 con 0x560d46ac3b40 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 10 client.17226 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d46adba40 con 0x560d46ac3b40 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2823236195 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30031970 con 0x560d46ac3b40 2024-09-12T02:49:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2823236195 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9c2001f3d0 con 0x560d46ac3b40 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 10 client.17226 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 10 client.17226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 20 client.17226 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46adce50 0x560d46adf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 4 client.17226 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d46a35860 con 0x560d46adce50 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.826+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46adce50 0x560d46adf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.827+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46adce50 0x560d46adf2b0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c46ee8758919e82 server_cookie=3178303acd6cd819 in_seq=0 out_seq=0 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.827+0000 7f9c1e7fc640 10 client.17226 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.827+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2823236195 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d46a35860 con 0x560d46adce50 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.827+0000 7f9c1e7fc640 10 client.17226 handle_command_reply: tid=0 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.827+0000 7f9c3f7e7740 1 client.17226 shutdown 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 msgr2=0x560d46ac9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac9fa0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9c20014210 tx=0x7f9c2001a000 comp rx=0 tx=0).stop 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 shutdown_connections 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46adce50 0x560d46adf2b0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46acd370 0x560d46aca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c1e7fc640 0 client.17226 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ac9fa0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2823236195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46accca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 >> 172.21.15.100:0/2823236195 conn(0x560d46a8b310 msgr2=0x560d46ac4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 shutdown_connections 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2823236195 wait complete. 2024-09-12T02:49:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.828+0000 7f9c3f7e7740 20 client.17226 trim_cache size 0 max 16384 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 Processor -- start 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 -- start start 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ad92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ae4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46ae5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381afec0 con 0x560d46ac3b40 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ad790 con 0x560d46ac25d0 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ab5e0 con 0x560d46acd370 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ae4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ae4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44878/0 (socket says 172.21.15.100:44878) 2024-09-12T02:49:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 -- 172.21.15.100:0/2095065413 learned_addr learned my addr 172.21.15.100:0/2095065413 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ad92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c377fe640 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46ae5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 -- 172.21.15.100:0/2095065413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 msgr2=0x560d46ae5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46ae5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 -- 172.21.15.100:0/2095065413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 msgr2=0x560d46ad92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ad92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c367fc640 1 -- 172.21.15.100:0/2095065413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d46acc8a0 con 0x560d46ac3b40 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.841+0000 7f9c377fe640 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46ae5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.842+0000 7f9c367fc640 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ae4bd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9c2001f7a0 tx=0x7f9c20015f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a38ef07b6db527 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.842+0000 7f9c2cff9640 1 -- 172.21.15.100:0/2095065413 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20039070 con 0x560d46ac3b40 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.842+0000 7f9c2cff9640 1 -- 172.21.15.100:0/2095065413 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c20024070 con 0x560d46ac3b40 2024-09-12T02:49:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.842+0000 7f9c2cff9640 1 -- 172.21.15.100:0/2095065413 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20011650 con 0x560d46ac3b40 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.842+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2095065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 msgr2=0x560d46ae4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.842+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ae4bd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9c2001f7a0 tx=0x7f9c20015f70 comp rx=0 tx=0).stop 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2095065413 shutdown_connections 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46acd370 0x560d46ae5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46ac3b40 0x560d46ae4bd0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2095065413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac25d0 0x560d46ad92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2095065413 >> 172.21.15.100:0/2095065413 conn(0x560d46a8b310 msgr2=0x560d46ac52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2095065413 shutdown_connections 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2095065413 wait complete. 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- start start 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 Processor -- start 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46ad10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac3b40 0x560d46ad15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46acd370 0x560d46ad1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381abc50 con 0x560d46acd370 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ad0c0 con 0x560d46ac3b40 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c381ac320 con 0x560d46ac25d0 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c3f7e7740 10 client.0 _ll_register_callbacks cb 0x7f9c20003ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46acd370 0x560d46ad1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46acd370 0x560d46ad1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44882/0 (socket says 172.21.15.100:44882) 2024-09-12T02:49:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c377fe640 1 -- 172.21.15.100:0/2357672508 learned_addr learned my addr 172.21.15.100:0/2357672508 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.843+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46ad10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c367fc640 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac3b40 0x560d46ad15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c377fe640 1 -- 172.21.15.100:0/2357672508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 msgr2=0x560d46ad10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c377fe640 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46ad10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c377fe640 1 -- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac3b40 msgr2=0x560d46ad15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c377fe640 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac3b40 0x560d46ad15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c377fe640 1 -- 172.21.15.100:0/2357672508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d46b46ba0 con 0x560d46acd370 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c377fe640 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46acd370 0x560d46ad1b20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009610 tx=0x7f9c28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb20814b3992d60e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2357672508 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28020040 con 0x560d46acd370 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2357672508 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f9c28097850 con 0x560d46acd370 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c20024070 con 0x560d46acd370 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2357672508 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c2809f4e0 con 0x560d46acd370 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c3f7e7740 10 client.17232 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.844+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d46b47da0 con 0x560d46acd370 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2357672508 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c20024070 con 0x560d46acd370 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2357672508 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9c2809a0a0 con 0x560d46acd370 2024-09-12T02:49:08.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c3f7e7740 10 client.17232 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c3f7e7740 10 client.17232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c3f7e7740 20 client.17232 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46b48510 0x560d46b4a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c3f7e7740 4 client.17232 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d46a2fd70 con 0x560d46b48510 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46b48510 0x560d46b4a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c1e7fc640 10 client.17232 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.845+0000 7f9c36ffd640 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46b48510 0x560d46b4a930 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdb0bf8d67202ae1 server_cookie=8f8e53a6d3f50212 in_seq=0 out_seq=0 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c1e7fc640 1 -- 172.21.15.100:0/2357672508 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d46a2fd70 con 0x560d46b48510 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c1e7fc640 10 client.17232 handle_command_reply: tid=0 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 client.17232 shutdown 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46acd370 msgr2=0x560d46ad1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46acd370 0x560d46ad1b20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009610 tx=0x7f9c28009bd0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 shutdown_connections 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x560d46b48510 0x560d46b4a930 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d46acd370 0x560d46ad1b20 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d46ac3b40 0x560d46ad15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 --2- 172.21.15.100:0/2357672508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560d46ac25d0 0x560d46ad10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c1e7fc640 0 client.17232 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 >> 172.21.15.100:0/2357672508 conn(0x560d46a8b310 msgr2=0x560d46acb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 shutdown_connections 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 1 -- 172.21.15.100:0/2357672508 wait complete. 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3f7e7740 20 client.17232 trim_cache size 0 max 16384 2024-09-12T02:49:08.864 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:49:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c240a2b80 msgr2=0x7f9c240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c240a2b80 0x7f9c240a5040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9c380fdce0 tx=0x7f9c20004410 comp rx=0 tx=0).stop 2024-09-12T02:49:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38106f10 msgr2=0x7f9c3819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.846+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38106f10 0x7f9c3819cd00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800d750 tx=0x7f9c2800dc10 comp rx=0 tx=0).stop 2024-09-12T02:49:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 shutdown_connections 2024-09-12T02:49:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f9c240a2b80 0x7f9c240a5040 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c38106f10 0x7f9c3819cd00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38102790 0x7f9c38198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 --2- 172.21.15.100:0/1904291177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c38101de0 0x7f9c38198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 >> 172.21.15.100:0/1904291177 conn(0x7f9c380fd8c0 msgr2=0x7f9c380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 shutdown_connections 2024-09-12T02:49:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:08.847+0000 7f9c3d40e640 1 -- 172.21.15.100:0/1904291177 wait complete. 2024-09-12T02:49:09.547 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.548 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.548 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:09.548 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:09.548 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:09.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:09.594 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:09.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:09.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:09.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:49:10.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:49:10.548 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:10 smithi100 ceph-mon[31390]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.4 MiB/s wr, 204 op/s 2024-09-12T02:49:10.579 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:49:10.579 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:49:10.599 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:10 smithi117 ceph-mon[34898]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.4 MiB/s wr, 204 op/s 2024-09-12T02:49:10.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:10 smithi189 ceph-mon[35196]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.4 MiB/s wr, 204 op/s 2024-09-12T02:49:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:11.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.245+0000 7f0f8df09640 1 -- 172.21.15.100:0/2631589365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f88106f20 msgr2=0x7f0f8810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 --2- 172.21.15.100:0/2631589365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f88106f20 0x7f0f8810eaa0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009900 tx=0x7f0f8002a410 comp rx=0 tx=0).stop 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 -- 172.21.15.100:0/2631589365 shutdown_connections 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 --2- 172.21.15.100:0/2631589365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f88106f20 0x7f0f8810eaa0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 --2- 172.21.15.100:0/2631589365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f881027a0 0x7f0f881067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 --2- 172.21.15.100:0/2631589365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f88101df0 0x7f0f881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 -- 172.21.15.100:0/2631589365 >> 172.21.15.100:0/2631589365 conn(0x7f0f880fd8b0 msgr2=0x7f0f880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 -- 172.21.15.100:0/2631589365 shutdown_connections 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 -- 172.21.15.100:0/2631589365 wait complete. 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 Processor -- start 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.246+0000 7f0f8df09640 1 -- start start 2024-09-12T02:49:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f88101df0 0x7f0f88198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f881027a0 0x7f0f881988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f88106f20 0x7f0f8819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f88111f80 con 0x7f0f881027a0 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f88111e00 con 0x7f0f88106f20 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f88112100 con 0x7f0f88101df0 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f881027a0 0x7f0f881988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f881027a0 0x7f0f881988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44912/0 (socket says 172.21.15.100:44912) 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 -- 172.21.15.100:0/1105175094 learned_addr learned my addr 172.21.15.100:0/1105175094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f87fff640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f88106f20 0x7f0f8819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f877fe640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f88101df0 0x7f0f88198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 -- 172.21.15.100:0/1105175094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f88101df0 msgr2=0x7f0f88198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f88101df0 0x7f0f88198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 -- 172.21.15.100:0/1105175094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f88106f20 msgr2=0x7f0f8819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f88106f20 0x7f0f8819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 -- 172.21.15.100:0/1105175094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8819d330 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f87fff640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f88106f20 0x7f0f8819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f86ffd640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f881027a0 0x7f0f881988c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e9f0 tx=0x7f0f7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f84ff9640 1 -- 172.21.15.100:0/1105175094 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00cd80 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8819d620 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f84ff9640 1 -- 172.21.15.100:0/1105175094 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f7c010910 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f84ff9640 1 -- 172.21.15.100:0/1105175094 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0188f0 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.247+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f881a4f00 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.248+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f881021d0 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.250+0000 7f0f84ff9640 1 -- 172.21.15.100:0/1105175094 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f0f7c010ac0 con 0x7f0f881027a0 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.250+0000 7f0f84ff9640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0f700a2b80 0x7f0f700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.250+0000 7f0f877fe640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0f700a2b80 0x7f0f700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.250+0000 7f0f84ff9640 1 -- 172.21.15.100:0/1105175094 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f0f7c0cf920 con 0x7f0f881027a0 2024-09-12T02:49:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.251+0000 7f0f877fe640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0f700a2b80 0x7f0f700a5040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0f78005fd0 tx=0x7f0f78009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.253+0000 7f0f84ff9640 1 -- 172.21.15.100:0/1105175094 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f7c09c810 con 0x7f0f881027a0 2024-09-12T02:49:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:11.304 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:49:11.861 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:11 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1105175094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:11.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.467+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f881996e0 con 0x7f0f881027a0 2024-09-12T02:49:11.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.468+0000 7f0f84ff9640 1 -- 172.21.15.100:0/1105175094 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f0f881996e0 con 0x7f0f881027a0 2024-09-12T02:49:11.862 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:49:11.862 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0f700a2b80 msgr2=0x7f0f700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0f700a2b80 0x7f0f700a5040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0f78005fd0 tx=0x7f0f78009500 comp rx=0 tx=0).stop 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f881027a0 msgr2=0x7f0f881988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f881027a0 0x7f0f881988c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e9f0 tx=0x7f0f7c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 shutdown_connections 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0f700a2b80 0x7f0f700a5040 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f88106f20 0x7f0f8819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f881027a0 0x7f0f881988c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 --2- 172.21.15.100:0/1105175094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f88101df0 0x7f0f88198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 >> 172.21.15.100:0/1105175094 conn(0x7f0f880fd8b0 msgr2=0x7f0f880fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 shutdown_connections 2024-09-12T02:49:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.470+0000 7f0f8df09640 1 -- 172.21.15.100:0/1105175094 wait complete. 2024-09-12T02:49:11.864 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:11 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1105175094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 -- 172.21.15.100:0/1853723252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec1055b0 msgr2=0x7f50ec10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 --2- 172.21.15.100:0/1853723252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec1055b0 0x7f50ec10d130 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009ca0 tx=0x7f50e402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 -- 172.21.15.100:0/1853723252 shutdown_connections 2024-09-12T02:49:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 --2- 172.21.15.100:0/1853723252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec1055b0 0x7f50ec10d130 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 --2- 172.21.15.100:0/1853723252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50ec100e30 0x7f50ec104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 --2- 172.21.15.100:0/1853723252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50ec100480 0x7f50ec100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 -- 172.21.15.100:0/1853723252 >> 172.21.15.100:0/1853723252 conn(0x7f50ec077210 msgr2=0x7f50ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 -- 172.21.15.100:0/1853723252 shutdown_connections 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 -- 172.21.15.100:0/1853723252 wait complete. 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 Processor -- start 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.882+0000 7f50f3f50640 1 -- start start 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50ec100480 0x7f50ec1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec100e30 0x7f50ec198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50ec1055b0 0x7f50ec19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec111f90 con 0x7f50ec100e30 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec111e10 con 0x7f50ec100480 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec112110 con 0x7f50ec1055b0 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec100e30 0x7f50ec198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec100e30 0x7f50ec198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44926/0 (socket says 172.21.15.100:44926) 2024-09-12T02:49:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 -- 172.21.15.100:0/3241433867 learned_addr learned my addr 172.21.15.100:0/3241433867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f1cec640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50ec100480 0x7f50ec1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50ec1055b0 0x7f50ec19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 -- 172.21.15.100:0/3241433867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50ec1055b0 msgr2=0x7f50ec19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50ec1055b0 0x7f50ec19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 -- 172.21.15.100:0/3241433867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50ec100480 msgr2=0x7f50ec1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50ec100480 0x7f50ec1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 -- 172.21.15.100:0/3241433867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec19d380 con 0x7f50ec100e30 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f14eb640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec100e30 0x7f50ec198910 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d950 tx=0x7f50dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50e2ffd640 1 -- 172.21.15.100:0/3241433867 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc017070 con 0x7f50ec100e30 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50e2ffd640 1 -- 172.21.15.100:0/3241433867 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50dc009c30 con 0x7f50ec100e30 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50e2ffd640 1 -- 172.21.15.100:0/3241433867 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00f6b0 con 0x7f50ec100e30 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec19d670 con 0x7f50ec100e30 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.883+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec1a4f50 con 0x7f50ec100e30 2024-09-12T02:49:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50e2ffd640 1 -- 172.21.15.100:0/3241433867 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f50dc0109d0 con 0x7f50ec100e30 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 Processor -- start 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 -- start start 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deab98f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deaba3d40 0x561deaba6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561deaafe280 con 0x561deab99480 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561deaaa5b10 con 0x561deab98b60 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.886+0000 7f50f6329740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561deaafa240 con 0x561deaba3d40 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44936/0 (socket says 172.21.15.100:44936) 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 -- 172.21.15.100:0/3847204039 learned_addr learned my addr 172.21.15.100:0/3847204039 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50e2ffd640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50d80a2b80 0x7f50d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deab98f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f14eb640 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deaba3d40 0x561deaba6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50d80a2b80 0x7f50d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50e2ffd640 1 -- 172.21.15.100:0/3241433867 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f50dc0ceb30 con 0x7f50ec100e30 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 -- 172.21.15.100:0/3847204039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deaba3d40 msgr2=0x561deaba6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deaba3d40 0x561deaba6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 -- 172.21.15.100:0/3847204039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 msgr2=0x561deab98f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deab98f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 -- 172.21.15.100:0/3847204039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561deaab21f0 con 0x561deab99480 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deab98f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f14eb640 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deaba3d40 0x561deaba6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f1cec640 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba3800 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f50e800bcd0 tx=0x7f50e80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f888475b940772c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50d80a2b80 0x7f50d80a5040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f50e4004af0 tx=0x7f50e4004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50d7fff640 1 -- 172.21.15.100:0/3847204039 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8005220 con 0x561deab99480 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50d7fff640 1 -- 172.21.15.100:0/3847204039 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e8004c80 con 0x561deab99480 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.887+0000 7f50d7fff640 1 -- 172.21.15.100:0/3847204039 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e80117a0 con 0x561deab99480 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 -- 172.21.15.100:0/3847204039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 msgr2=0x561deaba3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba3800 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f50e800bcd0 tx=0x7f50e80107a0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 -- 172.21.15.100:0/3847204039 shutdown_connections 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deaba3d40 0x561deaba6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba3800 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 --2- 172.21.15.100:0/3847204039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deab98f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 -- 172.21.15.100:0/3847204039 >> 172.21.15.100:0/3847204039 conn(0x561deab950f0 msgr2=0x561deab954d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 -- 172.21.15.100:0/3847204039 shutdown_connections 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.888+0000 7f50f6329740 1 -- 172.21.15.100:0/3847204039 wait complete. 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 -- start start 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 Processor -- start 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab98b60 0x561deaba0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deaba3d40 0x561deaba16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561deaba6910 con 0x561deab99480 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561deaab8f10 con 0x561deaba3d40 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561deaba6a90 con 0x561deab98b60 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f6329740 10 client.0 _ll_register_callbacks cb 0x561deaa81a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44946/0 (socket says 172.21.15.100:44946) 2024-09-12T02:49:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 -- 172.21.15.100:0/224515866 learned_addr learned my addr 172.21.15.100:0/224515866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f1cec640 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab98b60 0x561deaba0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f24ed640 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deaba3d40 0x561deaba16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 -- 172.21.15.100:0/224515866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab98b60 msgr2=0x561deaba0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab98b60 0x561deaba0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 -- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deaba3d40 msgr2=0x561deaba16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deaba3d40 0x561deaba16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.889+0000 7f50f14eb640 1 -- 172.21.15.100:0/224515866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dea86f6a0 con 0x561deab99480 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f14eb640 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba1160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f50dc09b3c0 tx=0x7f50dc010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354301feaf64caa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50d57fa640 1 -- 172.21.15.100:0/224515866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc020040 con 0x561deab99480 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50d57fa640 1 -- 172.21.15.100:0/224515866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f50dc09a880 con 0x561deab99480 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e8004c80 con 0x561deab99480 2024-09-12T02:49:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50d57fa640 1 -- 172.21.15.100:0/224515866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50dc09f730 con 0x561deab99480 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 10 client.17250 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561deabb24b0 con 0x561deab99480 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50d57fa640 1 -- 172.21.15.100:0/224515866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e8004c80 con 0x561deab99480 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50d57fa640 1 -- 172.21.15.100:0/224515866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f50dc097180 con 0x561deab99480 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 10 client.17250 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 20 client.17250 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deabb3970 0x561deabb5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 4 client.17250 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.890+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561deab0b7f0 con 0x561deabb3970 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.891+0000 7f50f1cec640 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deabb3970 0x561deabb5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.891+0000 7f50d57fa640 10 client.17250 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.891+0000 7f50f1cec640 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deabb3970 0x561deabb5d60 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=277a1940e4383b95 server_cookie=7b35b7999a7ca725 in_seq=0 out_seq=0 2024-09-12T02:49:11.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50d57fa640 1 -- 172.21.15.100:0/224515866 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561deab0b7f0 con 0x561deabb3970 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50d57fa640 10 client.17250 handle_command_reply: tid=0 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 client.17250 shutdown 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 msgr2=0x561deaba1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba1160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f50dc09b3c0 tx=0x7f50dc010d70 comp rx=0 tx=0).stop 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 shutdown_connections 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deabb3970 0x561deabb5d60 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deaba3d40 0x561deaba16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deab99480 0x561deaba1160 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50d57fa640 0 client.17250 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 --2- 172.21.15.100:0/224515866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab98b60 0x561deaba0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 >> 172.21.15.100:0/224515866 conn(0x561deab950f0 msgr2=0x561deab9ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 shutdown_connections 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 1 -- 172.21.15.100:0/224515866 wait complete. 2024-09-12T02:49:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.892+0000 7f50f6329740 20 client.17250 trim_cache size 0 max 16384 2024-09-12T02:49:11.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 Processor -- start 2024-09-12T02:49:11.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 -- start start 2024-09-12T02:49:11.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deabbb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deabbbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1afe00 con 0x561deaba3d40 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1ad6d0 con 0x561deab98b60 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f6329740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1ab520 con 0x561deab99480 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deabbbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deabbbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44952/0 (socket says 172.21.15.100:44952) 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 -- 172.21.15.100:0/3194204436 learned_addr learned my addr 172.21.15.100:0/3194204436 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f14eb640 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deabbb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f1cec640 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 -- 172.21.15.100:0/3194204436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 msgr2=0x561deabbb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deabbb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 -- 172.21.15.100:0/3194204436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 msgr2=0x561deaba2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 -- 172.21.15.100:0/3194204436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561deab94f20 con 0x561deaba3d40 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.910+0000 7f50f24ed640 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deabbbb70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009ca0 tx=0x7f50e4043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839e8bc0ad5a39b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50d77fe640 1 -- 172.21.15.100:0/3194204436 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4052070 con 0x561deaba3d40 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50d77fe640 1 -- 172.21.15.100:0/3194204436 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e4036040 con 0x561deaba3d40 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50d77fe640 1 -- 172.21.15.100:0/3194204436 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4049690 con 0x561deaba3d40 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 -- 172.21.15.100:0/3194204436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 msgr2=0x561deabbbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deabbbb70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009ca0 tx=0x7f50e4043000 comp rx=0 tx=0).stop 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 -- 172.21.15.100:0/3194204436 shutdown_connections 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deabbbb70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deabbb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 --2- 172.21.15.100:0/3194204436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 -- 172.21.15.100:0/3194204436 >> 172.21.15.100:0/3194204436 conn(0x561deab950f0 msgr2=0x561deaba2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.911+0000 7f50f6329740 1 -- 172.21.15.100:0/3194204436 shutdown_connections 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.912+0000 7f50f6329740 1 -- 172.21.15.100:0/3194204436 wait complete. 2024-09-12T02:49:11.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.912+0000 7f50f6329740 1 -- start start 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.912+0000 7f50f6329740 1 Processor -- start 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.912+0000 7f50f6329740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.912+0000 7f50f6329740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deaba82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.912+0000 7f50f6329740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deaba87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.912+0000 7f50f6329740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1abb90 con 0x561deaba3d40 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f6329740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1ad000 con 0x561deab98b60 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f6329740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1ac260 con 0x561deab99480 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f6329740 10 client.0 _ll_register_callbacks cb 0x7f50dc0976d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deaba87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deaba87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44964/0 (socket says 172.21.15.100:44964) 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 -- 172.21.15.100:0/1570556017 learned_addr learned my addr 172.21.15.100:0/1570556017 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f14eb640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deaba82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f1cec640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 -- 172.21.15.100:0/1570556017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 msgr2=0x561deaba82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deaba82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 -- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 msgr2=0x561deaba7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 -- 172.21.15.100:0/1570556017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561deac1d8a0 con 0x561deaba3d40 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f14eb640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deaba82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f24ed640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deaba87e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006010 tx=0x7f50e4030c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f175276cbf0df652 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50d57fa640 1 -- 172.21.15.100:0/1570556017 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4052030 con 0x561deaba3d40 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e4036040 con 0x561deaba3d40 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50d57fa640 1 -- 172.21.15.100:0/1570556017 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f50e402f9e0 con 0x561deaba3d40 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.913+0000 7f50d57fa640 1 -- 172.21.15.100:0/1570556017 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50e4030a50 con 0x561deaba3d40 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 10 client.17256 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561deac1ebc0 con 0x561deaba3d40 2024-09-12T02:49:11.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50d57fa640 1 -- 172.21.15.100:0/1570556017 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e4036040 con 0x561deaba3d40 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50d57fa640 1 -- 172.21.15.100:0/1570556017 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f50e4004340 con 0x561deaba3d40 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 10 client.17256 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 20 client.17256 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deac1f2c0 0x561deac216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 4 client.17256 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561deab05d00 con 0x561deac1f2c0 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.914+0000 7f50f1cec640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deac1f2c0 0x561deac216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.915+0000 7f50f1cec640 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deac1f2c0 0x561deac216e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2916c24805ffae42 server_cookie=806193f70af14bd in_seq=0 out_seq=0 2024-09-12T02:49:11.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.915+0000 7f50d57fa640 10 client.17256 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:11.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.915+0000 7f50d57fa640 1 -- 172.21.15.100:0/1570556017 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561deab05d00 con 0x561deac1f2c0 2024-09-12T02:49:11.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.915+0000 7f50d57fa640 10 client.17256 handle_command_reply: tid=0 2024-09-12T02:49:11.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 client.17256 shutdown 2024-09-12T02:49:11.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 msgr2=0x561deaba87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deaba87e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006010 tx=0x7f50e4030c20 comp rx=0 tx=0).stop 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 shutdown_connections 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561deac1f2c0 0x561deac216e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561deaba3d40 0x561deaba87e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561deab99480 0x561deaba82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50d57fa640 0 client.17256 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 --2- 172.21.15.100:0/1570556017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561deab98b60 0x561deaba7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 >> 172.21.15.100:0/1570556017 conn(0x561deab950f0 msgr2=0x561deab94270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 shutdown_connections 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 1 -- 172.21.15.100:0/1570556017 wait complete. 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f6329740 20 client.17256 trim_cache size 0 max 16384 2024-09-12T02:49:11.923 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:49:11.924 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:49:11.924 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "4367cfba-a71a-4942-9897-f59dbdbb770c", 2024-09-12T02:49:11.924 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:49:11.924 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:49:11.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50d80a2b80 msgr2=0x7f50d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f3f50640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50d80a2b80 0x7f50d80a5040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f50e4004af0 tx=0x7f50e4004a80 comp rx=0 tx=0).stop 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec100e30 msgr2=0x7f50ec198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.916+0000 7f50f3f50640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec100e30 0x7f50ec198910 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d950 tx=0x7f50dc00de10 comp rx=0 tx=0).stop 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 shutdown_connections 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f50d80a2b80 0x7f50d80a5040 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50ec1055b0 0x7f50ec19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ec100e30 0x7f50ec198910 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 --2- 172.21.15.100:0/3241433867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50ec100480 0x7f50ec1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 >> 172.21.15.100:0/3241433867 conn(0x7f50ec077210 msgr2=0x7f50ec103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 shutdown_connections 2024-09-12T02:49:11.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:11.917+0000 7f50f3f50640 1 -- 172.21.15.100:0/3241433867 wait complete. 2024-09-12T02:49:12.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:11 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1105175094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:12.584 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:49:12.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:12 smithi117 ceph-mon[34898]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.4 MiB/s wr, 205 op/s 2024-09-12T02:49:12.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:12 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:49:12.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:12 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:12.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:12 smithi100 ceph-mon[31390]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.4 MiB/s wr, 205 op/s 2024-09-12T02:49:12.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:12 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:49:12.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:12 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:13.001 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id bf958867 --release --await' 2024-09-12T02:49:13.001 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id bf958867 --release --await 2024-09-12T02:49:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:12 smithi189 ceph-mon[35196]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.4 MiB/s wr, 205 op/s 2024-09-12T02:49:13.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:12 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:49:13.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:12 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:13.079 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/4208304768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 msgr2=0x7fb6c8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/4208304768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8103120 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009900 tx=0x7fb6bc02a480 comp rx=0 tx=0).stop 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/4208304768 shutdown_connections 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/4208304768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c810c170 0x7fb6c810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/4208304768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6c8103660 0x7fb6c810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/4208304768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8103120 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/4208304768 >> 172.21.15.100:0/4208304768 conn(0x7fb6c80fc7a0 msgr2=0x7fb6c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/4208304768 shutdown_connections 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.545+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/4208304768 wait complete. 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 Processor -- start 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 -- start start 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8103660 0x7fb6c8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6c810c170 0x7fb6c819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8111f70 con 0x7fb6c8102d40 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8111df0 con 0x7fb6c810c170 2024-09-12T02:49:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cf0c6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81120f0 con 0x7fb6c8103660 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cce62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cce62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44978/0 (socket says 172.21.15.100:44978) 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.546+0000 7fb6cce62640 1 -- 172.21.15.100:0/208549155 learned_addr learned my addr 172.21.15.100:0/208549155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cd663640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6c810c170 0x7fb6c819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8103660 0x7fb6c8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cce62640 1 -- 172.21.15.100:0/208549155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8103660 msgr2=0x7fb6c8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cce62640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8103660 0x7fb6c8198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cce62640 1 -- 172.21.15.100:0/208549155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6c810c170 msgr2=0x7fb6c819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cce62640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6c810c170 0x7fb6c819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cce62640 1 -- 172.21.15.100:0/208549155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c819d3e0 con 0x7fb6c8102d40 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cd663640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6c810c170 0x7fb6c819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:13.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cce62640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8198430 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc006010 tx=0x7fb6bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6c5ffb640 1 -- 172.21.15.100:0/208549155 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc03f030 con 0x7fb6c8102d40 2024-09-12T02:49:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c819d670 con 0x7fb6c8102d40 2024-09-12T02:49:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6c5ffb640 1 -- 172.21.15.100:0/208549155 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc003ce0 con 0x7fb6c8102d40 2024-09-12T02:49:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.547+0000 7fb6c5ffb640 1 -- 172.21.15.100:0/208549155 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc035070 con 0x7fb6c8102d40 2024-09-12T02:49:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.548+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c81a4fb0 con 0x7fb6c8102d40 2024-09-12T02:49:13.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.550+0000 7fb6c5ffb640 1 -- 172.21.15.100:0/208549155 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb6bc042030 con 0x7fb6c8102d40 2024-09-12T02:49:13.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.550+0000 7fb6d149f740 1 Processor -- start 2024-09-12T02:49:13.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.550+0000 7fb6d149f740 1 -- start start 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d14880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d21a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6d149f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d241c7a2e0 con 0x55d241d14dc0 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6d149f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d241c21ce0 con 0x55d241d1f680 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6d149f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d241c762a0 con 0x55d241d144a0 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44994/0 (socket says 172.21.15.100:44994) 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 -- 172.21.15.100:0/2956646075 learned_addr learned my addr 172.21.15.100:0/2956646075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cd663640 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d14880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6c5ffb640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6b80a2b80 0x7fb6b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d21a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cd663640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6b80a2b80 0x7fb6b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6c5ffb640 1 -- 172.21.15.100:0/208549155 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb6bc0ef470 con 0x7fb6c8102d40 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 -- 172.21.15.100:0/2956646075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 msgr2=0x55d241d14880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d14880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 -- 172.21.15.100:0/2956646075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 msgr2=0x55d241d21a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d21a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.551+0000 7fb6cce62640 1 -- 172.21.15.100:0/2956646075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d241c06440 con 0x55d241d14dc0 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.552+0000 7fb6cce62640 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1f140 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0b8740 tx=0x7fb6bc02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24191a3547e2bec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.552+0000 7fb6b2ffd640 1 -- 172.21.15.100:0/2956646075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc049070 con 0x55d241d14dc0 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.552+0000 7fb6cd663640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6b80a2b80 0x7fb6b80a5040 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005c40 tx=0x7fb6c0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.552+0000 7fb6b2ffd640 1 -- 172.21.15.100:0/2956646075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc0bbd70 con 0x55d241d14dc0 2024-09-12T02:49:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.552+0000 7fb6b2ffd640 1 -- 172.21.15.100:0/2956646075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0c4930 con 0x55d241d14dc0 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 -- 172.21.15.100:0/2956646075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 msgr2=0x55d241d1f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1f140 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0b8740 tx=0x7fb6bc02a480 comp rx=0 tx=0).stop 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 -- 172.21.15.100:0/2956646075 shutdown_connections 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d21a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1f140 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 --2- 172.21.15.100:0/2956646075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d14880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 -- 172.21.15.100:0/2956646075 >> 172.21.15.100:0/2956646075 conn(0x55d241d10a30 msgr2=0x55d241d10e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 -- 172.21.15.100:0/2956646075 shutdown_connections 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 -- 172.21.15.100:0/2956646075 wait complete. 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 -- start start 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.553+0000 7fb6d149f740 1 Processor -- start 2024-09-12T02:49:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d1efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d1c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45002/0 (socket says 172.21.15.100:45002) 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6d149f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d241d22010 con 0x55d241d14dc0 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6c7fff640 1 -- 172.21.15.100:0/1301041659 learned_addr learned my addr 172.21.15.100:0/1301041659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d241c35050 con 0x55d241d1f680 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d241d22190 con 0x55d241d144a0 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6d149f740 10 client.0 _ll_register_callbacks cb 0x55d241c75160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6cce62640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d1efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.554+0000 7fb6cd663640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d1c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6c7fff640 1 -- 172.21.15.100:0/1301041659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 msgr2=0x55d241d1efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d1efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6c7fff640 1 -- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 msgr2=0x55d241d1c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d1c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6c7fff640 1 -- 172.21.15.100:0/1301041659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2419eb3c0 con 0x55d241d14dc0 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6cd663640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d1c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1c260 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4012700 tx=0x7fb6b4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24cde74c0109ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6a7fff640 1 -- 172.21.15.100:0/1301041659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4010c70 con 0x55d241d14dc0 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6a7fff640 1 -- 172.21.15.100:0/1301041659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb6b4010e10 con 0x55d241d14dc0 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6bc0bbd70 con 0x55d241d14dc0 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6a7fff640 1 -- 172.21.15.100:0/1301041659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb6b4005020 con 0x55d241d14dc0 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6d149f740 10 client.17268 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.555+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d241d31da0 con 0x55d241d14dc0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6a7fff640 1 -- 172.21.15.100:0/1301041659 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc0bbd70 con 0x55d241d14dc0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6a7fff640 1 -- 172.21.15.100:0/1301041659 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb6b4019030 con 0x55d241d14dc0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6d149f740 10 client.17268 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6d149f740 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6d149f740 20 client.17268 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6d149f740 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241d356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6d149f740 4 client.17268 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d241c87850 con 0x55d241d332b0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.556+0000 7fb6cce62640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241d356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6cce62640 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241d356d0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0a43940f8c7401c server_cookie=38f27dbc8c708bb3 in_seq=0 out_seq=0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6a7fff640 10 client.17268 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6a7fff640 1 -- 172.21.15.100:0/1301041659 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d241c87850 con 0x55d241d332b0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6a7fff640 10 client.17268 handle_command_reply: tid=0 2024-09-12T02:49:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6d149f740 1 client.17268 shutdown 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 msgr2=0x55d241d1c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6d149f740 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1c260 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4012700 tx=0x7fb6b4012bc0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.557+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 shutdown_connections 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241d356d0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d1c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6a7fff640 0 client.17268 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d14dc0 0x55d241d1c260 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 1 --2- 172.21.15.100:0/1301041659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d1efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 >> 172.21.15.100:0/1301041659 conn(0x55d241d10a30 msgr2=0x55d241d16710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 shutdown_connections 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 1 -- 172.21.15.100:0/1301041659 wait complete. 2024-09-12T02:49:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.558+0000 7fb6d149f740 20 client.17268 trim_cache size 0 max 16384 2024-09-12T02:49:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.576+0000 7fb6d149f740 1 Processor -- start 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6d149f740 1 -- start start 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d144a0 0x55d241d3afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d14dc0 0x55d241d3b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6d149f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81adcb0 con 0x55d241d144a0 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6d149f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81ab580 con 0x55d241d1f680 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6d149f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a93d0 con 0x55d241d14dc0 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d144a0 0x55d241d3afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d144a0 0x55d241d3afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45006/0 (socket says 172.21.15.100:45006) 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 -- 172.21.15.100:0/868063625 learned_addr learned my addr 172.21.15.100:0/868063625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cd663640 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d14dc0 0x55d241d3b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 -- 172.21.15.100:0/868063625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d14dc0 msgr2=0x55d241d3b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d14dc0 0x55d241d3b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 -- 172.21.15.100:0/868063625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 msgr2=0x55d241d194c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d194c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 -- 172.21.15.100:0/868063625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d241d14bf0 con 0x55d241d144a0 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d14dc0 0x55d241d3b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.577+0000 7fb6cce62640 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d144a0 0x55d241d3afa0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0ed2d0 tx=0x7fb6bc0b7f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934883462e2526da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6b27fc640 1 -- 172.21.15.100:0/868063625 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc049040 con 0x55d241d144a0 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6b27fc640 1 -- 172.21.15.100:0/868063625 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc0c4930 con 0x55d241d144a0 2024-09-12T02:49:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6b27fc640 1 -- 172.21.15.100:0/868063625 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0c44a0 con 0x55d241d144a0 2024-09-12T02:49:13.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6d149f740 1 -- 172.21.15.100:0/868063625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d144a0 msgr2=0x55d241d3afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6d149f740 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d144a0 0x55d241d3afa0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0ed2d0 tx=0x7fb6bc0b7f70 comp rx=0 tx=0).stop 2024-09-12T02:49:13.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6d149f740 1 -- 172.21.15.100:0/868063625 shutdown_connections 2024-09-12T02:49:13.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6d149f740 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d1f680 0x55d241d194c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6d149f740 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d14dc0 0x55d241d3b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6d149f740 1 --2- 172.21.15.100:0/868063625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d144a0 0x55d241d3afa0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.578+0000 7fb6d149f740 1 -- 172.21.15.100:0/868063625 >> 172.21.15.100:0/868063625 conn(0x55d241d10a30 msgr2=0x55d241d1e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 -- 172.21.15.100:0/868063625 shutdown_connections 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 -- 172.21.15.100:0/868063625 wait complete. 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 -- start start 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 Processor -- start 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d23610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d14dc0 0x55d241d23b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d1f680 0x55d241d9cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a9a40 con 0x55d241d1f680 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81aaeb0 con 0x55d241d14dc0 2024-09-12T02:49:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81aa110 con 0x55d241d144a0 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.579+0000 7fb6d149f740 10 client.0 _ll_register_callbacks cb 0x7fb6b400bd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d1f680 0x55d241d9cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d1f680 0x55d241d9cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45018/0 (socket says 172.21.15.100:45018) 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 -- 172.21.15.100:0/3693314679 learned_addr learned my addr 172.21.15.100:0/3693314679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d14dc0 0x55d241d23b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cce62640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d23610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 -- 172.21.15.100:0/3693314679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 msgr2=0x55d241d23610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d23610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 -- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d14dc0 msgr2=0x55d241d23b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d14dc0 0x55d241d23b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 -- 172.21.15.100:0/3693314679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d241d9d4b0 con 0x55d241d1f680 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6c7fff640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d14dc0 0x55d241d23b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6cd663640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d1f680 0x55d241d9cf70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005fd0 tx=0x7fb6c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f1685a2230ec58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6a7fff640 1 -- 172.21.15.100:0/3693314679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c002f060 con 0x55d241d1f680 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6a7fff640 1 -- 172.21.15.100:0/3693314679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb6c0020610 con 0x55d241d1f680 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.580+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6bc0c4930 con 0x55d241d1f680 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6a7fff640 1 -- 172.21.15.100:0/3693314679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb6c0020810 con 0x55d241d1f680 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 10 client.17274 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d241d9e720 con 0x55d241d1f680 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6a7fff640 1 -- 172.21.15.100:0/3693314679 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc0c4930 con 0x55d241d1f680 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6a7fff640 1 -- 172.21.15.100:0/3693314679 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb6c002abe0 con 0x55d241d1f680 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 10 client.17274 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 20 client.17274 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241da0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 4 client.17274 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:49:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d241c81d60 con 0x55d241d332b0 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.581+0000 7fb6cce62640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241da0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6cce62640 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241da0ee0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5635707944020ea6 server_cookie=f85fd858d76eaaa in_seq=0 out_seq=0 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6a7fff640 10 client.17274 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6a7fff640 1 -- 172.21.15.100:0/3693314679 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d241c81d60 con 0x55d241d332b0 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6a7fff640 10 client.17274 handle_command_reply: tid=0 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 client.17274 shutdown 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d1f680 msgr2=0x55d241d9cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d1f680 0x55d241d9cf70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005fd0 tx=0x7fb6c0004a40 comp rx=0 tx=0).stop 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 shutdown_connections 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d241d332b0 0x55d241da0ee0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d241d1f680 0x55d241d9cf70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d241d14dc0 0x55d241d23b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6a7fff640 0 client.17274 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 --2- 172.21.15.100:0/3693314679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d241d144a0 0x55d241d23610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 >> 172.21.15.100:0/3693314679 conn(0x55d241d10a30 msgr2=0x55d241d0f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 shutdown_connections 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 1 -- 172.21.15.100:0/3693314679 wait complete. 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.582+0000 7fb6d149f740 20 client.17274 trim_cache size 0 max 16384 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stdout: "4367cfba-a71a-4942-9897-f59dbdbb770c": { 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:49:13.589 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "4367cfba-a71a-4942-9897-f59dbdbb770c", 2024-09-12T02:49:13.590 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:49:13.590 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:13.590 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:13.590 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:49:13.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6b80a2b80 msgr2=0x7fb6b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6b80a2b80 0x7fb6b80a5040 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005c40 tx=0x7fb6c0004ab0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 msgr2=0x7fb6c8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8198430 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc006010 tx=0x7fb6bc0042f0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 shutdown_connections 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6b80a2b80 0x7fb6b80a5040 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6c810c170 0x7fb6c819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8103660 0x7fb6c8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 --2- 172.21.15.100:0/208549155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c8102d40 0x7fb6c8198430 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 >> 172.21.15.100:0/208549155 conn(0x7fb6c80fc7a0 msgr2=0x7fb6c80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 shutdown_connections 2024-09-12T02:49:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:13.583+0000 7fb6cf0c6640 1 -- 172.21.15.100:0/208549155 wait complete. 2024-09-12T02:49:13.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:13 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:49:13.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:13 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:13.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:13 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:49:13.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:13 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:13.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:13 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:49:13.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:13 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:13.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:13 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:49:13.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:13 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:14.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:13 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:49:14.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:13 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:14.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:13 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:49:14.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:13 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:14.558 INFO:tasks.cephfs.filesystem:scrub status for tag:4367cfba-a71a-4942-9897-f59dbdbb770c - {'path': '/', 'tag': '4367cfba-a71a-4942-9897-f59dbdbb770c', 'options': 'recursive,force'} 2024-09-12T02:49:14.798 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:14 smithi100 ceph-mon[31390]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 MiB/s wr, 120 op/s 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 -- 172.21.15.100:0/599362984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 msgr2=0x7f23401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 --2- 172.21.15.100:0/599362984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f23401021c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2330009900 tx=0x7f233002a410 comp rx=0 tx=0).stop 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 -- 172.21.15.100:0/599362984 shutdown_connections 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 --2- 172.21.15.100:0/599362984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106f10 0x7f234010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 --2- 172.21.15.100:0/599362984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2340102790 0x7f23401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 --2- 172.21.15.100:0/599362984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f23401021c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 -- 172.21.15.100:0/599362984 >> 172.21.15.100:0/599362984 conn(0x7f23400fd8c0 msgr2=0x7f23400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 -- 172.21.15.100:0/599362984 shutdown_connections 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 -- 172.21.15.100:0/599362984 wait complete. 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 Processor -- start 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.799+0000 7f2345f3e640 1 -- start start 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f2345f3e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f2340198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f2345f3e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2340102790 0x7f2340198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f2345f3e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106f10 0x7f234019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f2345f3e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111f90 con 0x7f2340101de0 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f2345f3e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111e10 con 0x7f2340102790 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f2345f3e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2340112110 con 0x7f2340106f10 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f2340198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f2340198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58144/0 (socket says 172.21.15.100:58144) 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 -- 172.21.15.100:0/3944172934 learned_addr learned my addr 172.21.15.100:0/3944172934 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233effd640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2340102790 0x7f2340198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233ffff640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106f10 0x7f234019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 -- 172.21.15.100:0/3944172934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106f10 msgr2=0x7f234019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106f10 0x7f234019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 -- 172.21.15.100:0/3944172934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2340102790 msgr2=0x7f2340198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2340102790 0x7f2340198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 -- 172.21.15.100:0/3944172934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234019d3c0 con 0x7f2340101de0 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233ffff640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106f10 0x7f234019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.800+0000 7f233f7fe640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f2340198410 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2330005ab0 tx=0x7f23300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.801+0000 7f233cff9640 1 -- 172.21.15.100:0/3944172934 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233003f030 con 0x7f2340101de0 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.801+0000 7f233cff9640 1 -- 172.21.15.100:0/3944172934 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2330003ce0 con 0x7f2340101de0 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.801+0000 7f233cff9640 1 -- 172.21.15.100:0/3944172934 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330035070 con 0x7f2340101de0 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.801+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234019d650 con 0x7f2340101de0 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.801+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23401a4f90 con 0x7f2340101de0 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.803+0000 7f233cff9640 1 -- 172.21.15.100:0/3944172934 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2330042030 con 0x7f2340101de0 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 Processor -- start 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 -- start start 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8060 0x557a290d8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233cff9640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23280a2b80 0x7f23280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8980 0x557a290e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557a2903d620 con 0x557a290e3240 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557a28fe4e50 con 0x557a290d8060 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f2348317740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a290395e0 con 0x557a290d8980 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233f7fe640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23280a2b80 0x7f23280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58156/0 (socket says 172.21.15.100:58156) 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233ffff640 1 -- 172.21.15.100:0/3163140347 learned_addr learned my addr 172.21.15.100:0/3163140347 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233ffff640 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8060 0x557a290d8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233effd640 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8980 0x557a290e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233cff9640 1 -- 172.21.15.100:0/3944172934 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f23300ef960 con 0x7f2340101de0 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.804+0000 7f233ffff640 1 -- 172.21.15.100:0/3163140347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8980 msgr2=0x557a290e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f233ffff640 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8980 0x557a290e2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f233ffff640 1 -- 172.21.15.100:0/3163140347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8060 msgr2=0x557a290d8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f233ffff640 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8060 0x557a290d8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f233ffff640 1 -- 172.21.15.100:0/3163140347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a28fd5d40 con 0x557a290e3240 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f233ffff640 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e5630 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f233400cfc0 tx=0x7f233400c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a36f40032d9900 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f233f7fe640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23280a2b80 0x7f23280a5040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f23300bc140 tx=0x7f23300e6d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f2325ffb640 1 -- 172.21.15.100:0/3163140347 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233401d070 con 0x557a290e3240 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f2325ffb640 1 -- 172.21.15.100:0/3163140347 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2334018b50 con 0x557a290e3240 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.805+0000 7f2325ffb640 1 -- 172.21.15.100:0/3163140347 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233400f040 con 0x557a290e3240 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 -- 172.21.15.100:0/3163140347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 msgr2=0x557a290e5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e5630 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f233400cfc0 tx=0x7f233400c1d0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 -- 172.21.15.100:0/3163140347 shutdown_connections 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e5630 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8980 0x557a290e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 --2- 172.21.15.100:0/3163140347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8060 0x557a290d8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 -- 172.21.15.100:0/3163140347 >> 172.21.15.100:0/3163140347 conn(0x557a290d45f0 msgr2=0x557a290d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 -- 172.21.15.100:0/3163140347 shutdown_connections 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 -- 172.21.15.100:0/3163140347 wait complete. 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 -- start start 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.806+0000 7f2348317740 1 Processor -- start 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290e0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290e0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557a290e5e10 con 0x557a290e3240 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557a28fc5f10 con 0x557a290d8980 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a290e5f90 con 0x557a290d8060 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 10 client.0 _ll_register_callbacks cb 0x557a28fe9db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58170/0 (socket says 172.21.15.100:58170) 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 -- 172.21.15.100:0/2047322973 learned_addr learned my addr 172.21.15.100:0/2047322973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233effd640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290e0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 -- 172.21.15.100:0/2047322973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 msgr2=0x557a290e0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290e0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 -- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 msgr2=0x557a290e0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290e0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 -- 172.21.15.100:0/2047322973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a28d4c580 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233effd640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290e0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f233ffff640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e0c90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f233400c520 tx=0x7f23340166a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3dbea8a26bb19a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f231effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f231effd640 1 -- 172.21.15.100:0/2047322973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233402a060 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f231effd640 1 -- 172.21.15.100:0/2047322973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2334016840 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2334018b50 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f231effd640 1 -- 172.21.15.100:0/2047322973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f233401d040 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 10 client.17286 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.807+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557a28e16960 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f231effd640 1 -- 172.21.15.100:0/2047322973 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2334018b50 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f231effd640 1 -- 172.21.15.100:0/2047322973 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2334023040 con 0x557a290e3240 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f2348317740 10 client.17286 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f2348317740 10 client.17286 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f2348317740 20 client.17286 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f2348317740 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a290f2d10 0x557a290f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f2348317740 4 client.17286 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a2904ab90 con 0x557a290f2d10 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f233effd640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a290f2d10 0x557a290f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f231effd640 10 client.17286 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.808+0000 7f233effd640 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a290f2d10 0x557a290f5100 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbe71697b15f6fef server_cookie=356eb34017ba4a9b in_seq=0 out_seq=0 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f231effd640 1 -- 172.21.15.100:0/2047322973 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a2904ab90 con 0x557a290f2d10 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f231effd640 10 client.17286 handle_command_reply: tid=0 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 client.17286 shutdown 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 msgr2=0x557a290e0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e0c90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f233400c520 tx=0x7f23340166a0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 shutdown_connections 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a290f2d10 0x557a290f5100 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290e3240 0x557a290e0c90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290e0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 --2- 172.21.15.100:0/2047322973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290e0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 >> 172.21.15.100:0/2047322973 conn(0x557a290d45f0 msgr2=0x557a290da2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.809+0000 7f231effd640 0 client.17286 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.810+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 shutdown_connections 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.810+0000 7f2348317740 1 -- 172.21.15.100:0/2047322973 wait complete. 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.810+0000 7f2348317740 20 client.17286 trim_cache size 0 max 16384 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 Processor -- start 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 -- start start 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8060 0x557a290e2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290fa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290e3240 0x557a290fac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23401afe60 con 0x557a290d8060 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ad730 con 0x557a290d8980 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f2348317740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ab580 con 0x557a290e3240 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.826+0000 7f233ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8060 0x557a290e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8060 0x557a290e2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58186/0 (socket says 172.21.15.100:58186) 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 -- 172.21.15.100:0/251956494 learned_addr learned my addr 172.21.15.100:0/251956494 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 -- 172.21.15.100:0/251956494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290e3240 msgr2=0x557a290fac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 --2- 172.21.15.100:0/251956494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290e3240 0x557a290fac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 -- 172.21.15.100:0/251956494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 msgr2=0x557a290fa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 --2- 172.21.15.100:0/251956494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290fa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 -- 172.21.15.100:0/251956494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a290e5c60 con 0x557a290d8060 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f233ffff640 1 --2- 172.21.15.100:0/251956494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8060 0x557a290e2180 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f233400cdd0 tx=0x7f233400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8807a829bd462f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f23257fa640 1 -- 172.21.15.100:0/251956494 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334034070 con 0x557a290d8060 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f23257fa640 1 -- 172.21.15.100:0/251956494 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f233400a070 con 0x557a290d8060 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.827+0000 7f23257fa640 1 -- 172.21.15.100:0/251956494 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233402a070 con 0x557a290d8060 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 -- 172.21.15.100:0/251956494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8060 msgr2=0x557a290e2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 --2- 172.21.15.100:0/251956494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8060 0x557a290e2180 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f233400cdd0 tx=0x7f233400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 -- 172.21.15.100:0/251956494 shutdown_connections 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 --2- 172.21.15.100:0/251956494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290e3240 0x557a290fac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 --2- 172.21.15.100:0/251956494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290d8980 0x557a290fa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 --2- 172.21.15.100:0/251956494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8060 0x557a290e2180 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 -- 172.21.15.100:0/251956494 >> 172.21.15.100:0/251956494 conn(0x557a290d45f0 msgr2=0x557a290e1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 -- 172.21.15.100:0/251956494 shutdown_connections 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 -- 172.21.15.100:0/251956494 wait complete. 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 -- start start 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.828+0000 7f2348317740 1 Processor -- start 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f2348317740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290eb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f2348317740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8980 0x557a290eb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f2348317740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290e3240 0x557a290e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f2348317740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23401abbf0 con 0x557a290d8980 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f2348317740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ad060 con 0x557a290e3240 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f2348317740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ac2c0 con 0x557a290d8060 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f2348317740 10 client.0 _ll_register_callbacks cb 0x7f2338007910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8980 0x557a290eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8980 0x557a290eb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58202/0 (socket says 172.21.15.100:58202) 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 -- 172.21.15.100:0/2158504044 learned_addr learned my addr 172.21.15.100:0/2158504044 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233ffff640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290e3240 0x557a290e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233ffff640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290eb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 -- 172.21.15.100:0/2158504044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 msgr2=0x557a290eb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290eb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 -- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290e3240 msgr2=0x557a290e81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290e3240 0x557a290e81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 -- 172.21.15.100:0/2158504044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a290d7e90 con 0x557a290d8980 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233ffff640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290e3240 0x557a290e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f233effd640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8980 0x557a290eb720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2338000f80 tx=0x7f2338012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681b678c9dea8725 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f231effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.829+0000 7f231effd640 1 -- 172.21.15.100:0/2158504044 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338022030 con 0x557a290d8980 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f231effd640 1 -- 172.21.15.100:0/2158504044 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f233800fb60 con 0x557a290d8980 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f233400a070 con 0x557a290d8980 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f231effd640 1 -- 172.21.15.100:0/2158504044 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f233800fd60 con 0x557a290d8980 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 10 client.17292 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557a29162030 con 0x557a290d8980 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f231effd640 1 -- 172.21.15.100:0/2158504044 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f233400a070 con 0x557a290d8980 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f231effd640 1 -- 172.21.15.100:0/2158504044 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f233801d550 con 0x557a290d8980 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 10 client.17292 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 10 client.17292 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 20 client.17292 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a291627e0 0x557a29164c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 4 client.17292 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bf958867", "release": true, "await": true}] 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bf958867", "release": true, "await": true}) -- 0x557a290e1020 con 0x557a291627e0 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.830+0000 7f233ffff640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a291627e0 0x557a29164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.831+0000 7f233ffff640 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a291627e0 0x557a29164c00 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a71bfef1218fbd44 server_cookie=571c50f2ab9d1f32 in_seq=0 out_seq=0 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.831+0000 7f231effd640 10 client.17292 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:14.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:14 smithi117 ceph-mon[34898]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 MiB/s wr, 120 op/s 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.903+0000 7f231effd640 1 -- 172.21.15.100:0/2158504044 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557a290e1020 con 0x557a291627e0 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.903+0000 7f231effd640 10 client.17292 handle_command_reply: tid=0 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.903+0000 7f2348317740 1 client.17292 shutdown 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8980 msgr2=0x557a290eb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8980 0x557a290eb720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2338000f80 tx=0x7f2338012b70 comp rx=0 tx=0).stop 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 shutdown_connections 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557a291627e0 0x557a29164c00 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a290e3240 0x557a290e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f231effd640 0 client.17292 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a290d8980 0x557a290eb720 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 --2- 172.21.15.100:0/2158504044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a290d8060 0x557a290eb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 >> 172.21.15.100:0/2158504044 conn(0x557a290d45f0 msgr2=0x557a290d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 shutdown_connections 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 1 -- 172.21.15.100:0/2158504044 wait complete. 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.904+0000 7f2348317740 20 client.17292 trim_cache size 0 max 16384 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 44, 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "bf958867": { 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 44, 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 142.6, 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23280a2b80 msgr2=0x7f23280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23280a2b80 0x7f23280a5040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f23300bc140 tx=0x7f23300e6d40 comp rx=0 tx=0).stop 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 msgr2=0x7f2340198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f2340198410 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2330005ab0 tx=0x7f23300042f0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 shutdown_connections 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f23280a2b80 0x7f23280a5040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106f10 0x7f234019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2340102790 0x7f2340198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 --2- 172.21.15.100:0/3944172934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101de0 0x7f2340198410 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 >> 172.21.15.100:0/3944172934 conn(0x7f23400fd8c0 msgr2=0x7f23400feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 shutdown_connections 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:14.905+0000 7f2345f3e640 1 -- 172.21.15.100:0/3944172934 wait complete. 2024-09-12T02:49:15.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:14 smithi189 ceph-mon[35196]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 MiB/s wr, 120 op/s 2024-09-12T02:49:15.617 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bf958867', total seconds elapsed: 27.6 2024-09-12T02:49:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 605.0 s, 583.1 tps, lat 868.798 ms stddev 4371.277 2024-09-12T02:49:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:16 smithi117 ceph-mon[34898]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 MiB/s wr, 41 op/s 2024-09-12T02:49:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:16 smithi100 ceph-mon[31390]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 MiB/s wr, 41 op/s 2024-09-12T02:49:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:16 smithi189 ceph-mon[35196]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 MiB/s wr, 41 op/s 2024-09-12T02:49:19.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:18 smithi117 ceph-mon[34898]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 177 KiB/s wr, 31 op/s 2024-09-12T02:49:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:18 smithi100 ceph-mon[31390]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 177 KiB/s wr, 31 op/s 2024-09-12T02:49:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:18 smithi189 ceph-mon[35196]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 177 KiB/s wr, 31 op/s 2024-09-12T02:49:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:19 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:49:20.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:19 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:49:20.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:19 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:49:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:20 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:49:21.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:20 smithi117 ceph-mon[34898]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-12T02:49:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:20 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:49:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:20 smithi100 ceph-mon[31390]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-12T02:49:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:20 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:49:21.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:20 smithi189 ceph-mon[35196]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-12T02:49:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 610.0 s, 3006.4 tps, lat 33.412 ms stddev 35.291 2024-09-12T02:49:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:22 smithi117 ceph-mon[34898]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.1 MiB/s wr, 300 op/s 2024-09-12T02:49:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:22 smithi100 ceph-mon[31390]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.1 MiB/s wr, 300 op/s 2024-09-12T02:49:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:22 smithi189 ceph-mon[35196]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.1 MiB/s wr, 300 op/s 2024-09-12T02:49:25.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:24 smithi117 ceph-mon[34898]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.6 MiB/s wr, 439 op/s 2024-09-12T02:49:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:24 smithi100 ceph-mon[31390]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.6 MiB/s wr, 439 op/s 2024-09-12T02:49:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:24 smithi189 ceph-mon[35196]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.6 MiB/s wr, 439 op/s 2024-09-12T02:49:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 615.0 s, 2490.8 tps, lat 40.049 ms stddev 45.211 2024-09-12T02:49:27.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:26 smithi117 ceph-mon[34898]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 504 op/s 2024-09-12T02:49:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:26 smithi100 ceph-mon[31390]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 504 op/s 2024-09-12T02:49:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:26 smithi189 ceph-mon[35196]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 504 op/s 2024-09-12T02:49:29.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:28 smithi117 ceph-mon[34898]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.4 MiB/s wr, 544 op/s 2024-09-12T02:49:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:28 smithi100 ceph-mon[31390]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.4 MiB/s wr, 544 op/s 2024-09-12T02:49:29.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:28 smithi189 ceph-mon[35196]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.4 MiB/s wr, 544 op/s 2024-09-12T02:49:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:30 smithi117 ceph-mon[34898]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 739 op/s 2024-09-12T02:49:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:30 smithi100 ceph-mon[31390]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 739 op/s 2024-09-12T02:49:31.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:30 smithi189 ceph-mon[35196]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 739 op/s 2024-09-12T02:49:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 620.0 s, 3239.8 tps, lat 30.963 ms stddev 33.335 2024-09-12T02:49:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:32 smithi117 ceph-mon[34898]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 737 op/s 2024-09-12T02:49:33.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:32 smithi100 ceph-mon[31390]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 737 op/s 2024-09-12T02:49:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:32 smithi189 ceph-mon[35196]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 737 op/s 2024-09-12T02:49:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:34 smithi117 ceph-mon[34898]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 MiB/s wr, 665 op/s 2024-09-12T02:49:35.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:34 smithi100 ceph-mon[31390]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 MiB/s wr, 665 op/s 2024-09-12T02:49:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:34 smithi189 ceph-mon[35196]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 MiB/s wr, 665 op/s 2024-09-12T02:49:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 625.0 s, 2713.0 tps, lat 36.411 ms stddev 39.237 2024-09-12T02:49:37.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:36 smithi117 ceph-mon[34898]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.4 MiB/s wr, 624 op/s 2024-09-12T02:49:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:36 smithi100 ceph-mon[31390]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.4 MiB/s wr, 624 op/s 2024-09-12T02:49:37.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:36 smithi189 ceph-mon[35196]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.4 MiB/s wr, 624 op/s 2024-09-12T02:49:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:38 smithi100 ceph-mon[31390]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 MiB/s wr, 645 op/s 2024-09-12T02:49:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:38 smithi189 ceph-mon[35196]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 MiB/s wr, 645 op/s 2024-09-12T02:49:39.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:38 smithi117 ceph-mon[34898]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 MiB/s wr, 645 op/s 2024-09-12T02:49:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:40 smithi100 ceph-mon[31390]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.5 MiB/s wr, 788 op/s 2024-09-12T02:49:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:40 smithi189 ceph-mon[35196]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.5 MiB/s wr, 788 op/s 2024-09-12T02:49:41.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 630.0 s, 2020.2 tps, lat 49.682 ms stddev 57.599 2024-09-12T02:49:41.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:40 smithi117 ceph-mon[34898]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.5 MiB/s wr, 788 op/s 2024-09-12T02:49:43.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:42 smithi100 ceph-mon[31390]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.8 MiB/s wr, 661 op/s 2024-09-12T02:49:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:42 smithi189 ceph-mon[35196]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.8 MiB/s wr, 661 op/s 2024-09-12T02:49:43.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:42 smithi117 ceph-mon[34898]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.8 MiB/s wr, 661 op/s 2024-09-12T02:49:44.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:43 smithi189 ceph-mon[35196]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.6 MiB/s wr, 721 op/s 2024-09-12T02:49:44.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:43 smithi117 ceph-mon[34898]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.6 MiB/s wr, 721 op/s 2024-09-12T02:49:44.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:43 smithi100 ceph-mon[31390]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.6 MiB/s wr, 721 op/s 2024-09-12T02:49:44.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:49:44.949 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 -- 172.21.15.100:0/81564546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100100 msgr2=0x7f53dc100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/81564546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100100 0x7f53dc100560 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d002a410 comp rx=0 tx=0).stop 2024-09-12T02:49:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 -- 172.21.15.100:0/81564546 shutdown_connections 2024-09-12T02:49:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/81564546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc100aa0 0x7f53dc10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/81564546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100100 0x7f53dc100560 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/81564546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc106b80 0x7f53dc106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 -- 172.21.15.100:0/81564546 >> 172.21.15.100:0/81564546 conn(0x7f53dc077230 msgr2=0x7f53dc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 -- 172.21.15.100:0/81564546 shutdown_connections 2024-09-12T02:49:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.478+0000 7f53e0bc2640 1 -- 172.21.15.100:0/81564546 wait complete. 2024-09-12T02:49:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.480+0000 7f53e0bc2640 1 Processor -- start 2024-09-12T02:49:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.480+0000 7f53e0bc2640 1 -- start start 2024-09-12T02:49:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.481+0000 7f53e0bc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc100100 0x7f53dc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.481+0000 7f53e0bc2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100aa0 0x7f53dc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.481+0000 7f53e0bc2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc106b80 0x7f53dc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.481+0000 7f53e0bc2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc112010 con 0x7f53dc100aa0 2024-09-12T02:49:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.481+0000 7f53e0bc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc111e90 con 0x7f53dc100100 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.481+0000 7f53e0bc2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc112190 con 0x7f53dc106b80 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.481+0000 7f53dad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc106b80 0x7f53dc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc106b80 0x7f53dc19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44420/0 (socket says 172.21.15.100:44420) 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 -- 172.21.15.100:0/1178562581 learned_addr learned my addr 172.21.15.100:0/1178562581 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53da59c640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc100100 0x7f53dc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100aa0 0x7f53dc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 -- 172.21.15.100:0/1178562581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc100100 msgr2=0x7f53dc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc100100 0x7f53dc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 -- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100aa0 msgr2=0x7f53dc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100aa0 0x7f53dc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 -- 172.21.15.100:0/1178562581 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc19d3d0 con 0x7f53dc106b80 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53da59c640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc100100 0x7f53dc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100aa0 0x7f53dc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53dad9d640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc106b80 0x7f53dc19ccf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ccb0 tx=0x7f53d400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.482+0000 7f53cb7fe640 1 -- 172.21.15.100:0/1178562581 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4003970 con 0x7f53dc106b80 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.483+0000 7f53cb7fe640 1 -- 172.21.15.100:0/1178562581 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53d4004030 con 0x7f53dc106b80 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.483+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc19d6c0 con 0x7f53dc106b80 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.483+0000 7f53cb7fe640 1 -- 172.21.15.100:0/1178562581 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d400f720 con 0x7f53dc106b80 2024-09-12T02:49:45.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.483+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1a4fa0 con 0x7f53dc106b80 2024-09-12T02:49:45.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.486+0000 7f53e2f9b740 1 Processor -- start 2024-09-12T02:49:45.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53cb7fe640 1 -- 172.21.15.100:0/1178562581 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f53d40041e0 con 0x7f53dc106b80 2024-09-12T02:49:45.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53e2f9b740 1 -- start start 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 0x561ad3585880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad3590140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad3592a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561ad34eb2e0 con 0x561ad3585dc0 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561ad3492ce0 con 0x561ad3590680 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561ad34e72a0 con 0x561ad35854a0 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53d9d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad3592a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53da59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad3590140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53d9d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad3592a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45542/0 (socket says 172.21.15.100:45542) 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53d9d9b640 1 -- 172.21.15.100:0/2210638726 learned_addr learned my addr 172.21.15.100:0/2210638726 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.487+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 0x561ad3585880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53cb7fe640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53c40a2c00 0x7f53c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53d9d9b640 1 -- 172.21.15.100:0/2210638726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 msgr2=0x561ad3585880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 0x561ad3585880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53d9d9b640 1 -- 172.21.15.100:0/2210638726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 msgr2=0x561ad3590140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad3590140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53d9d9b640 1 -- 172.21.15.100:0/2210638726 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad3477440 con 0x561ad3590680 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53dad9d640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53c40a2c00 0x7f53c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53cb7fe640 1 -- 172.21.15.100:0/1178562581 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f53d40cf0c0 con 0x7f53dc106b80 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad3592a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d00056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c733ad8086bc4577 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53c8ff9640 1 -- 172.21.15.100:0/2210638726 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d0035040 con 0x561ad3590680 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53c8ff9640 1 -- 172.21.15.100:0/2210638726 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53d00035f0 con 0x561ad3590680 2024-09-12T02:49:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.488+0000 7f53c8ff9640 1 -- 172.21.15.100:0/2210638726 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d003d680 con 0x561ad3590680 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 -- 172.21.15.100:0/2210638726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 msgr2=0x561ad3592a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad3592a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d00056d0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53dad9d640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53c40a2c00 0x7f53c40a50c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f53d4097d70 tx=0x7f53d4066590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 -- 172.21.15.100:0/2210638726 shutdown_connections 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad3592a70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad3590140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/2210638726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 0x561ad3585880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 -- 172.21.15.100:0/2210638726 >> 172.21.15.100:0/2210638726 conn(0x561ad3581a30 msgr2=0x561ad3581e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 -- 172.21.15.100:0/2210638726 shutdown_connections 2024-09-12T02:49:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 -- 172.21.15.100:0/2210638726 wait complete. 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.489+0000 7f53e2f9b740 1 -- start start 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 1 Processor -- start 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad35854a0 0x561ad3590050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3585dc0 0x561ad358d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad358d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561ad3593250 con 0x561ad35854a0 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561ad34a6050 con 0x561ad3585dc0 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561ad35933d0 con 0x561ad3590680 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53e2f9b740 10 client.0 _ll_register_callbacks cb 0x561ad34e6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53d9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad35854a0 0x561ad3590050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53d9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad35854a0 0x561ad3590050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52882/0 (socket says 172.21.15.100:52882) 2024-09-12T02:49:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53d9d9b640 1 -- 172.21.15.100:0/606483416 learned_addr learned my addr 172.21.15.100:0/606483416 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53da59c640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3585dc0 0x561ad358d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad358d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53da59c640 1 -- 172.21.15.100:0/606483416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 msgr2=0x561ad358d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53da59c640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad358d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53da59c640 1 -- 172.21.15.100:0/606483416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad35854a0 msgr2=0x561ad3590050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53da59c640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad35854a0 0x561ad3590050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53da59c640 1 -- 172.21.15.100:0/606483416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad325c3c0 con 0x561ad3585dc0 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.490+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad358d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53da59c640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3585dc0 0x561ad358d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005d00 tx=0x7f53cc011c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c834be545ca75e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53c1ffb640 1 -- 172.21.15.100:0/606483416 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc010c30 con 0x561ad3585dc0 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53d00035f0 con 0x561ad3585dc0 2024-09-12T02:49:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53c1ffb640 1 -- 172.21.15.100:0/606483416 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f53cc010dd0 con 0x561ad3585dc0 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53c1ffb640 1 -- 172.21.15.100:0/606483416 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53cc004020 con 0x561ad3585dc0 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 10 client.26615 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561ad359ecd0 con 0x561ad3585dc0 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53c1ffb640 1 -- 172.21.15.100:0/606483416 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53d00035f0 con 0x561ad3585dc0 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53c1ffb640 1 -- 172.21.15.100:0/606483416 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f53cc01a410 con 0x561ad3585dc0 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 10 client.26615 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 10 client.26615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 20 client.26615 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad35a05a0 0x561ad35a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 4 client.26615 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.491+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ad34f8850 con 0x561ad35a05a0 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.492+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad35a05a0 0x561ad35a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.493+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad35a05a0 0x561ad35a2a20 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f06868caebd1b2d server_cookie=3b8e2024f188fa15 in_seq=0 out_seq=0 2024-09-12T02:49:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.493+0000 7f53c1ffb640 10 client.26615 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.493+0000 7f53c1ffb640 1 -- 172.21.15.100:0/606483416 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ad34f8850 con 0x561ad35a05a0 2024-09-12T02:49:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.493+0000 7f53c1ffb640 10 client.26615 handle_command_reply: tid=0 2024-09-12T02:49:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 client.26615 shutdown 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3585dc0 msgr2=0x561ad358d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3585dc0 0x561ad358d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005d00 tx=0x7f53cc011c90 comp rx=0 tx=0).stop 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 shutdown_connections 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad35a05a0 0x561ad35a2a20 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad358d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3585dc0 0x561ad358d300 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/606483416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad35854a0 0x561ad3590050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.494+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 >> 172.21.15.100:0/606483416 conn(0x561ad3581a30 msgr2=0x561ad3587760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.495+0000 7f53c1ffb640 0 client.26615 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.495+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 shutdown_connections 2024-09-12T02:49:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.495+0000 7f53e2f9b740 1 -- 172.21.15.100:0/606483416 wait complete. 2024-09-12T02:49:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.495+0000 7f53e2f9b740 20 client.26615 trim_cache size 0 max 16384 2024-09-12T02:49:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.521+0000 7f53e2f9b740 1 Processor -- start 2024-09-12T02:49:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.524+0000 7f53e2f9b740 1 -- start start 2024-09-12T02:49:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.524+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 0x561ad358cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.524+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad358a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.524+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad358aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.524+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1afdb0 con 0x561ad3585dc0 2024-09-12T02:49:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1ad680 con 0x561ad3590680 2024-09-12T02:49:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1ab4d0 con 0x561ad35854a0 2024-09-12T02:49:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad358a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad358a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52892/0 (socket says 172.21.15.100:52892) 2024-09-12T02:49:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 -- 172.21.15.100:0/851630068 learned_addr learned my addr 172.21.15.100:0/851630068 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 -- 172.21.15.100:0/851630068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 msgr2=0x561ad358cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:49:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 --2- 172.21.15.100:0/851630068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 0x561ad358cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 -- 172.21.15.100:0/851630068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 msgr2=0x561ad358aac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:49:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 --2- 172.21.15.100:0/851630068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad358aac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.525+0000 7f53da59c640 1 -- 172.21.15.100:0/851630068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad358dc60 con 0x561ad3585dc0 2024-09-12T02:49:45.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.526+0000 7f53da59c640 1 --2- 172.21.15.100:0/851630068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad358a580 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c010 tx=0x7f53cc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328cab2f18433fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.527+0000 7f53c3fff640 1 -- 172.21.15.100:0/851630068 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc032070 con 0x561ad3585dc0 2024-09-12T02:49:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.527+0000 7f53c3fff640 1 -- 172.21.15.100:0/851630068 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53cc005510 con 0x561ad3585dc0 2024-09-12T02:49:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.527+0000 7f53c3fff640 1 -- 172.21.15.100:0/851630068 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc029070 con 0x561ad3585dc0 2024-09-12T02:49:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.531+0000 7f53e2f9b740 1 -- 172.21.15.100:0/851630068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 msgr2=0x561ad358a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.531+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/851630068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad358a580 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c010 tx=0x7f53cc010800 comp rx=0 tx=0).stop 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.534+0000 7f53e2f9b740 1 -- 172.21.15.100:0/851630068 shutdown_connections 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.534+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/851630068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad3590680 0x561ad358aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.534+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/851630068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad358a580 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.534+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/851630068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad35854a0 0x561ad358cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.534+0000 7f53e2f9b740 1 -- 172.21.15.100:0/851630068 >> 172.21.15.100:0/851630068 conn(0x561ad3581a30 msgr2=0x561ad3581e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.534+0000 7f53e2f9b740 1 -- 172.21.15.100:0/851630068 shutdown_connections 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.534+0000 7f53e2f9b740 1 -- 172.21.15.100:0/851630068 wait complete. 2024-09-12T02:49:45.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.535+0000 7f53e2f9b740 1 -- start start 2024-09-12T02:49:45.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.535+0000 7f53e2f9b740 1 Processor -- start 2024-09-12T02:49:45.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.536+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad35854a0 0x561ad35a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.536+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad35a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.536+0000 7f53e2f9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad35a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.536+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1abb40 con 0x561ad3585dc0 2024-09-12T02:49:45.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.536+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1acfb0 con 0x561ad35854a0 2024-09-12T02:49:45.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.536+0000 7f53e2f9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1ac210 con 0x561ad3590680 2024-09-12T02:49:45.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.536+0000 7f53e2f9b740 10 client.0 _ll_register_callbacks cb 0x7f53cc00bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad35854a0 0x561ad35a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad35854a0 0x561ad35a8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45560/0 (socket says 172.21.15.100:45560) 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 -- 172.21.15.100:0/213135336 learned_addr learned my addr 172.21.15.100:0/213135336 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad35a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 -- 172.21.15.100:0/213135336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 msgr2=0x561ad35a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad35a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 -- 172.21.15.100:0/213135336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 msgr2=0x561ad35a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad35a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.537+0000 7f53d9d9b640 1 -- 172.21.15.100:0/213135336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad35903c0 con 0x561ad35854a0 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.538+0000 7f53d9d9b640 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad35854a0 0x561ad35a8540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22456b92ee1db64c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:45.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.538+0000 7f53c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.539+0000 7f53c1ffb640 1 -- 172.21.15.100:0/213135336 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d0035040 con 0x561ad35854a0 2024-09-12T02:49:45.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.540+0000 7f53c1ffb640 1 -- 172.21.15.100:0/213135336 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f53d0003a00 con 0x561ad35854a0 2024-09-12T02:49:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.541+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53cc005510 con 0x561ad35854a0 2024-09-12T02:49:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.541+0000 7f53c1ffb640 1 -- 172.21.15.100:0/213135336 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53d0061050 con 0x561ad35854a0 2024-09-12T02:49:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 10 client.26618 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561ad360ac40 con 0x561ad35854a0 2024-09-12T02:49:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53c1ffb640 1 -- 172.21.15.100:0/213135336 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53cc005510 con 0x561ad35854a0 2024-09-12T02:49:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53c1ffb640 1 -- 172.21.15.100:0/213135336 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f53d003a040 con 0x561ad35854a0 2024-09-12T02:49:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 10 client.26618 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 10 client.26618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 20 client.26618 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad360aeb0 0x561ad360d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 4 client.26618 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:49:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.542+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561ad34f2d60 con 0x561ad360aeb0 2024-09-12T02:49:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.543+0000 7f53da59c640 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad360aeb0 0x561ad360d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.544+0000 7f53da59c640 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad360aeb0 0x561ad360d2a0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c36570bf65908b server_cookie=213cd5efbd100b1f in_seq=0 out_seq=0 2024-09-12T02:49:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.544+0000 7f53c1ffb640 10 client.26618 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.544+0000 7f53c1ffb640 1 -- 172.21.15.100:0/213135336 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561ad34f2d60 con 0x561ad360aeb0 2024-09-12T02:49:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.544+0000 7f53c1ffb640 10 client.26618 handle_command_reply: tid=0 2024-09-12T02:49:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.544+0000 7f53e2f9b740 1 client.26618 shutdown 2024-09-12T02:49:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.545+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad35854a0 msgr2=0x561ad35a8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.545+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad35854a0 0x561ad35a8540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009900 tx=0x7f53d002a410 comp rx=0 tx=0).stop 2024-09-12T02:49:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 shutdown_connections 2024-09-12T02:49:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x561ad360aeb0 0x561ad360d2a0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ad3590680 0x561ad35a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53c1ffb640 0 client.26618 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ad3585dc0 0x561ad35a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 --2- 172.21.15.100:0/213135336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561ad35854a0 0x561ad35a8540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 >> 172.21.15.100:0/213135336 conn(0x561ad3581a30 msgr2=0x561ad358cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 shutdown_connections 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 1 -- 172.21.15.100:0/213135336 wait complete. 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.546+0000 7f53e2f9b740 20 client.26618 trim_cache size 0 max 16384 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:49:45.548 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53c40a2c00 msgr2=0x7f53c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53c40a2c00 0x7f53c40a50c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f53d4097d70 tx=0x7f53d4066590 comp rx=0 tx=0).stop 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc106b80 msgr2=0x7f53dc19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc106b80 0x7f53dc19ccf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ccb0 tx=0x7f53d400a620 comp rx=0 tx=0).stop 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 shutdown_connections 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f53c40a2c00 0x7f53c40a50c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53dc106b80 0x7f53dc19ccf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53dc100aa0 0x7f53dc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 --2- 172.21.15.100:0/1178562581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc100100 0x7f53dc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:45.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 >> 172.21.15.100:0/1178562581 conn(0x7f53dc077230 msgr2=0x7f53dc104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 shutdown_connections 2024-09-12T02:49:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:45.547+0000 7f53e0bc2640 1 -- 172.21.15.100:0/1178562581 wait complete. 2024-09-12T02:49:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 635.0 s, 2299.0 tps, lat 43.556 ms stddev 47.350 2024-09-12T02:49:46.355 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:49:46.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:49:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:47.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:46 smithi117 ceph-mon[34898]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.1 MiB/s wr, 682 op/s 2024-09-12T02:49:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:46 smithi100 ceph-mon[31390]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.1 MiB/s wr, 682 op/s 2024-09-12T02:49:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:46 smithi189 ceph-mon[35196]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.1 MiB/s wr, 682 op/s 2024-09-12T02:49:47.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.738+0000 7f1f37fae640 1 -- 172.21.15.100:0/3595760276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 msgr2=0x7f1f3010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:47.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.738+0000 7f1f37fae640 1 --2- 172.21.15.100:0/3595760276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f3010d950 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009cd0 tx=0x7f1f2802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:49:47.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.738+0000 7f1f37fae640 1 -- 172.21.15.100:0/3595760276 shutdown_connections 2024-09-12T02:49:47.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.738+0000 7f1f37fae640 1 --2- 172.21.15.100:0/3595760276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f3010d950 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:47.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.738+0000 7f1f37fae640 1 --2- 172.21.15.100:0/3595760276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f30100a80 0x7f1f30100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:47.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.738+0000 7f1f37fae640 1 --2- 172.21.15.100:0/3595760276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f30106a80 0x7f1f30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.738+0000 7f1f37fae640 1 -- 172.21.15.100:0/3595760276 >> 172.21.15.100:0/3595760276 conn(0x7f1f300fc7a0 msgr2=0x7f1f300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.739+0000 7f1f37fae640 1 -- 172.21.15.100:0/3595760276 shutdown_connections 2024-09-12T02:49:47.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.739+0000 7f1f37fae640 1 -- 172.21.15.100:0/3595760276 wait complete. 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.740+0000 7f1f37fae640 1 Processor -- start 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.740+0000 7f1f37fae640 1 -- start start 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f37fae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f30100a80 0x7f1f301992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f37fae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f301997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f37fae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f30106a80 0x7f1f301a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f37fae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30110e80 con 0x7f1f30101420 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f37fae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30110d00 con 0x7f1f30100a80 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f37fae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30111000 con 0x7f1f30106a80 2024-09-12T02:49:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35549640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f301997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f3654b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f30106a80 0x7f1f301a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35d4a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f30100a80 0x7f1f301992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f3654b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f30106a80 0x7f1f301a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44474/0 (socket says 172.21.15.100:44474) 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f3654b640 1 -- 172.21.15.100:0/1275271028 learned_addr learned my addr 172.21.15.100:0/1275271028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35549640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f301997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52916/0 (socket says 172.21.15.100:52916) 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35d4a640 1 -- 172.21.15.100:0/1275271028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f30106a80 msgr2=0x7f1f301a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35d4a640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f30106a80 0x7f1f301a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35d4a640 1 -- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 msgr2=0x7f1f301997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35d4a640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f301997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35d4a640 1 -- 172.21.15.100:0/1275271028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f301a4860 con 0x7f1f30100a80 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.741+0000 7f1f35549640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f301997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.742+0000 7f1f35d4a640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f30100a80 0x7f1f301992a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e9f0 tx=0x7f1f2c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.742+0000 7f1f26ffd640 1 -- 172.21.15.100:0/1275271028 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00ccc0 con 0x7f1f30100a80 2024-09-12T02:49:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.742+0000 7f1f26ffd640 1 -- 172.21.15.100:0/1275271028 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2c010910 con 0x7f1f30100a80 2024-09-12T02:49:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.742+0000 7f1f37fae640 1 -- 172.21.15.100:0/1275271028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f301a4a30 con 0x7f1f30100a80 2024-09-12T02:49:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.742+0000 7f1f26ffd640 1 -- 172.21.15.100:0/1275271028 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c018960 con 0x7f1f30100a80 2024-09-12T02:49:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.742+0000 7f1f37fae640 1 -- 172.21.15.100:0/1275271028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f301a4f40 con 0x7f1f30100a80 2024-09-12T02:49:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.744+0000 7f1f37fae640 1 -- 172.21.15.100:0/1275271028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f30100ee0 con 0x7f1f30100a80 2024-09-12T02:49:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.745+0000 7f1f26ffd640 1 -- 172.21.15.100:0/1275271028 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1f2c010ac0 con 0x7f1f30100a80 2024-09-12T02:49:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.746+0000 7f1f26ffd640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1f1c0a2b80 0x7f1f1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.746+0000 7f1f35549640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1f1c0a2b80 0x7f1f1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.746+0000 7f1f26ffd640 1 -- 172.21.15.100:0/1275271028 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1f2c0cf370 con 0x7f1f30100a80 2024-09-12T02:49:47.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.746+0000 7f1f35549640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1f1c0a2b80 0x7f1f1c0a5040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1f3006b2e0 tx=0x7f1f2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:47.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:47.753+0000 7f1f26ffd640 1 -- 172.21.15.100:0/1275271028 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f2c09bc70 con 0x7f1f30100a80 2024-09-12T02:49:48.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.041+0000 7f1f37fae640 1 -- 172.21.15.100:0/1275271028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f30108ff0 con 0x7f1f30100a80 2024-09-12T02:49:48.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.047+0000 7f1f26ffd640 1 -- 172.21.15.100:0/1275271028 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f1f2c09ff70 con 0x7f1f30100a80 2024-09-12T02:49:48.049 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:49:48.049 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:49:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:49:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.053+0000 7f1f24ff9640 1 -- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1f1c0a2b80 msgr2=0x7f1f1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.053+0000 7f1f24ff9640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1f1c0a2b80 0x7f1f1c0a5040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1f3006b2e0 tx=0x7f1f2000b390 comp rx=0 tx=0).stop 2024-09-12T02:49:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.053+0000 7f1f24ff9640 1 -- 172.21.15.100:0/1275271028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f30100a80 msgr2=0x7f1f301992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.053+0000 7f1f24ff9640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f30100a80 0x7f1f301992a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e9f0 tx=0x7f1f2c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.054+0000 7f1f24ff9640 1 -- 172.21.15.100:0/1275271028 shutdown_connections 2024-09-12T02:49:48.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.054+0000 7f1f24ff9640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1f1c0a2b80 0x7f1f1c0a5040 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.054+0000 7f1f24ff9640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f30106a80 0x7f1f301a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.054+0000 7f1f24ff9640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f30101420 0x7f1f301997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.054+0000 7f1f24ff9640 1 --2- 172.21.15.100:0/1275271028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f30100a80 0x7f1f301992a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.054+0000 7f1f24ff9640 1 -- 172.21.15.100:0/1275271028 >> 172.21.15.100:0/1275271028 conn(0x7f1f300fc7a0 msgr2=0x7f1f300fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:48.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.057+0000 7f1f24ff9640 1 -- 172.21.15.100:0/1275271028 shutdown_connections 2024-09-12T02:49:48.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:48.057+0000 7f1f24ff9640 1 -- 172.21.15.100:0/1275271028 wait complete. 2024-09-12T02:49:48.766 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:49:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:49.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:48 smithi117 ceph-mon[34898]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-09-12T02:49:49.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1275271028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:49.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:48 smithi100 ceph-mon[31390]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-09-12T02:49:49.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1275271028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:49.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:48 smithi189 ceph-mon[35196]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-09-12T02:49:49.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1275271028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:49.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.677+0000 7f3b6c60a640 1 -- 172.21.15.100:0/4094779292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64102ef0 msgr2=0x7f3b6410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.677+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/4094779292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64102ef0 0x7f3b6410da40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009ca0 tx=0x7f3b5c02a950 comp rx=0 tx=0).stop 2024-09-12T02:49:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.678+0000 7f3b6c60a640 1 -- 172.21.15.100:0/4094779292 shutdown_connections 2024-09-12T02:49:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.678+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/4094779292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64102ef0 0x7f3b6410da40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.678+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/4094779292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b64102570 0x7f3b641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.678+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/4094779292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b64100e20 0x7f3b64101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.678+0000 7f3b6c60a640 1 -- 172.21.15.100:0/4094779292 >> 172.21.15.100:0/4094779292 conn(0x7f3b640fc7d0 msgr2=0x7f3b640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.679+0000 7f3b6c60a640 1 -- 172.21.15.100:0/4094779292 shutdown_connections 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.679+0000 7f3b6c60a640 1 -- 172.21.15.100:0/4094779292 wait complete. 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.680+0000 7f3b6c60a640 1 Processor -- start 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.680+0000 7f3b6c60a640 1 -- start start 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.680+0000 7f3b6c60a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64100e20 0x7f3b641970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6c60a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b64102570 0x7f3b641975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6c60a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b64102ef0 0x7f3b6419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6c60a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64110f80 con 0x7f3b64100e20 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6c60a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64110e00 con 0x7f3b64102570 2024-09-12T02:49:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6c60a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64111100 con 0x7f3b64102ef0 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64100e20 0x7f3b641970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b69ba5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b64102570 0x7f3b641975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64100e20 0x7f3b641970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52932/0 (socket says 172.21.15.100:52932) 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/472209402 learned_addr learned my addr 172.21.15.100:0/472209402 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b64102ef0 0x7f3b6419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/472209402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b64102ef0 msgr2=0x7f3b6419c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b64102ef0 0x7f3b6419c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/472209402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b64102570 msgr2=0x7f3b641975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b64102570 0x7f3b641975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/472209402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6419c630 con 0x7f3b64100e20 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.681+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b64102570 0x7f3b641975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.682+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64100e20 0x7f3b641970a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000d950 tx=0x7f3b6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.682+0000 7f3b5b7fe640 1 -- 172.21.15.100:0/472209402 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60017070 con 0x7f3b64100e20 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.682+0000 7f3b5b7fe640 1 -- 172.21.15.100:0/472209402 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b60009c30 con 0x7f3b64100e20 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.682+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6419c920 con 0x7f3b64100e20 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.682+0000 7f3b5b7fe640 1 -- 172.21.15.100:0/472209402 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000f6b0 con 0x7f3b64100e20 2024-09-12T02:49:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.682+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6419ceb0 con 0x7f3b64100e20 2024-09-12T02:49:49.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.684+0000 7f3b5b7fe640 1 -- 172.21.15.100:0/472209402 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3b600109d0 con 0x7f3b64100e20 2024-09-12T02:49:49.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.685+0000 7f3b6e9e3740 1 Processor -- start 2024-09-12T02:49:49.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.685+0000 7f3b6e9e3740 1 -- start start 2024-09-12T02:49:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.685+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10de090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.685+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.685+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a9c10442f0 con 0x55a9c10e9370 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6aba7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a9c0febcf0 con 0x55a9c10de5d0 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6aba7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10de090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44502/0 (socket says 172.21.15.100:44502) 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6aba7640 1 -- 172.21.15.100:0/3933909257 learned_addr learned my addr 172.21.15.100:0/3933909257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/3933909257 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a9c10402b0 con 0x55a9c10dfb40 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b5b7fe640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b500a2c00 0x7f3b500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b500a2c00 0x7f3b500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/3933909257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 msgr2=0x55a9c10de090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10de090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/3933909257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 msgr2=0x55a9c10eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10eb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/3933909257 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c0fd03a0 con 0x55a9c10de5d0 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b5b7fe640 1 -- 172.21.15.100:0/472209402 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3b600cebf0 con 0x7f3b64100e20 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.686+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dea10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b60097e60 tx=0x7f3b60000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd4e8c460a7fc151 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.687+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b500a2c00 0x7f3b500a50c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009ca0 tx=0x7f3b5c02a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.687+0000 7f3b58ff9640 1 -- 172.21.15.100:0/3933909257 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6001ebb0 con 0x55a9c10de5d0 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.687+0000 7f3b58ff9640 1 -- 172.21.15.100:0/3933909257 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b60009de0 con 0x55a9c10de5d0 2024-09-12T02:49:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.687+0000 7f3b58ff9640 1 -- 172.21.15.100:0/3933909257 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60097b00 con 0x55a9c10de5d0 2024-09-12T02:49:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.688+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/3933909257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 msgr2=0x55a9c10dea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.688+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dea10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b60097e60 tx=0x7f3b60000bc0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.689+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/3933909257 shutdown_connections 2024-09-12T02:49:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.689+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.689+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dea10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.689+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/3933909257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10de090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.689+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/3933909257 >> 172.21.15.100:0/3933909257 conn(0x55a9c10a7310 msgr2=0x55a9c10dac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.690+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/3933909257 shutdown_connections 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.690+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/3933909257 wait complete. 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.690+0000 7f3b6e9e3740 1 -- start start 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.690+0000 7f3b6e9e3740 1 Processor -- start 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10dfb40 0x55a9c10e6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a9c10ebfb0 con 0x55a9c10dfb40 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a9c0fff060 con 0x55a9c10de5d0 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a9c10ec130 con 0x55a9c10e9370 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6e9e3740 10 client.0 _ll_register_callbacks cb 0x55a9c0d528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10dfb40 0x55a9c10e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10dfb40 0x55a9c10e6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52950/0 (socket says 172.21.15.100:52950) 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6a3a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 -- 172.21.15.100:0/617248951 learned_addr learned my addr 172.21.15.100:0/617248951 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 -- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 msgr2=0x55a9c10e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 -- 172.21.15.100:0/617248951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 msgr2=0x55a9c10e8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10e8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 -- 172.21.15.100:0/617248951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9c0db53c0 con 0x55a9c10dfb40 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10dfb40 0x55a9c10e6040 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3b54012d00 tx=0x7f3b5400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42051d4bb37964a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.691+0000 7f3b4dffb640 1 -- 172.21.15.100:0/617248951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54009d90 con 0x55a9c10dfb40 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b4dffb640 1 -- 172.21.15.100:0/617248951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3b54012110 con 0x55a9c10dfb40 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b60009de0 con 0x55a9c10dfb40 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b4dffb640 1 -- 172.21.15.100:0/617248951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3b54004050 con 0x55a9c10dfb40 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 10 client.17325 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9c10f7ae0 con 0x55a9c10dfb40 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b4dffb640 1 -- 172.21.15.100:0/617248951 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b60009de0 con 0x55a9c10dfb40 2024-09-12T02:49:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b4dffb640 1 -- 172.21.15.100:0/617248951 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3b54010430 con 0x55a9c10dfb40 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 10 client.17325 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 10 client.17325 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 20 client.17325 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c10f8ff0 0x55a9c10fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 4 client.17325 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9c1051860 con 0x55a9c10f8ff0 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.692+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c10f8ff0 0x55a9c10fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.693+0000 7f3b4dffb640 10 client.17325 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.693+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c10f8ff0 0x55a9c10fb3e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b38ba5dc5c408c99 server_cookie=8f02781d1a2fed9e in_seq=0 out_seq=0 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.693+0000 7f3b4dffb640 1 -- 172.21.15.100:0/617248951 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9c1051860 con 0x55a9c10f8ff0 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.693+0000 7f3b4dffb640 10 client.17325 handle_command_reply: tid=0 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.693+0000 7f3b6e9e3740 1 client.17325 shutdown 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10dfb40 msgr2=0x55a9c10e6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10dfb40 0x55a9c10e6040 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3b54012d00 tx=0x7f3b5400f790 comp rx=0 tx=0).stop 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 shutdown_connections 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c10f8ff0 0x55a9c10fb3e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10dfb40 0x55a9c10e6040 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/617248951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 >> 172.21.15.100:0/617248951 conn(0x55a9c10a7310 msgr2=0x55a9c10e09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b4dffb640 0 client.17325 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 shutdown_connections 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/617248951 wait complete. 2024-09-12T02:49:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.694+0000 7f3b6e9e3740 20 client.17325 trim_cache size 0 max 16384 2024-09-12T02:49:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 Processor -- start 2024-09-12T02:49:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 -- start start 2024-09-12T02:49:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10f5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641b64e0 con 0x55a9c10e9370 2024-09-12T02:49:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641b3db0 con 0x55a9c10de5d0 2024-09-12T02:49:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641b1c00 con 0x55a9c10dfb40 2024-09-12T02:49:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6aba7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b69ba5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6aba7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52952/0 (socket says 172.21.15.100:52952) 2024-09-12T02:49:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b69ba5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44516/0 (socket says 172.21.15.100:44516) 2024-09-12T02:49:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.711+0000 7f3b6aba7640 1 -- 172.21.15.100:0/1539476633 learned_addr learned my addr 172.21.15.100:0/1539476633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b69ba5640 1 -- 172.21.15.100:0/1539476633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 msgr2=0x55a9c10dae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b69ba5640 1 -- 172.21.15.100:0/1539476633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 msgr2=0x55a9c10f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b69ba5640 1 -- 172.21.15.100:0/1539476633 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c10f5790 con 0x55a9c10dfb40 2024-09-12T02:49:49.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:49.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10e5900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b54010850 tx=0x7f3b540057d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27388b09457e7721 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:49.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b4ffff640 1 -- 172.21.15.100:0/1539476633 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54009e50 con 0x55a9c10dfb40 2024-09-12T02:49:49.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b4ffff640 1 -- 172.21.15.100:0/1539476633 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b54012110 con 0x55a9c10dfb40 2024-09-12T02:49:49.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.712+0000 7f3b4ffff640 1 -- 172.21.15.100:0/1539476633 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54003850 con 0x55a9c10dfb40 2024-09-12T02:49:49.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/1539476633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 msgr2=0x55a9c10e5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10e5900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b54010850 tx=0x7f3b540057d0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/1539476633 shutdown_connections 2024-09-12T02:49:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10e9370 0x55a9c10f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10dfb40 0x55a9c10e5900 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/1539476633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10de5d0 0x55a9c10dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/1539476633 >> 172.21.15.100:0/1539476633 conn(0x55a9c10a7310 msgr2=0x55a9c10da700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/1539476633 shutdown_connections 2024-09-12T02:49:49.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.713+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/1539476633 wait complete. 2024-09-12T02:49:49.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 -- start start 2024-09-12T02:49:49.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 Processor -- start 2024-09-12T02:49:49.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10de5d0 0x55a9c10f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10dfb40 0x55a9c10e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641b2270 con 0x55a9c10de5d0 2024-09-12T02:49:49.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641b36e0 con 0x55a9c10dfb40 2024-09-12T02:49:49.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641b2940 con 0x55a9c10e9370 2024-09-12T02:49:49.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6a3a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10de5d0 0x55a9c10f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6e9e3740 10 client.0 _ll_register_callbacks cb 0x7f3b54009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:49.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6a3a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10de5d0 0x55a9c10f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52960/0 (socket says 172.21.15.100:52960) 2024-09-12T02:49:49.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6a3a6640 1 -- 172.21.15.100:0/4247790052 learned_addr learned my addr 172.21.15.100:0/4247790052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:49.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.714+0000 7f3b69ba5640 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10dfb40 0x55a9c10e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6aba7640 1 -- 172.21.15.100:0/4247790052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10dfb40 msgr2=0x55a9c10e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10dfb40 0x55a9c10e2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6aba7640 1 -- 172.21.15.100:0/4247790052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10de5d0 msgr2=0x55a9c10f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:49.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10de5d0 0x55a9c10f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6aba7640 1 -- 172.21.15.100:0/4247790052 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9c10e3600 con 0x55a9c10e9370 2024-09-12T02:49:49.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6aba7640 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e3040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c005cc0 tx=0x7f3b5c0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52551f6f5bddd66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:49:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b4dffb640 1 -- 172.21.15.100:0/4247790052 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c043050 con 0x55a9c10e9370 2024-09-12T02:49:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b4dffb640 1 -- 172.21.15.100:0/4247790052 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3b5c004240 con 0x55a9c10e9370 2024-09-12T02:49:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b54012110 con 0x55a9c10e9370 2024-09-12T02:49:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b4dffb640 1 -- 172.21.15.100:0/4247790052 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3b5c034040 con 0x55a9c10e9370 2024-09-12T02:49:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6e9e3740 10 client.26560 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9c1163a30 con 0x55a9c10e9370 2024-09-12T02:49:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b4dffb640 1 -- 172.21.15.100:0/4247790052 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b54012110 con 0x55a9c10e9370 2024-09-12T02:49:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.715+0000 7f3b4dffb640 1 -- 172.21.15.100:0/4247790052 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3b5c053020 con 0x55a9c10e9370 2024-09-12T02:49:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 10 client.26560 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 10 client.26560 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:49:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 20 client.26560 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c1164150 0x55a9c1166540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 4 client.26560 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:49:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a9c104bd70 con 0x55a9c1164150 2024-09-12T02:49:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c1164150 0x55a9c1166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b4dffb640 10 client.26560 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6a3a6640 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c1164150 0x55a9c1166540 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f3ef6fae0968951 server_cookie=8f8997c6e673134d in_seq=0 out_seq=0 2024-09-12T02:49:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b4dffb640 1 -- 172.21.15.100:0/4247790052 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a9c104bd70 con 0x55a9c1164150 2024-09-12T02:49:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b4dffb640 10 client.26560 handle_command_reply: tid=0 2024-09-12T02:49:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 1 client.26560 shutdown 2024-09-12T02:49:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 msgr2=0x55a9c10e3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.716+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e3040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c005cc0 tx=0x7f3b5c0095c0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.717+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 shutdown_connections 2024-09-12T02:49:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.717+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a9c1164150 0x55a9c1166540 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.717+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a9c10e9370 0x55a9c10e3040 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.717+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9c10dfb40 0x55a9c10e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.717+0000 7f3b6e9e3740 1 --2- 172.21.15.100:0/4247790052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9c10de5d0 0x55a9c10f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.717+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 >> 172.21.15.100:0/4247790052 conn(0x55a9c10a7310 msgr2=0x55a9c10e78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.718+0000 7f3b4dffb640 0 client.26560 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:49:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.719+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 shutdown_connections 2024-09-12T02:49:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.719+0000 7f3b6e9e3740 1 -- 172.21.15.100:0/4247790052 wait complete. 2024-09-12T02:49:49.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.719+0000 7f3b6e9e3740 20 client.26560 trim_cache size 0 max 16384 2024-09-12T02:49:49.739 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:49:49.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b500a2c00 msgr2=0x7f3b500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b500a2c00 0x7f3b500a50c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009ca0 tx=0x7f3b5c02a950 comp rx=0 tx=0).stop 2024-09-12T02:49:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64100e20 msgr2=0x7f3b641970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64100e20 0x7f3b641970a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000d950 tx=0x7f3b6000de10 comp rx=0 tx=0).stop 2024-09-12T02:49:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 shutdown_connections 2024-09-12T02:49:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3b500a2c00 0x7f3b500a50c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b64102ef0 0x7f3b6419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b64102570 0x7f3b641975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 --2- 172.21.15.100:0/472209402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b64100e20 0x7f3b641970a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 >> 172.21.15.100:0/472209402 conn(0x7f3b640fc7d0 msgr2=0x7f3b64106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 shutdown_connections 2024-09-12T02:49:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:49.720+0000 7f3b6c60a640 1 -- 172.21.15.100:0/472209402 wait complete. 2024-09-12T02:49:50.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:49:50.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:50 smithi100 ceph-mon[31390]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7.6 MiB/s wr, 747 op/s 2024-09-12T02:49:50.928 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:50 smithi117 ceph-mon[34898]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7.6 MiB/s wr, 747 op/s 2024-09-12T02:49:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:50 smithi189 ceph-mon[35196]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7.6 MiB/s wr, 747 op/s 2024-09-12T02:49:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 640.0 s, 2222.8 tps, lat 45.200 ms stddev 51.687 2024-09-12T02:49:51.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 -- 172.21.15.100:0/244809597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c104000 msgr2=0x7f4b3c1043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/244809597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c104000 0x7f4b3c1043e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009900 tx=0x7f4b3802a410 comp rx=0 tx=0).stop 2024-09-12T02:49:51.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 -- 172.21.15.100:0/244809597 shutdown_connections 2024-09-12T02:49:51.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/244809597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c109130 0x7f4b3c110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/244809597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c1049b0 0x7f4b3c108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/244809597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c104000 0x7f4b3c1043e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 -- 172.21.15.100:0/244809597 >> 172.21.15.100:0/244809597 conn(0x7f4b3c0ffa20 msgr2=0x7f4b3c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 -- 172.21.15.100:0/244809597 shutdown_connections 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 -- 172.21.15.100:0/244809597 wait complete. 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.424+0000 7f4b43cc0640 1 Processor -- start 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b43cc0640 1 -- start start 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b43cc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c104000 0x7f4b3c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b43cc0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c1049b0 0x7f4b3c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b43cc0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c109130 0x7f4b3c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b43cc0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c114160 con 0x7f4b3c1049b0 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b43cc0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113fe0 con 0x7f4b3c104000 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b43cc0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1142e0 con 0x7f4b3c109130 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b4125b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c1049b0 0x7f4b3c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b4125b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c1049b0 0x7f4b3c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52978/0 (socket says 172.21.15.100:52978) 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b4125b640 1 -- 172.21.15.100:0/3949537540 learned_addr learned my addr 172.21.15.100:0/3949537540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b4225d640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c109130 0x7f4b3c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.425+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c104000 0x7f4b3c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b4225d640 1 -- 172.21.15.100:0/3949537540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c104000 msgr2=0x7f4b3c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b4225d640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c104000 0x7f4b3c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b4225d640 1 -- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c1049b0 msgr2=0x7f4b3c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b4225d640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c1049b0 0x7f4b3c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b4225d640 1 -- 172.21.15.100:0/3949537540 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c19f5b0 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c104000 0x7f4b3c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b4225d640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c109130 0x7f4b3c19eed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009fd0 tx=0x7f4b3400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b32ffd640 1 -- 172.21.15.100:0/3949537540 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3400ce20 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b32ffd640 1 -- 172.21.15.100:0/3949537540 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b34005020 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.426+0000 7f4b32ffd640 1 -- 172.21.15.100:0/3949537540 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34010720 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.427+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c19f8a0 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.427+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a7180 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.430+0000 7f4b32ffd640 1 -- 172.21.15.100:0/3949537540 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4b340051d0 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.431+0000 7f4b32ffd640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b280a2d50 0x7f4b280a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.432+0000 7f4b32ffd640 1 -- 172.21.15.100:0/3949537540 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4b340cf750 con 0x7f4b3c109130 2024-09-12T02:49:51.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.432+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b280a2d50 0x7f4b280a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.433+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b280a2d50 0x7f4b280a5210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005ab0 tx=0x7f4b38005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:51.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.433+0000 7f4b46099740 1 Processor -- start 2024-09-12T02:49:51.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.438+0000 7f4b46099740 1 -- start start 2024-09-12T02:49:51.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.438+0000 7f4b46099740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb66b40 0x55f99bb65090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.438+0000 7f4b46099740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb655d0 0x55f99bb65a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.438+0000 7f4b46099740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.438+0000 7f4b46099740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f99bacb2f0 con 0x55f99bb66b40 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.438+0000 7f4b46099740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f99ba72cf0 con 0x55f99bb655d0 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.438+0000 7f4b46099740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f99bac72b0 con 0x55f99bb70370 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.439+0000 7f4b41a5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb66b40 0x55f99bb65090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.439+0000 7f4b41a5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb66b40 0x55f99bb65090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52988/0 (socket says 172.21.15.100:52988) 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.439+0000 7f4b41a5c640 1 -- 172.21.15.100:0/2322788714 learned_addr learned my addr 172.21.15.100:0/2322788714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.441+0000 7f4b4225d640 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.442+0000 7f4b41a5c640 1 -- 172.21.15.100:0/2322788714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 msgr2=0x55f99bb72760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.442+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb72760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.442+0000 7f4b41a5c640 1 -- 172.21.15.100:0/2322788714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb655d0 msgr2=0x55f99bb65a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.442+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb655d0 0x55f99bb65a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.442+0000 7f4b41a5c640 1 -- 172.21.15.100:0/2322788714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99ba573a0 con 0x55f99bb66b40 2024-09-12T02:49:51.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.445+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb66b40 0x55f99bb65090 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009900 tx=0x7f4b3803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d242730fc819daca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:51.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.446+0000 7f4b27fff640 1 -- 172.21.15.100:0/2322788714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3804b070 con 0x55f99bb66b40 2024-09-12T02:49:51.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.446+0000 7f4b27fff640 1 -- 172.21.15.100:0/2322788714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b380035f0 con 0x55f99bb66b40 2024-09-12T02:49:51.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.446+0000 7f4b27fff640 1 -- 172.21.15.100:0/2322788714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38035050 con 0x55f99bb66b40 2024-09-12T02:49:51.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.447+0000 7f4b46099740 1 -- 172.21.15.100:0/2322788714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb66b40 msgr2=0x55f99bb65090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.447+0000 7f4b46099740 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb66b40 0x55f99bb65090 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009900 tx=0x7f4b3803c000 comp rx=0 tx=0).stop 2024-09-12T02:49:51.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.448+0000 7f4b46099740 1 -- 172.21.15.100:0/2322788714 shutdown_connections 2024-09-12T02:49:51.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.448+0000 7f4b46099740 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb72760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.448+0000 7f4b46099740 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb655d0 0x55f99bb65a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.448+0000 7f4b46099740 1 --2- 172.21.15.100:0/2322788714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb66b40 0x55f99bb65090 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.448+0000 7f4b46099740 1 -- 172.21.15.100:0/2322788714 >> 172.21.15.100:0/2322788714 conn(0x55f99bb2e310 msgr2=0x55f99bb61c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:51.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.448+0000 7f4b46099740 1 -- 172.21.15.100:0/2322788714 shutdown_connections 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.454+0000 7f4b46099740 1 -- 172.21.15.100:0/2322788714 wait complete. 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.454+0000 7f4b46099740 1 -- start start 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.454+0000 7f4b46099740 1 Processor -- start 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b46099740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb6fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b46099740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb6d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b46099740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b46099740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f99bb84020 con 0x55f99bb655d0 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b46099740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f99ba86060 con 0x55f99bb66b40 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b46099740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f99bb841a0 con 0x55f99bb70370 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b46099740 10 client.0 _ll_register_callbacks cb 0x55f99b7d98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b4225d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b4225d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44542/0 (socket says 172.21.15.100:44542) 2024-09-12T02:49:51.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.455+0000 7f4b4225d640 1 -- 172.21.15.100:0/2408931718 learned_addr learned my addr 172.21.15.100:0/2408931718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:51.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b4225d640 1 -- 172.21.15.100:0/2408931718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 msgr2=0x55f99bb6d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b4225d640 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb6d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b4225d640 1 -- 172.21.15.100:0/2408931718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 msgr2=0x55f99bb6fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b4225d640 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb6fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b4225d640 1 -- 172.21.15.100:0/2408931718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99b83c3c0 con 0x55f99bb70370 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b4225d640 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6d650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000f80 tx=0x7f4b3409c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6646a09ab49b2d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b257fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b257fa640 1 -- 172.21.15.100:0/2408931718 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b340a4bb0 con 0x55f99bb70370 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b380035f0 con 0x55f99bb70370 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b257fa640 1 -- 172.21.15.100:0/2408931718 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4b34005540 con 0x55f99bb70370 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.456+0000 7f4b257fa640 1 -- 172.21.15.100:0/2408931718 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4b3409c1a0 con 0x55f99bb70370 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.458+0000 7f4b46099740 10 client.26572 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.458+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f99bb74560 con 0x55f99bb70370 2024-09-12T02:49:51.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b257fa640 1 -- 172.21.15.100:0/2408931718 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b380035f0 con 0x55f99bb70370 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b257fa640 1 -- 172.21.15.100:0/2408931718 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4b340babf0 con 0x55f99bb70370 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b46099740 10 client.26572 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b46099740 10 client.26572 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b46099740 20 client.26572 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b46099740 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bb75a30 0x55f99bb77ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b46099740 4 client.26572 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f99bad8860 con 0x55f99bb75a30 2024-09-12T02:49:51.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.462+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bb75a30 0x55f99bb77ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.471+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bb75a30 0x55f99bb77ec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a28836072f07e6ee server_cookie=94ae13c90e73f727 in_seq=0 out_seq=0 2024-09-12T02:49:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.471+0000 7f4b257fa640 10 client.26572 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.477+0000 7f4b257fa640 1 -- 172.21.15.100:0/2408931718 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f99bad8860 con 0x55f99bb75a30 2024-09-12T02:49:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.477+0000 7f4b257fa640 10 client.26572 handle_command_reply: tid=0 2024-09-12T02:49:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.477+0000 7f4b46099740 1 client.26572 shutdown 2024-09-12T02:49:51.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 msgr2=0x55f99bb6d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6d650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000f80 tx=0x7f4b3409c780 comp rx=0 tx=0).stop 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 shutdown_connections 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bb75a30 0x55f99bb77ec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6d650 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb6d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 --2- 172.21.15.100:0/2408931718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb6fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.486+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 >> 172.21.15.100:0/2408931718 conn(0x55f99bb2e310 msgr2=0x55f99bb67930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.487+0000 7f4b257fa640 0 client.26572 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.487+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 shutdown_connections 2024-09-12T02:49:51.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.487+0000 7f4b46099740 1 -- 172.21.15.100:0/2408931718 wait complete. 2024-09-12T02:49:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.487+0000 7f4b46099740 20 client.26572 trim_cache size 0 max 16384 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 Processor -- start 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 -- start start 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb837c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb8d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a98b0 con 0x55f99bb655d0 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c074250 con 0x55f99bb66b40 2024-09-12T02:49:51.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.516+0000 7f4b46099740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c0720a0 con 0x55f99bb70370 2024-09-12T02:49:51.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4225d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4125b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb8d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4225d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44552/0 (socket says 172.21.15.100:44552) 2024-09-12T02:49:51.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4225d640 1 -- 172.21.15.100:0/2988423199 learned_addr learned my addr 172.21.15.100:0/2988423199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4125b640 1 -- 172.21.15.100:0/2988423199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 msgr2=0x55f99bb6c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4125b640 1 --2- 172.21.15.100:0/2988423199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4125b640 1 -- 172.21.15.100:0/2988423199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 msgr2=0x55f99bb837c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4125b640 1 --2- 172.21.15.100:0/2988423199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb837c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4125b640 1 -- 172.21.15.100:0/2988423199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99bb72ad0 con 0x55f99bb66b40 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.517+0000 7f4b4125b640 1 --2- 172.21.15.100:0/2988423199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb8d2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55f99bb6e680 tx=0x7f4b2c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2370302827130b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.518+0000 7f4b277fe640 1 -- 172.21.15.100:0/2988423199 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c012450 con 0x55f99bb66b40 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.518+0000 7f4b277fe640 1 -- 172.21.15.100:0/2988423199 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b2c012ad0 con 0x55f99bb66b40 2024-09-12T02:49:51.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.518+0000 7f4b277fe640 1 -- 172.21.15.100:0/2988423199 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00f9d0 con 0x55f99bb66b40 2024-09-12T02:49:51.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.519+0000 7f4b46099740 1 -- 172.21.15.100:0/2988423199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 msgr2=0x55f99bb8d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.519+0000 7f4b46099740 1 --2- 172.21.15.100:0/2988423199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb8d2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55f99bb6e680 tx=0x7f4b2c0117b0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.519+0000 7f4b46099740 1 -- 172.21.15.100:0/2988423199 shutdown_connections 2024-09-12T02:49:51.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.519+0000 7f4b46099740 1 --2- 172.21.15.100:0/2988423199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb70370 0x55f99bb6c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.519+0000 7f4b46099740 1 --2- 172.21.15.100:0/2988423199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb66b40 0x55f99bb8d2c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.519+0000 7f4b46099740 1 --2- 172.21.15.100:0/2988423199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb837c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.519+0000 7f4b46099740 1 -- 172.21.15.100:0/2988423199 >> 172.21.15.100:0/2988423199 conn(0x55f99bb2e310 msgr2=0x55f99bb6b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.520+0000 7f4b46099740 1 -- 172.21.15.100:0/2988423199 shutdown_connections 2024-09-12T02:49:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.520+0000 7f4b46099740 1 -- 172.21.15.100:0/2988423199 wait complete. 2024-09-12T02:49:51.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.520+0000 7f4b46099740 1 -- start start 2024-09-12T02:49:51.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.520+0000 7f4b46099740 1 Processor -- start 2024-09-12T02:49:51.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b46099740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb85620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b46099740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb66b40 0x55f99bb85b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b46099740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb70370 0x55f99bc0b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b46099740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c072710 con 0x55f99bb655d0 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b46099740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c073b80 con 0x55f99bb70370 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b46099740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c072de0 con 0x55f99bb66b40 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b46099740 10 client.0 _ll_register_callbacks cb 0x7f4b34005840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4225d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb70370 0x55f99bc0b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4225d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb70370 0x55f99bc0b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45666/0 (socket says 172.21.15.100:45666) 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4225d640 1 -- 172.21.15.100:0/1244367302 learned_addr learned my addr 172.21.15.100:0/1244367302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4125b640 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb66b40 0x55f99bb85b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb85620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4225d640 1 -- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb66b40 msgr2=0x55f99bb85b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4225d640 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb66b40 0x55f99bb85b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4225d640 1 -- 172.21.15.100:0/1244367302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 msgr2=0x55f99bb85620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:51.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.521+0000 7f4b4225d640 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb85620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.522+0000 7f4b4225d640 1 -- 172.21.15.100:0/1244367302 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99bc0b890 con 0x55f99bb70370 2024-09-12T02:49:51.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.522+0000 7f4b4225d640 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb70370 0x55f99bc0b350 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4b340a4680 tx=0x7f4b34009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4799fd3e7f47598 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:51.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.522+0000 7f4b257fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:51.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.522+0000 7f4b257fa640 1 -- 172.21.15.100:0/1244367302 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b340a4bb0 con 0x55f99bb70370 2024-09-12T02:49:51.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.523+0000 7f4b257fa640 1 -- 172.21.15.100:0/1244367302 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4b34005540 con 0x55f99bb70370 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.524+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2c012ad0 con 0x55f99bb70370 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.524+0000 7f4b257fa640 1 -- 172.21.15.100:0/1244367302 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4b3409b4d0 con 0x55f99bb70370 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 10 client.26654 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f99bc1db30 con 0x55f99bb70370 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b257fa640 1 -- 172.21.15.100:0/1244367302 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b2c012ad0 con 0x55f99bb70370 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b257fa640 1 -- 172.21.15.100:0/1244367302 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4b34081050 con 0x55f99bb70370 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 10 client.26654 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 10 client.26654 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:49:51.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 20 client.26654 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:51.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bc1df90 0x55f99bc20380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:51.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 4 client.26654 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:49:51.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.525+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f99bad2d70 con 0x55f99bc1df90 2024-09-12T02:49:51.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.526+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bc1df90 0x55f99bc20380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:51.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.526+0000 7f4b41a5c640 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bc1df90 0x55f99bc20380 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1448169a4067ee9e server_cookie=446396d6bafaaa40 in_seq=0 out_seq=0 2024-09-12T02:49:51.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.526+0000 7f4b257fa640 10 client.26654 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:51.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.527+0000 7f4b257fa640 1 -- 172.21.15.100:0/1244367302 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f99bad2d70 con 0x55f99bc1df90 2024-09-12T02:49:51.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.527+0000 7f4b257fa640 10 client.26654 handle_command_reply: tid=0 2024-09-12T02:49:51.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.527+0000 7f4b46099740 1 client.26654 shutdown 2024-09-12T02:49:51.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb70370 msgr2=0x55f99bc0b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb70370 0x55f99bc0b350 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4b340a4680 tx=0x7f4b34009590 comp rx=0 tx=0).stop 2024-09-12T02:49:51.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 shutdown_connections 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55f99bc1df90 0x55f99bc20380 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f99bb70370 0x55f99bc0b350 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f99bb66b40 0x55f99bb85b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 --2- 172.21.15.100:0/1244367302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f99bb655d0 0x55f99bb85620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 >> 172.21.15.100:0/1244367302 conn(0x55f99bb2e310 msgr2=0x55f99bb6e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b257fa640 0 client.26654 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.528+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 shutdown_connections 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.529+0000 7f4b46099740 1 -- 172.21.15.100:0/1244367302 wait complete. 2024-09-12T02:49:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.529+0000 7f4b46099740 20 client.26654 trim_cache size 0 max 16384 2024-09-12T02:49:51.532 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b280a2d50 msgr2=0x7f4b280a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b280a2d50 0x7f4b280a5210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005ab0 tx=0x7f4b38005a20 comp rx=0 tx=0).stop 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c109130 msgr2=0x7f4b3c19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c109130 0x7f4b3c19eed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009fd0 tx=0x7f4b3400ef10 comp rx=0 tx=0).stop 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 shutdown_connections 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4b280a2d50 0x7f4b280a5210 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c109130 0x7f4b3c19eed0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c1049b0 0x7f4b3c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 --2- 172.21.15.100:0/3949537540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c104000 0x7f4b3c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 >> 172.21.15.100:0/3949537540 conn(0x7f4b3c0ffa20 msgr2=0x7f4b3c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 shutdown_connections 2024-09-12T02:49:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:51.530+0000 7f4b43cc0640 1 -- 172.21.15.100:0/3949537540 wait complete. 2024-09-12T02:49:52.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:49:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:53.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:52 smithi117 ceph-mon[34898]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 MiB/s wr, 671 op/s 2024-09-12T02:49:53.125 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:52 smithi100 ceph-mon[31390]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 MiB/s wr, 671 op/s 2024-09-12T02:49:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:52 smithi189 ceph-mon[35196]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 MiB/s wr, 671 op/s 2024-09-12T02:49:53.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.464+0000 7f18ba93a640 1 -- 172.21.15.100:0/2023589629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 msgr2=0x7f18b41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.464+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2023589629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b41043d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009900 tx=0x7f18a402a410 comp rx=0 tx=0).stop 2024-09-12T02:49:53.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.464+0000 7f18ba93a640 1 -- 172.21.15.100:0/2023589629 shutdown_connections 2024-09-12T02:49:53.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.464+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2023589629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4109120 0x7f18b4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.464+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2023589629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b41049a0 0x7f18b41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.464+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2023589629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b41043d0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.465+0000 7f18ba93a640 1 -- 172.21.15.100:0/2023589629 >> 172.21.15.100:0/2023589629 conn(0x7f18b40ffa90 msgr2=0x7f18b4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:53.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.465+0000 7f18ba93a640 1 -- 172.21.15.100:0/2023589629 shutdown_connections 2024-09-12T02:49:53.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.465+0000 7f18ba93a640 1 -- 172.21.15.100:0/2023589629 wait complete. 2024-09-12T02:49:53.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 Processor -- start 2024-09-12T02:49:53.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 -- start start 2024-09-12T02:49:53.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b41049a0 0x7f18b419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4109120 0x7f18b419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4114140 con 0x7f18b4103ff0 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4113fc0 con 0x7f18b4109120 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.468+0000 7f18ba93a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f18b41142c0 con 0x7f18b41049a0 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53038/0 (socket says 172.21.15.100:53038) 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 -- 172.21.15.100:0/2742321427 learned_addr learned my addr 172.21.15.100:0/2742321427 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b8ed7640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4109120 0x7f18b419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b37fe640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b41049a0 0x7f18b419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 -- 172.21.15.100:0/2742321427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b41049a0 msgr2=0x7f18b419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b41049a0 0x7f18b419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 -- 172.21.15.100:0/2742321427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4109120 msgr2=0x7f18b419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4109120 0x7f18b419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 -- 172.21.15.100:0/2742321427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b419f5f0 con 0x7f18b4103ff0 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b8ed7640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4109120 0x7f18b419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b3fff640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b419a640 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f18a4006010 tx=0x7f18a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b17fa640 1 -- 172.21.15.100:0/2742321427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a403f030 con 0x7f18b4103ff0 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b419f880 con 0x7f18b4103ff0 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.469+0000 7f18b17fa640 1 -- 172.21.15.100:0/2742321427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18a4003ce0 con 0x7f18b4103ff0 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.470+0000 7f18b17fa640 1 -- 172.21.15.100:0/2742321427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4035070 con 0x7f18b4103ff0 2024-09-12T02:49:53.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.470+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b41a71c0 con 0x7f18b4103ff0 2024-09-12T02:49:53.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.473+0000 7f18b17fa640 1 -- 172.21.15.100:0/2742321427 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f18a4042030 con 0x7f18b4103ff0 2024-09-12T02:49:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.473+0000 7f18bcd13740 1 Processor -- start 2024-09-12T02:49:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.473+0000 7f18bcd13740 1 -- start start 2024-09-12T02:49:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b17fa640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f189c0a2c80 0x7f189c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053b6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18bcd13740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5561053132f0 con 0x5561053b7350 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18bcd13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5561052bacf0 con 0x5561053c0b80 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18bcd13740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55610530f2b0 con 0x5561053b5de0 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b17fa640 1 -- 172.21.15.100:0/2742321427 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f18a40ef5b0 con 0x7f18b4103ff0 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53046/0 (socket says 172.21.15.100:53046) 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b3fff640 1 -- 172.21.15.100:0/1916426295 learned_addr learned my addr 172.21.15.100:0/1916426295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b37fe640 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b37fe640 1 -- 172.21.15.100:0/1916426295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 msgr2=0x5561053c2f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b37fe640 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053c2f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b37fe640 1 -- 172.21.15.100:0/1916426295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 msgr2=0x5561053b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b37fe640 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b37fe640 1 -- 172.21.15.100:0/1916426295 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610529f3a0 con 0x5561053b5de0 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b8ed7640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f189c0a2c80 0x7f189c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b3fff640 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.474+0000 7f18b37fe640 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053b6220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f18a8005fd0 tx=0x7f18a800bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75bfee7940aeeb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.475+0000 7f189a7fc640 1 -- 172.21.15.100:0/1916426295 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8003bd0 con 0x5561053b5de0 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.475+0000 7f189a7fc640 1 -- 172.21.15.100:0/1916426295 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18a8015070 con 0x5561053b5de0 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.475+0000 7f189a7fc640 1 -- 172.21.15.100:0/1916426295 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8004db0 con 0x5561053b5de0 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.475+0000 7f18bcd13740 1 -- 172.21.15.100:0/1916426295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 msgr2=0x5561053b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.475+0000 7f18b8ed7640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f189c0a2c80 0x7f189c0a5140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x5561053b6880 tx=0x7f18ac0096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.475+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053b6220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f18a8005fd0 tx=0x7f18a800bb20 comp rx=0 tx=0).stop 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 -- 172.21.15.100:0/1916426295 shutdown_connections 2024-09-12T02:49:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053b6220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1916426295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 -- 172.21.15.100:0/1916426295 >> 172.21.15.100:0/1916426295 conn(0x556105376310 msgr2=0x5561053b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 -- 172.21.15.100:0/1916426295 shutdown_connections 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 -- 172.21.15.100:0/1916426295 wait complete. 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 -- start start 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.476+0000 7f18bcd13740 1 Processor -- start 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053b5de0 0x5561053c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b7350 0x5561053bd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053c0b80 0x5561053be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18bcd13740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5561053c3880 con 0x5561053c0b80 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18bcd13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5561052ce060 con 0x5561053b5de0 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18bcd13740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5561053c3a00 con 0x5561053b7350 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18bcd13740 10 client.0 _ll_register_callbacks cb 0x5561050218c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053b5de0 0x5561053c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053b5de0 0x5561053c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:45686/0 (socket says 172.21.15.100:45686) 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 -- 172.21.15.100:0/1160619515 learned_addr learned my addr 172.21.15.100:0/1160619515 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b8ed7640 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053c0b80 0x5561053be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b37fe640 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b7350 0x5561053bd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 -- 172.21.15.100:0/1160619515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b7350 msgr2=0x5561053bd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b7350 0x5561053bd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 -- 172.21.15.100:0/1160619515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053c0b80 msgr2=0x5561053be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053c0b80 0x5561053be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 -- 172.21.15.100:0/1160619515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561050843c0 con 0x5561053b5de0 2024-09-12T02:49:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18b3fff640 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053b5de0 0x5561053c0630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18a40bbc10 tx=0x7f18a40b8220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd2d68e7ebd1da4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.477+0000 7f18937fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.478+0000 7f18937fe640 1 -- 172.21.15.100:0/1160619515 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4049040 con 0x5561053b5de0 2024-09-12T02:49:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.478+0000 7f18937fe640 1 -- 172.21.15.100:0/1160619515 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f18a40b8580 con 0x5561053b5de0 2024-09-12T02:49:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.478+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18a8015070 con 0x5561053b5de0 2024-09-12T02:49:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.478+0000 7f18937fe640 1 -- 172.21.15.100:0/1160619515 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f18a40bb870 con 0x5561053b5de0 2024-09-12T02:49:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.478+0000 7f18bcd13740 10 client.26663 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.478+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5561053cf3f0 con 0x5561053b5de0 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.478+0000 7f18937fe640 1 -- 172.21.15.100:0/1160619515 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18a403b580 con 0x5561053b5de0 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.479+0000 7f18937fe640 1 -- 172.21.15.100:0/1160619515 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f18a40bc170 con 0x5561053b5de0 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.479+0000 7f18bcd13740 10 client.26663 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.479+0000 7f18bcd13740 10 client.26663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.479+0000 7f18bcd13740 20 client.26663 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.479+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5561053d0a30 0x5561053d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.479+0000 7f18bcd13740 4 client.26663 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.479+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f18a8015070 con 0x5561053d0a30 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.480+0000 7f18b37fe640 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5561053d0a30 0x5561053d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.480+0000 7f18b37fe640 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5561053d0a30 0x5561053d2e40 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba9ea471200469ed server_cookie=84914a352afae5d8 in_seq=0 out_seq=0 2024-09-12T02:49:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18937fe640 10 client.26663 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18937fe640 1 -- 172.21.15.100:0/1160619515 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f18a8015070 con 0x5561053d0a30 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18937fe640 10 client.26663 handle_command_reply: tid=0 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 client.26663 shutdown 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053b5de0 msgr2=0x5561053c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053b5de0 0x5561053c0630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18a40bbc10 tx=0x7f18a40b8220 comp rx=0 tx=0).stop 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 shutdown_connections 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5561053d0a30 0x5561053d2e40 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053c0b80 0x5561053be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b7350 0x5561053bd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 --2- 172.21.15.100:0/1160619515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053b5de0 0x5561053c0630 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 >> 172.21.15.100:0/1160619515 conn(0x556105376310 msgr2=0x5561053b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:53.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.481+0000 7f18937fe640 0 client.26663 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:53.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.482+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 shutdown_connections 2024-09-12T02:49:53.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.482+0000 7f18bcd13740 1 -- 172.21.15.100:0/1160619515 wait complete. 2024-09-12T02:49:53.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.482+0000 7f18bcd13740 20 client.26663 trim_cache size 0 max 16384 2024-09-12T02:49:53.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 Processor -- start 2024-09-12T02:49:53.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 -- start start 2024-09-12T02:49:53.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18b41adc50 con 0x5561053b7350 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18b41ab520 con 0x5561053c0b80 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44610/0 (socket says 172.21.15.100:44610) 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 -- 172.21.15.100:0/2193364590 learned_addr learned my addr 172.21.15.100:0/2193364590 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b37fe640 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53062/0 (socket says 172.21.15.100:53062) 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18bcd13740 1 -- 172.21.15.100:0/2193364590 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f18b41a9390 con 0x5561053b5de0 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b8ed7640 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 -- 172.21.15.100:0/2193364590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 msgr2=0x5561053c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 -- 172.21.15.100:0/2193364590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 msgr2=0x5561053c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053c1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.499+0000 7f18b3fff640 1 -- 172.21.15.100:0/2193364590 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561053be3a0 con 0x5561053b5de0 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.500+0000 7f18b3fff640 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053a8bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18a40ad040 tx=0x7f18a402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5c700c6c0ef8ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.500+0000 7f1899ffb640 1 -- 172.21.15.100:0/2193364590 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a40d9070 con 0x5561053b5de0 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.500+0000 7f1899ffb640 1 -- 172.21.15.100:0/2193364590 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18a403b580 con 0x5561053b5de0 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.500+0000 7f1899ffb640 1 -- 172.21.15.100:0/2193364590 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4049070 con 0x5561053b5de0 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 -- 172.21.15.100:0/2193364590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 msgr2=0x5561053a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053a8bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18a40ad040 tx=0x7f18a402a410 comp rx=0 tx=0).stop 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 -- 172.21.15.100:0/2193364590 shutdown_connections 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 --2- 172.21.15.100:0/2193364590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053a8bf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 -- 172.21.15.100:0/2193364590 >> 172.21.15.100:0/2193364590 conn(0x556105376310 msgr2=0x5561053a84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:53.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 -- 172.21.15.100:0/2193364590 shutdown_connections 2024-09-12T02:49:53.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 -- 172.21.15.100:0/2193364590 wait complete. 2024-09-12T02:49:53.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 -- start start 2024-09-12T02:49:53.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.501+0000 7f18bcd13740 1 Processor -- start 2024-09-12T02:49:53.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18bcd13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053d84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18bcd13740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18b41a99e0 con 0x5561053b7350 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18bcd13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18b41aae50 con 0x5561053c0b80 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18bcd13740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f18b41aa0b0 con 0x5561053b5de0 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18bcd13740 10 client.0 _ll_register_callbacks cb 0x7f18a40b7b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:44626/0 (socket says 172.21.15.100:44626) 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 -- 172.21.15.100:0/3116666623 learned_addr learned my addr 172.21.15.100:0/3116666623 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b37fe640 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053d7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53068/0 (socket says 172.21.15.100:53068) 2024-09-12T02:49:53.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b8ed7640 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053d84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 -- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 msgr2=0x5561053d84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053d84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 -- 172.21.15.100:0/3116666623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 msgr2=0x5561053d7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053d7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.502+0000 7f18b3fff640 1 -- 172.21.15.100:0/3116666623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561053d8cb0 con 0x5561053b5de0 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.503+0000 7f18b3fff640 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053c93e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f18a40ba1c0 tx=0x7f18a40ef380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13e2d9ead518e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.503+0000 7f18937fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.503+0000 7f18937fe640 1 -- 172.21.15.100:0/3116666623 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a40d9030 con 0x5561053b5de0 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.503+0000 7f18937fe640 1 -- 172.21.15.100:0/3116666623 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f18a40bb570 con 0x5561053b5de0 2024-09-12T02:49:53.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.505+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556105320860 con 0x5561053b5de0 2024-09-12T02:49:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.505+0000 7f18937fe640 1 -- 172.21.15.100:0/3116666623 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f18a4049070 con 0x5561053b5de0 2024-09-12T02:49:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 10 client.26596 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5561053d8cb0 con 0x5561053b5de0 2024-09-12T02:49:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18937fe640 1 -- 172.21.15.100:0/3116666623 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556105320860 con 0x5561053b5de0 2024-09-12T02:49:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18937fe640 1 -- 172.21.15.100:0/3116666623 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f18a40b7c60 con 0x5561053b5de0 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 10 client.26596 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 10 client.26596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 20 client.26596 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55610543b900 0x55610543dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 4 client.26596 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.506+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55610531ad70 con 0x55610543b900 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18b37fe640 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55610543b900 0x55610543dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18b37fe640 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55610543b900 0x55610543dcf0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19a3d2f63e4ffe1 server_cookie=9f949246a7cf0cc2 in_seq=0 out_seq=0 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18937fe640 10 client.26596 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18937fe640 1 -- 172.21.15.100:0/3116666623 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55610531ad70 con 0x55610543b900 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18937fe640 10 client.26596 handle_command_reply: tid=0 2024-09-12T02:49:53.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18bcd13740 1 client.26596 shutdown 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 msgr2=0x5561053c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.507+0000 7f18bcd13740 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053c93e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f18a40ba1c0 tx=0x7f18a40ef380 comp rx=0 tx=0).stop 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 shutdown_connections 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55610543b900 0x55610543dcf0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5561053c0b80 0x5561053d84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5561053b7350 0x5561053d7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18937fe640 0 client.26596 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 --2- 172.21.15.100:0/3116666623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561053b5de0 0x5561053c93e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 >> 172.21.15.100:0/3116666623 conn(0x556105376310 msgr2=0x5561053a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:53.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 shutdown_connections 2024-09-12T02:49:53.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 1 -- 172.21.15.100:0/3116666623 wait complete. 2024-09-12T02:49:53.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.508+0000 7f18bcd13740 20 client.26596 trim_cache size 0 max 16384 2024-09-12T02:49:53.513 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:49:53.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f189c0a2c80 msgr2=0x7f189c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f189c0a2c80 0x7f189c0a5140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x5561053b6880 tx=0x7f18ac0096a0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 msgr2=0x7f18b419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:53.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b419a640 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f18a4006010 tx=0x7f18a40042f0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 shutdown_connections 2024-09-12T02:49:53.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f189c0a2c80 0x7f189c0a5140 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4109120 0x7f18b419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b41049a0 0x7f18b419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 --2- 172.21.15.100:0/2742321427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4103ff0 0x7f18b419a640 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:53.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 >> 172.21.15.100:0/2742321427 conn(0x7f18b40ffa90 msgr2=0x7f18b4100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:53.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 shutdown_connections 2024-09-12T02:49:53.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:53.509+0000 7f18ba93a640 1 -- 172.21.15.100:0/2742321427 wait complete. 2024-09-12T02:49:55.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:54 smithi117 ceph-mon[34898]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 702 op/s 2024-09-12T02:49:55.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:54 smithi100 ceph-mon[31390]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 702 op/s 2024-09-12T02:49:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:54 smithi189 ceph-mon[35196]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 702 op/s 2024-09-12T02:49:55.264 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:49:55.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:49:55.607 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:56.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.193+0000 7f8457198640 1 -- 172.21.15.100:0/131625431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8450101df0 msgr2=0x7f84501021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.193+0000 7f8457198640 1 --2- 172.21.15.100:0/131625431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8450101df0 0x7f84501021d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8444009900 tx=0x7f844402a410 comp rx=0 tx=0).stop 2024-09-12T02:49:56.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.193+0000 7f8457198640 1 -- 172.21.15.100:0/131625431 shutdown_connections 2024-09-12T02:49:56.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.194+0000 7f8457198640 1 --2- 172.21.15.100:0/131625431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8450106f20 0x7f845010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.194+0000 7f8457198640 1 --2- 172.21.15.100:0/131625431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84501027a0 0x7f84501067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.194+0000 7f8457198640 1 --2- 172.21.15.100:0/131625431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8450101df0 0x7f84501021d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.194+0000 7f8457198640 1 -- 172.21.15.100:0/131625431 >> 172.21.15.100:0/131625431 conn(0x7f84500fd8b0 msgr2=0x7f84500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:56.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.194+0000 7f8457198640 1 -- 172.21.15.100:0/131625431 shutdown_connections 2024-09-12T02:49:56.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.194+0000 7f8457198640 1 -- 172.21.15.100:0/131625431 wait complete. 2024-09-12T02:49:56.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.194+0000 7f8457198640 1 Processor -- start 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8457198640 1 -- start start 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8457198640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8450101df0 0x7f8450075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8457198640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84501027a0 0x7f8450075fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8457198640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8450106f20 0x7f845006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8457198640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8450111f80 con 0x7f84501027a0 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8457198640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8450111e00 con 0x7f8450106f20 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8457198640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8450112100 con 0x7f8450101df0 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f844ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84501027a0 0x7f8450075fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f844ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84501027a0 0x7f8450075fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57346/0 (socket says 172.21.15.100:57346) 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f844ffff640 1 -- 172.21.15.100:0/857634574 learned_addr learned my addr 172.21.15.100:0/857634574 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:56.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8454f34640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8450101df0 0x7f8450075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.195+0000 7f8455735640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8450106f20 0x7f845006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f8454f34640 1 -- 172.21.15.100:0/857634574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8450106f20 msgr2=0x7f845006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f8454f34640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8450106f20 0x7f845006cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f8454f34640 1 -- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84501027a0 msgr2=0x7f8450075fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f8454f34640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84501027a0 0x7f8450075fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f8454f34640 1 -- 172.21.15.100:0/857634574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845006d390 con 0x7f8450101df0 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f8454f34640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8450101df0 0x7f8450075a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8444005940 tx=0x7f8444004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:56.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f844dffb640 1 -- 172.21.15.100:0/857634574 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844403f030 con 0x7f8450101df0 2024-09-12T02:49:56.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f844dffb640 1 -- 172.21.15.100:0/857634574 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8444003ad0 con 0x7f8450101df0 2024-09-12T02:49:56.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.196+0000 7f844dffb640 1 -- 172.21.15.100:0/857634574 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444035070 con 0x7f8450101df0 2024-09-12T02:49:56.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.197+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845006d620 con 0x7f8450101df0 2024-09-12T02:49:56.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.197+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84500716a0 con 0x7f8450101df0 2024-09-12T02:49:56.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.200+0000 7f844dffb640 1 -- 172.21.15.100:0/857634574 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8444042030 con 0x7f8450101df0 2024-09-12T02:49:56.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.200+0000 7f8459571740 1 Processor -- start 2024-09-12T02:49:56.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.200+0000 7f8459571740 1 -- start start 2024-09-12T02:49:56.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8459571740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8459571740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8459571740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x5644937b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8459571740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56449370a280 con 0x5644937a4b60 2024-09-12T02:49:56.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8459571740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5644936b1b10 con 0x5644937afd40 2024-09-12T02:49:56.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8459571740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564493706240 con 0x5644937a5480 2024-09-12T02:49:56.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:34964/0 (socket says 172.21.15.100:34964) 2024-09-12T02:49:56.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f844dffb640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84400a2c00 0x7f84400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 -- 172.21.15.100:0/2542610127 learned_addr learned my addr 172.21.15.100:0/2542610127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f844ffff640 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x5644937b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8455735640 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 -- 172.21.15.100:0/2542610127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 msgr2=0x5644937b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x5644937b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 -- 172.21.15.100:0/2542610127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 msgr2=0x5644937a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937a4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8454f34640 1 -- 172.21.15.100:0/2542610127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644936be1f0 con 0x5644937a5480 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.201+0000 7f8455735640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84400a2c00 0x7f84400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.202+0000 7f844dffb640 1 -- 172.21.15.100:0/857634574 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f84440ef330 con 0x7f8450101df0 2024-09-12T02:49:56.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.202+0000 7f8454f34640 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937af800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84440bb820 tx=0x7f84440bba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db1bee57210d1d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.202+0000 7f8455735640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84400a2c00 0x7f84400a50c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f84480094d0 tx=0x7f8448004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.202+0000 7f843affd640 1 -- 172.21.15.100:0/2542610127 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444049020 con 0x5644937a5480 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.202+0000 7f843affd640 1 -- 172.21.15.100:0/2542610127 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84440bce50 con 0x5644937a5480 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.202+0000 7f843affd640 1 -- 172.21.15.100:0/2542610127 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84440bfed0 con 0x5644937a5480 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 -- 172.21.15.100:0/2542610127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 msgr2=0x5644937af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937af800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84440bb820 tx=0x7f84440bba20 comp rx=0 tx=0).stop 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 -- 172.21.15.100:0/2542610127 shutdown_connections 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x5644937b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937af800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 --2- 172.21.15.100:0/2542610127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937a4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 -- 172.21.15.100:0/2542610127 >> 172.21.15.100:0/2542610127 conn(0x5644937a10f0 msgr2=0x5644937a14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:56.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 -- 172.21.15.100:0/2542610127 shutdown_connections 2024-09-12T02:49:56.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 -- 172.21.15.100:0/2542610127 wait complete. 2024-09-12T02:49:56.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 -- start start 2024-09-12T02:49:56.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.203+0000 7f8459571740 1 Processor -- start 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8459571740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8459571740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8459571740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 0x5644937ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8459571740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5644937b26d0 con 0x5644937a5480 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8459571740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5644936c4f10 con 0x5644937a4b60 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8459571740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5644937b2850 con 0x5644937afd40 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f844ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36268/0 (socket says 172.21.15.100:36268) 2024-09-12T02:49:56.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 -- 172.21.15.100:0/3542735651 learned_addr learned my addr 172.21.15.100:0/3542735651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8459571740 10 client.0 _ll_register_callbacks cb 0x56449368da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 -- 172.21.15.100:0/3542735651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 msgr2=0x5644937ad2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 0x5644937ad2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 -- 172.21.15.100:0/3542735651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 msgr2=0x5644937acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.204+0000 7f8454f34640 1 -- 172.21.15.100:0/3542735651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56449347b6a0 con 0x5644937a4b60 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f8454f34640 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937af800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f844403d040 tx=0x7f8444005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96aede8f8a722a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f842ffff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f842ffff640 1 -- 172.21.15.100:0/3542735651 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444049070 con 0x5644937a4b60 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f842ffff640 1 -- 172.21.15.100:0/3542735651 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f84440b8190 con 0x5644937a4b60 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84440bce50 con 0x5644937a4b60 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f842ffff640 1 -- 172.21.15.100:0/3542735651 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84440bc220 con 0x5644937a4b60 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f8459571740 10 client.26681 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.205+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644937b26d0 con 0x5644937a4b60 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f842ffff640 1 -- 172.21.15.100:0/3542735651 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84440bce50 con 0x5644937a4b60 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f842ffff640 1 -- 172.21.15.100:0/3542735651 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f84440bbdf0 con 0x5644937a4b60 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f8459571740 10 client.26681 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f8459571740 10 client.26681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f8459571740 20 client.26681 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f8459571740 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x5644937c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f8459571740 4 client.26681 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644937177f0 con 0x5644937bf420 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.206+0000 7f844ffff640 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x5644937c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f842ffff640 10 client.26681 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f844ffff640 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x5644937c1850 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff57dcbbc55d158 server_cookie=d30ffac02ff2247c in_seq=0 out_seq=0 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f842ffff640 1 -- 172.21.15.100:0/3542735651 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644937177f0 con 0x5644937bf420 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f842ffff640 10 client.26681 handle_command_reply: tid=0 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 client.26681 shutdown 2024-09-12T02:49:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 msgr2=0x5644937af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937af800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f844403d040 tx=0x7f8444005b50 comp rx=0 tx=0).stop 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 shutdown_connections 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x5644937c1850 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f842ffff640 0 client.26681 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 0x5644937ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 --2- 172.21.15.100:0/3542735651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937af800 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.207+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 >> 172.21.15.100:0/3542735651 conn(0x5644937a10f0 msgr2=0x5644937a6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.208+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 shutdown_connections 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.208+0000 7f8459571740 1 -- 172.21.15.100:0/3542735651 wait complete. 2024-09-12T02:49:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.208+0000 7f8459571740 20 client.26681 trim_cache size 0 max 16384 2024-09-12T02:49:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.229+0000 7f8459571740 1 Processor -- start 2024-09-12T02:49:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.229+0000 7f8459571740 1 -- start start 2024-09-12T02:49:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8459571740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8459571740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8459571740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 0x5644937a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8459571740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8434010d40 con 0x5644937a5480 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8459571740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f843400e610 con 0x5644937a4b60 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8459571740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f843400c460 con 0x5644937afd40 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57368/0 (socket says 172.21.15.100:57368) 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 -- 172.21.15.100:0/3204161272 learned_addr learned my addr 172.21.15.100:0/3204161272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8455735640 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 0x5644937a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f8454f34640 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 -- 172.21.15.100:0/3204161272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 msgr2=0x5644937a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 0x5644937a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 -- 172.21.15.100:0/3204161272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 msgr2=0x5644937c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:56.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 -- 172.21.15.100:0/3204161272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644937a52b0 con 0x5644937a5480 2024-09-12T02:49:56.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f844ffff640 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937c76a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f845006e290 tx=0x7f843c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b308da91488c82b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:56.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.230+0000 7f843a7fc640 1 -- 172.21.15.100:0/3204161272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c004220 con 0x5644937a5480 2024-09-12T02:49:56.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f843a7fc640 1 -- 172.21.15.100:0/3204161272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f843c0043c0 con 0x5644937a5480 2024-09-12T02:49:56.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f843a7fc640 1 -- 172.21.15.100:0/3204161272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c01eae0 con 0x5644937a5480 2024-09-12T02:49:56.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 -- 172.21.15.100:0/3204161272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 msgr2=0x5644937c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937c76a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f845006e290 tx=0x7f843c010800 comp rx=0 tx=0).stop 2024-09-12T02:49:56.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 -- 172.21.15.100:0/3204161272 shutdown_connections 2024-09-12T02:49:56.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937afd40 0x5644937a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a5480 0x5644937c76a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 --2- 172.21.15.100:0/3204161272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937a4b60 0x5644937c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 -- 172.21.15.100:0/3204161272 >> 172.21.15.100:0/3204161272 conn(0x5644937a10f0 msgr2=0x5644937abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 -- 172.21.15.100:0/3204161272 shutdown_connections 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.231+0000 7f8459571740 1 -- 172.21.15.100:0/3204161272 wait complete. 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 -- start start 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 Processor -- start 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x564493823100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f843400cad0 con 0x5644937a4b60 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f843400df40 con 0x5644937afd40 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f843400d1a0 con 0x5644937a5480 2024-09-12T02:49:56.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8459571740 10 client.0 _ll_register_callbacks cb 0x7f843c00a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8455735640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x564493823100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8455735640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x564493823100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36286/0 (socket says 172.21.15.100:36286) 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8455735640 1 -- 172.21.15.100:0/1240914482 learned_addr learned my addr 172.21.15.100:0/1240914482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.232+0000 7f8454f34640 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f844ffff640 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f8455735640 1 -- 172.21.15.100:0/1240914482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 msgr2=0x5644937b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f8455735640 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f8455735640 1 -- 172.21.15.100:0/1240914482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 msgr2=0x5644937b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f8455735640 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f8455735640 1 -- 172.21.15.100:0/1240914482 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564493823740 con 0x5644937afd40 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f8455735640 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x564493823100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8448011db0 tx=0x7f8448014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f365ee4d8854f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:56.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f842ffff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f842ffff640 1 -- 172.21.15.100:0/1240914482 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844802c060 con 0x5644937afd40 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f842ffff640 1 -- 172.21.15.100:0/1240914482 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8448027620 con 0x5644937afd40 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.233+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f843c0043c0 con 0x5644937afd40 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f842ffff640 1 -- 172.21.15.100:0/1240914482 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8448027820 con 0x5644937afd40 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 10 client.26687 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56449382ab10 con 0x5644937afd40 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f842ffff640 1 -- 172.21.15.100:0/1240914482 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f843c0043c0 con 0x5644937afd40 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f842ffff640 1 -- 172.21.15.100:0/1240914482 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f844801bc30 con 0x5644937afd40 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 10 client.26687 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 10 client.26687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 20 client.26687 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x56449382d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 4 client.26687 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.234+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564493711d00 con 0x5644937bf420 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.235+0000 7f8454f34640 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x56449382d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.235+0000 7f842ffff640 10 client.26687 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.235+0000 7f8454f34640 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x56449382d2d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4616e63f7a725b59 server_cookie=a755c6e8c397318a in_seq=0 out_seq=0 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f842ffff640 1 -- 172.21.15.100:0/1240914482 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564493711d00 con 0x5644937bf420 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f842ffff640 10 client.26687 handle_command_reply: tid=0 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 client.26687 shutdown 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 msgr2=0x564493823100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x564493823100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8448011db0 tx=0x7f8448014040 comp rx=0 tx=0).stop 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 shutdown_connections 2024-09-12T02:49:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5644937bf420 0x56449382d2d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f842ffff640 0 client.26687 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5644937afd40 0x564493823100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5644937a5480 0x5644937b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 --2- 172.21.15.100:0/1240914482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644937a4b60 0x5644937b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 >> 172.21.15.100:0/1240914482 conn(0x5644937a10f0 msgr2=0x5644937a65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 shutdown_connections 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.236+0000 7f8459571740 1 -- 172.21.15.100:0/1240914482 wait complete. 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8459571740 20 client.26687 trim_cache size 0 max 16384 2024-09-12T02:49:56.243 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:49:56.244 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:49:56.244 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "6c18f848-4c0a-479b-8d6b-1a5c91b82138", 2024-09-12T02:49:56.244 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:49:56.244 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:49:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84400a2c00 msgr2=0x7f84400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84400a2c00 0x7f84400a50c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f84480094d0 tx=0x7f8448004a40 comp rx=0 tx=0).stop 2024-09-12T02:49:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8450101df0 msgr2=0x7f8450075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8450101df0 0x7f8450075a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8444005940 tx=0x7f8444004270 comp rx=0 tx=0).stop 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 shutdown_connections 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84400a2c00 0x7f84400a50c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8450106f20 0x7f845006cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84501027a0 0x7f8450075fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 --2- 172.21.15.100:0/857634574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8450101df0 0x7f8450075a80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.237+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 >> 172.21.15.100:0/857634574 conn(0x7f84500fd8b0 msgr2=0x7f84500febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.238+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 shutdown_connections 2024-09-12T02:49:56.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:56.238+0000 7f8457198640 1 -- 172.21.15.100:0/857634574 wait complete. 2024-09-12T02:49:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 645.0 s, 2291.2 tps, lat 43.408 ms stddev 49.661 2024-09-12T02:49:57.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:56 smithi100 ceph-mon[31390]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.5 MiB/s wr, 660 op/s 2024-09-12T02:49:57.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:56 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:49:57.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:56 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:56 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:49:57.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:56 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:49:57.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:56 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:56 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:49:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:56 smithi117 ceph-mon[34898]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.5 MiB/s wr, 660 op/s 2024-09-12T02:49:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:56 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:49:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:56 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:56 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:49:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:56 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:49:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:56 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:56 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:56 smithi189 ceph-mon[35196]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.5 MiB/s wr, 660 op/s 2024-09-12T02:49:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:56 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:49:57.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:56 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:56 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:49:57.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:56 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:49:57.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:56 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:56 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:49:57.415 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:59.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:58 smithi100 ceph-mon[31390]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 643 op/s 2024-09-12T02:49:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.055+0000 7fce52e1e640 1 -- 172.21.15.100:0/2587837293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c108b50 msgr2=0x7fce4c115070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.055+0000 7fce52e1e640 1 --2- 172.21.15.100:0/2587837293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c108b50 0x7fce4c115070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fce4401acb0 tx=0x7fce4403b920 comp rx=0 tx=0).stop 2024-09-12T02:49:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.055+0000 7fce52e1e640 1 -- 172.21.15.100:0/2587837293 shutdown_connections 2024-09-12T02:49:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.055+0000 7fce52e1e640 1 --2- 172.21.15.100:0/2587837293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c108b50 0x7fce4c115070 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.055+0000 7fce52e1e640 1 --2- 172.21.15.100:0/2587837293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce4c1081f0 0x7fce4c108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.055+0000 7fce52e1e640 1 --2- 172.21.15.100:0/2587837293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 0x7fce4c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.055+0000 7fce52e1e640 1 -- 172.21.15.100:0/2587837293 >> 172.21.15.100:0/2587837293 conn(0x7fce4c077bb0 msgr2=0x7fce4c079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:59.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.059+0000 7fce52e1e640 1 -- 172.21.15.100:0/2587837293 shutdown_connections 2024-09-12T02:49:59.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.059+0000 7fce52e1e640 1 -- 172.21.15.100:0/2587837293 wait complete. 2024-09-12T02:49:59.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.060+0000 7fce52e1e640 1 Processor -- start 2024-09-12T02:49:59.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.060+0000 7fce52e1e640 1 -- start start 2024-09-12T02:49:59.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce52e1e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce4c1081f0 0x7fce4c114b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce52e1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 0x7fce4c110bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce52e1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c111130 0x7fce4c1115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce52e1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c06e680 con 0x7fce4c10e230 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce52e1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c06e500 con 0x7fce4c111130 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce52e1e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c06e800 con 0x7fce4c1081f0 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 0x7fce4c110bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 0x7fce4c110bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57374/0 (socket says 172.21.15.100:57374) 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce43fff640 1 -- 172.21.15.100:0/497159167 learned_addr learned my addr 172.21.15.100:0/497159167 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce50bba640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce4c1081f0 0x7fce4c114b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce513bb640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c111130 0x7fce4c1115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.061+0000 7fce43fff640 1 -- 172.21.15.100:0/497159167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce4c1081f0 msgr2=0x7fce4c114b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce43fff640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce4c1081f0 0x7fce4c114b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce43fff640 1 -- 172.21.15.100:0/497159167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c111130 msgr2=0x7fce4c1115e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce43fff640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c111130 0x7fce4c1115e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce43fff640 1 -- 172.21.15.100:0/497159167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c082a50 con 0x7fce4c10e230 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce43fff640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 0x7fce4c110bf0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00b450 tx=0x7fce3c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce41ffb640 1 -- 172.21.15.100:0/497159167 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c015020 con 0x7fce4c10e230 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c082d40 con 0x7fce4c10e230 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce41ffb640 1 -- 172.21.15.100:0/497159167 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce3c011d70 con 0x7fce4c10e230 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.062+0000 7fce41ffb640 1 -- 172.21.15.100:0/497159167 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00f340 con 0x7fce4c10e230 2024-09-12T02:49:59.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.063+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c1abaf0 con 0x7fce4c10e230 2024-09-12T02:49:59.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.066+0000 7fce551f7740 1 Processor -- start 2024-09-12T02:49:59.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.066+0000 7fce551f7740 1 -- start start 2024-09-12T02:49:59.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce551f7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce551f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce551f7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce551f7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fdb892c2e0 con 0x55fdb89c6dc0 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce551f7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fdb88d3ce0 con 0x55fdb89d1680 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce551f7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fdb89282a0 con 0x55fdb89c64a0 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57388/0 (socket says 172.21.15.100:57388) 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 -- 172.21.15.100:0/839843934 learned_addr learned my addr 172.21.15.100:0/839843934 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce513bb640 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 -- 172.21.15.100:0/839843934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 msgr2=0x55fdb89c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:59.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 -- 172.21.15.100:0/839843934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 msgr2=0x55fdb89d3a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89d3a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce50bba640 1 -- 172.21.15.100:0/839843934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb88b8440 con 0x55fdb89c6dc0 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.067+0000 7fce41ffb640 1 -- 172.21.15.100:0/497159167 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fce3c018020 con 0x7fce4c10e230 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.068+0000 7fce41ffb640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce340a2cc0 0x7fce340a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.068+0000 7fce50bba640 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d1140 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fce4800b820 tx=0x7fce4800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e202cb38c2d1687 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.068+0000 7fce41ffb640 1 -- 172.21.15.100:0/497159167 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fce3c0ceb90 con 0x7fce4c10e230 2024-09-12T02:49:59.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.069+0000 7fce513bb640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce340a2cc0 0x7fce340a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.069+0000 7fce32ffd640 1 -- 172.21.15.100:0/839843934 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4800d950 con 0x55fdb89c6dc0 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.069+0000 7fce32ffd640 1 -- 172.21.15.100:0/839843934 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce48019070 con 0x55fdb89c6dc0 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.069+0000 7fce32ffd640 1 -- 172.21.15.100:0/839843934 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce480123e0 con 0x55fdb89c6dc0 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce551f7740 1 -- 172.21.15.100:0/839843934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 msgr2=0x55fdb89d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce513bb640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce340a2cc0 0x7fce340a5180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fce44006010 tx=0x7fce44043040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce551f7740 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d1140 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fce4800b820 tx=0x7fce4800bce0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce551f7740 1 -- 172.21.15.100:0/839843934 shutdown_connections 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce551f7740 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89d3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce551f7740 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d1140 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce551f7740 1 --2- 172.21.15.100:0/839843934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.070+0000 7fce551f7740 1 -- 172.21.15.100:0/839843934 >> 172.21.15.100:0/839843934 conn(0x55fdb89c2a30 msgr2=0x55fdb89c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:59.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.071+0000 7fce551f7740 1 -- 172.21.15.100:0/839843934 shutdown_connections 2024-09-12T02:49:59.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.071+0000 7fce551f7740 1 -- 172.21.15.100:0/839843934 wait complete. 2024-09-12T02:49:59.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.072+0000 7fce551f7740 1 -- start start 2024-09-12T02:49:59.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.072+0000 7fce551f7740 1 Processor -- start 2024-09-12T02:49:59.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce551f7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce551f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce551f7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce551f7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fdb89d4250 con 0x55fdb89c6dc0 2024-09-12T02:49:59.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57398/0 (socket says 172.21.15.100:57398) 2024-09-12T02:49:59.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 -- 172.21.15.100:0/1787573078 learned_addr learned my addr 172.21.15.100:0/1787573078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:59.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce513bb640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fdb88e7050 con 0x55fdb89d1680 2024-09-12T02:49:59.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fdb89d43d0 con 0x55fdb89c64a0 2024-09-12T02:49:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce50bba640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce551f7740 10 client.0 _ll_register_callbacks cb 0x55fdb8927160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 -- 172.21.15.100:0/1787573078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 msgr2=0x55fdb89d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 -- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 msgr2=0x55fdb89ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce43fff640 1 -- 172.21.15.100:0/1787573078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb869d3c0 con 0x55fdb89c6dc0 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce50bba640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.073+0000 7fce513bb640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce43fff640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89ce2c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fce3c09b080 tx=0x7fce3c09af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75f405cff7b9f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce2bfff640 1 -- 172.21.15.100:0/1787573078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0b4060 con 0x55fdb89c6dc0 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce2bfff640 1 -- 172.21.15.100:0/1787573078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fce3c0b4200 con 0x55fdb89c6dc0 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce48019070 con 0x55fdb89c6dc0 2024-09-12T02:49:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce2bfff640 1 -- 172.21.15.100:0/1787573078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce3c09f730 con 0x55fdb89c6dc0 2024-09-12T02:49:59.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce551f7740 10 client.17388 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:59.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fdb89dfc50 con 0x55fdb89c6dc0 2024-09-12T02:49:59.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.074+0000 7fce2bfff640 1 -- 172.21.15.100:0/1787573078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce48019070 con 0x55fdb89c6dc0 2024-09-12T02:49:59.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce2bfff640 1 -- 172.21.15.100:0/1787573078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fce3c017b20 con 0x55fdb89c6dc0 2024-09-12T02:49:59.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce551f7740 10 client.17388 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:59.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce551f7740 10 client.17388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:59.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce551f7740 20 client.17388 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:59.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce551f7740 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb89e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce551f7740 4 client.17388 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:59.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb8939850 con 0x55fdb89e1000 2024-09-12T02:49:59.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce50bba640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb89e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.075+0000 7fce2bfff640 10 client.17388 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.078+0000 7fce50bba640 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb89e33f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce44565297f5f21 server_cookie=9adc783f1545ab40 in_seq=0 out_seq=0 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.078+0000 7fce2bfff640 1 -- 172.21.15.100:0/1787573078 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdb8939850 con 0x55fdb89e1000 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.078+0000 7fce2bfff640 10 client.17388 handle_command_reply: tid=0 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.078+0000 7fce551f7740 1 client.17388 shutdown 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 msgr2=0x55fdb89ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89ce2c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fce3c09b080 tx=0x7fce3c09af80 comp rx=0 tx=0).stop 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 shutdown_connections 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb89e33f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce2bfff640 0 client.17388 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:59.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89ce2c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 --2- 172.21.15.100:0/1787573078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.079+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 >> 172.21.15.100:0/1787573078 conn(0x55fdb89c2a30 msgr2=0x55fdb89c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:59.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.080+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 shutdown_connections 2024-09-12T02:49:59.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.080+0000 7fce551f7740 1 -- 172.21.15.100:0/1787573078 wait complete. 2024-09-12T02:49:59.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.080+0000 7fce551f7740 20 client.17388 trim_cache size 0 max 16384 2024-09-12T02:49:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.101+0000 7fce551f7740 1 Processor -- start 2024-09-12T02:49:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.101+0000 7fce551f7740 1 -- start start 2024-09-12T02:49:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.101+0000 7fce551f7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce551f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce50bba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce50bba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89dd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35014/0 (socket says 172.21.15.100:35014) 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce50bba640 1 -- 172.21.15.100:0/2133104193 learned_addr learned my addr 172.21.15.100:0/2133104193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce551f7740 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89e9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b6720 con 0x55fdb89c6dc0 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b3ff0 con 0x55fdb89d1680 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b1e40 con 0x55fdb89c64a0 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce513bb640 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.102+0000 7fce43fff640 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce50bba640 1 -- 172.21.15.100:0/2133104193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 msgr2=0x55fdb89e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce50bba640 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce50bba640 1 -- 172.21.15.100:0/2133104193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 msgr2=0x55fdb89e8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce50bba640 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89e8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce50bba640 1 -- 172.21.15.100:0/2133104193 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb89e3760 con 0x55fdb89c64a0 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce50bba640 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89dd4e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fce4800b5b0 tx=0x7fce48008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4268ef36e4bf126 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce327fc640 1 -- 172.21.15.100:0/2133104193 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48014850 con 0x55fdb89c64a0 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce327fc640 1 -- 172.21.15.100:0/2133104193 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce48019050 con 0x55fdb89c64a0 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.103+0000 7fce327fc640 1 -- 172.21.15.100:0/2133104193 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48004590 con 0x55fdb89c64a0 2024-09-12T02:49:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 msgr2=0x55fdb89dd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89dd4e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fce4800b5b0 tx=0x7fce48008040 comp rx=0 tx=0).stop 2024-09-12T02:49:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 shutdown_connections 2024-09-12T02:49:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89d1680 0x55fdb89e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89e8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 --2- 172.21.15.100:0/2133104193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89c64a0 0x55fdb89dd4e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 >> 172.21.15.100:0/2133104193 conn(0x55fdb89c2a30 msgr2=0x55fdb89c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 shutdown_connections 2024-09-12T02:49:59.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.104+0000 7fce551f7740 1 -- 172.21.15.100:0/2133104193 wait complete. 2024-09-12T02:49:59.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.105+0000 7fce551f7740 1 -- start start 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.105+0000 7fce551f7740 1 Processor -- start 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.105+0000 7fce551f7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89c64a0 0x55fdb89d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.105+0000 7fce551f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce551f7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89d1680 0x55fdb8a43c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce551f7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b24b0 con 0x55fdb89c6dc0 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce551f7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b3920 con 0x55fdb89c64a0 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce551f7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b2b80 con 0x55fdb89d1680 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce551f7740 10 client.0 _ll_register_callbacks cb 0x7fce3c010890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89c64a0 0x55fdb89d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89c64a0 0x55fdb89d4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36332/0 (socket says 172.21.15.100:36332) 2024-09-12T02:49:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 -- 172.21.15.100:0/1480157967 learned_addr learned my addr 172.21.15.100:0/1480157967 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce43fff640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57416/0 (socket says 172.21.15.100:57416) 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce513bb640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89d1680 0x55fdb8a43c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 -- 172.21.15.100:0/1480157967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89d1680 msgr2=0x55fdb8a43c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89d1680 0x55fdb8a43c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 -- 172.21.15.100:0/1480157967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 msgr2=0x55fdb89d52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 -- 172.21.15.100:0/1480157967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb89c6bf0 con 0x55fdb89c64a0 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce513bb640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89d1680 0x55fdb8a43c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce50bba640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89c64a0 0x55fdb89d4d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce48008010 tx=0x7fce48000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8eb3a6e32e7e841 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.106+0000 7fce2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce2bfff640 1 -- 172.21.15.100:0/1480157967 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48004040 con 0x55fdb89c64a0 2024-09-12T02:49:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce2bfff640 1 -- 172.21.15.100:0/1480157967 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fce48024040 con 0x55fdb89c64a0 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce48019050 con 0x55fdb89c64a0 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce2bfff640 1 -- 172.21.15.100:0/1480157967 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce48014850 con 0x55fdb89c64a0 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 10 client.26702 fetch_fsmap learned FSMap version 27 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fdb8a4b470 con 0x55fdb89c64a0 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce2bfff640 1 -- 172.21.15.100:0/1480157967 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce48019050 con 0x55fdb89c64a0 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce2bfff640 1 -- 172.21.15.100:0/1480157967 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fce4803a020 con 0x55fdb89c64a0 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 10 client.26702 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 10 client.26702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 20 client.26702 populate_metadata read hostname 'smithi100' 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb8a4d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 4 client.26702 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fdb8933d60 con 0x55fdb89e1000 2024-09-12T02:49:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.107+0000 7fce43fff640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb8a4d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.108+0000 7fce2bfff640 10 client.26702 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.108+0000 7fce43fff640 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb8a4d940 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b613053d5d30c43b server_cookie=3297874faa0b82ac in_seq=0 out_seq=0 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.108+0000 7fce2bfff640 1 -- 172.21.15.100:0/1480157967 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fdb8933d60 con 0x55fdb89e1000 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.108+0000 7fce2bfff640 10 client.26702 handle_command_reply: tid=0 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.108+0000 7fce551f7740 1 client.26702 shutdown 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.108+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89c64a0 msgr2=0x55fdb89d4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.108+0000 7fce551f7740 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89c64a0 0x55fdb89d4d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce48008010 tx=0x7fce48000bc0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 shutdown_connections 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55fdb89e1000 0x55fdb8a4d940 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce2bfff640 0 client.26702 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb89d1680 0x55fdb8a43c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdb89c6dc0 0x55fdb89d52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 --2- 172.21.15.100:0/1480157967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdb89c64a0 0x55fdb89d4d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 >> 172.21.15.100:0/1480157967 conn(0x55fdb89c2a30 msgr2=0x55fdb89cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 shutdown_connections 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 1 -- 172.21.15.100:0/1480157967 wait complete. 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce551f7740 20 client.26702 trim_cache size 0 max 16384 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stdout: "6c18f848-4c0a-479b-8d6b-1a5c91b82138": { 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "6c18f848-4c0a-479b-8d6b-1a5c91b82138", 2024-09-12T02:49:59.118 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:49:59.119 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:59.119 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:49:59.119 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:49:59.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce340a2cc0 msgr2=0x7fce340a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.109+0000 7fce52e1e640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce340a2cc0 0x7fce340a5180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fce44006010 tx=0x7fce44043040 comp rx=0 tx=0).stop 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 msgr2=0x7fce4c110bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 0x7fce4c110bf0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00b450 tx=0x7fce3c00b910 comp rx=0 tx=0).stop 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 shutdown_connections 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fce340a2cc0 0x7fce340a5180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce4c111130 0x7fce4c1115e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c10e230 0x7fce4c110bf0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 --2- 172.21.15.100:0/497159167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce4c1081f0 0x7fce4c114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 >> 172.21.15.100:0/497159167 conn(0x7fce4c077bb0 msgr2=0x7fce4c078e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 shutdown_connections 2024-09-12T02:49:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:49:59.110+0000 7fce52e1e640 1 -- 172.21.15.100:0/497159167 wait complete. 2024-09-12T02:49:59.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:58 smithi189 ceph-mon[35196]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 643 op/s 2024-09-12T02:49:59.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:58 smithi117 ceph-mon[34898]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 643 op/s 2024-09-12T02:50:00.007 INFO:tasks.cephfs.filesystem:scrub status for tag:6c18f848-4c0a-479b-8d6b-1a5c91b82138 - {'path': '/', 'tag': '6c18f848-4c0a-479b-8d6b-1a5c91b82138', 'options': 'recursive,force'} 2024-09-12T02:50:00.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:49:59 smithi100 ceph-mon[31390]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.0 MiB/s wr, 716 op/s 2024-09-12T02:50:00.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:49:59 smithi189 ceph-mon[35196]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.0 MiB/s wr, 716 op/s 2024-09-12T02:50:00.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:49:59 smithi117 ceph-mon[34898]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.0 MiB/s wr, 716 op/s 2024-09-12T02:50:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:00 smithi100 ceph-mon[31390]: overall HEALTH_OK 2024-09-12T02:50:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:00 smithi189 ceph-mon[35196]: overall HEALTH_OK 2024-09-12T02:50:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 650.0 s, 1597.0 tps, lat 62.633 ms stddev 68.763 2024-09-12T02:50:01.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:00 smithi117 ceph-mon[34898]: overall HEALTH_OK 2024-09-12T02:50:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:01 smithi189 ceph-mon[35196]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 644 op/s 2024-09-12T02:50:02.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:01 smithi117 ceph-mon[34898]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 644 op/s 2024-09-12T02:50:02.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:01 smithi100 ceph-mon[31390]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 644 op/s 2024-09-12T02:50:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:04 smithi117 ceph-mon[34898]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.8 MiB/s wr, 693 op/s 2024-09-12T02:50:05.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:04 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:50:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:04 smithi100 ceph-mon[31390]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.8 MiB/s wr, 693 op/s 2024-09-12T02:50:05.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:04 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:50:05.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:04 smithi189 ceph-mon[35196]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.8 MiB/s wr, 693 op/s 2024-09-12T02:50:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:04 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:50:06.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:05 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:50:06.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:05 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:50:06.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:05 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:50:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 655.0 s, 2070.6 tps, lat 48.440 ms stddev 50.233 2024-09-12T02:50:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:06 smithi117 ceph-mon[34898]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-09-12T02:50:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:06 smithi100 ceph-mon[31390]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-09-12T02:50:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:06 smithi189 ceph-mon[35196]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-09-12T02:50:09.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:08 smithi189 ceph-mon[35196]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 575 op/s 2024-09-12T02:50:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:08 smithi117 ceph-mon[34898]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 575 op/s 2024-09-12T02:50:09.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:08 smithi100 ceph-mon[31390]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 575 op/s 2024-09-12T02:50:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:50:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:10.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:09 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:10.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:50:10.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:10.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:09 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:10.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:50:10.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:10.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:09 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:10 smithi117 ceph-mon[34898]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.9 MiB/s wr, 701 op/s 2024-09-12T02:50:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:50:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:50:11.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:10 smithi100 ceph-mon[31390]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.9 MiB/s wr, 701 op/s 2024-09-12T02:50:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:50:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:50:11.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:11.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:10 smithi189 ceph-mon[35196]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.9 MiB/s wr, 701 op/s 2024-09-12T02:50:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:50:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:50:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:50:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 660.0 s, 2527.8 tps, lat 39.238 ms stddev 42.998 2024-09-12T02:50:13.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:12 smithi117 ceph-mon[34898]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 660 op/s 2024-09-12T02:50:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:12 smithi100 ceph-mon[31390]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 660 op/s 2024-09-12T02:50:13.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:12 smithi189 ceph-mon[35196]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 660 op/s 2024-09-12T02:50:15.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:14 smithi117 ceph-mon[34898]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 686 op/s 2024-09-12T02:50:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:14 smithi100 ceph-mon[31390]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 686 op/s 2024-09-12T02:50:15.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:14 smithi189 ceph-mon[35196]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 686 op/s 2024-09-12T02:50:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 665.0 s, 2634.4 tps, lat 38.412 ms stddev 44.775 2024-09-12T02:50:17.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:16 smithi117 ceph-mon[34898]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 639 op/s 2024-09-12T02:50:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:16 smithi100 ceph-mon[31390]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 639 op/s 2024-09-12T02:50:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:16 smithi189 ceph-mon[35196]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 639 op/s 2024-09-12T02:50:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:18 smithi100 ceph-mon[31390]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 645 op/s 2024-09-12T02:50:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:18 smithi189 ceph-mon[35196]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 645 op/s 2024-09-12T02:50:19.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:18 smithi117 ceph-mon[34898]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 645 op/s 2024-09-12T02:50:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:20 smithi100 ceph-mon[31390]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 766 op/s 2024-09-12T02:50:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:20 smithi189 ceph-mon[35196]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 766 op/s 2024-09-12T02:50:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 670.0 s, 2542.4 tps, lat 38.964 ms stddev 42.444 2024-09-12T02:50:21.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:20 smithi117 ceph-mon[34898]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 766 op/s 2024-09-12T02:50:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:22 smithi100 ceph-mon[31390]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 704 op/s 2024-09-12T02:50:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:22 smithi189 ceph-mon[35196]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 704 op/s 2024-09-12T02:50:23.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:22 smithi117 ceph-mon[34898]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 704 op/s 2024-09-12T02:50:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:24 smithi100 ceph-mon[31390]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.9 MiB/s wr, 728 op/s 2024-09-12T02:50:25.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:24 smithi189 ceph-mon[35196]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.9 MiB/s wr, 728 op/s 2024-09-12T02:50:25.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:24 smithi117 ceph-mon[34898]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.9 MiB/s wr, 728 op/s 2024-09-12T02:50:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 675.0 s, 2064.4 tps, lat 48.419 ms stddev 53.331 2024-09-12T02:50:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:26 smithi100 ceph-mon[31390]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.0 MiB/s wr, 719 op/s 2024-09-12T02:50:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:26 smithi189 ceph-mon[35196]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.0 MiB/s wr, 719 op/s 2024-09-12T02:50:27.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:26 smithi117 ceph-mon[34898]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.0 MiB/s wr, 719 op/s 2024-09-12T02:50:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:28 smithi100 ceph-mon[31390]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 650 op/s 2024-09-12T02:50:29.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:28 smithi189 ceph-mon[35196]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 650 op/s 2024-09-12T02:50:29.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:28 smithi117 ceph-mon[34898]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 650 op/s 2024-09-12T02:50:30.009 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:50:30.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:29 smithi189 ceph-mon[35196]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 713 op/s 2024-09-12T02:50:30.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:29 smithi117 ceph-mon[34898]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 713 op/s 2024-09-12T02:50:30.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:29 smithi100 ceph-mon[31390]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 713 op/s 2024-09-12T02:50:30.388 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 680.0 s, 2147.4 tps, lat 46.701 ms stddev 47.729 2024-09-12T02:50:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 -- 172.21.15.100:0/1674764006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70102790 msgr2=0x7f1b701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/1674764006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70102790 0x7f1b701067e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009900 tx=0x7f1b5802a410 comp rx=0 tx=0).stop 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 -- 172.21.15.100:0/1674764006 shutdown_connections 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/1674764006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b70106f10 0x7f1b7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/1674764006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70102790 0x7f1b701067e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/1674764006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b70101de0 0x7f1b701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 -- 172.21.15.100:0/1674764006 >> 172.21.15.100:0/1674764006 conn(0x7f1b700fd8c0 msgr2=0x7f1b700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 -- 172.21.15.100:0/1674764006 shutdown_connections 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.251+0000 7f1b74e7c640 1 -- 172.21.15.100:0/1674764006 wait complete. 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 Processor -- start 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 -- start start 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b70101de0 0x7f1b70198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b70102790 0x7f1b70198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70106f10 0x7f1b7019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b70111f30 con 0x7f1b70106f10 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1b70111db0 con 0x7f1b70102790 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b74e7c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701120b0 con 0x7f1b70101de0 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b6e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b70101de0 0x7f1b70198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b6ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70106f10 0x7f1b7019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b6e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b70101de0 0x7f1b70198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:57614/0 (socket says 172.21.15.100:57614) 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b6e59c640 1 -- 172.21.15.100:0/948455867 learned_addr learned my addr 172.21.15.100:0/948455867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.252+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b70102790 0x7f1b70198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b6ed9d640 1 -- 172.21.15.100:0/948455867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b70101de0 msgr2=0x7f1b70198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b6ed9d640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b70101de0 0x7f1b70198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b6ed9d640 1 -- 172.21.15.100:0/948455867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b70102790 msgr2=0x7f1b70198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b6ed9d640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b70102790 0x7f1b70198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b6ed9d640 1 -- 172.21.15.100:0/948455867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7019d4c0 con 0x7f1b70106f10 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b70102790 0x7f1b70198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b6ed9d640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70106f10 0x7f1b7019cde0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800da10 tx=0x7f1b6800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b677fe640 1 -- 172.21.15.100:0/948455867 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800bd70 con 0x7f1b70106f10 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b677fe640 1 -- 172.21.15.100:0/948455867 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b68003e50 con 0x7f1b70106f10 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b677fe640 1 -- 172.21.15.100:0/948455867 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680106a0 con 0x7f1b70106f10 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7019d7b0 con 0x7f1b70106f10 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.253+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b70074420 con 0x7f1b70106f10 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.255+0000 7f1b677fe640 1 -- 172.21.15.100:0/948455867 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1b68003970 con 0x7f1b70106f10 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 Processor -- start 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 -- start start 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d35880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d35dc0 0x556d29d40140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d40680 0x556d29d42a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556d29c9b2e0 con 0x556d29d40680 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556d29c42ce0 con 0x556d29d354a0 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b77255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556d29c972a0 con 0x556d29d35dc0 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b677fe640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1b5c0a7010 0x7f1b5c0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b6dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d40680 0x556d29d42a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b6dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d40680 0x556d29d42a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36676/0 (socket says 172.21.15.100:36676) 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/926657199 learned_addr learned my addr 172.21.15.100:0/926657199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d35dc0 0x556d29d40140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.256+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d35880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6ed9d640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1b5c0a7010 0x7f1b5c0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/926657199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d35dc0 msgr2=0x556d29d40140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d35dc0 0x556d29d40140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/926657199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 msgr2=0x556d29d35880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b677fe640 1 -- 172.21.15.100:0/948455867 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1b680cf3a0 con 0x7f1b70106f10 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d35880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/926657199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d29c27440 con 0x556d29d40680 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d35dc0 0x556d29d40140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d40680 0x556d29d42a70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1b580096c0 tx=0x7f1b580314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ac8a9242c97032 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b64ff9640 1 -- 172.21.15.100:0/926657199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58035070 con 0x556d29d40680 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b64ff9640 1 -- 172.21.15.100:0/926657199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b58005020 con 0x556d29d40680 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.257+0000 7f1b64ff9640 1 -- 172.21.15.100:0/926657199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58004a00 con 0x556d29d40680 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 -- 172.21.15.100:0/926657199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d40680 msgr2=0x556d29d42a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d40680 0x556d29d42a70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1b580096c0 tx=0x7f1b580314e0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b6ed9d640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1b5c0a7010 0x7f1b5c0a94d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1b68097ff0 tx=0x7f1b68066810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 -- 172.21.15.100:0/926657199 shutdown_connections 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d40680 0x556d29d42a70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d35dc0 0x556d29d40140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 --2- 172.21.15.100:0/926657199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d35880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 -- 172.21.15.100:0/926657199 >> 172.21.15.100:0/926657199 conn(0x556d29d31a30 msgr2=0x556d29d31e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 -- 172.21.15.100:0/926657199 shutdown_connections 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 -- 172.21.15.100:0/926657199 wait complete. 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 -- start start 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.258+0000 7f1b77255740 1 Processor -- start 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d3fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d3d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d40680 0x556d29d3d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556d29d432f0 con 0x556d29d35dc0 2024-09-12T02:50:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556d29c56050 con 0x556d29d40680 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556d29d43470 con 0x556d29d354a0 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 10 client.0 _ll_register_callbacks cb 0x556d29c96160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d3d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6dd9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d40680 0x556d29d3d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d3d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36686/0 (socket says 172.21.15.100:36686) 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 -- 172.21.15.100:0/1940318865 learned_addr learned my addr 172.21.15.100:0/1940318865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d3fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 -- 172.21.15.100:0/1940318865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 msgr2=0x556d29d3fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d3fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 -- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d40680 msgr2=0x556d29d3d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d40680 0x556d29d3d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 -- 172.21.15.100:0/1940318865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d29a0c3c0 con 0x556d29d35dc0 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d40680 0x556d29d3d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d3d1a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1b60012500 tx=0x7f1b600129c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3573f2cac8c2c9cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b55ffb640 1 -- 172.21.15.100:0/1940318865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6001f060 con 0x556d29d35dc0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.259+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b58005020 con 0x556d29d35dc0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b55ffb640 1 -- 172.21.15.100:0/1940318865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1b600035f0 con 0x556d29d35dc0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b55ffb640 1 -- 172.21.15.100:0/1940318865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1b60003810 con 0x556d29d35dc0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 10 client.17406 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d29d4ec90 con 0x556d29d35dc0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b55ffb640 1 -- 172.21.15.100:0/1940318865 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b58005020 con 0x556d29d35dc0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b55ffb640 1 -- 172.21.15.100:0/1940318865 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1b60019030 con 0x556d29d35dc0 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 10 client.17406 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 10 client.17406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 20 client.17406 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d500f0 0x556d29d52530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 4 client.17406 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d29ca8850 con 0x556d29d500f0 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.260+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d500f0 0x556d29d52530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.261+0000 7f1b55ffb640 10 client.17406 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.261+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d500f0 0x556d29d52530 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f3862b02108563 server_cookie=822187a9c61f4485 in_seq=0 out_seq=0 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.261+0000 7f1b55ffb640 1 -- 172.21.15.100:0/1940318865 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d29ca8850 con 0x556d29d500f0 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.261+0000 7f1b55ffb640 10 client.17406 handle_command_reply: tid=0 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.261+0000 7f1b77255740 1 client.17406 shutdown 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 msgr2=0x556d29d3d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d3d1a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1b60012500 tx=0x7f1b600129c0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 shutdown_connections 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d500f0 0x556d29d52530 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d40680 0x556d29d3d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d3d1a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 --2- 172.21.15.100:0/1940318865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d3fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 >> 172.21.15.100:0/1940318865 conn(0x556d29d31a30 msgr2=0x556d29d37710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b55ffb640 0 client.17406 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 shutdown_connections 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 1 -- 172.21.15.100:0/1940318865 wait complete. 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.262+0000 7f1b77255740 20 client.17406 trim_cache size 0 max 16384 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 Processor -- start 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 -- start start 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d31a30 0x556d29d388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d3f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d57e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701adc40 con 0x556d29d35dc0 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701ab510 con 0x556d29d354a0 2024-09-12T02:50:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.280+0000 7f1b77255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701a9360 con 0x556d29d31a30 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d57e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d57e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36698/0 (socket says 172.21.15.100:36698) 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/1847241663 learned_addr learned my addr 172.21.15.100:0/1847241663 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d31a30 0x556d29d388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d3f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/1847241663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d31a30 msgr2=0x556d29d388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d31a30 0x556d29d388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/1847241663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 msgr2=0x556d29d3f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d3f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/1847241663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d29d31860 con 0x556d29d35dc0 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d3f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d57e00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1b58033000 tx=0x7f1b5802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44138cfdaf056bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b57fff640 1 -- 172.21.15.100:0/1847241663 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58035030 con 0x556d29d35dc0 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b57fff640 1 -- 172.21.15.100:0/1847241663 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b58031b70 con 0x556d29d35dc0 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.281+0000 7f1b57fff640 1 -- 172.21.15.100:0/1847241663 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b580322b0 con 0x556d29d35dc0 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 -- 172.21.15.100:0/1847241663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 msgr2=0x556d29d57e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d57e00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1b58033000 tx=0x7f1b5802a410 comp rx=0 tx=0).stop 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 -- 172.21.15.100:0/1847241663 shutdown_connections 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d57e00 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d354a0 0x556d29d3f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 --2- 172.21.15.100:0/1847241663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d31a30 0x556d29d388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 -- 172.21.15.100:0/1847241663 >> 172.21.15.100:0/1847241663 conn(0x556d29d3d840 msgr2=0x556d29d3ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 -- 172.21.15.100:0/1847241663 shutdown_connections 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.282+0000 7f1b77255740 1 -- 172.21.15.100:0/1847241663 wait complete. 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.283+0000 7f1b77255740 1 -- start start 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.283+0000 7f1b77255740 1 Processor -- start 2024-09-12T02:50:32.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.283+0000 7f1b77255740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d31a30 0x556d29d44420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.283+0000 7f1b77255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d44960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.283+0000 7f1b77255740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d44ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b77255740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701a99d0 con 0x556d29d35dc0 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b77255740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701aae40 con 0x556d29d31a30 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b77255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701aa0a0 con 0x556d29d354a0 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b77255740 10 client.0 _ll_register_callbacks cb 0x7f1b6000bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d44ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d44ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36708/0 (socket says 172.21.15.100:36708) 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/783250603 learned_addr learned my addr 172.21.15.100:0/783250603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d44960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d31a30 0x556d29d44420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/783250603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 msgr2=0x556d29d44960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d44960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d31a30 msgr2=0x556d29d44420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d31a30 0x556d29d44420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 -- 172.21.15.100:0/783250603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d29db9dd0 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b6dd9b640 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d44ea0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1b58005630 tx=0x7f1b58004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4f7984f82c0777 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b55ffb640 1 -- 172.21.15.100:0/783250603 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58035070 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b55ffb640 1 -- 172.21.15.100:0/783250603 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1b58004990 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b58031b70 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b55ffb640 1 -- 172.21.15.100:0/783250603 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1b58004b90 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.284+0000 7f1b77255740 10 client.17412 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d29dbb030 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b55ffb640 1 -- 172.21.15.100:0/783250603 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b58031b70 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b55ffb640 1 -- 172.21.15.100:0/783250603 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1b5803d450 con 0x556d29d35dc0 2024-09-12T02:50:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b77255740 10 client.17412 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b77255740 10 client.17412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b77255740 20 client.17412 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b77255740 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d40680 0x556d29dbd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b77255740 4 client.17412 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d29ca2d60 con 0x556d29d40680 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d40680 0x556d29dbd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b55ffb640 10 client.17412 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.285+0000 7f1b6e59c640 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d40680 0x556d29dbd210 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd3a146b6b50641 server_cookie=94931f0c3b6cc30f in_seq=0 out_seq=0 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b55ffb640 1 -- 172.21.15.100:0/783250603 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556d29ca2d60 con 0x556d29d40680 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b55ffb640 10 client.17412 handle_command_reply: tid=0 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 client.17412 shutdown 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 msgr2=0x556d29d44ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d44ea0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1b58005630 tx=0x7f1b58004f30 comp rx=0 tx=0).stop 2024-09-12T02:50:32.540 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:50:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:50:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:50:32.540 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:50:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 shutdown_connections 2024-09-12T02:50:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556d29d40680 0x556d29dbd210 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d29d35dc0 0x556d29d44ea0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d29d354a0 0x556d29d44960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b55ffb640 0 client.17412 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 --2- 172.21.15.100:0/783250603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556d29d31a30 0x556d29d44420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 >> 172.21.15.100:0/783250603 conn(0x556d29d3d840 msgr2=0x556d29d3b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 shutdown_connections 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 1 -- 172.21.15.100:0/783250603 wait complete. 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.286+0000 7f1b77255740 20 client.17412 trim_cache size 0 max 16384 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1b5c0a7010 msgr2=0x7f1b5c0a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1b5c0a7010 0x7f1b5c0a94d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1b68097ff0 tx=0x7f1b68066810 comp rx=0 tx=0).stop 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70106f10 msgr2=0x7f1b7019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70106f10 0x7f1b7019cde0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800da10 tx=0x7f1b6800ded0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 shutdown_connections 2024-09-12T02:50:32.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1b5c0a7010 0x7f1b5c0a94d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b70106f10 0x7f1b7019cde0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b70102790 0x7f1b70198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 --2- 172.21.15.100:0/948455867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b70101de0 0x7f1b70198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 >> 172.21.15.100:0/948455867 conn(0x7f1b700fd8c0 msgr2=0x7f1b700fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 shutdown_connections 2024-09-12T02:50:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:31.287+0000 7f1b74e7c640 1 -- 172.21.15.100:0/948455867 wait complete. 2024-09-12T02:50:33.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:32 smithi117 ceph-mon[34898]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-09-12T02:50:33.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:32 smithi100 ceph-mon[31390]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-09-12T02:50:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:32 smithi189 ceph-mon[35196]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-09-12T02:50:33.388 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:50:33.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:50:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 -- 172.21.15.100:0/109623007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69f01082a0 msgr2=0x7f69f010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 --2- 172.21.15.100:0/109623007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69f01082a0 0x7f69f010ec40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009930 tx=0x7f69e802a420 comp rx=0 tx=0).stop 2024-09-12T02:50:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 -- 172.21.15.100:0/109623007 shutdown_connections 2024-09-12T02:50:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 --2- 172.21.15.100:0/109623007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69f01082a0 0x7f69f010ec40 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 --2- 172.21.15.100:0/109623007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f01036e0 0x7f69f0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 --2- 172.21.15.100:0/109623007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f0102d30 0x7f69f0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 -- 172.21.15.100:0/109623007 >> 172.21.15.100:0/109623007 conn(0x7f69f00fc7d0 msgr2=0x7f69f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 -- 172.21.15.100:0/109623007 shutdown_connections 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.250+0000 7f69f71dd640 1 -- 172.21.15.100:0/109623007 wait complete. 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.251+0000 7f69f71dd640 1 Processor -- start 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.251+0000 7f69f71dd640 1 -- start start 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f71dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f0102d30 0x7f69f0198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f71dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f01036e0 0x7f69f0198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f71dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69f01082a0 0x7f69f019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f71dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01120f0 con 0x7f69f01082a0 2024-09-12T02:50:34.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f71dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0111f70 con 0x7f69f01036e0 2024-09-12T02:50:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f71dd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0112270 con 0x7f69f0102d30 2024-09-12T02:50:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f0102d30 0x7f69f0198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f0102d30 0x7f69f0198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:36998/0 (socket says 172.21.15.100:36998) 2024-09-12T02:50:34.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 -- 172.21.15.100:0/4178463887 learned_addr learned my addr 172.21.15.100:0/4178463887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 -- 172.21.15.100:0/4178463887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f01036e0 msgr2=0x7f69f0198b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f01036e0 0x7f69f0198b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 -- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69f01082a0 msgr2=0x7f69f019cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69f01082a0 0x7f69f019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.252+0000 7f69f4f79640 1 -- 172.21.15.100:0/4178463887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f019d5e0 con 0x7f69f0102d30 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.253+0000 7f69f4f79640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f0102d30 0x7f69f0198630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69e000ebc0 tx=0x7f69e000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.253+0000 7f69edffb640 1 -- 172.21.15.100:0/4178463887 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0021640 con 0x7f69f0102d30 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.253+0000 7f69edffb640 1 -- 172.21.15.100:0/4178463887 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e0021cc0 con 0x7f69f0102d30 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.253+0000 7f69edffb640 1 -- 172.21.15.100:0/4178463887 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0029c10 con 0x7f69f0102d30 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.253+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f019d8d0 con 0x7f69f0102d30 2024-09-12T02:50:34.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.254+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f019dd00 con 0x7f69f0102d30 2024-09-12T02:50:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.255+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f0103110 con 0x7f69f0102d30 2024-09-12T02:50:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.256+0000 7f69edffb640 1 -- 172.21.15.100:0/4178463887 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f69e00217e0 con 0x7f69f0102d30 2024-09-12T02:50:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.256+0000 7f69edffb640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69dc0a2cd0 0x7f69dc0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.257+0000 7f69effff640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69dc0a2cd0 0x7f69dc0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.257+0000 7f69edffb640 1 -- 172.21.15.100:0/4178463887 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f69e00e0980 con 0x7f69f0102d30 2024-09-12T02:50:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.257+0000 7f69effff640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69dc0a2cd0 0x7f69dc0a5190 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f69f0107440 tx=0x7f69d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:34.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.261+0000 7f69edffb640 1 -- 172.21.15.100:0/4178463887 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69e00651b0 con 0x7f69f0102d30 2024-09-12T02:50:34.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.542+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69f010a2b0 con 0x7f69f0102d30 2024-09-12T02:50:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.544+0000 7f69edffb640 1 -- 172.21.15.100:0/4178463887 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f69e00ad870 con 0x7f69f0102d30 2024-09-12T02:50:34.546 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:50:34.546 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:50:34.546 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69dc0a2cd0 msgr2=0x7f69dc0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69dc0a2cd0 0x7f69dc0a5190 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f69f0107440 tx=0x7f69d8005f90 comp rx=0 tx=0).stop 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f0102d30 msgr2=0x7f69f0198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f0102d30 0x7f69f0198630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69e000ebc0 tx=0x7f69e000c6a0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 shutdown_connections 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f69dc0a2cd0 0x7f69dc0a5190 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69f01082a0 0x7f69f019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69f01036e0 0x7f69f0198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 --2- 172.21.15.100:0/4178463887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69f0102d30 0x7f69f0198630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 >> 172.21.15.100:0/4178463887 conn(0x7f69f00fc7d0 msgr2=0x7f69f00fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 shutdown_connections 2024-09-12T02:50:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:34.547+0000 7f69f71dd640 1 -- 172.21.15.100:0/4178463887 wait complete. 2024-09-12T02:50:35.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:34 smithi117 ceph-mon[34898]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.7 MiB/s wr, 733 op/s 2024-09-12T02:50:35.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:34 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4178463887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:50:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:34 smithi100 ceph-mon[31390]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.7 MiB/s wr, 733 op/s 2024-09-12T02:50:35.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:34 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4178463887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:50:35.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:50:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:34 smithi189 ceph-mon[35196]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.7 MiB/s wr, 733 op/s 2024-09-12T02:50:35.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:34 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4178463887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:50:35.560 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 -- 172.21.15.100:0/2236881113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 msgr2=0x7fbbc0100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/2236881113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 0x7fbbc0100970 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009ca0 tx=0x7fbbb802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 -- 172.21.15.100:0/2236881113 shutdown_connections 2024-09-12T02:50:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/2236881113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc0104e30 0x7fbbc01052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/2236881113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 0x7fbbc0100970 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/2236881113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbc00696e0 0x7fbbc0100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 -- 172.21.15.100:0/2236881113 >> 172.21.15.100:0/2236881113 conn(0x7fbbc0077230 msgr2=0x7fbbc00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 -- 172.21.15.100:0/2236881113 shutdown_connections 2024-09-12T02:50:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.187+0000 7fbbc4e31640 1 -- 172.21.15.100:0/2236881113 wait complete. 2024-09-12T02:50:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.188+0000 7fbbc4e31640 1 Processor -- start 2024-09-12T02:50:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.188+0000 7fbbc4e31640 1 -- start start 2024-09-12T02:50:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbc4e31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc00696e0 0x7fbbc0196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbc4e31640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 0x7fbbc0196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbc4e31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbc0104e30 0x7fbbc019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbc4e31640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc010fd60 con 0x7fbbc0104e30 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbc4e31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc010fbe0 con 0x7fbbc00696e0 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbc4e31640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc010fee0 con 0x7fbbc0069b50 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc00696e0 0x7fbbc0196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc00696e0 0x7fbbc0196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56176/0 (socket says 172.21.15.100:56176) 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1645551642 learned_addr learned my addr 172.21.15.100:0/1645551642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 0x7fbbc0196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbc0104e30 0x7fbbc019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1645551642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 msgr2=0x7fbbc0196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 0x7fbbc0196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbc0104e30 msgr2=0x7fbbc019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbc0104e30 0x7fbbc019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1645551642 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc019b1f0 con 0x7fbbc00696e0 2024-09-12T02:50:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbc0104e30 0x7fbbc019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc00696e0 0x7fbbc0196240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400e9f0 tx=0x7fbbb400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.189+0000 7fbbaf7fe640 1 -- 172.21.15.100:0/1645551642 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb400cd80 con 0x7fbbc00696e0 2024-09-12T02:50:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.190+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc019b4e0 con 0x7fbbc00696e0 2024-09-12T02:50:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.190+0000 7fbbaf7fe640 1 -- 172.21.15.100:0/1645551642 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb4010910 con 0x7fbbc00696e0 2024-09-12T02:50:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.190+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc01a2dc0 con 0x7fbbc00696e0 2024-09-12T02:50:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.190+0000 7fbbaf7fe640 1 -- 172.21.15.100:0/1645551642 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40188f0 con 0x7fbbc00696e0 2024-09-12T02:50:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbaf7fe640 1 -- 172.21.15.100:0/1645551642 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fbbb4018bb0 con 0x7fbbc00696e0 2024-09-12T02:50:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 Processor -- start 2024-09-12T02:50:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 -- start start 2024-09-12T02:50:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212a9c5d0 0x55e212a9ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212aa7370 0x55e212aa9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e212a022f0 con 0x55e212a9db40 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e2129a9cf0 con 0x55e212a9c5d0 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.192+0000 7fbbc720a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e2129fe2b0 con 0x55e212aa7370 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.193+0000 7fbbbed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.193+0000 7fbbbed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41994/0 (socket says 172.21.15.100:41994) 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.193+0000 7fbbbed9d640 1 -- 172.21.15.100:0/1657003261 learned_addr learned my addr 172.21.15.100:0/1657003261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.193+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212a9c5d0 0x55e212a9ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.193+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212aa7370 0x55e212aa9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.193+0000 7fbbaf7fe640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbba80a4c60 0x7fbba80a7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.194+0000 7fbbaf7fe640 1 -- 172.21.15.100:0/1645551642 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbbb40cf430 con 0x7fbbc00696e0 2024-09-12T02:50:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.195+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1657003261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212aa7370 msgr2=0x55e212aa9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.195+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212aa7370 0x55e212aa9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.195+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1657003261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 msgr2=0x55e212a9c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.195+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.195+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1657003261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21298e3a0 con 0x55e212a9c5d0 2024-09-12T02:50:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.195+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.195+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212aa7370 0x55e212aa9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.196+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212a9c5d0 0x55e212a9ca10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40cce60 tx=0x7fbbb409b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86e07f46de0833c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.196+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbba80a4c60 0x7fbba80a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.196+0000 7fbbacff9640 1 -- 172.21.15.100:0/1657003261 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb409c320 con 0x55e212a9c5d0 2024-09-12T02:50:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.196+0000 7fbbacff9640 1 -- 172.21.15.100:0/1657003261 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb409bc20 con 0x55e212a9c5d0 2024-09-12T02:50:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbacff9640 1 -- 172.21.15.100:0/1657003261 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb409b070 con 0x55e212a9c5d0 2024-09-12T02:50:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbba80a4c60 0x7fbba80a7120 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0005f60 tx=0x7fbbb00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 -- 172.21.15.100:0/1657003261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212a9c5d0 msgr2=0x55e212a9ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212a9c5d0 0x55e212a9ca10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40cce60 tx=0x7fbbb409b9f0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 -- 172.21.15.100:0/1657003261 shutdown_connections 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212aa7370 0x55e212aa9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212a9c5d0 0x55e212a9ca10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1657003261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 -- 172.21.15.100:0/1657003261 >> 172.21.15.100:0/1657003261 conn(0x55e212a65310 msgr2=0x55e212a98c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 -- 172.21.15.100:0/1657003261 shutdown_connections 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 -- 172.21.15.100:0/1657003261 wait complete. 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.197+0000 7fbbc720a740 1 -- start start 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 1 Processor -- start 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212aa6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212aa3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e212aaa050 con 0x55e212a9db40 2024-09-12T02:50:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e2129bd060 con 0x55e212aa7370 2024-09-12T02:50:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e212aaa1d0 con 0x55e212a9c5d0 2024-09-12T02:50:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbc720a740 10 client.0 _ll_register_callbacks cb 0x55e2127108c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212aa3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212aa6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212aa6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37026/0 (socket says 172.21.15.100:37026) 2024-09-12T02:50:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 -- 172.21.15.100:0/2995557361 learned_addr learned my addr 172.21.15.100:0/2995557361 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 -- 172.21.15.100:0/2995557361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 msgr2=0x55e212aa4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 -- 172.21.15.100:0/2995557361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 msgr2=0x55e212aa3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212aa3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbe59c640 1 -- 172.21.15.100:0/2995557361 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2127733c0 con 0x55e212a9c5d0 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.198+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212aa3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212aa6ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbb409b920 tx=0x7fbbb40977a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d0ccab5b16e7c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbba5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbba5ffb640 1 -- 172.21.15.100:0/2995557361 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb409b270 con 0x55e212a9c5d0 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbba5ffb640 1 -- 172.21.15.100:0/2995557361 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbbb4010430 con 0x55e212a9c5d0 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb409bc20 con 0x55e212a9c5d0 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbba5ffb640 1 -- 172.21.15.100:0/2995557361 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbb40ccfd0 con 0x55e212a9c5d0 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 10 client.26659 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e212aaa050 con 0x55e212a9c5d0 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbba5ffb640 1 -- 172.21.15.100:0/2995557361 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb409bc20 con 0x55e212a9c5d0 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbba5ffb640 1 -- 172.21.15.100:0/2995557361 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbbb4097b70 con 0x55e212a9c5d0 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 10 client.26659 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 10 client.26659 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 20 client.26659 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212ab6c10 0x55e212ab9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 4 client.26659 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.199+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e212a0f860 con 0x55e212ab6c10 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.200+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212ab6c10 0x55e212ab9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.200+0000 7fbba5ffb640 10 client.26659 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.200+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212ab6c10 0x55e212ab9000 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c7b779d71e659a7f server_cookie=fbd46302fa12fc51 in_seq=0 out_seq=0 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbba5ffb640 1 -- 172.21.15.100:0/2995557361 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e212a0f860 con 0x55e212ab6c10 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbba5ffb640 10 client.26659 handle_command_reply: tid=0 2024-09-12T02:50:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 client.26659 shutdown 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 msgr2=0x55e212aa6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212aa6ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbb409b920 tx=0x7fbbb40977a0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 shutdown_connections 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212ab6c10 0x55e212ab9000 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212aa3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 --2- 172.21.15.100:0/2995557361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212aa6ca0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 >> 172.21.15.100:0/2995557361 conn(0x55e212a65310 msgr2=0x55e212a9e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbba5ffb640 0 client.26659 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 shutdown_connections 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.201+0000 7fbbc720a740 1 -- 172.21.15.100:0/2995557361 wait complete. 2024-09-12T02:50:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.202+0000 7fbbc720a740 20 client.26659 trim_cache size 0 max 16384 2024-09-12T02:50:36.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 Processor -- start 2024-09-12T02:50:36.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 -- start start 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212ab3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212a9f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc01ad9d0 con 0x55e212a9db40 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc01ab2a0 con 0x55e212aa7370 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbc720a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc01a90f0 con 0x55e212a9c5d0 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbbdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbbdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42020/0 (socket says 172.21.15.100:42020) 2024-09-12T02:50:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.219+0000 7fbbbdd9b640 1 -- 172.21.15.100:0/716473458 learned_addr learned my addr 172.21.15.100:0/716473458 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.220+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212a9f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.220+0000 7fbbbdd9b640 1 -- 172.21.15.100:0/716473458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 msgr2=0x55e212ab3340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:50:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.220+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212ab3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.220+0000 7fbbbdd9b640 1 -- 172.21.15.100:0/716473458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 msgr2=0x55e212a9f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.220+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212a9f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.220+0000 7fbbbdd9b640 1 -- 172.21.15.100:0/716473458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e212aa24a0 con 0x55e212a9db40 2024-09-12T02:50:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.220+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212a9f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.221+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9f120 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009bf0 tx=0x7fbbb8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bff607dc632bccb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.221+0000 7fbba7fff640 1 -- 172.21.15.100:0/716473458 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8031990 con 0x55e212a9db40 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbba7fff640 1 -- 172.21.15.100:0/716473458 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb8036040 con 0x55e212a9db40 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbba7fff640 1 -- 172.21.15.100:0/716473458 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8030920 con 0x55e212a9db40 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 -- 172.21.15.100:0/716473458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 msgr2=0x55e212a9f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9f120 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009bf0 tx=0x7fbbb8009360 comp rx=0 tx=0).stop 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 -- 172.21.15.100:0/716473458 shutdown_connections 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212a9f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9db40 0x55e212a9f120 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 --2- 172.21.15.100:0/716473458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9c5d0 0x55e212ab3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 -- 172.21.15.100:0/716473458 >> 172.21.15.100:0/716473458 conn(0x55e212a65310 msgr2=0x55e212a97d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 -- 172.21.15.100:0/716473458 shutdown_connections 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.222+0000 7fbbc720a740 1 -- 172.21.15.100:0/716473458 wait complete. 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 -- start start 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 Processor -- start 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9c5d0 0x55e212aafa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9db40 0x55e212aa0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc01a9760 con 0x55e212a9c5d0 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc01aabd0 con 0x55e212aa7370 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc01a9e30 con 0x55e212a9db40 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbc720a740 10 client.0 _ll_register_callbacks cb 0x7fbbb0009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9c5d0 0x55e212aafa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9c5d0 0x55e212aafa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42022/0 (socket says 172.21.15.100:42022) 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1340572388 learned_addr learned my addr 172.21.15.100:0/1340572388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.223+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9db40 0x55e212aa0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9db40 msgr2=0x55e212aa0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9db40 0x55e212aa0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1340572388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 msgr2=0x55e212aa1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbe59c640 1 -- 172.21.15.100:0/1340572388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e212aa1690 con 0x55e212a9c5d0 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9db40 0x55e212aa0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbed9d640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbbe59c640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9c5d0 0x55e212aafa70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4099ed0 tx=0x7fbbb409af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e846463b9a448017 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbba5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbba5ffb640 1 -- 172.21.15.100:0/1340572388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb409bc20 con 0x55e212a9c5d0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb8036040 con 0x55e212a9c5d0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.224+0000 7fbba5ffb640 1 -- 172.21.15.100:0/1340572388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbbb4010430 con 0x55e212a9c5d0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.225+0000 7fbba5ffb640 1 -- 172.21.15.100:0/1340572388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbb409ffd0 con 0x55e212a9c5d0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.225+0000 7fbbc720a740 10 client.17433 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.225+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e212b25880 con 0x55e212a9c5d0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.225+0000 7fbba5ffb640 1 -- 172.21.15.100:0/1340572388 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb8036040 con 0x55e212a9c5d0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbba5ffb640 1 -- 172.21.15.100:0/1340572388 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbbb40a4b70 con 0x55e212a9c5d0 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbc720a740 10 client.17433 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbc720a740 10 client.17433 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbc720a740 20 client.17433 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212b25cb0 0x55e212b280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbc720a740 4 client.17433 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:50:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e212a09d70 con 0x55e212b25cb0 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212b25cb0 0x55e212b280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbba5ffb640 10 client.17433 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.226+0000 7fbbbdd9b640 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212b25cb0 0x55e212b280a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6c778bb6874a7f8 server_cookie=a2edd02d4a47e852 in_seq=0 out_seq=0 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbba5ffb640 1 -- 172.21.15.100:0/1340572388 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e212a09d70 con 0x55e212b25cb0 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbba5ffb640 10 client.17433 handle_command_reply: tid=0 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 client.17433 shutdown 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9c5d0 msgr2=0x55e212aafa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9c5d0 0x55e212aafa70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4099ed0 tx=0x7fbbb409af40 comp rx=0 tx=0).stop 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 shutdown_connections 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55e212b25cb0 0x55e212b280a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e212aa7370 0x55e212aa1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e212a9db40 0x55e212aa0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 --2- 172.21.15.100:0/1340572388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e212a9c5d0 0x55e212aafa70 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 >> 172.21.15.100:0/1340572388 conn(0x55e212a65310 msgr2=0x55e212aa57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:36.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbba5ffb640 0 client.17433 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:50:36.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 shutdown_connections 2024-09-12T02:50:36.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 1 -- 172.21.15.100:0/1340572388 wait complete. 2024-09-12T02:50:36.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.227+0000 7fbbc720a740 20 client.17433 trim_cache size 0 max 16384 2024-09-12T02:50:36.234 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbba80a4c60 msgr2=0x7fbba80a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbba80a4c60 0x7fbba80a7120 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0005f60 tx=0x7fbbb00046c0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc00696e0 msgr2=0x7fbbc0196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc00696e0 0x7fbbc0196240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400e9f0 tx=0x7fbbb400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 shutdown_connections 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbba80a4c60 0x7fbba80a7120 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbc0104e30 0x7fbbc019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbc0069b50 0x7fbbc0196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 --2- 172.21.15.100:0/1645551642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc00696e0 0x7fbbc0196240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 >> 172.21.15.100:0/1645551642 conn(0x7fbbc0077230 msgr2=0x7fbbc0102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 shutdown_connections 2024-09-12T02:50:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:36.228+0000 7fbbc4e31640 1 -- 172.21.15.100:0/1645551642 wait complete. 2024-09-12T02:50:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 685.0 s, 1975.4 tps, lat 50.298 ms stddev 54.467 2024-09-12T02:50:37.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:36 smithi100 ceph-mon[31390]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-12T02:50:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:36 smithi117 ceph-mon[34898]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-12T02:50:37.110 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:50:37.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:36 smithi189 ceph-mon[35196]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-12T02:50:37.457 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:38.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 -- 172.21.15.100:0/2163181467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc100a70 msgr2=0x7f73fc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2163181467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc100a70 0x7f73fc100ed0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009930 tx=0x7f73e402a420 comp rx=0 tx=0).stop 2024-09-12T02:50:38.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 -- 172.21.15.100:0/2163181467 shutdown_connections 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2163181467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73fc101410 0x7f73fc10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2163181467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc100a70 0x7f73fc100ed0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2163181467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc106a70 0x7f73fc106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 -- 172.21.15.100:0/2163181467 >> 172.21.15.100:0/2163181467 conn(0x7f73fc0fc7d0 msgr2=0x7f73fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 -- 172.21.15.100:0/2163181467 shutdown_connections 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.469+0000 7f7400ad8640 1 -- 172.21.15.100:0/2163181467 wait complete. 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 Processor -- start 2024-09-12T02:50:38.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 -- start start 2024-09-12T02:50:38.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc100a70 0x7f73fc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73fc101410 0x7f73fc198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc106a70 0x7f73fc19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc110e70 con 0x7f73fc106a70 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc110cf0 con 0x7f73fc100a70 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.470+0000 7f7400ad8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc110ff0 con 0x7f73fc101410 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc100a70 0x7f73fc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc106a70 0x7f73fc19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc106a70 0x7f73fc19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42046/0 (socket says 172.21.15.100:42046) 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 -- 172.21.15.100:0/2254046914 learned_addr learned my addr 172.21.15.100:0/2254046914 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc100a70 0x7f73fc198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56232/0 (socket says 172.21.15.100:56232) 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73f3fff640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73fc101410 0x7f73fc198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 -- 172.21.15.100:0/2254046914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73fc101410 msgr2=0x7f73fc198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73fc101410 0x7f73fc198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 -- 172.21.15.100:0/2254046914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc100a70 msgr2=0x7f73fc198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc100a70 0x7f73fc198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 -- 172.21.15.100:0/2254046914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc19d3f0 con 0x7f73fc106a70 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fa59c640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc100a70 0x7f73fc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73fad9d640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc106a70 0x7f73fc19cd10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009d10 tx=0x7f73f4007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73f37fe640 1 -- 172.21.15.100:0/2254046914 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4004b20 con 0x7f73fc106a70 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc19d680 con 0x7f73fc106a70 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc0fcdb0 con 0x7f73fc106a70 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73f37fe640 1 -- 172.21.15.100:0/2254046914 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73f4004cc0 con 0x7f73fc106a70 2024-09-12T02:50:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.471+0000 7f73f37fe640 1 -- 172.21.15.100:0/2254046914 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f400ee10 con 0x7f73fc106a70 2024-09-12T02:50:38.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.475+0000 7f73f37fe640 1 -- 172.21.15.100:0/2254046914 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f73f400e660 con 0x7f73fc106a70 2024-09-12T02:50:38.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.476+0000 7f7402eb1740 1 Processor -- start 2024-09-12T02:50:38.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.476+0000 7f73f37fe640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73e80a2c00 0x7f73e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73f3fff640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73e80a2c00 0x7f73e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f7402eb1740 1 -- start start 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73f37fe640 1 -- 172.21.15.100:0/2254046914 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f73f40d2500 con 0x7f73fc106a70 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f941a350 0x5640f94188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9418de0 0x5640f9419220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f9423b80 0x5640f9425f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f7402eb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5640f93762f0 con 0x5640f9423b80 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f7402eb1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5640f931dcf0 con 0x5640f941a350 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f7402eb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5640f93722b0 con 0x5640f9418de0 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f941a350 0x5640f94188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73f3fff640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73e80a2c00 0x7f73e80a50c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009900 tx=0x7f73e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f941a350 0x5640f94188a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56240/0 (socket says 172.21.15.100:56240) 2024-09-12T02:50:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 -- 172.21.15.100:0/2267097593 learned_addr learned my addr 172.21.15.100:0/2267097593 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fad9d640 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f9423b80 0x5640f9425f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73f3fff640 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9418de0 0x5640f9419220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 -- 172.21.15.100:0/2267097593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9418de0 msgr2=0x5640f9419220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9418de0 0x5640f9419220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 -- 172.21.15.100:0/2267097593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f9423b80 msgr2=0x5640f9425f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f9423b80 0x5640f9425f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.477+0000 7f73fa59c640 1 -- 172.21.15.100:0/2267097593 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640f93023a0 con 0x5640f941a350 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.478+0000 7f73fad9d640 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f9423b80 0x5640f9425f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.478+0000 7f73fa59c640 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f941a350 0x5640f94188a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0114f0 tx=0x7f73ec0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf1b37deab7814ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.478+0000 7f73f0ff9640 1 -- 172.21.15.100:0/2267097593 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec01e070 con 0x5640f941a350 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.478+0000 7f73f0ff9640 1 -- 172.21.15.100:0/2267097593 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73ec00faa0 con 0x5640f941a350 2024-09-12T02:50:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.478+0000 7f73f0ff9640 1 -- 172.21.15.100:0/2267097593 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec019b90 con 0x5640f941a350 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 -- 172.21.15.100:0/2267097593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f941a350 msgr2=0x5640f94188a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f941a350 0x5640f94188a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0114f0 tx=0x7f73ec0119b0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 -- 172.21.15.100:0/2267097593 shutdown_connections 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f9423b80 0x5640f9425f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9418de0 0x5640f9419220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 --2- 172.21.15.100:0/2267097593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f941a350 0x5640f94188a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 -- 172.21.15.100:0/2267097593 >> 172.21.15.100:0/2267097593 conn(0x5640f93d9310 msgr2=0x5640f9415470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 -- 172.21.15.100:0/2267097593 shutdown_connections 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 -- 172.21.15.100:0/2267097593 wait complete. 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 -- start start 2024-09-12T02:50:38.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.479+0000 7f7402eb1740 1 Processor -- start 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9420770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9423b80 0x5640f9420cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f7402eb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5640f9426880 con 0x5640f941a350 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f7402eb1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5640f9331060 con 0x5640f9418de0 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f7402eb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5640f9426a00 con 0x5640f9423b80 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9420770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f7402eb1740 10 client.0 _ll_register_callbacks cb 0x5640f90848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94234c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56252/0 (socket says 172.21.15.100:56252) 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73fa59c640 1 -- 172.21.15.100:0/3640282571 learned_addr learned my addr 172.21.15.100:0/3640282571 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9420770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42066/0 (socket says 172.21.15.100:42066) 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73fad9d640 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9423b80 0x5640f9420cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73f3fff640 1 -- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9423b80 msgr2=0x5640f9420cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73f3fff640 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9423b80 0x5640f9420cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73f3fff640 1 -- 172.21.15.100:0/3640282571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 msgr2=0x5640f94234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73f3fff640 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73f3fff640 1 -- 172.21.15.100:0/3640282571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640f90e73c0 con 0x5640f941a350 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.480+0000 7f73fa59c640 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f73f3fff640 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9420770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f73e4005940 tx=0x7f73e4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f05df1ed8e0b39e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f73e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f73e1ffb640 1 -- 172.21.15.100:0/3640282571 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4035040 con 0x5640f941a350 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f73e1ffb640 1 -- 172.21.15.100:0/3640282571 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f73e4003b80 con 0x5640f941a350 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73ec00faa0 con 0x5640f941a350 2024-09-12T02:50:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f73e1ffb640 1 -- 172.21.15.100:0/3640282571 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f73e4003d80 con 0x5640f941a350 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f7402eb1740 10 client.17445 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640f94322a0 con 0x5640f941a350 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f73e1ffb640 1 -- 172.21.15.100:0/3640282571 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73ec00faa0 con 0x5640f941a350 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f73e1ffb640 1 -- 172.21.15.100:0/3640282571 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f73e403c560 con 0x5640f941a350 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f7402eb1740 10 client.17445 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f7402eb1740 10 client.17445 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f7402eb1740 20 client.17445 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.481+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f94337b0 0x5640f9435bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.482+0000 7f7402eb1740 4 client.17445 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.482+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640f9383860 con 0x5640f94337b0 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.482+0000 7f73fa59c640 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f94337b0 0x5640f9435bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.482+0000 7f73fa59c640 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f94337b0 0x5640f9435bf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b4a884da74cc533 server_cookie=9a34a75e04dfe4e4 in_seq=0 out_seq=0 2024-09-12T02:50:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.482+0000 7f73e1ffb640 10 client.17445 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f73e1ffb640 1 -- 172.21.15.100:0/3640282571 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640f9383860 con 0x5640f94337b0 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f73e1ffb640 10 client.17445 handle_command_reply: tid=0 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 client.17445 shutdown 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 msgr2=0x5640f9420770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9420770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f73e4005940 tx=0x7f73e4009260 comp rx=0 tx=0).stop 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 shutdown_connections 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f94337b0 0x5640f9435bf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f73e1ffb640 0 client.17445 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f9423b80 0x5640f9420cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9420770 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3640282571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 >> 172.21.15.100:0/3640282571 conn(0x5640f93d9310 msgr2=0x5640f941b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 shutdown_connections 2024-09-12T02:50:38.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 1 -- 172.21.15.100:0/3640282571 wait complete. 2024-09-12T02:50:38.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.483+0000 7f7402eb1740 20 client.17445 trim_cache size 0 max 16384 2024-09-12T02:50:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.498+0000 7f7402eb1740 1 Processor -- start 2024-09-12T02:50:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.498+0000 7f7402eb1740 1 -- start start 2024-09-12T02:50:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f93d9310 0x5640f9420030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f941a350 0x5640f941b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f7402eb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc010d70 con 0x5640f93d9310 2024-09-12T02:50:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f7402eb1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc00e640 con 0x5640f9418de0 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f7402eb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc00c490 con 0x5640f941a350 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f93d9310 0x5640f9420030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f93d9310 0x5640f9420030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42072/0 (socket says 172.21.15.100:42072) 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 -- 172.21.15.100:0/3677058917 learned_addr learned my addr 172.21.15.100:0/3677058917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fad9d640 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f941a350 0x5640f941b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73f3fff640 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 -- 172.21.15.100:0/3677058917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f941a350 msgr2=0x5640f941b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f941a350 0x5640f941b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 -- 172.21.15.100:0/3677058917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 msgr2=0x5640f94226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 -- 172.21.15.100:0/3677058917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640f941ecc0 con 0x5640f93d9310 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73fa59c640 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f93d9310 0x5640f9420030 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f73ec019700 tx=0x7f73ec019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53acab300b84684d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.499+0000 7f73e3fff640 1 -- 172.21.15.100:0/3677058917 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec01e040 con 0x5640f93d9310 2024-09-12T02:50:38.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.500+0000 7f73e3fff640 1 -- 172.21.15.100:0/3677058917 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73ec02a070 con 0x5640f93d9310 2024-09-12T02:50:38.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.500+0000 7f73e3fff640 1 -- 172.21.15.100:0/3677058917 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec019860 con 0x5640f93d9310 2024-09-12T02:50:38.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 -- 172.21.15.100:0/3677058917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f93d9310 msgr2=0x5640f9420030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f93d9310 0x5640f9420030 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f73ec019700 tx=0x7f73ec019690 comp rx=0 tx=0).stop 2024-09-12T02:50:38.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 -- 172.21.15.100:0/3677058917 shutdown_connections 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f941a350 0x5640f941b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 --2- 172.21.15.100:0/3677058917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f93d9310 0x5640f9420030 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 -- 172.21.15.100:0/3677058917 >> 172.21.15.100:0/3677058917 conn(0x5640f9420e10 msgr2=0x5640f9421fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 -- 172.21.15.100:0/3677058917 shutdown_connections 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 -- 172.21.15.100:0/3677058917 wait complete. 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 -- start start 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.501+0000 7f7402eb1740 1 Processor -- start 2024-09-12T02:50:38.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f93d9310 0x5640f9428280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f7402eb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9497460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f7402eb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc00cb00 con 0x5640f941a350 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f7402eb1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc00df70 con 0x5640f9418de0 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f7402eb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc00d1d0 con 0x5640f93d9310 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f7402eb1740 10 client.0 _ll_register_callbacks cb 0x7f73e4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f93d9310 0x5640f9428280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f93d9310 0x5640f9428280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37108/0 (socket says 172.21.15.100:37108) 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9497460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 -- 172.21.15.100:0/807078285 learned_addr learned my addr 172.21.15.100:0/807078285 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73f3fff640 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 -- 172.21.15.100:0/807078285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 msgr2=0x5640f94287c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94287c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 -- 172.21.15.100:0/807078285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 msgr2=0x5640f9497460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9497460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.502+0000 7f73fa59c640 1 -- 172.21.15.100:0/807078285 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640f9497aa0 con 0x5640f93d9310 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f73fa59c640 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f93d9310 0x5640f9428280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00f470 tx=0x7f73ec009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b62c939a786d8237 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f73e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f73e1ffb640 1 -- 172.21.15.100:0/807078285 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec032020 con 0x5640f93d9310 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73ec02a070 con 0x5640f93d9310 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f73e1ffb640 1 -- 172.21.15.100:0/807078285 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f73ec00f5c0 con 0x5640f93d9310 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f73e1ffb640 1 -- 172.21.15.100:0/807078285 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f73ec01e040 con 0x5640f93d9310 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 10 client.26680 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640f949ee10 con 0x5640f93d9310 2024-09-12T02:50:38.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f73e1ffb640 1 -- 172.21.15.100:0/807078285 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73ec02a070 con 0x5640f93d9310 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f73e1ffb640 1 -- 172.21.15.100:0/807078285 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f73ec0035f0 con 0x5640f93d9310 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 10 client.26680 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 10 client.26680 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 20 client.26680 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f9423b80 0x5640f94a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 4 client.26680 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.503+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640f937dd70 con 0x5640f9423b80 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.504+0000 7f73f3fff640 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f9423b80 0x5640f94a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.504+0000 7f73e1ffb640 10 client.26680 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.504+0000 7f73f3fff640 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f9423b80 0x5640f94a12e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=40d5e452b1ab8073 server_cookie=c24ea8aceb105f29 in_seq=0 out_seq=0 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.504+0000 7f73e1ffb640 1 -- 172.21.15.100:0/807078285 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640f937dd70 con 0x5640f9423b80 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.504+0000 7f73e1ffb640 10 client.26680 handle_command_reply: tid=0 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.504+0000 7f7402eb1740 1 client.26680 shutdown 2024-09-12T02:50:38.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.504+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f93d9310 msgr2=0x5640f9428280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f93d9310 0x5640f9428280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00f470 tx=0x7f73ec009cc0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 shutdown_connections 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5640f9423b80 0x5640f94a12e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f941a350 0x5640f9497460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5640f9418de0 0x5640f94287c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 --2- 172.21.15.100:0/807078285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f93d9310 0x5640f9428280 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00f470 tx=0x7f73ec009cc0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 >> 172.21.15.100:0/807078285 conn(0x5640f9420e10 msgr2=0x5640f940bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f73e1ffb640 0 client.26680 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.505+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 shutdown_connections 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.506+0000 7f7402eb1740 1 -- 172.21.15.100:0/807078285 wait complete. 2024-09-12T02:50:38.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.506+0000 7f7402eb1740 20 client.26680 trim_cache size 0 max 16384 2024-09-12T02:50:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:50:38.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73e80a2c00 msgr2=0x7f73e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73e80a2c00 0x7f73e80a50c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009900 tx=0x7f73e40058d0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc106a70 msgr2=0x7f73fc19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc106a70 0x7f73fc19cd10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009d10 tx=0x7f73f4007590 comp rx=0 tx=0).stop 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 shutdown_connections 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f73e80a2c00 0x7f73e80a50c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73fc106a70 0x7f73fc19cd10 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73fc101410 0x7f73fc198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 --2- 172.21.15.100:0/2254046914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73fc100a70 0x7f73fc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 >> 172.21.15.100:0/2254046914 conn(0x7f73fc0fc7d0 msgr2=0x7f73fc06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 shutdown_connections 2024-09-12T02:50:38.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:38.508+0000 7f7400ad8640 1 -- 172.21.15.100:0/2254046914 wait complete. 2024-09-12T02:50:39.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:38 smithi100 ceph-mon[31390]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 779 op/s 2024-09-12T02:50:39.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:38 smithi117 ceph-mon[34898]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 779 op/s 2024-09-12T02:50:39.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:50:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:38 smithi189 ceph-mon[35196]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 779 op/s 2024-09-12T02:50:39.375 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.2 2024-09-12T02:50:39.376 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:50:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.134+0000 7f6188c70640 1 -- 172.21.15.100:0/298059677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6184101de0 msgr2=0x7f61841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 --2- 172.21.15.100:0/298059677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6184101de0 0x7f61841021c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6174009900 tx=0x7f617402a410 comp rx=0 tx=0).stop 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 -- 172.21.15.100:0/298059677 shutdown_connections 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 --2- 172.21.15.100:0/298059677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6184106f10 0x7f618410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 --2- 172.21.15.100:0/298059677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184102790 0x7f61841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 --2- 172.21.15.100:0/298059677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6184101de0 0x7f61841021c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 -- 172.21.15.100:0/298059677 >> 172.21.15.100:0/298059677 conn(0x7f61840fd880 msgr2=0x7f61840ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 -- 172.21.15.100:0/298059677 shutdown_connections 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 -- 172.21.15.100:0/298059677 wait complete. 2024-09-12T02:50:40.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 Processor -- start 2024-09-12T02:50:40.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.135+0000 7f6188c70640 1 -- start start 2024-09-12T02:50:40.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f6188c70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101de0 0x7f6184198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f6188c70640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6184102790 0x7f61841989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f618259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101de0 0x7f6184198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f618259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101de0 0x7f6184198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37130/0 (socket says 172.21.15.100:37130) 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f6188c70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6184106f10 0x7f618419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f618259c640 1 -- 172.21.15.100:0/3113987327 learned_addr learned my addr 172.21.15.100:0/3113987327 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6184111f70 con 0x7f6184102790 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6184111df0 con 0x7f6184106f10 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.136+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f61841120f0 con 0x7f6184101de0 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f618259c640 1 -- 172.21.15.100:0/3113987327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6184106f10 msgr2=0x7f618419cd50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f618259c640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6184106f10 0x7f618419cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f618259c640 1 -- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6184102790 msgr2=0x7f61841989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f618259c640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6184102790 0x7f61841989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f618259c640 1 -- 172.21.15.100:0/3113987327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618419d430 con 0x7f6184101de0 2024-09-12T02:50:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f618259c640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101de0 0x7f6184198480 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6174006010 tx=0x7f6174031a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f617b7fe640 1 -- 172.21.15.100:0/3113987327 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174050030 con 0x7f6184101de0 2024-09-12T02:50:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.137+0000 7f617b7fe640 1 -- 172.21.15.100:0/3113987327 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6174003ad0 con 0x7f6184101de0 2024-09-12T02:50:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.138+0000 7f617b7fe640 1 -- 172.21.15.100:0/3113987327 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174035070 con 0x7f6184101de0 2024-09-12T02:50:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.138+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618419d6c0 con 0x7f6184101de0 2024-09-12T02:50:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.138+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618406bc10 con 0x7f6184101de0 2024-09-12T02:50:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.141+0000 7f617b7fe640 1 -- 172.21.15.100:0/3113987327 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6174053030 con 0x7f6184101de0 2024-09-12T02:50:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.141+0000 7f618b049740 1 Processor -- start 2024-09-12T02:50:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618b049740 1 -- start start 2024-09-12T02:50:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618b049740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33da090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618b049740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33daa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618b049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618b049740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5611a33402f0 con 0x5611a33da5d0 2024-09-12T02:50:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618b049740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5611a32e7cf0 con 0x5611a33dbb40 2024-09-12T02:50:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618b049740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5611a333c2b0 con 0x5611a33e9780 2024-09-12T02:50:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f618259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f6182d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f6182d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33da090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56296/0 (socket says 172.21.15.100:56296) 2024-09-12T02:50:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f6182d9d640 1 -- 172.21.15.100:0/4243555847 learned_addr learned my addr 172.21.15.100:0/4243555847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.142+0000 7f617bfff640 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f6182d9d640 1 -- 172.21.15.100:0/4243555847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 msgr2=0x5611a33ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f6182d9d640 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f6182d9d640 1 -- 172.21.15.100:0/4243555847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 msgr2=0x5611a33daa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f6182d9d640 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33daa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f6182d9d640 1 -- 172.21.15.100:0/4243555847 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a32cc3a0 con 0x5611a33dbb40 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f617bfff640 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f618259c640 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33daa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f617b7fe640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61700ab410 0x7f61700ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f6182d9d640 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33da090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f617c007b50 tx=0x7f617c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4760f3233e7280ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f617b7fe640 1 -- 172.21.15.100:0/3113987327 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6174100920 con 0x7f6184101de0 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.143+0000 7f618259c640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61700ab410 0x7f61700ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.144+0000 7f6178ff9640 1 -- 172.21.15.100:0/4243555847 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c014070 con 0x5611a33dbb40 2024-09-12T02:50:40.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.144+0000 7f6178ff9640 1 -- 172.21.15.100:0/4243555847 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f617c007e50 con 0x5611a33dbb40 2024-09-12T02:50:40.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.144+0000 7f618259c640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61700ab410 0x7f61700ad8d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f61740fe780 tx=0x7f617402a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:40.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f6178ff9640 1 -- 172.21.15.100:0/4243555847 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c00eb30 con 0x5611a33dbb40 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 -- 172.21.15.100:0/4243555847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 msgr2=0x5611a33da090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33da090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f617c007b50 tx=0x7f617c00c6a0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 -- 172.21.15.100:0/4243555847 shutdown_connections 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33daa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 --2- 172.21.15.100:0/4243555847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33da090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 -- 172.21.15.100:0/4243555847 >> 172.21.15.100:0/4243555847 conn(0x5611a33a3310 msgr2=0x5611a33d6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 -- 172.21.15.100:0/4243555847 shutdown_connections 2024-09-12T02:50:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.145+0000 7f618b049740 1 -- 172.21.15.100:0/4243555847 wait complete. 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 -- start start 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 Processor -- start 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33e3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5611a33dd5a0 con 0x5611a33da5d0 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5611a32fb060 con 0x5611a33dbb40 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5611a33dd720 con 0x5611a33e9780 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f618b049740 10 client.0 _ll_register_callbacks cb 0x5611a304e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f617bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f617bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33e2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56300/0 (socket says 172.21.15.100:56300) 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f617bfff640 1 -- 172.21.15.100:0/1580150408 learned_addr learned my addr 172.21.15.100:0/1580150408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.146+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f617bfff640 1 -- 172.21.15.100:0/1580150408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 msgr2=0x5611a33e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f617bfff640 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33e3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f617bfff640 1 -- 172.21.15.100:0/1580150408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 msgr2=0x5611a33e26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f617bfff640 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33e26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f617bfff640 1 -- 172.21.15.100:0/1580150408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a30b13c0 con 0x5611a33dbb40 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f617bfff640 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33e2be0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f616c010620 tx=0x7f616c010ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1dbc481df181735 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f6169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f6169ffb640 1 -- 172.21.15.100:0/1580150408 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c012920 con 0x5611a33dbb40 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f6169ffb640 1 -- 172.21.15.100:0/1580150408 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f616c012ac0 con 0x5611a33dbb40 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.147+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f617c007e50 con 0x5611a33dbb40 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f6169ffb640 1 -- 172.21.15.100:0/1580150408 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f616c012cc0 con 0x5611a33dbb40 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 10 client.26762 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5611a33f3b20 con 0x5611a33dbb40 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f6169ffb640 1 -- 172.21.15.100:0/1580150408 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f617c007e50 con 0x5611a33dbb40 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f6169ffb640 1 -- 172.21.15.100:0/1580150408 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f616c00f040 con 0x5611a33dbb40 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 10 client.26762 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 10 client.26762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 20 client.26762 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a33f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 4 client.26762 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.148+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611a334d860 con 0x5611a33f4fe0 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.149+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a33f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.149+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a33f73d0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=659f2d71d445e7ca server_cookie=9f2213ef700fc081 in_seq=0 out_seq=0 2024-09-12T02:50:40.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.149+0000 7f6169ffb640 10 client.26762 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:40.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f6169ffb640 1 -- 172.21.15.100:0/1580150408 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611a334d860 con 0x5611a33f4fe0 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f6169ffb640 10 client.26762 handle_command_reply: tid=0 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 client.26762 shutdown 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 msgr2=0x5611a33e2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33e2be0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f616c010620 tx=0x7f616c010ae0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 shutdown_connections 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a33f73d0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f6169ffb640 0 client.26762 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33e9780 0x5611a33e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33dbb40 0x5611a33e2be0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 --2- 172.21.15.100:0/1580150408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33da5d0 0x5611a33e26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 >> 172.21.15.100:0/1580150408 conn(0x5611a33a3310 msgr2=0x5611a33dc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:40.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 shutdown_connections 2024-09-12T02:50:40.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 1 -- 172.21.15.100:0/1580150408 wait complete. 2024-09-12T02:50:40.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.150+0000 7f618b049740 20 client.26762 trim_cache size 0 max 16384 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 Processor -- start 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 -- start start 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33da5d0 0x5611a33dde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33dbb40 0x5611a33e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33e9780 0x5611a33fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f617bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33dbb40 0x5611a33e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f617bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33dbb40 0x5611a33e2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42146/0 (socket says 172.21.15.100:42146) 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f617bfff640 1 -- 172.21.15.100:0/1796373071 learned_addr learned my addr 172.21.15.100:0/1796373071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f61841a5520 con 0x5611a33dbb40 2024-09-12T02:50:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6184074420 con 0x5611a33e9780 2024-09-12T02:50:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6184072270 con 0x5611a33da5d0 2024-09-12T02:50:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33da5d0 0x5611a33dde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.166+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33e9780 0x5611a33fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.167+0000 7f6182d9d640 1 -- 172.21.15.100:0/1796373071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33e9780 msgr2=0x5611a33fcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.167+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33e9780 0x5611a33fcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.167+0000 7f6182d9d640 1 -- 172.21.15.100:0/1796373071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33dbb40 msgr2=0x5611a33e2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.167+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33dbb40 0x5611a33e2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.167+0000 7f6182d9d640 1 -- 172.21.15.100:0/1796373071 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a33d5310 con 0x5611a33da5d0 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.167+0000 7f617bfff640 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33dbb40 0x5611a33e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.167+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33da5d0 0x5611a33dde50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f617c00d010 tx=0x7f617c00e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742535991d30889b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.168+0000 7f616bfff640 1 -- 172.21.15.100:0/1796373071 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c014070 con 0x5611a33da5d0 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.168+0000 7f616bfff640 1 -- 172.21.15.100:0/1796373071 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f617c02d040 con 0x5611a33da5d0 2024-09-12T02:50:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.168+0000 7f616bfff640 1 -- 172.21.15.100:0/1796373071 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c022040 con 0x5611a33da5d0 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33da5d0 msgr2=0x5611a33dde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33da5d0 0x5611a33dde50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f617c00d010 tx=0x7f617c00e690 comp rx=0 tx=0).stop 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 shutdown_connections 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33e9780 0x5611a33fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33dbb40 0x5611a33e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 --2- 172.21.15.100:0/1796373071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33da5d0 0x5611a33dde50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 >> 172.21.15.100:0/1796373071 conn(0x5611a33a3310 msgr2=0x5611a33e6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 shutdown_connections 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.169+0000 7f618b049740 1 -- 172.21.15.100:0/1796373071 wait complete. 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 -- start start 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 Processor -- start 2024-09-12T02:50:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33da5d0 0x5611a33f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33dbb40 0x5611a33ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33e9780 0x5611a33ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f61840728e0 con 0x5611a33e9780 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6184073d50 con 0x5611a33da5d0 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6184072fb0 con 0x5611a33dbb40 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f618b049740 10 client.0 _ll_register_callbacks cb 0x7f616c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f617bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33dbb40 0x5611a33ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f6182d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33da5d0 0x5611a33f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f617bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33dbb40 0x5611a33ecdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37172/0 (socket says 172.21.15.100:37172) 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f617bfff640 1 -- 172.21.15.100:0/1254615047 learned_addr learned my addr 172.21.15.100:0/1254615047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.170+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33e9780 0x5611a33ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f617bfff640 1 -- 172.21.15.100:0/1254615047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33da5d0 msgr2=0x5611a33f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f617bfff640 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33da5d0 0x5611a33f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f617bfff640 1 -- 172.21.15.100:0/1254615047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33e9780 msgr2=0x5611a33ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f617bfff640 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33e9780 0x5611a33ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f617bfff640 1 -- 172.21.15.100:0/1254615047 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a33ed9e0 con 0x5611a33dbb40 2024-09-12T02:50:40.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f617bfff640 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33dbb40 0x5611a33ecdb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f616c0114b0 tx=0x7f616c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec7a3772e5b7a4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f6169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f6169ffb640 1 -- 172.21.15.100:0/1254615047 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c029050 con 0x5611a33dbb40 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f6169ffb640 1 -- 172.21.15.100:0/1254615047 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f616c012920 con 0x5611a33dbb40 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.171+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f617c02d040 con 0x5611a33dbb40 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f6169ffb640 1 -- 172.21.15.100:0/1254615047 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f616c0111f0 con 0x5611a33dbb40 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 10 client.26695 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5611a345fbc0 con 0x5611a33dbb40 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f6169ffb640 1 -- 172.21.15.100:0/1254615047 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f616c035070 con 0x5611a33dbb40 2024-09-12T02:50:40.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f6169ffb640 1 -- 172.21.15.100:0/1254615047 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f616c0047a0 con 0x5611a33dbb40 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 10 client.26695 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 10 client.26695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 20 client.26695 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a3462350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 4 client.26695 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.172+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f617c02d040 con 0x5611a33f4fe0 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.173+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a3462350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.173+0000 7f6169ffb640 10 client.26695 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f6182d9d640 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a3462350 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89cba8750c14e9b5 server_cookie=9ddbc02a94ddfae6 in_seq=0 out_seq=0 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f6169ffb640 1 -- 172.21.15.100:0/1254615047 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f617c02d040 con 0x5611a33f4fe0 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f6169ffb640 10 client.26695 handle_command_reply: tid=0 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 client.26695 shutdown 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33dbb40 msgr2=0x5611a33ecdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33dbb40 0x5611a33ecdb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f616c0114b0 tx=0x7f616c0118d0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 shutdown_connections 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5611a33f4fe0 0x5611a3462350 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611a33e9780 0x5611a33ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f6169ffb640 0 client.26695 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611a33dbb40 0x5611a33ecdb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 --2- 172.21.15.100:0/1254615047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611a33da5d0 0x5611a33f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 >> 172.21.15.100:0/1254615047 conn(0x5611a33a3310 msgr2=0x5611a33d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:40.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 shutdown_connections 2024-09-12T02:50:40.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 1 -- 172.21.15.100:0/1254615047 wait complete. 2024-09-12T02:50:40.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.174+0000 7f618b049740 20 client.26695 trim_cache size 0 max 16384 2024-09-12T02:50:40.179 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61700ab410 msgr2=0x7f61700ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61700ab410 0x7f61700ad8d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f61740fe780 tx=0x7f617402a410 comp rx=0 tx=0).stop 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101de0 msgr2=0x7f6184198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101de0 0x7f6184198480 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6174006010 tx=0x7f6174031a60 comp rx=0 tx=0).stop 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 shutdown_connections 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f61700ab410 0x7f61700ad8d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6184106f10 0x7f618419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6184102790 0x7f61841989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 --2- 172.21.15.100:0/3113987327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101de0 0x7f6184198480 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 >> 172.21.15.100:0/3113987327 conn(0x7f61840fd880 msgr2=0x7f61840fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 shutdown_connections 2024-09-12T02:50:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:40.175+0000 7f6188c70640 1 -- 172.21.15.100:0/3113987327 wait complete. 2024-09-12T02:50:40.181 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:41.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:40 smithi100 ceph-mon[31390]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 896 op/s 2024-09-12T02:50:41.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:40 smithi117 ceph-mon[34898]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 896 op/s 2024-09-12T02:50:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:40 smithi189 ceph-mon[35196]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 896 op/s 2024-09-12T02:50:41.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 690.0 s, 1796.0 tps, lat 56.076 ms stddev 57.931 2024-09-12T02:50:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.358+0000 7f01e3fff640 1 -- 172.21.15.100:0/3904529086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410e680 msgr2=0x7f01e410ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.358+0000 7f01e3fff640 1 --2- 172.21.15.100:0/3904529086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410e680 0x7f01e410ee10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009ca0 tx=0x7f01dc02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.359+0000 7f01e3fff640 1 -- 172.21.15.100:0/3904529086 shutdown_connections 2024-09-12T02:50:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.359+0000 7f01e3fff640 1 --2- 172.21.15.100:0/3904529086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410e680 0x7f01e410ee10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.359+0000 7f01e3fff640 1 --2- 172.21.15.100:0/3904529086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e410dce0 0x7f01e410e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.359+0000 7f01e3fff640 1 --2- 172.21.15.100:0/3904529086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e406e4f0 0x7f01e406e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.359+0000 7f01e3fff640 1 -- 172.21.15.100:0/3904529086 >> 172.21.15.100:0/3904529086 conn(0x7f01e4073180 msgr2=0x7f01e4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:41.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.359+0000 7f01e3fff640 1 -- 172.21.15.100:0/3904529086 shutdown_connections 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.360+0000 7f01e3fff640 1 -- 172.21.15.100:0/3904529086 wait complete. 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 Processor -- start 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 -- start start 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e406e4f0 0x7f01e4117ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e410dce0 0x7f01e4114b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e410e680 0x7f01e41150b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4111b00 con 0x7f01e410dce0 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4111980 con 0x7f01e410e680 2024-09-12T02:50:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.361+0000 7f01e3fff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4111c80 con 0x7f01e406e4f0 2024-09-12T02:50:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.362+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e410e680 0x7f01e41150b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.362+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e410e680 0x7f01e41150b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56334/0 (socket says 172.21.15.100:56334) 2024-09-12T02:50:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.362+0000 7f01e37fe640 1 -- 172.21.15.100:0/1578937482 learned_addr learned my addr 172.21.15.100:0/1578937482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.363+0000 7f01e2ffd640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e406e4f0 0x7f01e4117ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.364+0000 7f01e27fc640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e410dce0 0x7f01e4114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.364+0000 7f01e2ffd640 1 -- 172.21.15.100:0/1578937482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e410e680 msgr2=0x7f01e41150b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.364+0000 7f01e2ffd640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e410e680 0x7f01e41150b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.364+0000 7f01e2ffd640 1 -- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e410dce0 msgr2=0x7f01e4114b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.364+0000 7f01e2ffd640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e410dce0 0x7f01e4114b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.364+0000 7f01e2ffd640 1 -- 172.21.15.100:0/1578937482 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e4115970 con 0x7f01e406e4f0 2024-09-12T02:50:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.364+0000 7f01e2ffd640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e406e4f0 0x7f01e4117ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009fd0 tx=0x7f01d400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:41.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.366+0000 7f01dbfff640 1 -- 172.21.15.100:0/1578937482 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4015020 con 0x7f01e406e4f0 2024-09-12T02:50:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.366+0000 7f01dbfff640 1 -- 172.21.15.100:0/1578937482 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d4011d10 con 0x7f01e406e4f0 2024-09-12T02:50:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.366+0000 7f01dbfff640 1 -- 172.21.15.100:0/1578937482 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d400f2e0 con 0x7f01e406e4f0 2024-09-12T02:50:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.367+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e411d010 con 0x7f01e406e4f0 2024-09-12T02:50:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.367+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e411d580 con 0x7f01e406e4f0 2024-09-12T02:50:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.369+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e41096d0 con 0x7f01e406e4f0 2024-09-12T02:50:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.371+0000 7f01dbfff640 1 -- 172.21.15.100:0/1578937482 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f01d4018020 con 0x7f01e406e4f0 2024-09-12T02:50:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.371+0000 7f01dbfff640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01d00a2d90 0x7f01d00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.372+0000 7f01e27fc640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01d00a2d90 0x7f01d00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.372+0000 7f01dbfff640 1 -- 172.21.15.100:0/1578937482 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f01d40ce670 con 0x7f01e406e4f0 2024-09-12T02:50:41.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.372+0000 7f01e27fc640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01d00a2d90 0x7f01d00a5250 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f01cc006fd0 tx=0x7f01cc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:41.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.377+0000 7f01dbfff640 1 -- 172.21.15.100:0/1578937482 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01d409b560 con 0x7f01e406e4f0 2024-09-12T02:50:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.650+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01e411d8b0 con 0x7f01e406e4f0 2024-09-12T02:50:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.651+0000 7f01dbfff640 1 -- 172.21.15.100:0/1578937482 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f01d409ae60 con 0x7f01e406e4f0 2024-09-12T02:50:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:50:41.652 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:50:41.652 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01d00a2d90 msgr2=0x7f01d00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01d00a2d90 0x7f01d00a5250 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f01cc006fd0 tx=0x7f01cc008040 comp rx=0 tx=0).stop 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e406e4f0 msgr2=0x7f01e4117ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e406e4f0 0x7f01e4117ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009fd0 tx=0x7f01d400b870 comp rx=0 tx=0).stop 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 shutdown_connections 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f01d00a2d90 0x7f01d00a5250 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01e410e680 0x7f01e41150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e410dce0 0x7f01e4114b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 --2- 172.21.15.100:0/1578937482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e406e4f0 0x7f01e4117ac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.654+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 >> 172.21.15.100:0/1578937482 conn(0x7f01e4073180 msgr2=0x7f01e410bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.655+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 shutdown_connections 2024-09-12T02:50:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:41.655+0000 7f01e3fff640 1 -- 172.21.15.100:0/1578937482 wait complete. 2024-09-12T02:50:41.864 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:50:41.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:50:41.986 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:41 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1578937482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:50:42.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:41 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1578937482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:50:42.328 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 147.2 --await-for 45.0' 2024-09-12T02:50:42.328 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 147.2 --await-for 45.0 2024-09-12T02:50:42.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:41 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1578937482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:50:42.483 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:42.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:42 smithi100 ceph-mon[31390]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 850 op/s 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.989+0000 7f91f9ad5640 1 -- 172.21.15.100:0/3564797648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4102570 msgr2=0x7f91f41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.989+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/3564797648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4102570 0x7f91f41029b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009900 tx=0x7f91e802a480 comp rx=0 tx=0).stop 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.989+0000 7f91f9ad5640 1 -- 172.21.15.100:0/3564797648 shutdown_connections 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.989+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/3564797648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91f4102ef0 0x7f91f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.989+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/3564797648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4102570 0x7f91f41029b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.989+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/3564797648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91f4100e20 0x7f91f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.989+0000 7f91f9ad5640 1 -- 172.21.15.100:0/3564797648 >> 172.21.15.100:0/3564797648 conn(0x7f91f40fc7d0 msgr2=0x7f91f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.990+0000 7f91f9ad5640 1 -- 172.21.15.100:0/3564797648 shutdown_connections 2024-09-12T02:50:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.990+0000 7f91f9ad5640 1 -- 172.21.15.100:0/3564797648 wait complete. 2024-09-12T02:50:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.991+0000 7f91f9ad5640 1 Processor -- start 2024-09-12T02:50:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.991+0000 7f91f9ad5640 1 -- start start 2024-09-12T02:50:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.991+0000 7f91f9ad5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4100e20 0x7f91f4109e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.991+0000 7f91f9ad5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91f4102570 0x7f91f410a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.991+0000 7f91f9ad5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91f4102ef0 0x7f91f410a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f9ad5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410fe70 con 0x7f91f4100e20 2024-09-12T02:50:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f9ad5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410fcf0 con 0x7f91f4102ef0 2024-09-12T02:50:42.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f9ad5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410fff0 con 0x7f91f4102570 2024-09-12T02:50:42.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4100e20 0x7f91f4109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:42.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4100e20 0x7f91f4109e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42194/0 (socket says 172.21.15.100:42194) 2024-09-12T02:50:42.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f37fe640 1 -- 172.21.15.100:0/2288096805 learned_addr learned my addr 172.21.15.100:0/2288096805 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:42.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f37fe640 1 -- 172.21.15.100:0/2288096805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91f4102570 msgr2=0x7f91f410a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.992+0000 7f91f37fe640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91f4102570 0x7f91f410a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.993+0000 7f91f37fe640 1 -- 172.21.15.100:0/2288096805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91f4102ef0 msgr2=0x7f91f410a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.993+0000 7f91f37fe640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91f4102ef0 0x7f91f410a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.993+0000 7f91f37fe640 1 -- 172.21.15.100:0/2288096805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f41aad80 con 0x7f91f4100e20 2024-09-12T02:50:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.993+0000 7f91f37fe640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4100e20 0x7f91f4109e00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f91e400e9f0 tx=0x7f91e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.994+0000 7f91f0ff9640 1 -- 172.21.15.100:0/2288096805 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e400cd80 con 0x7f91f4100e20 2024-09-12T02:50:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.994+0000 7f91f0ff9640 1 -- 172.21.15.100:0/2288096805 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91e4005500 con 0x7f91f4100e20 2024-09-12T02:50:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.994+0000 7f91f0ff9640 1 -- 172.21.15.100:0/2288096805 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e4010690 con 0x7f91f4100e20 2024-09-12T02:50:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.995+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f41ab070 con 0x7f91f4100e20 2024-09-12T02:50:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:42.995+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f41ab530 con 0x7f91f4100e20 2024-09-12T02:50:43.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.007+0000 7f91f0ff9640 1 -- 172.21.15.100:0/2288096805 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f91e40046c0 con 0x7f91f4100e20 2024-09-12T02:50:43.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.008+0000 7f91fbeae740 1 Processor -- start 2024-09-12T02:50:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.011+0000 7f91f0ff9640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91dc0a2d50 0x7f91dc0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.012+0000 7f91f0ff9640 1 -- 172.21.15.100:0/2288096805 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f91e40cf5b0 con 0x7f91f4100e20 2024-09-12T02:50:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.013+0000 7f91fbeae740 1 -- start start 2024-09-12T02:50:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.013+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff76f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.013+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff81800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.013+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ff84130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.013+0000 7f91fbeae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c50fedc280 con 0x55c50ff77480 2024-09-12T02:50:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.013+0000 7f91fbeae740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c50fe83b10 con 0x55c50ff76b60 2024-09-12T02:50:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.013+0000 7f91fbeae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c50fed8240 con 0x55c50ff81d40 2024-09-12T02:50:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.014+0000 7f91f3fff640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91dc0a2d50 0x7f91dc0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.016+0000 7f91f2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff81800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.016+0000 7f91f2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff81800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42206/0 (socket says 172.21.15.100:42206) 2024-09-12T02:50:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.016+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1680765061 learned_addr learned my addr 172.21.15.100:0/1680765061 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.016+0000 7f91f3fff640 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ff84130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.016+0000 7f91f37fe640 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff76f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.017+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1680765061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 msgr2=0x55c50ff84130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.017+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ff84130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.017+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1680765061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 msgr2=0x55c50ff76f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.017+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff76f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.017+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1680765061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50fe901f0 con 0x55c50ff77480 2024-09-12T02:50:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.017+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff81800 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f91e80315d0 tx=0x7f91e8031600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795c510c522a97d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.017+0000 7f91f37fe640 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.018+0000 7f91d9ffb640 1 -- 172.21.15.100:0/1680765061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8040070 con 0x55c50ff77480 2024-09-12T02:50:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.018+0000 7f91d9ffb640 1 -- 172.21.15.100:0/1680765061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91e8004040 con 0x55c50ff77480 2024-09-12T02:50:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.018+0000 7f91d9ffb640 1 -- 172.21.15.100:0/1680765061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8035020 con 0x55c50ff77480 2024-09-12T02:50:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.018+0000 7f91f3fff640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91dc0a2d50 0x7f91dc0a5210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f91f410df50 tx=0x7f91ec009c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:43.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.020+0000 7f91fbeae740 1 -- 172.21.15.100:0/1680765061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 msgr2=0x55c50ff81800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:43.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.020+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff81800 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f91e80315d0 tx=0x7f91e8031600 comp rx=0 tx=0).stop 2024-09-12T02:50:43.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.021+0000 7f91fbeae740 1 -- 172.21.15.100:0/1680765061 shutdown_connections 2024-09-12T02:50:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.021+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ff84130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.021+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff81800 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.021+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1680765061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.021+0000 7f91fbeae740 1 -- 172.21.15.100:0/1680765061 >> 172.21.15.100:0/1680765061 conn(0x55c50ff730f0 msgr2=0x55c50ff734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.021+0000 7f91fbeae740 1 -- 172.21.15.100:0/1680765061 shutdown_connections 2024-09-12T02:50:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.021+0000 7f91fbeae740 1 -- 172.21.15.100:0/1680765061 wait complete. 2024-09-12T02:50:43.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 -- start start 2024-09-12T02:50:43.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 Processor -- start 2024-09-12T02:50:43.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff7f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c50ff7f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c50ff95920 con 0x55c50ff81d40 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c50fe96f10 con 0x55c50ff76b60 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c50ff95aa0 con 0x55c50ff77480 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.022+0000 7f91fbeae740 10 client.0 _ll_register_callbacks cb 0x55c50fe5fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.023+0000 7f91f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c50ff7f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.023+0000 7f91f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c50ff7f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42218/0 (socket says 172.21.15.100:42218) 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.023+0000 7f91f3fff640 1 -- 172.21.15.100:0/4165794076 learned_addr learned my addr 172.21.15.100:0/4165794076 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.023+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff7f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91f37fe640 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91f2ffd640 1 -- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 msgr2=0x55c50ff7ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff7ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91f2ffd640 1 -- 172.21.15.100:0/4165794076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 msgr2=0x55c50ff7f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c50ff7f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91f2ffd640 1 -- 172.21.15.100:0/4165794076 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c50fc4d6a0 con 0x55c50ff77480 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff7f1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91e802a9a0 tx=0x7f91e8004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9212cb31576b7230 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91d2ffd640 1 -- 172.21.15.100:0/4165794076 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8040070 con 0x55c50ff77480 2024-09-12T02:50:43.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91d2ffd640 1 -- 172.21.15.100:0/4165794076 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f91e8031670 con 0x55c50ff77480 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.024+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91e8004040 con 0x55c50ff77480 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91d2ffd640 1 -- 172.21.15.100:0/4165794076 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f91e8035040 con 0x55c50ff77480 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 10 client.26710 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c50ff95920 con 0x55c50ff77480 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91d2ffd640 1 -- 172.21.15.100:0/4165794076 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91e8004040 con 0x55c50ff77480 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91d2ffd640 1 -- 172.21.15.100:0/4165794076 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f91e8052050 con 0x55c50ff77480 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 10 client.26710 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 10 client.26710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 20 client.26710 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c50ffa26e0 0x55c50ffa4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 4 client.26710 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:43.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.025+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c50fee97f0 con 0x55c50ffa26e0 2024-09-12T02:50:43.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.026+0000 7f91f37fe640 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c50ffa26e0 0x55c50ffa4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.027+0000 7f91f37fe640 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c50ffa26e0 0x55c50ffa4ad0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6003cd25b34664a server_cookie=3ce9fae457063555 in_seq=0 out_seq=0 2024-09-12T02:50:43.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.027+0000 7f91d2ffd640 10 client.26710 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:43.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91d2ffd640 1 -- 172.21.15.100:0/4165794076 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c50fee97f0 con 0x55c50ffa26e0 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91d2ffd640 10 client.26710 handle_command_reply: tid=0 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 client.26710 shutdown 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 msgr2=0x55c50ff7f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff7f1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91e802a9a0 tx=0x7f91e8004980 comp rx=0 tx=0).stop 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 shutdown_connections 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c50ffa26e0 0x55c50ffa4ad0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c50ff7f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff7f1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 --2- 172.21.15.100:0/4165794076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91d2ffd640 0 client.26710 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 >> 172.21.15.100:0/4165794076 conn(0x55c50ff730f0 msgr2=0x55c50ff78e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.028+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 shutdown_connections 2024-09-12T02:50:43.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.029+0000 7f91fbeae740 1 -- 172.21.15.100:0/4165794076 wait complete. 2024-09-12T02:50:43.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.029+0000 7f91fbeae740 20 client.26710 trim_cache size 0 max 16384 2024-09-12T02:50:43.046 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 Processor -- start 2024-09-12T02:50:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 -- start start 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff795c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff7f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ffaa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41add30 con 0x55c50ff77480 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41a2880 con 0x55c50ff76b60 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91fbeae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91f4101200 con 0x55c50ff81d40 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91f2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff7f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91f37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff795c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91f2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff7f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42222/0 (socket says 172.21.15.100:42222) 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91f37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff795c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:56374/0 (socket says 172.21.15.100:56374) 2024-09-12T02:50:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1561918055 learned_addr learned my addr 172.21.15.100:0/1561918055 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.055+0000 7f91f3fff640 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ffaa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.056+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1561918055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 msgr2=0x55c50ffaa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.056+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ffaa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.056+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1561918055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 msgr2=0x55c50ff795c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.056+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff795c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.056+0000 7f91f2ffd640 1 -- 172.21.15.100:0/1561918055 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50ff772b0 con 0x55c50ff77480 2024-09-12T02:50:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.056+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff7f530 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f91e804b040 tx=0x7f91e8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef3d2651726de5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.058+0000 7f91d97fa640 1 -- 172.21.15.100:0/1561918055 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8040040 con 0x55c50ff77480 2024-09-12T02:50:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.058+0000 7f91d97fa640 1 -- 172.21.15.100:0/1561918055 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91e8003ad0 con 0x55c50ff77480 2024-09-12T02:50:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.058+0000 7f91d97fa640 1 -- 172.21.15.100:0/1561918055 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e803ce40 con 0x55c50ff77480 2024-09-12T02:50:43.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 -- 172.21.15.100:0/1561918055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 msgr2=0x55c50ff7f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:43.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff7f530 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f91e804b040 tx=0x7f91e8009800 comp rx=0 tx=0).stop 2024-09-12T02:50:43.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 -- 172.21.15.100:0/1561918055 shutdown_connections 2024-09-12T02:50:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff81d40 0x55c50ffaa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff77480 0x55c50ff7f530 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1561918055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff795c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 -- 172.21.15.100:0/1561918055 >> 172.21.15.100:0/1561918055 conn(0x55c50ff730f0 msgr2=0x55c50ff7dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 -- 172.21.15.100:0/1561918055 shutdown_connections 2024-09-12T02:50:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 -- 172.21.15.100:0/1561918055 wait complete. 2024-09-12T02:50:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.059+0000 7f91fbeae740 1 -- start start 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 1 Processor -- start 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff96d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c51000c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41a0d40 con 0x55c50ff81d40 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c51000c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c51000c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42238/0 (socket says 172.21.15.100:42238) 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91f3fff640 1 -- 172.21.15.100:0/1930300490 learned_addr learned my addr 172.21.15.100:0/1930300490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41a21b0 con 0x55c50ff76b60 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91f2ffd640 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91f37fe640 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff96d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41a1410 con 0x55c50ff77480 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.060+0000 7f91fbeae740 10 client.0 _ll_register_callbacks cb 0x7f91ec0145f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91f3fff640 1 -- 172.21.15.100:0/1930300490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 msgr2=0x55c50ff972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91f3fff640 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91f3fff640 1 -- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 msgr2=0x55c50ff96d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91f3fff640 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff96d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91f3fff640 1 -- 172.21.15.100:0/1930300490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c50ff97b50 con 0x55c50ff81d40 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91f3fff640 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c51000c190 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f91ec012ea0 tx=0x7f91ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ec1c0dead666 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91d2ffd640 1 -- 172.21.15.100:0/1930300490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec020ba0 con 0x55c50ff81d40 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91d2ffd640 1 -- 172.21.15.100:0/1930300490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f91ec01a030 con 0x55c50ff81d40 2024-09-12T02:50:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91e8003ad0 con 0x55c50ff81d40 2024-09-12T02:50:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91d2ffd640 1 -- 172.21.15.100:0/1930300490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f91ec020d40 con 0x55c50ff81d40 2024-09-12T02:50:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91fbeae740 10 client.17484 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.061+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c51000d7c0 con 0x55c50ff81d40 2024-09-12T02:50:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91d2ffd640 1 -- 172.21.15.100:0/1930300490 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91e8003ad0 con 0x55c50ff81d40 2024-09-12T02:50:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91d2ffd640 1 -- 172.21.15.100:0/1930300490 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f91ec0044c0 con 0x55c50ff81d40 2024-09-12T02:50:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91fbeae740 10 client.17484 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91fbeae740 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91fbeae740 20 client.17484 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c51000df10 0x55c510010350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91fbeae740 4 client.17484 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c50fee3d00 con 0x55c51000df10 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.062+0000 7f91f37fe640 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c51000df10 0x55c510010350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.063+0000 7f91f37fe640 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c51000df10 0x55c510010350 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd0bbb0ee644196 server_cookie=b8f01b7f537cfc3f in_seq=0 out_seq=0 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.063+0000 7f91d2ffd640 10 client.17484 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91d2ffd640 1 -- 172.21.15.100:0/1930300490 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c50fee3d00 con 0x55c51000df10 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91d2ffd640 10 client.17484 handle_command_reply: tid=0 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 client.17484 shutdown 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 msgr2=0x55c51000c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c51000c190 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f91ec012ea0 tx=0x7f91ec019000 comp rx=0 tx=0).stop 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 shutdown_connections 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55c51000df10 0x55c510010350 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c50ff81d40 0x55c51000c190 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c50ff77480 0x55c50ff972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 --2- 172.21.15.100:0/1930300490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c50ff76b60 0x55c50ff96d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 >> 172.21.15.100:0/1930300490 conn(0x55c50ff730f0 msgr2=0x55c50ff9db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91d2ffd640 0 client.17484 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 shutdown_connections 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.064+0000 7f91fbeae740 1 -- 172.21.15.100:0/1930300490 wait complete. 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91fbeae740 20 client.17484 trim_cache size 0 max 16384 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "13453b0f-6b28-49a8-88a0-dbd84df4e5bc", 2024-09-12T02:50:43.067 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:50:43.068 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:50:43.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91dc0a2d50 msgr2=0x7f91dc0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:43.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91dc0a2d50 0x7f91dc0a5210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f91f410df50 tx=0x7f91ec009c90 comp rx=0 tx=0).stop 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4100e20 msgr2=0x7f91f4109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4100e20 0x7f91f4109e00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f91e400e9f0 tx=0x7f91e400edf0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 shutdown_connections 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91dc0a2d50 0x7f91dc0a5210 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91f4102ef0 0x7f91f410a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91f4102570 0x7f91f410a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 --2- 172.21.15.100:0/2288096805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f4100e20 0x7f91f4109e00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.065+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 >> 172.21.15.100:0/2288096805 conn(0x7f91f40fc7d0 msgr2=0x7f91f40fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.066+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 shutdown_connections 2024-09-12T02:50:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:43.066+0000 7f91f9ad5640 1 -- 172.21.15.100:0/2288096805 wait complete. 2024-09-12T02:50:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:42 smithi189 ceph-mon[35196]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 850 op/s 2024-09-12T02:50:43.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:42 smithi117 ceph-mon[34898]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 850 op/s 2024-09-12T02:50:44.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:43 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:50:44.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:43 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:43 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:50:44.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:43 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:50:44.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:43 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:43 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:43 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:50:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:43 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:43 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:50:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:43 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:50:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:43 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:43 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:43 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:50:44.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:43 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:43 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:50:44.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:43 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:50:44.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:43 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:43 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:50:44.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 -- 172.21.15.100:0/1025122845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720100a70 msgr2=0x7f6720100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 --2- 172.21.15.100:0/1025122845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720100a70 0x7f6720100ed0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f6710009930 tx=0x7f671002a420 comp rx=0 tx=0).stop 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 -- 172.21.15.100:0/1025122845 shutdown_connections 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 --2- 172.21.15.100:0/1025122845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6720101410 0x7f672010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 --2- 172.21.15.100:0/1025122845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720100a70 0x7f6720100ed0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 --2- 172.21.15.100:0/1025122845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6720106a70 0x7f6720106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 -- 172.21.15.100:0/1025122845 >> 172.21.15.100:0/1025122845 conn(0x7f67200fc790 msgr2=0x7f67200febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 -- 172.21.15.100:0/1025122845 shutdown_connections 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.623+0000 7f67272fb640 1 -- 172.21.15.100:0/1025122845 wait complete. 2024-09-12T02:50:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 Processor -- start 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 -- start start 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6720100a70 0x7f672019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720101410 0x7f672019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6720106a70 0x7f672019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6720110e30 con 0x7f6720101410 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6720110cb0 con 0x7f6720100a70 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f67272fb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6720110fb0 con 0x7f6720106a70 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f6724896640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720101410 0x7f672019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f6724896640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720101410 0x7f672019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59428/0 (socket says 172.21.15.100:59428) 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f6724896640 1 -- 172.21.15.100:0/2463689424 learned_addr learned my addr 172.21.15.100:0/2463689424 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.624+0000 7f6725898640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6720106a70 0x7f672019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6725097640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6720100a70 0x7f672019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6724896640 1 -- 172.21.15.100:0/2463689424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6720106a70 msgr2=0x7f672019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6724896640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6720106a70 0x7f672019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6724896640 1 -- 172.21.15.100:0/2463689424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6720100a70 msgr2=0x7f672019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6724896640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6720100a70 0x7f672019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6724896640 1 -- 172.21.15.100:0/2463689424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672019f5a0 con 0x7f6720101410 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6725097640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6720100a70 0x7f672019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6725898640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6720106a70 0x7f672019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f6724896640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720101410 0x7f672019ab30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6710009230 tx=0x7f6710004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f67167fc640 1 -- 172.21.15.100:0/2463689424 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671003f030 con 0x7f6720101410 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672019f830 con 0x7f6720101410 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f67167fc640 1 -- 172.21.15.100:0/2463689424 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6710003ad0 con 0x7f6720101410 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f67167fc640 1 -- 172.21.15.100:0/2463689424 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710035070 con 0x7f6720101410 2024-09-12T02:50:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.625+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67201a7170 con 0x7f6720101410 2024-09-12T02:50:44.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.629+0000 7f67167fc640 1 -- 172.21.15.100:0/2463689424 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6710042030 con 0x7f6720101410 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 Processor -- start 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 -- start start 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf049760 0x55d1cf049b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf054400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf056d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d1cefaf2a0 con 0x55d1cf054940 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d1cef56b10 con 0x55d1cf04a080 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67296d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d1cefab260 con 0x55d1cf049760 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f67167fc640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f670c0a2b80 0x7f670c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f6724896640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf056d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f6725898640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf049760 0x55d1cf049b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f6725898640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf049760 0x55d1cf049b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43244/0 (socket says 172.21.15.100:43244) 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.630+0000 7f6725898640 1 -- 172.21.15.100:0/1181118437 learned_addr learned my addr 172.21.15.100:0/1181118437 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725097640 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf054400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f670c0a2b80 0x7f670c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f67167fc640 1 -- 172.21.15.100:0/2463689424 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f67100ef3a0 con 0x7f6720101410 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 -- 172.21.15.100:0/1181118437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 msgr2=0x55d1cf054400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf054400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 -- 172.21.15.100:0/1181118437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 msgr2=0x55d1cf056d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf056d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 -- 172.21.15.100:0/1181118437 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ced20b90 con 0x55d1cf049760 2024-09-12T02:50:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf049760 0x55d1cf049b40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6718012e40 tx=0x7f6718010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c2d4cf7d39110c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f6725898640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f670c0a2b80 0x7f670c0a5040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f671801b000 tx=0x7f671801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.631+0000 7f670b7fe640 1 -- 172.21.15.100:0/1181118437 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718011dc0 con 0x55d1cf049760 2024-09-12T02:50:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.632+0000 7f670b7fe640 1 -- 172.21.15.100:0/1181118437 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f671801d8e0 con 0x55d1cf049760 2024-09-12T02:50:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.632+0000 7f670b7fe640 1 -- 172.21.15.100:0/1181118437 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671801c6e0 con 0x55d1cf049760 2024-09-12T02:50:44.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.632+0000 7f67296d4740 1 -- 172.21.15.100:0/1181118437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf049760 msgr2=0x55d1cf049b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:44.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.632+0000 7f67296d4740 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf049760 0x55d1cf049b40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6718012e40 tx=0x7f6718010740 comp rx=0 tx=0).stop 2024-09-12T02:50:44.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.633+0000 7f67296d4740 1 -- 172.21.15.100:0/1181118437 shutdown_connections 2024-09-12T02:50:44.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.634+0000 7f67296d4740 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf056d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.634+0000 7f67296d4740 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf054400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.634+0000 7f67296d4740 1 --2- 172.21.15.100:0/1181118437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf049760 0x55d1cf049b40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.634+0000 7f67296d4740 1 -- 172.21.15.100:0/1181118437 >> 172.21.15.100:0/1181118437 conn(0x55d1cf045cf0 msgr2=0x55d1cf0460d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.634+0000 7f67296d4740 1 -- 172.21.15.100:0/1181118437 shutdown_connections 2024-09-12T02:50:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.634+0000 7f67296d4740 1 -- 172.21.15.100:0/1181118437 wait complete. 2024-09-12T02:50:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.635+0000 7f67296d4740 1 -- start start 2024-09-12T02:50:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.635+0000 7f67296d4740 1 Processor -- start 2024-09-12T02:50:44.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f67296d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf049760 0x55d1cf051750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f67296d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf051c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f67296d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf054940 0x55d1cf0521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f6725097640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf049760 0x55d1cf051750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f6725097640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf049760 0x55d1cf051750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59436/0 (socket says 172.21.15.100:59436) 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f6725097640 1 -- 172.21.15.100:0/4022372355 learned_addr learned my addr 172.21.15.100:0/4022372355 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f6725898640 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf054940 0x55d1cf0521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f6724896640 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf0575b0 con 0x55d1cf049760 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d1cef376e0 con 0x55d1cf04a080 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf057730 con 0x55d1cf054940 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.636+0000 7f67296d4740 10 client.0 _ll_register_callbacks cb 0x55d1cef5ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6725097640 1 -- 172.21.15.100:0/4022372355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf054940 msgr2=0x55d1cf0521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6725097640 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf054940 0x55d1cf0521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6725097640 1 -- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 msgr2=0x55d1cf051c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6725097640 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf051c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6725097640 1 -- 172.21.15.100:0/4022372355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1cf060ab0 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6725097640 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf049760 0x55d1cf051750 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f671c010810 tx=0x7f671c010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6615660a75688f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6708ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6708ff9640 1 -- 172.21.15.100:0/4022372355 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c00ed40 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f671801d8e0 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6708ff9640 1 -- 172.21.15.100:0/4022372355 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f671c01c480 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f6708ff9640 1 -- 172.21.15.100:0/4022372355 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f671c01c680 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f67296d4740 10 client.17496 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.637+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1cf063470 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f6708ff9640 1 -- 172.21.15.100:0/4022372355 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f671801d8e0 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f6708ff9640 1 -- 172.21.15.100:0/4022372355 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f671c0118b0 con 0x55d1cf049760 2024-09-12T02:50:44.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f67296d4740 10 client.17496 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:44.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f67296d4740 10 client.17496 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:50:44.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f67296d4740 20 client.17496 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:44.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f67296d4740 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf064c70 0x55d1cf067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f67296d4740 4 client.17496 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:44.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1cefbc9d0 con 0x55d1cf064c70 2024-09-12T02:50:44.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.638+0000 7f6724896640 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf064c70 0x55d1cf067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f6724896640 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf064c70 0x55d1cf067110 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33c5332d6031cc0e server_cookie=5cc1a21be5ee95d6 in_seq=0 out_seq=0 2024-09-12T02:50:44.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f6708ff9640 10 client.17496 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:44.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f6708ff9640 1 -- 172.21.15.100:0/4022372355 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1cefbc9d0 con 0x55d1cf064c70 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f6708ff9640 10 client.17496 handle_command_reply: tid=0 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f67296d4740 1 client.17496 shutdown 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf049760 msgr2=0x55d1cf051750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f67296d4740 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf049760 0x55d1cf051750 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f671c010810 tx=0x7f671c010cd0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 shutdown_connections 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.639+0000 7f67296d4740 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf064c70 0x55d1cf067110 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.640+0000 7f67296d4740 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf054940 0x55d1cf0521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.640+0000 7f67296d4740 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf04a080 0x55d1cf051c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.640+0000 7f67296d4740 1 --2- 172.21.15.100:0/4022372355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf049760 0x55d1cf051750 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.640+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 >> 172.21.15.100:0/4022372355 conn(0x55d1cf045cf0 msgr2=0x55d1cf04ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.640+0000 7f6708ff9640 0 client.17496 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.640+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 shutdown_connections 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.640+0000 7f67296d4740 1 -- 172.21.15.100:0/4022372355 wait complete. 2024-09-12T02:50:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.641+0000 7f67296d4740 20 client.17496 trim_cache size 0 max 16384 2024-09-12T02:50:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.664+0000 7f67296d4740 1 Processor -- start 2024-09-12T02:50:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.664+0000 7f67296d4740 1 -- start start 2024-09-12T02:50:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f67296d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 0x55d1cf0536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f67296d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf06ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f67296d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf06cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f67296d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6704010d40 con 0x55d1cf054940 2024-09-12T02:50:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f67296d4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f670400e610 con 0x55d1cf049760 2024-09-12T02:50:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f67296d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f670400c460 con 0x55d1cf04a080 2024-09-12T02:50:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf06ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf06ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:43262/0 (socket says 172.21.15.100:43262) 2024-09-12T02:50:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 -- 172.21.15.100:0/2718173741 learned_addr learned my addr 172.21.15.100:0/2718173741 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6725898640 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf06cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 -- 172.21.15.100:0/2718173741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 msgr2=0x55d1cf0536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 0x55d1cf0536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 -- 172.21.15.100:0/2718173741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 msgr2=0x55d1cf06cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf06cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.665+0000 7f6724896640 1 -- 172.21.15.100:0/2718173741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1cf045b20 con 0x55d1cf04a080 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.666+0000 7f6724896640 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf06ca20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f67100ed200 tx=0x7f671008ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34127e4003f3f736 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.666+0000 7f670affd640 1 -- 172.21.15.100:0/2718173741 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710049040 con 0x55d1cf04a080 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.666+0000 7f670affd640 1 -- 172.21.15.100:0/2718173741 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67100a6040 con 0x55d1cf04a080 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.666+0000 7f670affd640 1 -- 172.21.15.100:0/2718173741 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67100b8260 con 0x55d1cf04a080 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 -- 172.21.15.100:0/2718173741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 msgr2=0x55d1cf06ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf06ca20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f67100ed200 tx=0x7f671008ecb0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 -- 172.21.15.100:0/2718173741 shutdown_connections 2024-09-12T02:50:44.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf06cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf06ca20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 --2- 172.21.15.100:0/2718173741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 0x55d1cf0536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 -- 172.21.15.100:0/2718173741 >> 172.21.15.100:0/2718173741 conn(0x55d1cf045cf0 msgr2=0x55d1cf052fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 -- 172.21.15.100:0/2718173741 shutdown_connections 2024-09-12T02:50:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 -- 172.21.15.100:0/2718173741 wait complete. 2024-09-12T02:50:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.667+0000 7f67296d4740 1 -- start start 2024-09-12T02:50:44.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 1 Processor -- start 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 0x55d1cf05cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf058310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf058850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f670400cad0 con 0x55d1cf054940 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f670400df40 con 0x55d1cf049760 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f670400d1a0 con 0x55d1cf04a080 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.668+0000 7f67296d4740 10 client.0 _ll_register_callbacks cb 0x7f671c0103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6725898640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf058850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6725898640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf058850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59462/0 (socket says 172.21.15.100:59462) 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6725898640 1 -- 172.21.15.100:0/179460554 learned_addr learned my addr 172.21.15.100:0/179460554 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6724896640 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf058310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6725097640 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 0x55d1cf05cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6724896640 1 -- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 msgr2=0x55d1cf05cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6724896640 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 0x55d1cf05cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6724896640 1 -- 172.21.15.100:0/179460554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 msgr2=0x55d1cf058850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6724896640 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf058850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.669+0000 7f6724896640 1 -- 172.21.15.100:0/179460554 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1cf041260 con 0x55d1cf04a080 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f6724896640 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf058310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55d1cf045740 tx=0x7f6710009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa482770c50e0c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f6708ff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f6708ff9640 1 -- 172.21.15.100:0/179460554 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710049040 con 0x55d1cf04a080 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f6708ff9640 1 -- 172.21.15.100:0/179460554 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6710003c80 con 0x55d1cf04a080 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67100a6040 con 0x55d1cf04a080 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f6708ff9640 1 -- 172.21.15.100:0/179460554 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67100c4860 con 0x55d1cf04a080 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f67296d4740 10 client.26734 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.670+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1cf0e0680 con 0x55d1cf04a080 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f6708ff9640 1 -- 172.21.15.100:0/179460554 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67100a6040 con 0x55d1cf04a080 2024-09-12T02:50:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f6708ff9640 1 -- 172.21.15.100:0/179460554 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6710031bd0 con 0x55d1cf04a080 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f67296d4740 10 client.26734 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f67296d4740 10 client.26734 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f67296d4740 20 client.26734 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f67296d4740 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf0e0e00 0x55d1cf0e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f67296d4740 4 client.26734 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.2, "await_for": 45.0}] 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.671+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.2, "await_for": 45.0}) -- 0x55d1cefb6d20 con 0x55d1cf0e0e00 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.672+0000 7f6725097640 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf0e0e00 0x55d1cf0e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.672+0000 7f6725097640 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf0e0e00 0x55d1cf0e3220 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6046f1f4a253b92d server_cookie=a296e71737e2459d in_seq=0 out_seq=0 2024-09-12T02:50:44.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.672+0000 7f6708ff9640 10 client.26734 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:44.774 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:50:44.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.993+0000 7f6708ff9640 1 -- 172.21.15.100:0/179460554 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d1cefb6d20 con 0x55d1cf0e0e00 2024-09-12T02:50:44.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.993+0000 7f6708ff9640 10 client.26734 handle_command_reply: tid=0 2024-09-12T02:50:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.993+0000 7f67296d4740 1 client.26734 shutdown 2024-09-12T02:50:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 msgr2=0x55d1cf058310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf058310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55d1cf045740 tx=0x7f6710009260 comp rx=0 tx=0).stop 2024-09-12T02:50:44.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:44 smithi100 ceph-mon[31390]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 903 op/s 2024-09-12T02:50:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 shutdown_connections 2024-09-12T02:50:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55d1cf0e0e00 0x55d1cf0e3220 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1cf054940 0x55d1cf058850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d1cf04a080 0x55d1cf058310 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f6708ff9640 0 client.26734 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 --2- 172.21.15.100:0/179460554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1cf049760 0x55d1cf05cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 >> 172.21.15.100:0/179460554 conn(0x55d1cf045cf0 msgr2=0x55d1cf044e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 shutdown_connections 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 1 -- 172.21.15.100:0/179460554 wait complete. 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.994+0000 7f67296d4740 20 client.26734 trim_cache size 0 max 16384 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 46, 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:50:44.997 INFO:teuthology.orchestra.run.smithi100.stdout: "a38cb0a5": { 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 46, 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 147.2, 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:50:44.998 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:50:44.999 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:50:44.999 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:50:44.999 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:50:44.999 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:50:44.999 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:50:44.999 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:50:44.999 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f670c0a2b80 msgr2=0x7f670c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f670c0a2b80 0x7f670c0a5040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f671801b000 tx=0x7f671801d000 comp rx=0 tx=0).stop 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720101410 msgr2=0x7f672019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720101410 0x7f672019ab30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6710009230 tx=0x7f6710004270 comp rx=0 tx=0).stop 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 shutdown_connections 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f670c0a2b80 0x7f670c0a5040 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6720106a70 0x7f672019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6720101410 0x7f672019ab30 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 --2- 172.21.15.100:0/2463689424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6720100a70 0x7f672019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 >> 172.21.15.100:0/2463689424 conn(0x7f67200fc790 msgr2=0x7f672006a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 shutdown_connections 2024-09-12T02:50:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:44.995+0000 7f67272fb640 1 -- 172.21.15.100:0/2463689424 wait complete. 2024-09-12T02:50:45.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:44 smithi189 ceph-mon[35196]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 903 op/s 2024-09-12T02:50:45.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:44 smithi117 ceph-mon[34898]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 903 op/s 2024-09-12T02:50:45.654 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a38cb0a5', quiesce took 6.3 seconds. Will release after: 20.9 2024-09-12T02:50:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 -- 172.21.15.100:0/683999460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141068d0 msgr2=0x7fd214106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 --2- 172.21.15.100:0/683999460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141068d0 0x7fd214106cb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009930 tx=0x7fd20c02a420 comp rx=0 tx=0).stop 2024-09-12T02:50:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 -- 172.21.15.100:0/683999460 shutdown_connections 2024-09-12T02:50:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 --2- 172.21.15.100:0/683999460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd214101270 0x7fd21410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 --2- 172.21.15.100:0/683999460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2141008d0 0x7fd214100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 --2- 172.21.15.100:0/683999460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141068d0 0x7fd214106cb0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 -- 172.21.15.100:0/683999460 >> 172.21.15.100:0/683999460 conn(0x7fd2140fc630 msgr2=0x7fd2140fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 -- 172.21.15.100:0/683999460 shutdown_connections 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.826+0000 7fd21359e640 1 -- 172.21.15.100:0/683999460 wait complete. 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 Processor -- start 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 -- start start 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141008d0 0x7fd21410e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd214101270 0x7fd21410e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2141068d0 0x7fd21410ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd214111df0 con 0x7fd2141008d0 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd214111c70 con 0x7fd2141068d0 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21359e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd214111f70 con 0x7fd214101270 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141008d0 0x7fd21410e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd211d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd214101270 0x7fd21410e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141008d0 0x7fd21410e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59478/0 (socket says 172.21.15.100:59478) 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 -- 172.21.15.100:0/1714713133 learned_addr learned my addr 172.21.15.100:0/1714713133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd212d9d640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2141068d0 0x7fd21410ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 -- 172.21.15.100:0/1714713133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd214101270 msgr2=0x7fd21410e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd214101270 0x7fd21410e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 -- 172.21.15.100:0/1714713133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2141068d0 msgr2=0x7fd21410ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2141068d0 0x7fd21410ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 -- 172.21.15.100:0/1714713133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2141a6710 con 0x7fd2141008d0 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.827+0000 7fd21259c640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141008d0 0x7fd21410e230 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009230 tx=0x7fd20c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.828+0000 7fd20b7fe640 1 -- 172.21.15.100:0/1714713133 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c03f030 con 0x7fd2141008d0 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.828+0000 7fd20b7fe640 1 -- 172.21.15.100:0/1714713133 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd20c003ad0 con 0x7fd2141008d0 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.828+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2141a69a0 con 0x7fd2141008d0 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.828+0000 7fd20b7fe640 1 -- 172.21.15.100:0/1714713133 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c035070 con 0x7fd2141008d0 2024-09-12T02:50:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.828+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2141a6e80 con 0x7fd2141008d0 2024-09-12T02:50:45.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.830+0000 7fd20b7fe640 1 -- 172.21.15.100:0/1714713133 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fd20c042030 con 0x7fd2141008d0 2024-09-12T02:50:45.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.830+0000 7fd21b1dd740 1 Processor -- start 2024-09-12T02:50:45.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.830+0000 7fd21b1dd740 1 -- start start 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda478a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda483310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd20b7fe640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2000a2b80 0x7fd2000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda485c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564fda3de2e0 con 0x564fda483850 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564fda385ce0 con 0x564fda478f90 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564fda3da2a0 con 0x564fda478670 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda485c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda485c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59492/0 (socket says 172.21.15.100:59492) 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 -- 172.21.15.100:0/3643936665 learned_addr learned my addr 172.21.15.100:0/3643936665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21259c640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2000a2b80 0x7fd2000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd211d9b640 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda483310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda478a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd20b7fe640 1 -- 172.21.15.100:0/1714713133 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd20c0ef4f0 con 0x7fd2141008d0 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 -- 172.21.15.100:0/3643936665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 msgr2=0x564fda478a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda478a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 -- 172.21.15.100:0/3643936665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 msgr2=0x564fda483310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda483310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 -- 172.21.15.100:0/3643936665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fda36a440 con 0x564fda483850 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd21259c640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2000a2b80 0x7fd2000a5040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd20c04a000 tx=0x7fd20c02a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.831+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda485c40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd204012a30 tx=0x7fd204009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818adc3380d451cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:45.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd208ff9640 1 -- 172.21.15.100:0/3643936665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204003970 con 0x564fda483850 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd208ff9640 1 -- 172.21.15.100:0/3643936665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd204010770 con 0x564fda483850 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd208ff9640 1 -- 172.21.15.100:0/3643936665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204004390 con 0x564fda483850 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3643936665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 msgr2=0x564fda485c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda485c40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd204012a30 tx=0x7fd204009aa0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3643936665 shutdown_connections 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda485c40 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda483310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3643936665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda478a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.832+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3643936665 >> 172.21.15.100:0/3643936665 conn(0x564fda474c00 msgr2=0x564fda474fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3643936665 shutdown_connections 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3643936665 wait complete. 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 -- start start 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 Processor -- start 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda483220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda4804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda483850 0x564fda480ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564fda486420 con 0x564fda478f90 2024-09-12T02:50:45.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564fda399050 con 0x564fda483850 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564fda4865a0 con 0x564fda478670 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd21b1dd740 10 client.0 _ll_register_callbacks cb 0x564fda3d9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd211d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda4804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd211d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda4804d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59496/0 (socket says 172.21.15.100:59496) 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.833+0000 7fd211d9b640 1 -- 172.21.15.100:0/3326031039 learned_addr learned my addr 172.21.15.100:0/3326031039 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda483220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd211d9b640 1 -- 172.21.15.100:0/3326031039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 msgr2=0x564fda483220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda483850 0x564fda480ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd211d9b640 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda483220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd211d9b640 1 -- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda483850 msgr2=0x564fda480ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd211d9b640 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda483850 0x564fda480ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd211d9b640 1 -- 172.21.15.100:0/3326031039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fda14f3c0 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd211d9b640 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda4804d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00bad0 tx=0x7fd1fc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268a3e4d61d81416 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd1f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/3326031039 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc003e20 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/3326031039 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd1fc011440 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd204010770 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/3326031039 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1fc005020 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd21b1dd740 10 client.17511 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564fda491ee0 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.834+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/3326031039 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd204010770 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/3326031039 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd1fc011640 con 0x564fda478f90 2024-09-12T02:50:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd21b1dd740 10 client.17511 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd21b1dd740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd21b1dd740 20 client.17511 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda493440 0x564fda495880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd21b1dd740 4 client.17511 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fda3eb850 con 0x564fda493440 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda493440 0x564fda495880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda493440 0x564fda495880 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dca73daf5d19fe server_cookie=6e9ffa56d75a9bde in_seq=0 out_seq=0 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.835+0000 7fd1f9ffb640 10 client.17511 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/3326031039 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fda3eb850 con 0x564fda493440 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd1f9ffb640 10 client.17511 handle_command_reply: tid=0 2024-09-12T02:50:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 client.17511 shutdown 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 msgr2=0x564fda4804d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda4804d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00bad0 tx=0x7fd1fc00bf90 comp rx=0 tx=0).stop 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 shutdown_connections 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda493440 0x564fda495880 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda483850 0x564fda480ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda4804d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd1f9ffb640 0 client.17511 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3326031039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda483220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 >> 172.21.15.100:0/3326031039 conn(0x564fda474c00 msgr2=0x564fda47a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 shutdown_connections 2024-09-12T02:50:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3326031039 wait complete. 2024-09-12T02:50:45.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.836+0000 7fd21b1dd740 20 client.17511 trim_cache size 0 max 16384 2024-09-12T02:50:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 Processor -- start 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 -- start start 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda48f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda4823a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda49b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141b1ea0 con 0x564fda483850 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141af770 con 0x564fda478f90 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141ad5c0 con 0x564fda478670 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd212d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda49b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd212d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda49b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59502/0 (socket says 172.21.15.100:59502) 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd212d9d640 1 -- 172.21.15.100:0/3312746036 learned_addr learned my addr 172.21.15.100:0/3312746036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.853+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda48f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd211d9b640 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda4823a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd212d9d640 1 -- 172.21.15.100:0/3312746036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 msgr2=0x564fda48f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda48f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd212d9d640 1 -- 172.21.15.100:0/3312746036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 msgr2=0x564fda4823a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda4823a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd212d9d640 1 -- 172.21.15.100:0/3312746036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fda4784a0 con 0x564fda483850 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd211d9b640 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda4823a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd212d9d640 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda49b150 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd204012a30 tx=0x7fd204009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0c7c15291dffe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd1fbfff640 1 -- 172.21.15.100:0/3312746036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204010ce0 con 0x564fda483850 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd1fbfff640 1 -- 172.21.15.100:0/3312746036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd204003e50 con 0x564fda483850 2024-09-12T02:50:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd1fbfff640 1 -- 172.21.15.100:0/3312746036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20401f420 con 0x564fda483850 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3312746036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 msgr2=0x564fda49b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.854+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda49b150 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd204012a30 tx=0x7fd204009aa0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3312746036 shutdown_connections 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda483850 0x564fda49b150 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478f90 0x564fda4823a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/3312746036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda478670 0x564fda48f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3312746036 >> 172.21.15.100:0/3312746036 conn(0x564fda474c00 msgr2=0x564fda47ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3312746036 shutdown_connections 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- 172.21.15.100:0/3312746036 wait complete. 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- start start 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 Processor -- start 2024-09-12T02:50:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478670 0x564fda48bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda48c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda483850 0x564fda4888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141adc30 con 0x564fda478f90 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141af0a0 con 0x564fda478670 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141ae300 con 0x564fda483850 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd21b1dd740 10 client.0 _ll_register_callbacks cb 0x7fd1fc004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd211d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda48c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd211d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda48c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59504/0 (socket says 172.21.15.100:59504) 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.855+0000 7fd211d9b640 1 -- 172.21.15.100:0/1273161222 learned_addr learned my addr 172.21.15.100:0/1273161222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd212d9d640 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478670 0x564fda48bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd212d9d640 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda483850 0x564fda4888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd211d9b640 1 -- 172.21.15.100:0/1273161222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda483850 msgr2=0x564fda4888e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd211d9b640 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda483850 0x564fda4888e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd211d9b640 1 -- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478670 msgr2=0x564fda48bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd211d9b640 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478670 0x564fda48bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd211d9b640 1 -- 172.21.15.100:0/1273161222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fda4890e0 con 0x564fda478f90 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd211d9b640 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda48c0a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc011b30 tx=0x7fd1fc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5366e693c65ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd1f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/1273161222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc02a070 con 0x564fda478f90 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/1273161222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd1fc004300 con 0x564fda478f90 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd204003e50 con 0x564fda478f90 2024-09-12T02:50:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/1273161222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1fc0051c0 con 0x564fda478f90 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd21b1dd740 10 client.17517 fetch_fsmap learned FSMap version 27 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564fda4fed00 con 0x564fda478f90 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/1273161222 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd204003e50 con 0x564fda478f90 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/1273161222 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd1fc038050 con 0x564fda478f90 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd21b1dd740 10 client.17517 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd21b1dd740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.856+0000 7fd21b1dd740 20 client.17517 populate_metadata read hostname 'smithi100' 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda4ff320 0x564fda501740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 4 client.17517 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564fda3e5d60 con 0x564fda4ff320 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd212d9d640 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda4ff320 0x564fda501740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd1f9ffb640 10 client.17517 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd212d9d640 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda4ff320 0x564fda501740 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=447c43da62a577dc server_cookie=5b6091b8d47d2ece in_seq=0 out_seq=0 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd1f9ffb640 1 -- 172.21.15.100:0/1273161222 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564fda3e5d60 con 0x564fda4ff320 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd1f9ffb640 10 client.17517 handle_command_reply: tid=0 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 client.17517 shutdown 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 msgr2=0x564fda48c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda48c0a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc011b30 tx=0x7fd1fc00b480 comp rx=0 tx=0).stop 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 shutdown_connections 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x564fda4ff320 0x564fda501740 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fda483850 0x564fda4888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fda478f90 0x564fda48c0a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 --2- 172.21.15.100:0/1273161222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564fda478670 0x564fda48bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 >> 172.21.15.100:0/1273161222 conn(0x564fda474c00 msgr2=0x564fda473500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.857+0000 7fd1f9ffb640 0 client.17517 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 shutdown_connections 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21b1dd740 1 -- 172.21.15.100:0/1273161222 wait complete. 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21b1dd740 20 client.17517 trim_cache size 0 max 16384 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:50:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:50:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "13453b0f-6b28-49a8-88a0-dbd84df4e5bc": { 2024-09-12T02:50:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:50:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "13453b0f-6b28-49a8-88a0-dbd84df4e5bc", 2024-09-12T02:50:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:50:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:50:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:50:45.867 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:50:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2000a2b80 msgr2=0x7fd2000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2000a2b80 0x7fd2000a5040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd20c04a000 tx=0x7fd20c02a420 comp rx=0 tx=0).stop 2024-09-12T02:50:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141008d0 msgr2=0x7fd21410e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141008d0 0x7fd21410e230 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009230 tx=0x7fd20c004270 comp rx=0 tx=0).stop 2024-09-12T02:50:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 shutdown_connections 2024-09-12T02:50:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd2000a2b80 0x7fd2000a5040 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2141068d0 0x7fd21410ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd214101270 0x7fd21410e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 --2- 172.21.15.100:0/1714713133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2141008d0 0x7fd21410e230 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 >> 172.21.15.100:0/1714713133 conn(0x7fd2140fc630 msgr2=0x7fd2140fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 shutdown_connections 2024-09-12T02:50:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:50:45.858+0000 7fd21359e640 1 -- 172.21.15.100:0/1714713133 wait complete. 2024-09-12T02:50:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 695.0 s, 1333.4 tps, lat 51.244 ms stddev 54.893 2024-09-12T02:50:46.602 INFO:tasks.cephfs.filesystem:scrub status for tag:13453b0f-6b28-49a8-88a0-dbd84df4e5bc - {'path': '/', 'tag': '13453b0f-6b28-49a8-88a0-dbd84df4e5bc', 'options': 'recursive,force'} 2024-09-12T02:50:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:46 smithi100 ceph-mon[31390]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.6 MiB/s wr, 767 op/s 2024-09-12T02:50:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:46 smithi189 ceph-mon[35196]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.6 MiB/s wr, 767 op/s 2024-09-12T02:50:47.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:46 smithi117 ceph-mon[34898]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.6 MiB/s wr, 767 op/s 2024-09-12T02:50:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:48 smithi100 ceph-mon[31390]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 621 op/s 2024-09-12T02:50:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:48 smithi189 ceph-mon[35196]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 621 op/s 2024-09-12T02:50:49.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:48 smithi117 ceph-mon[34898]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 621 op/s 2024-09-12T02:50:50.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:49 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:50:50.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:49 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:50:50.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:49 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:50:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:50 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:50:51.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:50 smithi189 ceph-mon[35196]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 544 op/s 2024-09-12T02:50:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:50:51.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:50 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:50:51.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:50 smithi117 ceph-mon[34898]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 544 op/s 2024-09-12T02:50:51.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:50 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:50:51.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:50 smithi100 ceph-mon[31390]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 544 op/s 2024-09-12T02:50:52.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:51 smithi189 ceph-mon[35196]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.4 MiB/s wr, 382 op/s 2024-09-12T02:50:52.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:51 smithi117 ceph-mon[34898]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.4 MiB/s wr, 382 op/s 2024-09-12T02:50:52.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:51 smithi100 ceph-mon[31390]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.4 MiB/s wr, 382 op/s 2024-09-12T02:50:55.098 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:54 smithi117 ceph-mon[34898]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.7 MiB/s wr, 293 op/s 2024-09-12T02:50:55.127 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:54 smithi100 ceph-mon[31390]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.7 MiB/s wr, 293 op/s 2024-09-12T02:50:55.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:54 smithi189 ceph-mon[35196]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.7 MiB/s wr, 293 op/s 2024-09-12T02:50:56.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:50:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:56 smithi117 ceph-mon[34898]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-12T02:50:57.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:56 smithi100 ceph-mon[31390]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-12T02:50:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:56 smithi189 ceph-mon[35196]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-12T02:50:59.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:50:58 smithi117 ceph-mon[34898]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 623 KiB/s wr, 79 op/s 2024-09-12T02:50:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:50:58 smithi100 ceph-mon[31390]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 623 KiB/s wr, 79 op/s 2024-09-12T02:50:59.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:50:58 smithi189 ceph-mon[35196]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 623 KiB/s wr, 79 op/s 2024-09-12T02:51:01.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:00 smithi117 ceph-mon[34898]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.1 MiB/s wr, 214 op/s 2024-09-12T02:51:01.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:00 smithi100 ceph-mon[31390]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.1 MiB/s wr, 214 op/s 2024-09-12T02:51:01.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:00 smithi189 ceph-mon[35196]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.1 MiB/s wr, 214 op/s 2024-09-12T02:51:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:51:03.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:02 smithi100 ceph-mon[31390]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 MiB/s wr, 387 op/s 2024-09-12T02:51:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:02 smithi189 ceph-mon[35196]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 MiB/s wr, 387 op/s 2024-09-12T02:51:03.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:02 smithi117 ceph-mon[34898]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 MiB/s wr, 387 op/s 2024-09-12T02:51:05.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:04 smithi100 ceph-mon[31390]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 14 MiB/s wr, 511 op/s 2024-09-12T02:51:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:04 smithi189 ceph-mon[35196]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 14 MiB/s wr, 511 op/s 2024-09-12T02:51:05.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:04 smithi117 ceph-mon[34898]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 14 MiB/s wr, 511 op/s 2024-09-12T02:51:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:51:06.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:51:06.816 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:07.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:06 smithi100 ceph-mon[31390]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 21 MiB/s wr, 755 op/s 2024-09-12T02:51:07.146 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:06 smithi117 ceph-mon[34898]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 21 MiB/s wr, 755 op/s 2024-09-12T02:51:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:06 smithi189 ceph-mon[35196]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 21 MiB/s wr, 755 op/s 2024-09-12T02:51:07.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 -- 172.21.15.100:0/1655725320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 msgr2=0x7f043810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 --2- 172.21.15.100:0/1655725320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043810eaa0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0428009ca0 tx=0x7f042802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 -- 172.21.15.100:0/1655725320 shutdown_connections 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 --2- 172.21.15.100:0/1655725320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043810eaa0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 --2- 172.21.15.100:0/1655725320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04381027a0 0x7f04381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 --2- 172.21.15.100:0/1655725320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0438101df0 0x7f04381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 -- 172.21.15.100:0/1655725320 >> 172.21.15.100:0/1655725320 conn(0x7f04380fd8f0 msgr2=0x7f04380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 -- 172.21.15.100:0/1655725320 shutdown_connections 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 -- 172.21.15.100:0/1655725320 wait complete. 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 Processor -- start 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 -- start start 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.282+0000 7f043fb25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0438101df0 0x7f04381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043fb25640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04381027a0 0x7f0438198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043fb25640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043fb25640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0438111f80 con 0x7f0438106f20 2024-09-12T02:51:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043fb25640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0438111e00 con 0x7f0438101df0 2024-09-12T02:51:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043fb25640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0438112100 con 0x7f04381027a0 2024-09-12T02:51:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47654/0 (socket says 172.21.15.100:47654) 2024-09-12T02:51:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 -- 172.21.15.100:0/2805902098 learned_addr learned my addr 172.21.15.100:0/2805902098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043d0c0640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04381027a0 0x7f0438198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043d8c1640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0438101df0 0x7f04381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 -- 172.21.15.100:0/2805902098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04381027a0 msgr2=0x7f0438198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04381027a0 0x7f0438198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 -- 172.21.15.100:0/2805902098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0438101df0 msgr2=0x7f04381983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0438101df0 0x7f04381983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 -- 172.21.15.100:0/2805902098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043819d390 con 0x7f0438106f20 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043e0c2640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043819ccb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0428031a20 tx=0x7f0428031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f0436ffd640 1 -- 172.21.15.100:0/2805902098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428003c30 con 0x7f0438106f20 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043819d620 con 0x7f0438106f20 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f0436ffd640 1 -- 172.21.15.100:0/2805902098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0428003dd0 con 0x7f0438106f20 2024-09-12T02:51:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f0436ffd640 1 -- 172.21.15.100:0/2805902098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042802fcf0 con 0x7f0438106f20 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.283+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04381a4f60 con 0x7f0438106f20 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.284+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04381021d0 con 0x7f0438106f20 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.286+0000 7f0436ffd640 1 -- 172.21.15.100:0/2805902098 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f0428004b40 con 0x7f0438106f20 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.286+0000 7f0436ffd640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04200a2b80 0x7f04200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.286+0000 7f043d8c1640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04200a2b80 0x7f04200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.286+0000 7f0436ffd640 1 -- 172.21.15.100:0/2805902098 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f04280f05d0 con 0x7f0438106f20 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.287+0000 7f043d8c1640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04200a2b80 0x7f04200a5040 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0430005fd0 tx=0x7f0430005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.290+0000 7f0436ffd640 1 -- 172.21.15.100:0/2805902098 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04280bd5b0 con 0x7f0438106f20 2024-09-12T02:51:07.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.494+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f043810a130 con 0x7f0438106f20 2024-09-12T02:51:07.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.495+0000 7f0436ffd640 1 -- 172.21.15.100:0/2805902098 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f042802fe90 con 0x7f0438106f20 2024-09-12T02:51:07.497 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:51:07.497 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:51:07.497 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:51:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04200a2b80 msgr2=0x7f04200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04200a2b80 0x7f04200a5040 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0430005fd0 tx=0x7f0430005850 comp rx=0 tx=0).stop 2024-09-12T02:51:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 msgr2=0x7f043819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043819ccb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0428031a20 tx=0x7f0428031a50 comp rx=0 tx=0).stop 2024-09-12T02:51:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 shutdown_connections 2024-09-12T02:51:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04200a2b80 0x7f04200a5040 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0438106f20 0x7f043819ccb0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04381027a0 0x7f0438198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 --2- 172.21.15.100:0/2805902098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0438101df0 0x7f04381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 >> 172.21.15.100:0/2805902098 conn(0x7f04380fd8f0 msgr2=0x7f04380febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 shutdown_connections 2024-09-12T02:51:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:07.497+0000 7f043fb25640 1 -- 172.21.15.100:0/2805902098 wait complete. 2024-09-12T02:51:08.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:07 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2805902098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:51:08.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:07 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2805902098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:51:08.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:07 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2805902098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:51:08.412 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id a38cb0a5 --release --await' 2024-09-12T02:51:08.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id a38cb0a5 --release --await 2024-09-12T02:51:08.656 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:09.054 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:08 smithi100 ceph-mon[31390]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 23 MiB/s wr, 845 op/s 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 -- 172.21.15.100:0/810784612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 msgr2=0x7f825c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 --2- 172.21.15.100:0/810784612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c1021c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f824c009900 tx=0x7f824c02a410 comp rx=0 tx=0).stop 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 -- 172.21.15.100:0/810784612 shutdown_connections 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 --2- 172.21.15.100:0/810784612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f825c106f10 0x7f825c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 --2- 172.21.15.100:0/810784612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f825c102790 0x7f825c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 --2- 172.21.15.100:0/810784612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c1021c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 -- 172.21.15.100:0/810784612 >> 172.21.15.100:0/810784612 conn(0x7f825c0fd8c0 msgr2=0x7f825c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 -- 172.21.15.100:0/810784612 shutdown_connections 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.138+0000 7f8260b34640 1 -- 172.21.15.100:0/810784612 wait complete. 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 Processor -- start 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 -- start start 2024-09-12T02:51:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f825c102790 0x7f825c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f825c106f10 0x7f825c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f825c111f90 con 0x7f825c101de0 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f825c111e10 con 0x7f825c106f10 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f8260b34640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f825c112110 con 0x7f825c102790 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f825a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f825a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47668/0 (socket says 172.21.15.100:47668) 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.139+0000 7f825a59c640 1 -- 172.21.15.100:0/912641433 learned_addr learned my addr 172.21.15.100:0/912641433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f8259d9b640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f825c102790 0x7f825c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825a59c640 1 -- 172.21.15.100:0/912641433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f825c102790 msgr2=0x7f825c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825a59c640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f825c102790 0x7f825c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825a59c640 1 -- 172.21.15.100:0/912641433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f825c106f10 msgr2=0x7f825c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825ad9d640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f825c106f10 0x7f825c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825a59c640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f825c106f10 0x7f825c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825a59c640 1 -- 172.21.15.100:0/912641433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825c19d4c0 con 0x7f825c101de0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f8259d9b640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f825c102790 0x7f825c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825ad9d640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f825c106f10 0x7f825c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f825a59c640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c198510 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f824c005ab0 tx=0x7f824c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f824b7fe640 1 -- 172.21.15.100:0/912641433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c03f030 con 0x7f825c101de0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f824b7fe640 1 -- 172.21.15.100:0/912641433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f824c003ce0 con 0x7f825c101de0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825c19d750 con 0x7f825c101de0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f824b7fe640 1 -- 172.21.15.100:0/912641433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c035070 con 0x7f825c101de0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.140+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825c1a5090 con 0x7f825c101de0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.142+0000 7f824b7fe640 1 -- 172.21.15.100:0/912641433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f824c042030 con 0x7f825c101de0 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 Processor -- start 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 -- start start 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e220440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f824b7fe640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f82440a2b80 0x7f82440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e22ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 0x56080e22d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56080e185620 con 0x56080e220060 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56080e12ce50 con 0x56080e22b240 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8262f0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56080e1815e0 con 0x56080e220980 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e220440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f825a59c640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f82440a2b80 0x7f82440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e220440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47672/0 (socket says 172.21.15.100:47672) 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f825ad9d640 1 -- 172.21.15.100:0/1621707058 learned_addr learned my addr 172.21.15.100:0/1621707058 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f8259d9b640 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e22ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.143+0000 7f824b7fe640 1 -- 172.21.15.100:0/912641433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f824c0ef9d0 con 0x7f825c101de0 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f825ad9d640 1 -- 172.21.15.100:0/1621707058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 msgr2=0x56080e22ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f825ad9d640 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e22ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f825ad9d640 1 -- 172.21.15.100:0/1621707058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 msgr2=0x56080e22d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f825ad9d640 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 0x56080e22d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f825ad9d640 1 -- 172.21.15.100:0/1621707058 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56080e11dd40 con 0x56080e220060 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f825ad9d640 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e220440 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f825400e2e0 tx=0x7f825400e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320a058417b8dac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f825a59c640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f82440a2b80 0x7f82440a5040 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f824c0bc1b0 tx=0x7f824c04cae0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f8248ff9640 1 -- 172.21.15.100:0/1621707058 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254014070 con 0x56080e220060 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f8248ff9640 1 -- 172.21.15.100:0/1621707058 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8254010ce0 con 0x56080e220060 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.144+0000 7f8248ff9640 1 -- 172.21.15.100:0/1621707058 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254017d30 con 0x56080e220060 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- 172.21.15.100:0/1621707058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 msgr2=0x56080e220440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e220440 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f825400e2e0 tx=0x7f825400e7a0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- 172.21.15.100:0/1621707058 shutdown_connections 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 0x56080e22d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e22ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 --2- 172.21.15.100:0/1621707058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e220440 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- 172.21.15.100:0/1621707058 >> 172.21.15.100:0/1621707058 conn(0x56080e21c5f0 msgr2=0x56080e21c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- 172.21.15.100:0/1621707058 shutdown_connections 2024-09-12T02:51:09.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- 172.21.15.100:0/1621707058 wait complete. 2024-09-12T02:51:09.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- start start 2024-09-12T02:51:09.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 Processor -- start 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e228120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e228660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e22b240 0x56080e228ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56080e22de10 con 0x56080e220060 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56080e10df10 con 0x56080e220980 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56080e22df90 con 0x56080e22b240 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.145+0000 7f8262f0d740 10 client.0 _ll_register_callbacks cb 0x56080e131db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e228120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e228120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47676/0 (socket says 172.21.15.100:47676) 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 -- 172.21.15.100:0/3242692194 learned_addr learned my addr 172.21.15.100:0/3242692194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:09.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e22b240 0x56080e228ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8259d9b640 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e228660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 -- 172.21.15.100:0/3242692194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e22b240 msgr2=0x56080e228ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e22b240 0x56080e228ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 -- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 msgr2=0x56080e228660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e228660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 -- 172.21.15.100:0/3242692194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56080de94580 con 0x56080e220060 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e228120 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8254007410 tx=0x7f8254007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589a7119a4866100 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8241ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:51:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8241ffb640 1 -- 172.21.15.100:0/3242692194 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254014070 con 0x56080e220060 2024-09-12T02:51:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8241ffb640 1 -- 172.21.15.100:0/3242692194 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8254010800 con 0x56080e220060 2024-09-12T02:51:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8254010ce0 con 0x56080e220060 2024-09-12T02:51:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8241ffb640 1 -- 172.21.15.100:0/3242692194 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8254010a00 con 0x56080e220060 2024-09-12T02:51:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8262f0d740 10 client.17535 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.146+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56080df5e960 con 0x56080e220060 2024-09-12T02:51:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8241ffb640 1 -- 172.21.15.100:0/3242692194 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8254010ce0 con 0x56080e220060 2024-09-12T02:51:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8241ffb640 1 -- 172.21.15.100:0/3242692194 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f82540263d0 con 0x56080e220060 2024-09-12T02:51:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8262f0d740 10 client.17535 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8262f0d740 10 client.17535 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:51:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8262f0d740 20 client.17535 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e23aca0 0x56080e23d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8262f0d740 4 client.17535 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56080e192b90 con 0x56080e23aca0 2024-09-12T02:51:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8259d9b640 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e23aca0 0x56080e23d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8241ffb640 10 client.17535 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.147+0000 7f8259d9b640 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e23aca0 0x56080e23d090 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf53c3004b0304cd server_cookie=70b07956e11c53fc in_seq=0 out_seq=0 2024-09-12T02:51:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8241ffb640 1 -- 172.21.15.100:0/3242692194 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56080e192b90 con 0x56080e23aca0 2024-09-12T02:51:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8241ffb640 10 client.17535 handle_command_reply: tid=0 2024-09-12T02:51:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 client.17535 shutdown 2024-09-12T02:51:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 msgr2=0x56080e228120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e228120 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8254007410 tx=0x7f8254007340 comp rx=0 tx=0).stop 2024-09-12T02:51:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 shutdown_connections 2024-09-12T02:51:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e23aca0 0x56080e23d090 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e22b240 0x56080e228ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e228660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3242692194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e228120 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 >> 172.21.15.100:0/3242692194 conn(0x56080e21c5f0 msgr2=0x56080e2222d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8241ffb640 0 client.17535 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 shutdown_connections 2024-09-12T02:51:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 1 -- 172.21.15.100:0/3242692194 wait complete. 2024-09-12T02:51:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.148+0000 7f8262f0d740 20 client.17535 trim_cache size 0 max 16384 2024-09-12T02:51:09.177 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:08 smithi189 ceph-mon[35196]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 23 MiB/s wr, 845 op/s 2024-09-12T02:51:09.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.165+0000 7f8262f0d740 1 Processor -- start 2024-09-12T02:51:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.165+0000 7f8262f0d740 1 -- start start 2024-09-12T02:51:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220060 0x56080e223610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e2287f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e22b240 0x56080e228d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8262f0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f825c1aff40 con 0x56080e22b240 2024-09-12T02:51:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8262f0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f825c1ad810 con 0x56080e220980 2024-09-12T02:51:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8262f0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f825c1ab660 con 0x56080e220060 2024-09-12T02:51:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e22b240 0x56080e228d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e22b240 0x56080e228d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47684/0 (socket says 172.21.15.100:47684) 2024-09-12T02:51:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 -- 172.21.15.100:0/3634850920 learned_addr learned my addr 172.21.15.100:0/3634850920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220060 0x56080e223610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8259d9b640 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e2287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 -- 172.21.15.100:0/3634850920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220060 msgr2=0x56080e223610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220060 0x56080e223610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 -- 172.21.15.100:0/3634850920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 msgr2=0x56080e2287f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e2287f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 -- 172.21.15.100:0/3634850920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56080e222ed0 con 0x56080e22b240 2024-09-12T02:51:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8259d9b640 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e2287f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f825ad9d640 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e22b240 0x56080e228d30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8254007310 tx=0x7f825400e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf3d8368623c5f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8243fff640 1 -- 172.21.15.100:0/3634850920 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825403a070 con 0x56080e22b240 2024-09-12T02:51:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.166+0000 7f8243fff640 1 -- 172.21.15.100:0/3634850920 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8254023040 con 0x56080e22b240 2024-09-12T02:51:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8243fff640 1 -- 172.21.15.100:0/3634850920 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254014070 con 0x56080e22b240 2024-09-12T02:51:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 -- 172.21.15.100:0/3634850920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e22b240 msgr2=0x56080e228d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e22b240 0x56080e228d30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8254007310 tx=0x7f825400e7a0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 -- 172.21.15.100:0/3634850920 shutdown_connections 2024-09-12T02:51:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e22b240 0x56080e228d30 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e220980 0x56080e2287f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 --2- 172.21.15.100:0/3634850920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220060 0x56080e223610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 -- 172.21.15.100:0/3634850920 >> 172.21.15.100:0/3634850920 conn(0x56080e21c5f0 msgr2=0x56080e2280e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 -- 172.21.15.100:0/3634850920 shutdown_connections 2024-09-12T02:51:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 -- 172.21.15.100:0/3634850920 wait complete. 2024-09-12T02:51:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.167+0000 7f8262f0d740 1 -- start start 2024-09-12T02:51:09.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 1 Processor -- start 2024-09-12T02:51:09.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e2331e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e233720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 0x56080e2301b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f825c1abcd0 con 0x56080e220060 2024-09-12T02:51:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f825c1ad140 con 0x56080e22b240 2024-09-12T02:51:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f825c1ac3a0 con 0x56080e220980 2024-09-12T02:51:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8262f0d740 10 client.0 _ll_register_callbacks cb 0x7f82540173f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e2331e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e2331e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47692/0 (socket says 172.21.15.100:47692) 2024-09-12T02:51:09.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 -- 172.21.15.100:0/2203967414 learned_addr learned my addr 172.21.15.100:0/2203967414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:09.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8259d9b640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e233720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 0x56080e2301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 -- 172.21.15.100:0/2203967414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 msgr2=0x56080e233720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e233720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 -- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 msgr2=0x56080e2301b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 0x56080e2301b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f825ad9d640 1 -- 172.21.15.100:0/2203967414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56080e2306f0 con 0x56080e220060 2024-09-12T02:51:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.168+0000 7f8259d9b640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e233720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f825ad9d640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e2331e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f8254000f80 tx=0x7f8254010600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8ea869b56e511 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8241ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:51:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8241ffb640 1 -- 172.21.15.100:0/2203967414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254014070 con 0x56080e220060 2024-09-12T02:51:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8241ffb640 1 -- 172.21.15.100:0/2203967414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8254026340 con 0x56080e220060 2024-09-12T02:51:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8254023040 con 0x56080e220060 2024-09-12T02:51:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8241ffb640 1 -- 172.21.15.100:0/2203967414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f825403a040 con 0x56080e220060 2024-09-12T02:51:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 10 client.17541 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56080e2a5df0 con 0x56080e220060 2024-09-12T02:51:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8241ffb640 1 -- 172.21.15.100:0/2203967414 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8254023040 con 0x56080e220060 2024-09-12T02:51:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8241ffb640 1 -- 172.21.15.100:0/2203967414 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8254040070 con 0x56080e220060 2024-09-12T02:51:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 10 client.17541 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 10 client.17541 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:51:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 20 client.17541 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e2a6310 0x56080e2a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 4 client.17541 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a38cb0a5", "release": true, "await": true}] 2024-09-12T02:51:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.169+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a38cb0a5", "release": true, "await": true}) -- 0x56080e18d0a0 con 0x56080e2a6310 2024-09-12T02:51:09.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.170+0000 7f8259d9b640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e2a6310 0x56080e2a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.170+0000 7f8241ffb640 10 client.17541 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:09.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.170+0000 7f8259d9b640 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e2a6310 0x56080e2a8700 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a709783c21462ddf server_cookie=fb3f8e532637b27e in_seq=0 out_seq=0 2024-09-12T02:51:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.218+0000 7f8241ffb640 1 -- 172.21.15.100:0/2203967414 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56080e18d0a0 con 0x56080e2a6310 2024-09-12T02:51:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.218+0000 7f8241ffb640 10 client.17541 handle_command_reply: tid=0 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.226+0000 7f8262f0d740 1 client.17541 shutdown 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 msgr2=0x56080e2331e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e2331e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f8254000f80 tx=0x7f8254010600 comp rx=0 tx=0).stop 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 shutdown_connections 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56080e2a6310 0x56080e2a8700 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56080e22b240 0x56080e2301b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080e220980 0x56080e233720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8241ffb640 0 client.17541 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 --2- 172.21.15.100:0/2203967414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56080e220060 0x56080e2331e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 >> 172.21.15.100:0/2203967414 conn(0x56080e21c5f0 msgr2=0x56080e228900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.227+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 shutdown_connections 2024-09-12T02:51:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.229+0000 7f8262f0d740 1 -- 172.21.15.100:0/2203967414 wait complete. 2024-09-12T02:51:09.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.230+0000 7f8262f0d740 20 client.17541 trim_cache size 0 max 16384 2024-09-12T02:51:09.233 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:51:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:51:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 48, 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "a38cb0a5": { 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 48, 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:51:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:51:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:51:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:51:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 147.2, 2024-09-12T02:51:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:51:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:51:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:51:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:51:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:51:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:51:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:51:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:51:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:51:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:51:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:51:09.237 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f82440a2b80 msgr2=0x7f82440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f82440a2b80 0x7f82440a5040 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f824c0bc1b0 tx=0x7f824c04cae0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 msgr2=0x7f825c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c198510 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f824c005ab0 tx=0x7f824c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 shutdown_connections 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f82440a2b80 0x7f82440a5040 secure :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f824c0bc1b0 tx=0x7f824c04cae0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f825c106f10 0x7f825c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f825c102790 0x7f825c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 --2- 172.21.15.100:0/912641433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f825c101de0 0x7f825c198510 secure :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f824c005ab0 tx=0x7f824c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.233+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 >> 172.21.15.100:0/912641433 conn(0x7f825c0fd8c0 msgr2=0x7f825c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.235+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 shutdown_connections 2024-09-12T02:51:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:09.235+0000 7f8260b34640 1 -- 172.21.15.100:0/912641433 wait complete. 2024-09-12T02:51:09.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:08 smithi117 ceph-mon[34898]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 23 MiB/s wr, 845 op/s 2024-09-12T02:51:10.020 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a38cb0a5', total seconds elapsed: 30.6 2024-09-12T02:51:11.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:10 smithi100 ceph-mon[31390]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 25 MiB/s wr, 919 op/s 2024-09-12T02:51:11.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:51:11.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:10 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:10 smithi189 ceph-mon[35196]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 25 MiB/s wr, 919 op/s 2024-09-12T02:51:11.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:51:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:10 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 720.0 s, 810.8 tps, lat 656.670 ms stddev 3811.343 2024-09-12T02:51:11.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:10 smithi117 ceph-mon[34898]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 25 MiB/s wr, 919 op/s 2024-09-12T02:51:11.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:51:11.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:11.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:10 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:12.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:51:12.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:51:12.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:12.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:51:12.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:51:12.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:12.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:51:12.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:51:12.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:51:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:12 smithi100 ceph-mon[31390]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 784 op/s 2024-09-12T02:51:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:12 smithi189 ceph-mon[35196]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 784 op/s 2024-09-12T02:51:13.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:12 smithi117 ceph-mon[34898]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 784 op/s 2024-09-12T02:51:15.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:14 smithi100 ceph-mon[31390]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 619 op/s 2024-09-12T02:51:15.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:14 smithi189 ceph-mon[35196]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 619 op/s 2024-09-12T02:51:15.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:14 smithi117 ceph-mon[34898]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 619 op/s 2024-09-12T02:51:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 725.0 s, 1992.4 tps, lat 50.114 ms stddev 52.645 2024-09-12T02:51:16.603 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:51:16.975 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:17.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:16 smithi100 ceph-mon[31390]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 607 op/s 2024-09-12T02:51:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:16 smithi189 ceph-mon[35196]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 607 op/s 2024-09-12T02:51:17.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:16 smithi117 ceph-mon[34898]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 607 op/s 2024-09-12T02:51:17.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 -- 172.21.15.100:0/125251585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4101440 msgr2=0x7fe6a4105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 --2- 172.21.15.100:0/125251585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4101440 0x7fe6a4105910 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe694009900 tx=0x7fe69402a470 comp rx=0 tx=0).stop 2024-09-12T02:51:17.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 -- 172.21.15.100:0/125251585 shutdown_connections 2024-09-12T02:51:17.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 --2- 172.21.15.100:0/125251585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6a4105f30 0x7fe6a41063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 --2- 172.21.15.100:0/125251585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4101440 0x7fe6a4105910 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 --2- 172.21.15.100:0/125251585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 0x7fe6a4100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 -- 172.21.15.100:0/125251585 >> 172.21.15.100:0/125251585 conn(0x7fe6a40fc7d0 msgr2=0x7fe6a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.546+0000 7fe6abec3640 1 -- 172.21.15.100:0/125251585 shutdown_connections 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.547+0000 7fe6abec3640 1 -- 172.21.15.100:0/125251585 wait complete. 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.547+0000 7fe6abec3640 1 Processor -- start 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.547+0000 7fe6abec3640 1 -- start start 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6abec3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 0x7fe6a41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6abec3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6a4101440 0x7fe6a41a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6abec3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4105f30 0x7fe6a419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6abec3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4118550 con 0x7fe6a4105f30 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6abec3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41183d0 con 0x7fe6a4101440 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 0x7fe6a41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6abec3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41186d0 con 0x7fe6a4100b20 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 0x7fe6a41a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51680/0 (socket says 172.21.15.100:51680) 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/990713623 learned_addr learned my addr 172.21.15.100:0/990713623 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6aa460640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4105f30 0x7fe6a419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a945e640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6a4101440 0x7fe6a41a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/990713623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6a4101440 msgr2=0x7fe6a41a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6a4101440 0x7fe6a41a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4105f30 msgr2=0x7fe6a419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4105f30 0x7fe6a419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/990713623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a419f070 con 0x7fe6a4100b20 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.548+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 0x7fe6a41a4780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000e9f0 tx=0x7fe6a000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.549+0000 7fe69affd640 1 -- 172.21.15.100:0/990713623 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000cd80 con 0x7fe6a4100b20 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.549+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a419f360 con 0x7fe6a4100b20 2024-09-12T02:51:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.549+0000 7fe69affd640 1 -- 172.21.15.100:0/990713623 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a0005500 con 0x7fe6a4100b20 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.549+0000 7fe69affd640 1 -- 172.21.15.100:0/990713623 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0010690 con 0x7fe6a4100b20 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.549+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a41ab650 con 0x7fe6a4100b20 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 Processor -- start 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 -- start start 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306f9b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9bdc0 0x557306fa6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557306f012e0 con 0x557306f9b4a0 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557306ea8ce0 con 0x557306fa6680 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557306efd2a0 con 0x557306f9bdc0 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6aa460640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306f9b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6aa460640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306f9b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43900/0 (socket says 172.21.15.100:43900) 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe69affd640 1 -- 172.21.15.100:0/990713623 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe6a00046c0 con 0x7fe6a4100b20 2024-09-12T02:51:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6aa460640 1 -- 172.21.15.100:0/2258666731 learned_addr learned my addr 172.21.15.100:0/2258666731 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.553+0000 7fe6a945e640 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a945e640 1 -- 172.21.15.100:0/2258666731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9bdc0 msgr2=0x557306fa6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9bdc0 0x557306fa6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a945e640 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9bdc0 0x557306fa6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a945e640 1 -- 172.21.15.100:0/2258666731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 msgr2=0x557306f9b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a945e640 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306f9b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a945e640 1 -- 172.21.15.100:0/2258666731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557306e8d440 con 0x557306fa6680 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9bdc0 0x557306fa6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6aa460640 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306f9b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6a945e640 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa8a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe694005940 tx=0x7fe694005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6bf4946b5ce52c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe69affd640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6900a2c00 0x7fe6900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe6aa460640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6900a2c00 0x7fe6900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe69affd640 1 -- 172.21.15.100:0/990713623 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe6a00cf490 con 0x7fe6a4100b20 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.554+0000 7fe68ffff640 1 -- 172.21.15.100:0/2258666731 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694040070 con 0x557306fa6680 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe68ffff640 1 -- 172.21.15.100:0/2258666731 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe694031870 con 0x557306fa6680 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe68ffff640 1 -- 172.21.15.100:0/2258666731 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694035040 con 0x557306fa6680 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2258666731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 msgr2=0x557306fa8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6aa460640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6900a2c00 0x7fe6900a50c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009fd0 tx=0x7fe69c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa8a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe694005940 tx=0x7fe694005be0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2258666731 shutdown_connections 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa8a70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9bdc0 0x557306fa6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2258666731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306f9b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.555+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2258666731 >> 172.21.15.100:0/2258666731 conn(0x557306f97a30 msgr2=0x557306f97e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.556+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2258666731 shutdown_connections 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.556+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2258666731 wait complete. 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.556+0000 7fe6ae29c740 1 -- start start 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.556+0000 7fe6ae29c740 1 Processor -- start 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306fa6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306f9bdc0 0x557306fa32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306fa6680 0x557306fa3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557306fa9250 con 0x557306f9b4a0 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306fa6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306fa6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43914/0 (socket says 172.21.15.100:43914) 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/1592662947 learned_addr learned my addr 172.21.15.100:0/1592662947 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6a945e640 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306f9bdc0 0x557306fa32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6aa460640 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306fa6680 0x557306fa3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.557+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557306ebc050 con 0x557306f9bdc0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557306fa93d0 con 0x557306fa6680 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6ae29c740 10 client.0 _ll_register_callbacks cb 0x557306efc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/1592662947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306fa6680 msgr2=0x557306fa3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306fa6680 0x557306fa3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306f9bdc0 msgr2=0x557306fa32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306f9bdc0 0x557306fa32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/1592662947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557306c723c0 con 0x557306f9b4a0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306fa6030 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe6a009bc10 tx=0x7fe6a009b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1267c79c6d4da1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe68d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe68d7fa640 1 -- 172.21.15.100:0/1592662947 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00a4660 con 0x557306f9b4a0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe68d7fa640 1 -- 172.21.15.100:0/1592662947 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe6a009b0d0 con 0x557306f9b4a0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe694031870 con 0x557306f9b4a0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe68d7fa640 1 -- 172.21.15.100:0/1592662947 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6a00a0030 con 0x557306f9b4a0 2024-09-12T02:51:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6ae29c740 10 client.17553 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.558+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557306fb4bd0 con 0x557306f9b4a0 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe68d7fa640 1 -- 172.21.15.100:0/1592662947 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe694031870 con 0x557306f9b4a0 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe68d7fa640 1 -- 172.21.15.100:0/1592662947 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe6a00b4020 con 0x557306f9b4a0 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe6ae29c740 10 client.17553 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe6ae29c740 10 client.17553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe6ae29c740 20 client.17553 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x557306fb8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe6ae29c740 4 client.17553 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557306f0e850 con 0x557306fb6090 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.559+0000 7fe6a945e640 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x557306fb8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.560+0000 7fe68d7fa640 10 client.17553 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.560+0000 7fe6a945e640 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x557306fb8480 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ae777c4b970da2 server_cookie=8bfaa855ba9ac457 in_seq=0 out_seq=0 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.561+0000 7fe68d7fa640 1 -- 172.21.15.100:0/1592662947 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557306f0e850 con 0x557306fb6090 2024-09-12T02:51:17.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.561+0000 7fe68d7fa640 10 client.17553 handle_command_reply: tid=0 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.562+0000 7fe6ae29c740 1 client.17553 shutdown 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.562+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 msgr2=0x557306fa6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.562+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306fa6030 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe6a009bc10 tx=0x7fe6a009b5e0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.562+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 shutdown_connections 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.562+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x557306fb8480 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306fa6680 0x557306fa3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe68d7fa640 0 client.17553 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306f9bdc0 0x557306fa32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/1592662947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9b4a0 0x557306fa6030 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 >> 172.21.15.100:0/1592662947 conn(0x557306f97a30 msgr2=0x557306f9d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 shutdown_connections 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe6ae29c740 1 -- 172.21.15.100:0/1592662947 wait complete. 2024-09-12T02:51:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.563+0000 7fe6ae29c740 20 client.17553 trim_cache size 0 max 16384 2024-09-12T02:51:17.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.588+0000 7fe6ae29c740 1 Processor -- start 2024-09-12T02:51:17.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6ae29c740 1 -- start start 2024-09-12T02:51:17.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fb24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306f97e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fbdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41b6470 con 0x557306f9bdc0 2024-09-12T02:51:17.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41b3d40 con 0x557306fa6680 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41b1b90 con 0x557306f9b4a0 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fb24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fb24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51704/0 (socket says 172.21.15.100:51704) 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/2038413311 learned_addr learned my addr 172.21.15.100:0/2038413311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a945e640 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306f97e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/2038413311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 msgr2=0x557306fbdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fbdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/2038413311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 msgr2=0x557306f97e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306f97e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/2038413311 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557306fb87f0 con 0x557306f9b4a0 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.589+0000 7fe6a945e640 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306f97e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:17.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.590+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fb24b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c6a0 tx=0x7fe6a009be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=744e2d839fe5320e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.590+0000 7fe68f7fe640 1 -- 172.21.15.100:0/2038413311 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00a1570 con 0x557306f9b4a0 2024-09-12T02:51:17.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.590+0000 7fe68f7fe640 1 -- 172.21.15.100:0/2038413311 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a00a48f0 con 0x557306f9b4a0 2024-09-12T02:51:17.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe68f7fe640 1 -- 172.21.15.100:0/2038413311 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a009b330 con 0x557306f9b4a0 2024-09-12T02:51:17.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2038413311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 msgr2=0x557306fb24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fb24b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c6a0 tx=0x7fe6a009be00 comp rx=0 tx=0).stop 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2038413311 shutdown_connections 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fbdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306f97e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/2038413311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fb24b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2038413311 >> 172.21.15.100:0/2038413311 conn(0x557306f97a30 msgr2=0x557306f9e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2038413311 shutdown_connections 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.591+0000 7fe6ae29c740 1 -- 172.21.15.100:0/2038413311 wait complete. 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.592+0000 7fe6ae29c740 1 -- start start 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.592+0000 7fe6ae29c740 1 Processor -- start 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fa0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306fa0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6ae29c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41b2200 con 0x557306f9bdc0 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41b3670 con 0x557306fa6680 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6ae29c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41b28d0 con 0x557306f9b4a0 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6ae29c740 10 client.0 _ll_register_callbacks cb 0x7fe6a0009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fa0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6a9c5f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fa0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51712/0 (socket says 172.21.15.100:51712) 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6a9c5f640 1 -- 172.21.15.100:0/672465019 learned_addr learned my addr 172.21.15.100:0/672465019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6aa460640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6a945e640 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306fa0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6aa460640 1 -- 172.21.15.100:0/672465019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 msgr2=0x557306fa0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6aa460640 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fa0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6aa460640 1 -- 172.21.15.100:0/672465019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 msgr2=0x557306fa0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6aa460640 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306fa0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6aa460640 1 -- 172.21.15.100:0/672465019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55730701fd00 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe6aa460640 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa0da0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00f790 tx=0x7fe69c011fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d8733c318d1661 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.593+0000 7fe68d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe68d7fa640 1 -- 172.21.15.100:0/672465019 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c004b20 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a00a48f0 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe68d7fa640 1 -- 172.21.15.100:0/672465019 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe69c017030 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe68d7fa640 1 -- 172.21.15.100:0/672465019 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe69c004cc0 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 10 client.26834 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5573070210a0 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe68d7fa640 1 -- 172.21.15.100:0/672465019 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a00a48f0 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe68d7fa640 1 -- 172.21.15.100:0/672465019 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe69c027870 con 0x557306fa6680 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 10 client.26834 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 10 client.26834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 20 client.26834 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x5573070238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 4 client.26834 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557306f08d60 con 0x557306fb6090 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.594+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x5573070238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe68d7fa640 10 client.26834 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6a9c5f640 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x5573070238c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff86258681fec644 server_cookie=f1f85b1008674cf6 in_seq=0 out_seq=0 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe68d7fa640 1 -- 172.21.15.100:0/672465019 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557306f08d60 con 0x557306fb6090 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe68d7fa640 10 client.26834 handle_command_reply: tid=0 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 client.26834 shutdown 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 msgr2=0x557306fa0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa0da0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00f790 tx=0x7fe69c011fd0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 shutdown_connections 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x557306fb6090 0x5573070238c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557306fa6680 0x557306fa0da0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557306f9bdc0 0x557306fa0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 --2- 172.21.15.100:0/672465019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557306f9b4a0 0x557306fa0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 >> 172.21.15.100:0/672465019 conn(0x557306f97a30 msgr2=0x557306f96350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe68d7fa640 0 client.26834 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 shutdown_connections 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.595+0000 7fe6ae29c740 1 -- 172.21.15.100:0/672465019 wait complete. 2024-09-12T02:51:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6ae29c740 20 client.26834 trim_cache size 0 max 16384 2024-09-12T02:51:17.604 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:51:17.604 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:51:17.604 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:51:17.604 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:51:17.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6900a2c00 msgr2=0x7fe6900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6900a2c00 0x7fe6900a50c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009fd0 tx=0x7fe69c009500 comp rx=0 tx=0).stop 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 msgr2=0x7fe6a41a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 0x7fe6a41a4780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000e9f0 tx=0x7fe6a000edf0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 shutdown_connections 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe6900a2c00 0x7fe6900a50c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6a4105f30 0x7fe6a419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6a4101440 0x7fe6a41a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 --2- 172.21.15.100:0/990713623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6a4100b20 0x7fe6a41a4780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 >> 172.21.15.100:0/990713623 conn(0x7fe6a40fc7d0 msgr2=0x7fe6a410f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 shutdown_connections 2024-09-12T02:51:17.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:17.596+0000 7fe6abec3640 1 -- 172.21.15.100:0/990713623 wait complete. 2024-09-12T02:51:18.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:17 smithi189 ceph-mon[35196]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.5 MiB/s wr, 448 op/s 2024-09-12T02:51:18.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:17 smithi117 ceph-mon[34898]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.5 MiB/s wr, 448 op/s 2024-09-12T02:51:18.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:17 smithi100 ceph-mon[31390]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.5 MiB/s wr, 448 op/s 2024-09-12T02:51:18.435 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:51:18.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:51:18.817 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.300+0000 7fef92ed6640 1 -- 172.21.15.100:0/1704713903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c1036c0 msgr2=0x7fef8c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.300+0000 7fef92ed6640 1 --2- 172.21.15.100:0/1704713903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c1036c0 0x7fef8c10bbb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009900 tx=0x7fef7c02a480 comp rx=0 tx=0).stop 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.300+0000 7fef92ed6640 1 -- 172.21.15.100:0/1704713903 shutdown_connections 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.300+0000 7fef92ed6640 1 --2- 172.21.15.100:0/1704713903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c10c180 0x7fef8c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.300+0000 7fef92ed6640 1 --2- 172.21.15.100:0/1704713903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c1036c0 0x7fef8c10bbb0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.300+0000 7fef92ed6640 1 --2- 172.21.15.100:0/1704713903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef8c102da0 0x7fef8c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.300+0000 7fef92ed6640 1 -- 172.21.15.100:0/1704713903 >> 172.21.15.100:0/1704713903 conn(0x7fef8c0fc780 msgr2=0x7fef8c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.301+0000 7fef92ed6640 1 -- 172.21.15.100:0/1704713903 shutdown_connections 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.301+0000 7fef92ed6640 1 -- 172.21.15.100:0/1704713903 wait complete. 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.302+0000 7fef92ed6640 1 Processor -- start 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.302+0000 7fef92ed6640 1 -- start start 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef92ed6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef8c102da0 0x7fef8c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef92ed6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c1036c0 0x7fef8c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef92ed6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c10c180 0x7fef8c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef83fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c1036c0 0x7fef8c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef83fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c1036c0 0x7fef8c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54654/0 (socket says 172.21.15.100:54654) 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef83fff640 1 -- 172.21.15.100:0/3468205584 learned_addr learned my addr 172.21.15.100:0/3468205584 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef90c72640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef8c102da0 0x7fef8c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef91473640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c10c180 0x7fef8c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c111f60 con 0x7fef8c10c180 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c111de0 con 0x7fef8c1036c0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.303+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1120e0 con 0x7fef8c102da0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.304+0000 7fef83fff640 1 -- 172.21.15.100:0/3468205584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef8c102da0 msgr2=0x7fef8c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.304+0000 7fef83fff640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef8c102da0 0x7fef8c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.304+0000 7fef83fff640 1 -- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c10c180 msgr2=0x7fef8c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.304+0000 7fef83fff640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c10c180 0x7fef8c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.304+0000 7fef83fff640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c19d450 con 0x7fef8c1036c0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.304+0000 7fef83fff640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c1036c0 0x7fef8c1989e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef7c006010 tx=0x7fef7c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.304+0000 7fef81ffb640 1 -- 172.21.15.100:0/3468205584 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c03f030 con 0x7fef8c1036c0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.305+0000 7fef81ffb640 1 -- 172.21.15.100:0/3468205584 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef7c004440 con 0x7fef8c1036c0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.305+0000 7fef81ffb640 1 -- 172.21.15.100:0/3468205584 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c035070 con 0x7fef8c1036c0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.305+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c19d6e0 con 0x7fef8c1036c0 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.305+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c19db70 con 0x7fef8c1036c0 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.306+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef8c103180 con 0x7fef8c1036c0 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.307+0000 7fef81ffb640 1 -- 172.21.15.100:0/3468205584 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fef7c042030 con 0x7fef8c1036c0 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.308+0000 7fef81ffb640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef740a2c00 0x7fef740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.308+0000 7fef81ffb640 1 -- 172.21.15.100:0/3468205584 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fef7c0ef620 con 0x7fef8c1036c0 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.308+0000 7fef90c72640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef740a2c00 0x7fef740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.309+0000 7fef90c72640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef740a2c00 0x7fef740a50c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fef88009bd0 tx=0x7fef88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.311+0000 7fef81ffb640 1 -- 172.21.15.100:0/3468205584 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef7c0bbec0 con 0x7fef8c1036c0 2024-09-12T02:51:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.651+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef8c199800 con 0x7fef8c1036c0 2024-09-12T02:51:19.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.651+0000 7fef81ffb640 1 -- 172.21.15.100:0/3468205584 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fef7c0c01c0 con 0x7fef8c1036c0 2024-09-12T02:51:19.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:51:19.653 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:51:19.653 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:51:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef740a2c00 msgr2=0x7fef740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef740a2c00 0x7fef740a50c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fef88009bd0 tx=0x7fef88005f90 comp rx=0 tx=0).stop 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c1036c0 msgr2=0x7fef8c1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c1036c0 0x7fef8c1989e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef7c006010 tx=0x7fef7c004040 comp rx=0 tx=0).stop 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 shutdown_connections 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fef740a2c00 0x7fef740a50c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef8c10c180 0x7fef8c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8c1036c0 0x7fef8c1989e0 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef7c006010 tx=0x7fef7c004040 comp rx=0 tx=0).stop 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 --2- 172.21.15.100:0/3468205584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef8c102da0 0x7fef8c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 >> 172.21.15.100:0/3468205584 conn(0x7fef8c0fc780 msgr2=0x7fef8c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 shutdown_connections 2024-09-12T02:51:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:19.655+0000 7fef92ed6640 1 -- 172.21.15.100:0/3468205584 wait complete. 2024-09-12T02:51:20.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:19 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3468205584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:51:20.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:19 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3468205584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:51:20.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:19 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3468205584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:51:20.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:51:20.825 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:20.975 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:20 smithi100 ceph-mon[31390]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.3 MiB/s wr, 521 op/s 2024-09-12T02:51:21.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:20 smithi189 ceph-mon[35196]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.3 MiB/s wr, 521 op/s 2024-09-12T02:51:21.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:20 smithi117 ceph-mon[34898]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.3 MiB/s wr, 521 op/s 2024-09-12T02:51:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 730.0 s, 2423.0 tps, lat 41.202 ms stddev 46.715 2024-09-12T02:51:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 -- 172.21.15.100:0/2042592897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 msgr2=0x7f38d41095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 --2- 172.21.15.100:0/2042592897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41095d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009900 tx=0x7f38c802a410 comp rx=0 tx=0).stop 2024-09-12T02:51:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 -- 172.21.15.100:0/2042592897 shutdown_connections 2024-09-12T02:51:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 --2- 172.21.15.100:0/2042592897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 0x7f38d4119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 --2- 172.21.15.100:0/2042592897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d4109b10 0x7f38d4116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 --2- 172.21.15.100:0/2042592897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41095d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 -- 172.21.15.100:0/2042592897 >> 172.21.15.100:0/2042592897 conn(0x7f38d406e2d0 msgr2=0x7f38d406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 -- 172.21.15.100:0/2042592897 shutdown_connections 2024-09-12T02:51:21.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.378+0000 7f38db14c640 1 -- 172.21.15.100:0/2042592897 wait complete. 2024-09-12T02:51:21.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 Processor -- start 2024-09-12T02:51:21.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 -- start start 2024-09-12T02:51:21.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d4109b10 0x7f38d41a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 0x7f38d41a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f38d411ca20 con 0x7f38d4109b10 2024-09-12T02:51:21.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38d411c8a0 con 0x7f38d41091f0 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.379+0000 7f38db14c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38d411cba0 con 0x7f38d4116ea0 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d4109b10 0x7f38d41a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 0x7f38d41a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 0x7f38d41a7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51760/0 (socket says 172.21.15.100:51760) 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 -- 172.21.15.100:0/1110977876 learned_addr learned my addr 172.21.15.100:0/1110977876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41a2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54666/0 (socket says 172.21.15.100:54666) 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 -- 172.21.15.100:0/1110977876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 msgr2=0x7f38d41a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41a2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 -- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d4109b10 msgr2=0x7f38d41a33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d4109b10 0x7f38d41a33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 -- 172.21.15.100:0/1110977876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d41a7e50 con 0x7f38d4116ea0 2024-09-12T02:51:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.380+0000 7f38d96e9640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 0x7f38d41a7770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00eb40 tx=0x7f38cc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.381+0000 7f38d1ffb640 1 -- 172.21.15.100:0/1110977876 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc004b20 con 0x7f38d4116ea0 2024-09-12T02:51:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.381+0000 7f38d1ffb640 1 -- 172.21.15.100:0/1110977876 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38cc004cc0 con 0x7f38d4116ea0 2024-09-12T02:51:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.382+0000 7f38d1ffb640 1 -- 172.21.15.100:0/1110977876 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc010850 con 0x7f38d4116ea0 2024-09-12T02:51:21.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.382+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d41a8140 con 0x7f38d4116ea0 2024-09-12T02:51:21.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.383+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d41afa20 con 0x7f38d4116ea0 2024-09-12T02:51:21.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.385+0000 7f38d1ffb640 1 -- 172.21.15.100:0/1110977876 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f38cc005000 con 0x7f38d4116ea0 2024-09-12T02:51:21.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.386+0000 7f38d1ffb640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38c40a2c00 0x7f38c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.386+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38c40a2c00 0x7f38c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.386+0000 7f38d1ffb640 1 -- 172.21.15.100:0/1110977876 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f38cc0cf130 con 0x7f38d4116ea0 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.386+0000 7f38dd525740 1 Processor -- start 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.386+0000 7f38dd525740 1 -- start start 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38c40a2c00 0x7f38c40a50c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f38c8005ab0 tx=0x7f38c802a910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38dd525740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2bb40 0x562439c2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38dd525740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2a5d0 0x562439c2aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38dd525740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c37760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38dd525740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562439b902f0 con 0x562439c35370 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38dd525740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562439b37cf0 con 0x562439c2bb40 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38dd525740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562439b8c2b0 con 0x562439c2a5d0 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2bb40 0x562439c2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2bb40 0x562439c2a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54672/0 (socket says 172.21.15.100:54672) 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 -- 172.21.15.100:0/1203690667 learned_addr learned my addr 172.21.15.100:0/1203690667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d3fff640 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2a5d0 0x562439c2aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d96e9640 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c37760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 -- 172.21.15.100:0/1203690667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2a5d0 msgr2=0x562439c2aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2a5d0 0x562439c2aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 -- 172.21.15.100:0/1203690667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 msgr2=0x562439c37760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c37760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 -- 172.21.15.100:0/1203690667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562439b1c3a0 con 0x562439c2bb40 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.387+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2bb40 0x562439c2a090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38c8000c00 tx=0x7f38c803d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd17273881c71593 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38beffd640 1 -- 172.21.15.100:0/1203690667 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8035040 con 0x562439c2bb40 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38beffd640 1 -- 172.21.15.100:0/1203690667 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c804e070 con 0x562439c2bb40 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 -- 172.21.15.100:0/1203690667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2bb40 msgr2=0x562439c2a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2bb40 0x562439c2a090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38c8000c00 tx=0x7f38c803d000 comp rx=0 tx=0).stop 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 -- 172.21.15.100:0/1203690667 shutdown_connections 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c37760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2a5d0 0x562439c2aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 --2- 172.21.15.100:0/1203690667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2bb40 0x562439c2a090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 -- 172.21.15.100:0/1203690667 >> 172.21.15.100:0/1203690667 conn(0x562439bf3310 msgr2=0x562439c26c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.388+0000 7f38dd525740 1 -- 172.21.15.100:0/1203690667 shutdown_connections 2024-09-12T02:51:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.389+0000 7f38dd525740 1 -- 172.21.15.100:0/1203690667 wait complete. 2024-09-12T02:51:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.389+0000 7f38dd525740 1 -- start start 2024-09-12T02:51:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.389+0000 7f38dd525740 1 Processor -- start 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.390+0000 7f38dd525740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c34c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.390+0000 7f38dd525740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c31ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.390+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c34c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.390+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c34c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54678/0 (socket says 172.21.15.100:54678) 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d8ee8640 1 -- 172.21.15.100:0/3662825921 learned_addr learned my addr 172.21.15.100:0/3662825921 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d3fff640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c31ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38dd525740 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c32400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562439c380b0 con 0x562439c35370 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562439b4b060 con 0x562439c2a5d0 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562439c38230 con 0x562439c2bb40 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38dd525740 10 client.0 _ll_register_callbacks cb 0x56243989e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d96e9640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c32400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d8ee8640 1 -- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 msgr2=0x562439c31ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c31ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d8ee8640 1 -- 172.21.15.100:0/3662825921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 msgr2=0x562439c32400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c32400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d8ee8640 1 -- 172.21.15.100:0/3662825921 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624399013c0 con 0x562439c2a5d0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38d96e9640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c32400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.391+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c804e070 con 0x562439c2a5d0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c34c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38c802a980 tx=0x7f38c8009830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6012afdd56dc3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38b3fff640 10 client.26852 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38b3fff640 1 -- 172.21.15.100:0/3662825921 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8035070 con 0x562439c2a5d0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38b3fff640 1 -- 172.21.15.100:0/3662825921 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f38c80037f0 con 0x562439c2a5d0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38b3fff640 1 -- 172.21.15.100:0/3662825921 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38c8003a30 con 0x562439c2a5d0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 10 client.26852 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=27}) -- 0x562439c4c170 con 0x562439c2a5d0 2024-09-12T02:51:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38b3fff640 1 -- 172.21.15.100:0/3662825921 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f38c8003bd0 con 0x562439c2a5d0 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 10 client.26852 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 10 client.26852 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 20 client.26852 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c4d4c0 0x562439c4f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 4 client.26852 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562439b9d860 con 0x562439c4d4c0 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.392+0000 7f38d3fff640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c4d4c0 0x562439c4f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.393+0000 7f38b3fff640 10 client.26852 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.393+0000 7f38d3fff640 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c4d4c0 0x562439c4f8b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1976ecbb3784bc79 server_cookie=d1998daba9e51d8f in_seq=0 out_seq=0 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.393+0000 7f38b3fff640 1 -- 172.21.15.100:0/3662825921 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562439b9d860 con 0x562439c4d4c0 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38b3fff640 10 client.26852 handle_command_reply: tid=0 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 client.26852 shutdown 2024-09-12T02:51:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 msgr2=0x562439c34c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c34c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38c802a980 tx=0x7f38c8009830 comp rx=0 tx=0).stop 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 shutdown_connections 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c4d4c0 0x562439c4f8b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c35370 0x562439c32400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c31ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 --2- 172.21.15.100:0/3662825921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c34c10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 >> 172.21.15.100:0/3662825921 conn(0x562439bf3310 msgr2=0x562439c2c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38b3fff640 0 client.26852 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 shutdown_connections 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 1 -- 172.21.15.100:0/3662825921 wait complete. 2024-09-12T02:51:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.394+0000 7f38dd525740 20 client.26852 trim_cache size 0 max 16384 2024-09-12T02:51:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.410+0000 7f38dd525740 1 Processor -- start 2024-09-12T02:51:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.410+0000 7f38dd525740 1 -- start start 2024-09-12T02:51:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38dd525740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439bf3310 0x562439c2d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38dd525740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38dd525740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c52e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38dd525740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41b6130 con 0x562439bf3310 2024-09-12T02:51:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38dd525740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41b3a00 con 0x562439c2a5d0 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38dd525740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41b1890 con 0x562439c2bb40 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439bf3310 0x562439c2d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54686/0 (socket says 172.21.15.100:54686) 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 -- 172.21.15.100:0/3967356844 learned_addr learned my addr 172.21.15.100:0/3967356844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d96e9640 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c52e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 -- 172.21.15.100:0/3967356844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 msgr2=0x562439c52e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c52e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 -- 172.21.15.100:0/3967356844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439bf3310 msgr2=0x562439c2d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439bf3310 0x562439c2d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 -- 172.21.15.100:0/3967356844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562439c2dae0 con 0x562439c2a5d0 2024-09-12T02:51:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38d3fff640 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c528d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e50 tx=0x7f38c0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b555d60f5b12b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.411+0000 7f38be7fc640 1 -- 172.21.15.100:0/3967356844 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c001e6e0 con 0x562439c2a5d0 2024-09-12T02:51:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.412+0000 7f38be7fc640 1 -- 172.21.15.100:0/3967356844 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c001ed60 con 0x562439c2a5d0 2024-09-12T02:51:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.412+0000 7f38be7fc640 1 -- 172.21.15.100:0/3967356844 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c001d380 con 0x562439c2a5d0 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 -- 172.21.15.100:0/3967356844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 msgr2=0x562439c528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c528d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e50 tx=0x7f38c0005f90 comp rx=0 tx=0).stop 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 -- 172.21.15.100:0/3967356844 shutdown_connections 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c52e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439c2a5d0 0x562439c528d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 --2- 172.21.15.100:0/3967356844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439bf3310 0x562439c2d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 -- 172.21.15.100:0/3967356844 >> 172.21.15.100:0/3967356844 conn(0x562439c32560 msgr2=0x562439c30fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.413+0000 7f38dd525740 1 -- 172.21.15.100:0/3967356844 shutdown_connections 2024-09-12T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.414+0000 7f38dd525740 1 -- 172.21.15.100:0/3967356844 wait complete. 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.414+0000 7f38dd525740 1 -- start start 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.414+0000 7f38dd525740 1 Processor -- start 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439bf3310 0x562439c50900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c2a5d0 0x562439c50e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c51380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41b1ee0 con 0x562439c2a5d0 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c2a5d0 0x562439c50e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439bf3310 0x562439c50900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41b3330 con 0x562439bf3310 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439bf3310 0x562439c50900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54690/0 (socket says 172.21.15.100:54690) 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 -- 172.21.15.100:0/2231687233 learned_addr learned my addr 172.21.15.100:0/2231687233 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41b2590 con 0x562439c2bb40 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 -- 172.21.15.100:0/2231687233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 msgr2=0x562439c51380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c51380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 -- 172.21.15.100:0/2231687233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c2a5d0 msgr2=0x562439c50e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c2a5d0 0x562439c50e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 -- 172.21.15.100:0/2231687233 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562439cb7050 con 0x562439bf3310 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d3fff640 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c2a5d0 0x562439c50e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 10 client.0 _ll_register_callbacks cb 0x7f38c0009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:21.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c001ed60 con 0x562439bf3310 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38d8ee8640 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439bf3310 0x562439c50900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38c8005280 tx=0x7f38c8040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a499fa445f9afab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.415+0000 7f38b3fff640 10 client.26858 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38b3fff640 1 -- 172.21.15.100:0/2231687233 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8004e50 con 0x562439bf3310 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38b3fff640 1 -- 172.21.15.100:0/2231687233 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f38c8049480 con 0x562439bf3310 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38b3fff640 1 -- 172.21.15.100:0/2231687233 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38c80496c0 con 0x562439bf3310 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 10 client.26858 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=27}) -- 0x562439cb8110 con 0x562439bf3310 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38b3fff640 1 -- 172.21.15.100:0/2231687233 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f38c806e020 con 0x562439bf3310 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 10 client.26858 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 10 client.26858 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 20 client.26858 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:21.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c35370 0x562439cba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 4 client.26858 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:51:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562439b97d70 con 0x562439c35370 2024-09-12T02:51:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.416+0000 7f38d3fff640 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c35370 0x562439cba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38b3fff640 10 client.26858 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:51:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38d3fff640 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c35370 0x562439cba8a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30e11f8354341bf3 server_cookie=ede71f6d09e7a2ac in_seq=0 out_seq=0 2024-09-12T02:51:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38b3fff640 1 -- 172.21.15.100:0/2231687233 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562439b97d70 con 0x562439c35370 2024-09-12T02:51:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38b3fff640 10 client.26858 handle_command_reply: tid=0 2024-09-12T02:51:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 client.26858 shutdown 2024-09-12T02:51:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439bf3310 msgr2=0x562439c50900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439bf3310 0x562439c50900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38c8005280 tx=0x7f38c8040000 comp rx=0 tx=0).stop 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 shutdown_connections 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x562439c35370 0x562439cba8a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562439c2bb40 0x562439c51380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562439c2a5d0 0x562439c50e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38dd525740 1 --2- 172.21.15.100:0/2231687233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562439bf3310 0x562439c50900 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.417+0000 7f38b3fff640 0 client.26858 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 >> 172.21.15.100:0/2231687233 conn(0x562439c32560 msgr2=0x562439c25500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 shutdown_connections 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38dd525740 1 -- 172.21.15.100:0/2231687233 wait complete. 2024-09-12T02:51:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38dd525740 20 client.26858 trim_cache size 0 max 16384 2024-09-12T02:51:21.424 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:51:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38c40a2c00 msgr2=0x7f38c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38db14c640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38c40a2c00 0x7f38c40a50c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f38c8005ab0 tx=0x7f38c802a910 comp rx=0 tx=0).stop 2024-09-12T02:51:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 msgr2=0x7f38d41a7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.418+0000 7f38db14c640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 0x7f38d41a7770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00eb40 tx=0x7f38cc00c2d0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.419+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 shutdown_connections 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.419+0000 7f38db14c640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f38c40a2c00 0x7f38c40a50c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.419+0000 7f38db14c640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d4116ea0 0x7f38d41a7770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.419+0000 7f38db14c640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d4109b10 0x7f38d41a33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.419+0000 7f38db14c640 1 --2- 172.21.15.100:0/1110977876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38d41091f0 0x7f38d41a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.419+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 >> 172.21.15.100:0/1110977876 conn(0x7f38d406e2d0 msgr2=0x7f38d4117380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.420+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 shutdown_connections 2024-09-12T02:51:21.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:21.420+0000 7f38db14c640 1 -- 172.21.15.100:0/1110977876 wait complete. 2024-09-12T02:51:22.138 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:51:22.484 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:22.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:22 smithi100 ceph-mon[31390]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.8 MiB/s wr, 538 op/s 2024-09-12T02:51:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 -- 172.21.15.100:0/1994217622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0cc106a00 msgr2=0x7fd0cc106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 --2- 172.21.15.100:0/1994217622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0cc106a00 0x7fd0cc106de0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd0c001a910 tx=0x7fd0c003b470 comp rx=0 tx=0).stop 2024-09-12T02:51:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 -- 172.21.15.100:0/1994217622 shutdown_connections 2024-09-12T02:51:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 --2- 172.21.15.100:0/1994217622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc1008c0 0x7fd0cc104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 --2- 172.21.15.100:0/1994217622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 0x7fd0cc100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 --2- 172.21.15.100:0/1994217622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0cc106a00 0x7fd0cc106de0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 -- 172.21.15.100:0/1994217622 >> 172.21.15.100:0/1994217622 conn(0x7fd0cc077070 msgr2=0x7fd0cc0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 -- 172.21.15.100:0/1994217622 shutdown_connections 2024-09-12T02:51:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.024+0000 7fd0d1d52640 1 -- 172.21.15.100:0/1994217622 wait complete. 2024-09-12T02:51:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.026+0000 7fd0d1d52640 1 Processor -- start 2024-09-12T02:51:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.026+0000 7fd0d1d52640 1 -- start start 2024-09-12T02:51:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.026+0000 7fd0d1d52640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 0x7fd0cc195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.026+0000 7fd0d1d52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0cc1008c0 0x7fd0cc196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d0d50640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 0x7fd0cc195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d1d52640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc106a00 0x7fd0cc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d0d50640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 0x7fd0cc195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51808/0 (socket says 172.21.15.100:51808) 2024-09-12T02:51:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d0d50640 1 -- 172.21.15.100:0/4174564681 learned_addr learned my addr 172.21.15.100:0/4174564681 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d1551640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc106a00 0x7fd0cc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d1d52640 1 -- 172.21.15.100:0/4174564681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc109ca0 con 0x7fd0cc1008c0 2024-09-12T02:51:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d1d52640 1 -- 172.21.15.100:0/4174564681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc109b20 con 0x7fd0cc106a00 2024-09-12T02:51:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.027+0000 7fd0d1d52640 1 -- 172.21.15.100:0/4174564681 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc109e20 con 0x7fd0cc0fff40 2024-09-12T02:51:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.028+0000 7fd0d0d50640 1 -- 172.21.15.100:0/4174564681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc106a00 msgr2=0x7fd0cc19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.028+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc106a00 0x7fd0cc19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.028+0000 7fd0d0d50640 1 -- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0cc1008c0 msgr2=0x7fd0cc196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.028+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0cc1008c0 0x7fd0cc196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.028+0000 7fd0d0d50640 1 -- 172.21.15.100:0/4174564681 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc19aed0 con 0x7fd0cc0fff40 2024-09-12T02:51:23.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.028+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 0x7fd0cc195f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0005ab0 tx=0x7fd0c0005150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.029+0000 7fd0c9ffb640 1 -- 172.21.15.100:0/4174564681 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0051020 con 0x7fd0cc0fff40 2024-09-12T02:51:23.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.029+0000 7fd0c9ffb640 1 -- 172.21.15.100:0/4174564681 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0c0005340 con 0x7fd0cc0fff40 2024-09-12T02:51:23.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.029+0000 7fd0c9ffb640 1 -- 172.21.15.100:0/4174564681 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c004dac0 con 0x7fd0cc0fff40 2024-09-12T02:51:23.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.029+0000 7fd0d1d52640 1 -- 172.21.15.100:0/4174564681 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0cc19b160 con 0x7fd0cc0fff40 2024-09-12T02:51:23.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.030+0000 7fd0d1d52640 1 -- 172.21.15.100:0/4174564681 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0cc1a2aa0 con 0x7fd0cc0fff40 2024-09-12T02:51:23.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.034+0000 7fd0d538d740 1 Processor -- start 2024-09-12T02:51:23.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.034+0000 7fd0d538d740 1 -- start start 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.034+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a5e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.034+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5e970 0x55b6b3a5edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a69730 0x55b6b3a6bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0d538d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b6b39c42f0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0d538d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b6b396bcf0 con 0x55b6b3a69730 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0d538d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b6b39c02b0 con 0x55b6b3a5e970 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a69730 0x55b6b3a6bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a69730 0x55b6b3a6bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54710/0 (socket says 172.21.15.100:54710) 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 -- 172.21.15.100:0/611301290 learned_addr learned my addr 172.21.15.100:0/611301290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0d1551640 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 -- 172.21.15.100:0/611301290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5e970 msgr2=0x55b6b3a5edb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5e970 0x55b6b3a5edb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 -- 172.21.15.100:0/611301290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5fde0 msgr2=0x55b6b3a5e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a5e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 -- 172.21.15.100:0/611301290 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b39503a0 con 0x55b6b3a69730 2024-09-12T02:51:23.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0c9ffb640 1 -- 172.21.15.100:0/4174564681 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fd0c0054020 con 0x7fd0cc0fff40 2024-09-12T02:51:23.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.035+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a69730 0x55b6b3a6bb20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009be0 tx=0x7fd0b800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f26fb50e3df48c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.036+0000 7fd0d1d52640 1 -- 172.21.15.100:0/611301290 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8005020 con 0x55b6b3a69730 2024-09-12T02:51:23.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.036+0000 7fd0d1d52640 1 -- 172.21.15.100:0/611301290 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0b80047a0 con 0x55b6b3a69730 2024-09-12T02:51:23.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.036+0000 7fd0d1d52640 1 -- 172.21.15.100:0/611301290 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8010690 con 0x55b6b3a69730 2024-09-12T02:51:23.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.036+0000 7fd0c9ffb640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0bc0a2cd0 0x7fd0bc0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.037+0000 7fd0d1551640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0bc0a2cd0 0x7fd0bc0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.037+0000 7fd0c9ffb640 1 -- 172.21.15.100:0/4174564681 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd0c0100d50 con 0x7fd0cc0fff40 2024-09-12T02:51:23.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.037+0000 7fd0d538d740 1 -- 172.21.15.100:0/611301290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a69730 msgr2=0x55b6b3a6bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.037+0000 7fd0d538d740 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a69730 0x55b6b3a6bb20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009be0 tx=0x7fd0b800e720 comp rx=0 tx=0).stop 2024-09-12T02:51:23.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 -- 172.21.15.100:0/611301290 shutdown_connections 2024-09-12T02:51:23.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a69730 0x55b6b3a6bb20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5e970 0x55b6b3a5edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 --2- 172.21.15.100:0/611301290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a5e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 -- 172.21.15.100:0/611301290 >> 172.21.15.100:0/611301290 conn(0x55b6b3a27310 msgr2=0x55b6b3a5b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 -- 172.21.15.100:0/611301290 shutdown_connections 2024-09-12T02:51:23.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 -- 172.21.15.100:0/611301290 wait complete. 2024-09-12T02:51:23.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.038+0000 7fd0d538d740 1 -- start start 2024-09-12T02:51:23.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 1 Processor -- start 2024-09-12T02:51:23.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d1551640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0bc0a2cd0 0x7fd0bc0a5190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc107640 tx=0x7fd0c400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a69110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a69730 0x55b6b3a66990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3a6c2a0 con 0x55b6b3a5e970 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b6b397f060 con 0x55b6b3a5fde0 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3a6c420 con 0x55b6b3a69730 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d538d740 10 client.0 _ll_register_callbacks cb 0x55b6b36d28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a663c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54726/0 (socket says 172.21.15.100:54726) 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0cbfff640 1 -- 172.21.15.100:0/2981226016 learned_addr learned my addr 172.21.15.100:0/2981226016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.039+0000 7fd0d1551640 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a69730 0x55b6b3a66990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a69110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0cbfff640 1 -- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a69730 msgr2=0x55b6b3a66990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a69730 0x55b6b3a66990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0cbfff640 1 -- 172.21.15.100:0/2981226016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 msgr2=0x55b6b3a69110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a69110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0cbfff640 1 -- 172.21.15.100:0/2981226016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b37353c0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a663c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005710 tx=0x7fd0b8004f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb05ead2f6e39d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0abfff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0abfff640 1 -- 172.21.15.100:0/2981226016 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b801d040 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0abfff640 1 -- 172.21.15.100:0/2981226016 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd0b8005220 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b80047a0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.040+0000 7fd0abfff640 1 -- 172.21.15.100:0/2981226016 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd0b8009860 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 10 client.26867 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b6b3a77ce0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0abfff640 1 -- 172.21.15.100:0/2981226016 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0b80047a0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0abfff640 1 -- 172.21.15.100:0/2981226016 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd0b8010430 con 0x55b6b3a5fde0 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 10 client.26867 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 10 client.26867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:51:23.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 20 client.26867 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:23.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a790e0 0x55b6b3a7b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 4 client.26867 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:23.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6b39d1860 con 0x55b6b3a790e0 2024-09-12T02:51:23.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.041+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a790e0 0x55b6b3a7b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.042+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a790e0 0x55b6b3a7b4d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e17553b2b5c2427f server_cookie=fe074ee8ab81e10f in_seq=0 out_seq=0 2024-09-12T02:51:23.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.042+0000 7fd0abfff640 10 client.26867 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:51:23.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.043+0000 7fd0abfff640 1 -- 172.21.15.100:0/2981226016 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6b39d1860 con 0x55b6b3a790e0 2024-09-12T02:51:23.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.043+0000 7fd0abfff640 10 client.26867 handle_command_reply: tid=0 2024-09-12T02:51:23.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.043+0000 7fd0d538d740 1 client.26867 shutdown 2024-09-12T02:51:23.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a5fde0 msgr2=0x55b6b3a663c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a663c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005710 tx=0x7fd0b8004f20 comp rx=0 tx=0).stop 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 shutdown_connections 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a790e0 0x55b6b3a7b4d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a69730 0x55b6b3a66990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a663c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2981226016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a69110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0abfff640 0 client.26867 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 >> 172.21.15.100:0/2981226016 conn(0x55b6b3a27310 msgr2=0x55b6b3a60d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 shutdown_connections 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 1 -- 172.21.15.100:0/2981226016 wait complete. 2024-09-12T02:51:23.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.044+0000 7fd0d538d740 20 client.26867 trim_cache size 0 max 16384 2024-09-12T02:51:23.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.060+0000 7fd0d538d740 1 Processor -- start 2024-09-12T02:51:23.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.060+0000 7fd0d538d740 1 -- start start 2024-09-12T02:51:23.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a75500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a80ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d538d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1ad8c0 con 0x55b6b3a5e970 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d538d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1ab190 con 0x55b6b3a27310 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d538d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1a8fe0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a75500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a75500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54732/0 (socket says 172.21.15.100:54732) 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 -- 172.21.15.100:0/2338780029 learned_addr learned my addr 172.21.15.100:0/2338780029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d1551640 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a80ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 -- 172.21.15.100:0/2338780029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 msgr2=0x55b6b3a80ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a80ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 -- 172.21.15.100:0/2338780029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 msgr2=0x55b6b3a653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d0d50640 1 -- 172.21.15.100:0/2338780029 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b3a64910 con 0x55b6b3a27310 2024-09-12T02:51:23.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.061+0000 7fd0d1551640 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a80ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:23.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.062+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a75500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00c9a00 tx=0x7fd0c00d0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f00ca515dc29183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.062+0000 7fd0b67fc640 1 -- 172.21.15.100:0/2338780029 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00e6070 con 0x55b6b3a27310 2024-09-12T02:51:23.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.062+0000 7fd0b67fc640 1 -- 172.21.15.100:0/2338780029 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0c00d6210 con 0x55b6b3a27310 2024-09-12T02:51:23.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.062+0000 7fd0b67fc640 1 -- 172.21.15.100:0/2338780029 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00d5fe0 con 0x55b6b3a27310 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.063+0000 7fd0d538d740 1 -- 172.21.15.100:0/2338780029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 msgr2=0x55b6b3a75500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.063+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a75500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00c9a00 tx=0x7fd0c00d0040 comp rx=0 tx=0).stop 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.063+0000 7fd0d538d740 1 -- 172.21.15.100:0/2338780029 shutdown_connections 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.063+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a80ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.063+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.063+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2338780029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a75500 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.063+0000 7fd0d538d740 1 -- 172.21.15.100:0/2338780029 >> 172.21.15.100:0/2338780029 conn(0x55b6b3a61db0 msgr2=0x55b6b3a64c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.064+0000 7fd0d538d740 1 -- 172.21.15.100:0/2338780029 shutdown_connections 2024-09-12T02:51:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.064+0000 7fd0d538d740 1 -- 172.21.15.100:0/2338780029 wait complete. 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.064+0000 7fd0d538d740 1 -- start start 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.064+0000 7fd0d538d740 1 Processor -- start 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a6d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a6db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d538d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a6e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d538d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1a9650 con 0x55b6b3a5e970 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d538d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1aaac0 con 0x55b6b3a27310 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d538d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1a9d20 con 0x55b6b3a5fde0 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d538d740 10 client.0 _ll_register_callbacks cb 0x7fd0b8009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d1551640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a6e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d1551640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a6e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51836/0 (socket says 172.21.15.100:51836) 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.065+0000 7fd0d1551640 1 -- 172.21.15.100:0/2290542356 learned_addr learned my addr 172.21.15.100:0/2290542356 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a6db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a6d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0d1551640 1 -- 172.21.15.100:0/2290542356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 msgr2=0x55b6b3a6d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0d1551640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a6d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0d1551640 1 -- 172.21.15.100:0/2290542356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 msgr2=0x55b6b3a6db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0d1551640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a6db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0d1551640 1 -- 172.21.15.100:0/2290542356 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b3ae2ca0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.066+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a6d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.067+0000 7fd0cbfff640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a6db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.067+0000 7fd0d1551640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a6e050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400ad70 tx=0x7fd0c4004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc750b845ebdf6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.067+0000 7fd0abfff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:51:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.067+0000 7fd0abfff640 1 -- 172.21.15.100:0/2290542356 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c402a020 con 0x55b6b3a5fde0 2024-09-12T02:51:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.067+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c00d6210 con 0x55b6b3a5fde0 2024-09-12T02:51:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.067+0000 7fd0abfff640 1 -- 172.21.15.100:0/2290542356 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fd0c4026870 con 0x55b6b3a5fde0 2024-09-12T02:51:23.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.068+0000 7fd0abfff640 1 -- 172.21.15.100:0/2290542356 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd0c400ae60 con 0x55b6b3a5fde0 2024-09-12T02:51:23.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.068+0000 7fd0d538d740 10 client.26812 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:23.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.068+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b6b3ae3fe0 con 0x55b6b3a5fde0 2024-09-12T02:51:23.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.068+0000 7fd0abfff640 1 -- 172.21.15.100:0/2290542356 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0c00d6210 con 0x55b6b3a5fde0 2024-09-12T02:51:23.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.068+0000 7fd0abfff640 1 -- 172.21.15.100:0/2290542356 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd0c4037020 con 0x55b6b3a5fde0 2024-09-12T02:51:23.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d538d740 10 client.26812 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d538d740 10 client.26812 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d538d740 20 client.26812 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a69730 0x55b6b3ae67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d538d740 4 client.26812 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b6b39cbd70 con 0x55b6b3a69730 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a69730 0x55b6b3ae67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0abfff640 10 client.26812 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d0d50640 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a69730 0x55b6b3ae67a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87a5ac39fd07cd73 server_cookie=59a9a6d73b6be35d in_seq=0 out_seq=0 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0abfff640 1 -- 172.21.15.100:0/2290542356 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b6b39cbd70 con 0x55b6b3a69730 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0abfff640 10 client.26812 handle_command_reply: tid=0 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.069+0000 7fd0d538d740 1 client.26812 shutdown 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 msgr2=0x55b6b3a6e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a6e050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400ad70 tx=0x7fd0c4004a80 comp rx=0 tx=0).stop 2024-09-12T02:51:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 shutdown_connections 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x55b6b3a69730 0x55b6b3ae67a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6b3a5fde0 0x55b6b3a6e050 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6b3a5e970 0x55b6b3a6db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 --2- 172.21.15.100:0/2290542356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6b3a27310 0x55b6b3a6d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 >> 172.21.15.100:0/2290542356 conn(0x55b6b3a61db0 msgr2=0x55b6b3a654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0abfff640 0 client.26812 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 shutdown_connections 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 1 -- 172.21.15.100:0/2290542356 wait complete. 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0d538d740 20 client.26812 trim_cache size 0 max 16384 2024-09-12T02:51:23.076 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:51:23.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0b77fe640 1 -- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0bc0a2cd0 msgr2=0x7fd0bc0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0b77fe640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0bc0a2cd0 0x7fd0bc0a5190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc107640 tx=0x7fd0c400d040 comp rx=0 tx=0).stop 2024-09-12T02:51:23.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0b77fe640 1 -- 172.21.15.100:0/4174564681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 msgr2=0x7fd0cc195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.070+0000 7fd0b77fe640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 0x7fd0cc195f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0005ab0 tx=0x7fd0c0005150 comp rx=0 tx=0).stop 2024-09-12T02:51:23.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 -- 172.21.15.100:0/4174564681 shutdown_connections 2024-09-12T02:51:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fd0bc0a2cd0 0x7fd0bc0a5190 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc106a00 0x7fd0cc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0cc1008c0 0x7fd0cc196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 --2- 172.21.15.100:0/4174564681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0cc0fff40 0x7fd0cc195f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 -- 172.21.15.100:0/4174564681 >> 172.21.15.100:0/4174564681 conn(0x7fd0cc077070 msgr2=0x7fd0cc1022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 -- 172.21.15.100:0/4174564681 shutdown_connections 2024-09-12T02:51:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:23.071+0000 7fd0b77fe640 1 -- 172.21.15.100:0/4174564681 wait complete. 2024-09-12T02:51:23.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:22 smithi117 ceph-mon[34898]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.8 MiB/s wr, 538 op/s 2024-09-12T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:22 smithi189 ceph-mon[35196]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.8 MiB/s wr, 538 op/s 2024-09-12T02:51:24.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:51:24.386 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:24 smithi100 ceph-mon[31390]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.3 MiB/s wr, 572 op/s 2024-09-12T02:51:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.190+0000 7f0edccfa640 1 -- 172.21.15.100:0/1111929677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8100e20 msgr2=0x7f0ed8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.190+0000 7f0edccfa640 1 --2- 172.21.15.100:0/1111929677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8100e20 0x7f0ed8101200 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009900 tx=0x7f0ec802a480 comp rx=0 tx=0).stop 2024-09-12T02:51:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.190+0000 7f0edccfa640 1 -- 172.21.15.100:0/1111929677 shutdown_connections 2024-09-12T02:51:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.190+0000 7f0edccfa640 1 --2- 172.21.15.100:0/1111929677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8102ef0 0x7f0ed810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.190+0000 7f0edccfa640 1 --2- 172.21.15.100:0/1111929677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102570 0x7f0ed81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.190+0000 7f0edccfa640 1 --2- 172.21.15.100:0/1111929677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8100e20 0x7f0ed8101200 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.190+0000 7f0edccfa640 1 -- 172.21.15.100:0/1111929677 >> 172.21.15.100:0/1111929677 conn(0x7f0ed80fc7d0 msgr2=0x7f0ed80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.191+0000 7f0edccfa640 1 -- 172.21.15.100:0/1111929677 shutdown_connections 2024-09-12T02:51:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.191+0000 7f0edccfa640 1 -- 172.21.15.100:0/1111929677 wait complete. 2024-09-12T02:51:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.192+0000 7f0edccfa640 1 Processor -- start 2024-09-12T02:51:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0edccfa640 1 -- start start 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0edccfa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8100e20 0x7f0ed8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0edccfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8102570 0x7f0ed81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0edccfa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102ef0 0x7f0ed81a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0edccfa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8110f80 con 0x7f0ed8102570 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0edccfa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8110e00 con 0x7f0ed8102ef0 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0edccfa640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8111100 con 0x7f0ed8100e20 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8102570 0x7f0ed81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8100e20 0x7f0ed8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8102570 0x7f0ed81998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56810/0 (socket says 172.21.15.100:56810) 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8100e20 0x7f0ed8199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:47458/0 (socket says 172.21.15.100:47458) 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/32839779 learned_addr learned my addr 172.21.15.100:0/32839779 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed6d9d640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102ef0 0x7f0ed81a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed659c640 1 -- 172.21.15.100:0/32839779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102ef0 msgr2=0x7f0ed81a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed659c640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102ef0 0x7f0ed81a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed659c640 1 -- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8102570 msgr2=0x7f0ed81998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed659c640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8102570 0x7f0ed81998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed659c640 1 -- 172.21.15.100:0/32839779 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed81a4920 con 0x7f0ed8100e20 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.193+0000 7f0ed6d9d640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102ef0 0x7f0ed81a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.194+0000 7f0ed659c640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8100e20 0x7f0ed8199360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005940 tx=0x7f0ec8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.194+0000 7f0ec77fe640 1 -- 172.21.15.100:0/32839779 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec803f070 con 0x7f0ed8100e20 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.194+0000 7f0ec77fe640 1 -- 172.21.15.100:0/32839779 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec8031c30 con 0x7f0ed8100e20 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.194+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed8197150 con 0x7f0ed8100e20 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.194+0000 7f0ec77fe640 1 -- 172.21.15.100:0/32839779 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8035030 con 0x7f0ed8100e20 2024-09-12T02:51:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.194+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed8197630 con 0x7f0ed8100e20 2024-09-12T02:51:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.197+0000 7f0ec77fe640 1 -- 172.21.15.100:0/32839779 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f0ec8042070 con 0x7f0ed8100e20 2024-09-12T02:51:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.197+0000 7f0edf0d3740 1 Processor -- start 2024-09-12T02:51:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.197+0000 7f0edf0d3740 1 -- start start 2024-09-12T02:51:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a41090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a41a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eca79a72f0 con 0x55eca7a415d0 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55eca794ecf0 con 0x55eca7a4c370 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eca79a32b0 con 0x55eca7a42b40 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed6d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a41a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed6d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a41090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:47466/0 (socket says 172.21.15.100:47466) 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed6d9d640 1 -- 172.21.15.100:0/3439066439 learned_addr learned my addr 172.21.15.100:0/3439066439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ec77fe640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ec00a2b80 0x7f0ec00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed6d9d640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ec00a2b80 0x7f0ec00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/3439066439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 msgr2=0x55eca7a41090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a41090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/3439066439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 msgr2=0x55eca7a41a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a41a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/3439066439 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca79333a0 con 0x55eca7a4c370 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.198+0000 7f0ec77fe640 1 -- 172.21.15.100:0/32839779 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f0ec80ef6b0 con 0x7f0ed8100e20 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.199+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a4e760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ed806aac0 tx=0x7f0ecc005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556296a1a1958d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.199+0000 7f0ed6d9d640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ec00a2b80 0x7f0ec00a5040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0012db0 tx=0x7f0ed0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.199+0000 7f0ec4ff9640 1 -- 172.21.15.100:0/3439066439 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc004250 con 0x55eca7a4c370 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.199+0000 7f0ec4ff9640 1 -- 172.21.15.100:0/3439066439 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc0043f0 con 0x55eca7a4c370 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.199+0000 7f0ec4ff9640 1 -- 172.21.15.100:0/3439066439 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc01aa40 con 0x55eca7a4c370 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.199+0000 7f0edf0d3740 1 -- 172.21.15.100:0/3439066439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 msgr2=0x55eca7a4e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.199+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a4e760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ed806aac0 tx=0x7f0ecc005f90 comp rx=0 tx=0).stop 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- 172.21.15.100:0/3439066439 shutdown_connections 2024-09-12T02:51:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a4e760 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a41a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/3439066439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a41090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- 172.21.15.100:0/3439066439 >> 172.21.15.100:0/3439066439 conn(0x55eca7a0a310 msgr2=0x55eca7a3dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- 172.21.15.100:0/3439066439 shutdown_connections 2024-09-12T02:51:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- 172.21.15.100:0/3439066439 wait complete. 2024-09-12T02:51:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- start start 2024-09-12T02:51:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 Processor -- start 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a4bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a42b40 0x55eca7a48f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a4c370 0x55eca7a494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eca7a4f070 con 0x55eca7a4c370 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55eca7962060 con 0x55eca7a42b40 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eca7a4f1f0 con 0x55eca7a415d0 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.200+0000 7f0edf0d3740 10 client.0 _ll_register_callbacks cb 0x55eca76b58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a4bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a4bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:47472/0 (socket says 172.21.15.100:47472) 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed659c640 1 -- 172.21.15.100:0/2913363832 learned_addr learned my addr 172.21.15.100:0/2913363832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a42b40 0x55eca7a48f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed6d9d640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a4c370 0x55eca7a494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/2913363832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 msgr2=0x55eca7a4bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a4bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/2913363832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a4c370 msgr2=0x55eca7a494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a4c370 0x55eca7a494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/2913363832 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca77183c0 con 0x55eca7a42b40 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.201+0000 7f0ed6d9d640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a4c370 0x55eca7a494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.202+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a42b40 0x55eca7a48f90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc01a5e0 tx=0x7f0ecc01aa90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d40e3ef2970550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.202+0000 7f0ebdffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.202+0000 7f0ebdffb640 1 -- 172.21.15.100:0/2913363832 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc02a020 con 0x55eca7a42b40 2024-09-12T02:51:25.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.202+0000 7f0ebdffb640 1 -- 172.21.15.100:0/2913363832 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f0ecc005460 con 0x55eca7a42b40 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.202+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ecc0043f0 con 0x55eca7a42b40 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0ebdffb640 1 -- 172.21.15.100:0/2913363832 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ecc010a90 con 0x55eca7a42b40 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 10 client.26885 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eca7a5aa80 con 0x55eca7a42b40 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0ebdffb640 1 -- 172.21.15.100:0/2913363832 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc003ad0 con 0x55eca7a42b40 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0ebdffb640 1 -- 172.21.15.100:0/2913363832 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0ecc004c30 con 0x55eca7a42b40 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 10 client.26885 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 10 client.26885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 20 client.26885 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7a5bdd0 0x55eca7a5e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 4 client.26885 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.203+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ecc0043f0 con 0x55eca7a5bdd0 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.204+0000 7f0ed659c640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7a5bdd0 0x55eca7a5e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.204+0000 7f0ebdffb640 10 client.26885 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.204+0000 7f0ed659c640 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7a5bdd0 0x55eca7a5e1c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3270cbc54ce1aea1 server_cookie=dbeba35626b5ec94 in_seq=0 out_seq=0 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0ebdffb640 1 -- 172.21.15.100:0/2913363832 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0ecc0043f0 con 0x55eca7a5bdd0 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0ebdffb640 10 client.26885 handle_command_reply: tid=0 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 client.26885 shutdown 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a42b40 msgr2=0x55eca7a48f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a42b40 0x55eca7a48f90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc01a5e0 tx=0x7f0ecc01aa90 comp rx=0 tx=0).stop 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 shutdown_connections 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7a5bdd0 0x55eca7a5e1c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a4c370 0x55eca7a494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a42b40 0x55eca7a48f90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0ebdffb640 0 client.26885 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/2913363832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a4bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 >> 172.21.15.100:0/2913363832 conn(0x55eca7a0a310 msgr2=0x55eca7a43960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 shutdown_connections 2024-09-12T02:51:25.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 1 -- 172.21.15.100:0/2913363832 wait complete. 2024-09-12T02:51:25.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.205+0000 7f0edf0d3740 20 client.26885 trim_cache size 0 max 16384 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 Processor -- start 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 -- start start 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a3de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a58310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a48850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81add30 con 0x55eca7a415d0 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81ab600 con 0x55eca7a4c370 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81a9450 con 0x55eca7a42b40 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0ed659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a3de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a58310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a58310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:47480/0 (socket says 172.21.15.100:47480) 2024-09-12T02:51:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/4138835291 learned_addr learned my addr 172.21.15.100:0/4138835291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.222+0000 7f0ed6d9d640 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a48850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.223+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/4138835291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 msgr2=0x55eca7a48850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.223+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a48850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.223+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/4138835291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 msgr2=0x55eca7a3de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.223+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a3de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.223+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/4138835291 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca7a44ba0 con 0x55eca7a42b40 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.223+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a58310 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc031040 tx=0x7f0ecc005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf960bb1295e0785 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.224+0000 7f0ebffff640 1 -- 172.21.15.100:0/4138835291 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0043f0 con 0x55eca7a42b40 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.224+0000 7f0ebffff640 1 -- 172.21.15.100:0/4138835291 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc01a400 con 0x55eca7a42b40 2024-09-12T02:51:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.224+0000 7f0ebffff640 1 -- 172.21.15.100:0/4138835291 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc004680 con 0x55eca7a42b40 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 -- 172.21.15.100:0/4138835291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 msgr2=0x55eca7a58310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a58310 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc031040 tx=0x7f0ecc005d30 comp rx=0 tx=0).stop 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 -- 172.21.15.100:0/4138835291 shutdown_connections 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a48850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a42b40 0x55eca7a58310 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/4138835291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a415d0 0x55eca7a3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 -- 172.21.15.100:0/4138835291 >> 172.21.15.100:0/4138835291 conn(0x55eca7a0a310 msgr2=0x55eca7a3d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 -- 172.21.15.100:0/4138835291 shutdown_connections 2024-09-12T02:51:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.225+0000 7f0edf0d3740 1 -- 172.21.15.100:0/4138835291 wait complete. 2024-09-12T02:51:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 -- start start 2024-09-12T02:51:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 Processor -- start 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a547f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a42b40 0x55eca7a54d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a45b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81a9ac0 con 0x55eca7a42b40 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81aaf30 con 0x55eca7a4c370 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81aa190 con 0x55eca7a415d0 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.226+0000 7f0edf0d3740 10 client.0 _ll_register_callbacks cb 0x7f0ecc010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a42b40 0x55eca7a54d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a45b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a42b40 0x55eca7a54d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56852/0 (socket says 172.21.15.100:56852) 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/550981091 learned_addr learned my addr 172.21.15.100:0/550981091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed659c640 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/550981091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 msgr2=0x55eca7a547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/550981091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 msgr2=0x55eca7a45b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a45b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 -- 172.21.15.100:0/550981091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca7a46330 con 0x55eca7a42b40 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ed5d9b640 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a42b40 0x55eca7a54d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc012040 tx=0x7f0ecc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd65c9d5d5b7a953 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ebdffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.227+0000 7f0ebdffb640 1 -- 172.21.15.100:0/550981091 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc046060 con 0x55eca7a42b40 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ecc01a400 con 0x55eca7a42b40 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0ebdffb640 1 -- 172.21.15.100:0/550981091 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f0ecc010030 con 0x55eca7a42b40 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0ebdffb640 1 -- 172.21.15.100:0/550981091 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ecc0043f0 con 0x55eca7a42b40 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 10 client.17613 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eca7acec00 con 0x55eca7a42b40 2024-09-12T02:51:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0ebdffb640 1 -- 172.21.15.100:0/550981091 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc01a400 con 0x55eca7a42b40 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0ebdffb640 1 -- 172.21.15.100:0/550981091 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0ecc004b60 con 0x55eca7a42b40 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 10 client.17613 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 20 client.17613 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7acf290 0x55eca7ad16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 4 client.17613 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eca79b4860 con 0x55eca7acf290 2024-09-12T02:51:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.228+0000 7f0ed659c640 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7acf290 0x55eca7ad16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.229+0000 7f0ebdffb640 10 client.17613 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.229+0000 7f0ed659c640 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7acf290 0x55eca7ad16b0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d589c24138598df server_cookie=7913c0ef1b71d686 in_seq=0 out_seq=0 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0ebdffb640 1 -- 172.21.15.100:0/550981091 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eca79b4860 con 0x55eca7acf290 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0ebdffb640 10 client.17613 handle_command_reply: tid=0 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 client.17613 shutdown 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a42b40 msgr2=0x55eca7a54d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a42b40 0x55eca7a54d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc012040 tx=0x7f0ecc0056d0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 shutdown_connections 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55eca7acf290 0x55eca7ad16b0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eca7a4c370 0x55eca7a45b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eca7a42b40 0x55eca7a54d30 secure :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc012040 tx=0x7f0ecc0056d0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 --2- 172.21.15.100:0/550981091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eca7a415d0 0x55eca7a547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 >> 172.21.15.100:0/550981091 conn(0x55eca7a0a310 msgr2=0x55eca7a3d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0ebdffb640 0 client.17613 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:25.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.230+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 shutdown_connections 2024-09-12T02:51:25.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edf0d3740 1 -- 172.21.15.100:0/550981091 wait complete. 2024-09-12T02:51:25.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edf0d3740 20 client.17613 trim_cache size 0 max 16384 2024-09-12T02:51:25.234 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ec00a2b80 msgr2=0x7f0ec00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ec00a2b80 0x7f0ec00a5040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0012db0 tx=0x7f0ed0004ab0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8100e20 msgr2=0x7f0ed8199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8100e20 0x7f0ed8199360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005940 tx=0x7f0ec8003c10 comp rx=0 tx=0).stop 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 shutdown_connections 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f0ec00a2b80 0x7f0ec00a5040 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102ef0 0x7f0ed81a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ed8102570 0x7f0ed81998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 --2- 172.21.15.100:0/32839779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ed8100e20 0x7f0ed8199360 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.231+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 >> 172.21.15.100:0/32839779 conn(0x7f0ed80fc7d0 msgr2=0x7f0ed80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.232+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 shutdown_connections 2024-09-12T02:51:25.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:25.232+0000 7f0edccfa640 1 -- 172.21.15.100:0/32839779 wait complete. 2024-09-12T02:51:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:24 smithi189 ceph-mon[35196]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.3 MiB/s wr, 572 op/s 2024-09-12T02:51:25.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:24 smithi117 ceph-mon[34898]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.3 MiB/s wr, 572 op/s 2024-09-12T02:51:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 735.0 s, 2839.2 tps, lat 35.364 ms stddev 40.376 2024-09-12T02:51:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:26 smithi100 ceph-mon[31390]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.5 MiB/s wr, 676 op/s 2024-09-12T02:51:27.129 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:51:27.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:51:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:26 smithi189 ceph-mon[35196]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.5 MiB/s wr, 676 op/s 2024-09-12T02:51:27.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:26 smithi117 ceph-mon[34898]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.5 MiB/s wr, 676 op/s 2024-09-12T02:51:27.519 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.055+0000 7f3341049640 1 -- 172.21.15.100:0/1397677729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c102570 msgr2=0x7f333c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.055+0000 7f3341049640 1 --2- 172.21.15.100:0/1397677729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c102570 0x7f333c1029b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3330009900 tx=0x7f333002a480 comp rx=0 tx=0).stop 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.056+0000 7f3341049640 1 -- 172.21.15.100:0/1397677729 shutdown_connections 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.056+0000 7f3341049640 1 --2- 172.21.15.100:0/1397677729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102ef0 0x7f333c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.056+0000 7f3341049640 1 --2- 172.21.15.100:0/1397677729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c102570 0x7f333c1029b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.056+0000 7f3341049640 1 --2- 172.21.15.100:0/1397677729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f333c100e20 0x7f333c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.056+0000 7f3341049640 1 -- 172.21.15.100:0/1397677729 >> 172.21.15.100:0/1397677729 conn(0x7f333c0fc7d0 msgr2=0x7f333c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.056+0000 7f3341049640 1 -- 172.21.15.100:0/1397677729 shutdown_connections 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.056+0000 7f3341049640 1 -- 172.21.15.100:0/1397677729 wait complete. 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 Processor -- start 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 -- start start 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c100e20 0x7f333c19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102570 0x7f333c19e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f333c102ef0 0x7f333c1964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f333c110fd0 con 0x7f333c100e20 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f333c110e50 con 0x7f333c102570 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.057+0000 7f3341049640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f333c111150 con 0x7f333c102ef0 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102570 0x7f333c19e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102570 0x7f333c19e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:57948/0 (socket says 172.21.15.100:57948) 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 -- 172.21.15.100:0/2603255711 learned_addr learned my addr 172.21.15.100:0/2603255711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333b59e640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f333c102ef0 0x7f333c1964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333ad9d640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c100e20 0x7f333c19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 -- 172.21.15.100:0/2603255711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f333c102ef0 msgr2=0x7f333c1964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f333c102ef0 0x7f333c1964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 -- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c100e20 msgr2=0x7f333c19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c100e20 0x7f333c19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 -- 172.21.15.100:0/2603255711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c196d60 con 0x7f333c102570 2024-09-12T02:51:28.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333b59e640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f333c102ef0 0x7f333c1964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:28.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f333a59c640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102570 0x7f333c19e6e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f333002aa70 tx=0x7f3330003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f3323fff640 1 -- 172.21.15.100:0/2603255711 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333003f070 con 0x7f333c102570 2024-09-12T02:51:28.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c196ff0 con 0x7f333c102570 2024-09-12T02:51:28.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f3323fff640 1 -- 172.21.15.100:0/2603255711 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330031c30 con 0x7f333c102570 2024-09-12T02:51:28.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.058+0000 7f3323fff640 1 -- 172.21.15.100:0/2603255711 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330035030 con 0x7f333c102570 2024-09-12T02:51:28.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.059+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c1b3e70 con 0x7f333c102570 2024-09-12T02:51:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.061+0000 7f3323fff640 1 -- 172.21.15.100:0/2603255711 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3330042070 con 0x7f333c102570 2024-09-12T02:51:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.062+0000 7f3343422740 1 Processor -- start 2024-09-12T02:51:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.062+0000 7f3343422740 1 -- start start 2024-09-12T02:51:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3343422740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd8ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3343422740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd99800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3323fff640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33240a2c80 0x7f33240a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3343422740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd99d40 0x556aafd9c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd8ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd8ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:57962/0 (socket says 172.21.15.100:57962) 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333ad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd99800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 -- 172.21.15.100:0/3003115571 learned_addr learned my addr 172.21.15.100:0/3003115571 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556aafcf4280 con 0x556aafd99d40 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333a59c640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33240a2c80 0x7f33240a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556aafc9bb10 con 0x556aafd8eb60 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556aafcf0240 con 0x556aafd8f480 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd99d40 0x556aafd9c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f3323fff640 1 -- 172.21.15.100:0/2603255711 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f33300ef5e0 con 0x7f333c102570 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 -- 172.21.15.100:0/3003115571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 msgr2=0x556aafd99800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd99800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 -- 172.21.15.100:0/3003115571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd99d40 msgr2=0x556aafd9c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd99d40 0x556aafd9c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.063+0000 7f333b59e640 1 -- 172.21.15.100:0/3003115571 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aafca81f0 con 0x556aafd8eb60 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.064+0000 7f333b59e640 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd8ef40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3334009fd0 tx=0x7f3334009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3050d67d55e59e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.064+0000 7f333a59c640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33240a2c80 0x7f33240a5140 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f33300b8850 tx=0x7f33300d2040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.064+0000 7f33217fa640 1 -- 172.21.15.100:0/3003115571 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333400fc50 con 0x556aafd8eb60 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.064+0000 7f33217fa640 1 -- 172.21.15.100:0/3003115571 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333400fdf0 con 0x556aafd8eb60 2024-09-12T02:51:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.064+0000 7f33217fa640 1 -- 172.21.15.100:0/3003115571 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333400e5b0 con 0x556aafd8eb60 2024-09-12T02:51:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.065+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 msgr2=0x556aafd8ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.065+0000 7f3343422740 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd8ef40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3334009fd0 tx=0x7f3334009f20 comp rx=0 tx=0).stop 2024-09-12T02:51:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.066+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 shutdown_connections 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.066+0000 7f3343422740 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd99d40 0x556aafd9c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.066+0000 7f3343422740 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd99800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.066+0000 7f3343422740 1 --2- 172.21.15.100:0/3003115571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd8ef40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.067+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 >> 172.21.15.100:0/3003115571 conn(0x556aafd8b0f0 msgr2=0x556aafd8b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.067+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 shutdown_connections 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.067+0000 7f3343422740 1 -- 172.21.15.100:0/3003115571 wait complete. 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.067+0000 7f3343422740 1 -- start start 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.067+0000 7f3343422740 1 Processor -- start 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f3343422740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd96c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f3343422740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8f480 0x556aafd971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f3343422740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd99d40 0x556aafd976e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f3343422740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556aafd9c910 con 0x556aafd8f480 2024-09-12T02:51:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f3343422740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556aafcaef10 con 0x556aafd8eb60 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f3343422740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556aafd9ca90 con 0x556aafd99d40 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd96c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd96c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:57970/0 (socket says 172.21.15.100:57970) 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 -- 172.21.15.100:0/335286729 learned_addr learned my addr 172.21.15.100:0/335286729 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333ad9d640 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8f480 0x556aafd971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd99d40 0x556aafd976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f3343422740 10 client.0 _ll_register_callbacks cb 0x556aafc77a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 -- 172.21.15.100:0/335286729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd99d40 msgr2=0x556aafd976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd99d40 0x556aafd976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 -- 172.21.15.100:0/335286729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8f480 msgr2=0x556aafd971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8f480 0x556aafd971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.068+0000 7f333b59e640 1 -- 172.21.15.100:0/335286729 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aafa656a0 con 0x556aafd8eb60 2024-09-12T02:51:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f333b59e640 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd96c60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3334003ed0 tx=0x7f3334011cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572d10154243487 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f331eff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f331eff5640 1 -- 172.21.15.100:0/335286729 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334004d10 con 0x556aafd8eb60 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f331eff5640 1 -- 172.21.15.100:0/335286729 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3334003fb0 con 0x556aafd8eb60 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333400fdf0 con 0x556aafd8eb60 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f331eff5640 1 -- 172.21.15.100:0/335286729 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3334035050 con 0x556aafd8eb60 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 10 client.26903 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556aafda8570 con 0x556aafd8eb60 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f331eff5640 1 -- 172.21.15.100:0/335286729 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333400fdf0 con 0x556aafd8eb60 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f331eff5640 1 -- 172.21.15.100:0/335286729 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f333401d020 con 0x556aafd8eb60 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 10 client.26903 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 10 client.26903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 20 client.26903 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafda98c0 0x556aafdabcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 4 client.26903 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:28.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.069+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aafd017f0 con 0x556aafda98c0 2024-09-12T02:51:28.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.070+0000 7f333ad9d640 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafda98c0 0x556aafdabcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.070+0000 7f331eff5640 10 client.26903 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:28.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.070+0000 7f333ad9d640 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafda98c0 0x556aafdabcb0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bacc640a96658e5 server_cookie=ff7fdd214921e866 in_seq=0 out_seq=0 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.071+0000 7f331eff5640 1 -- 172.21.15.100:0/335286729 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556aafd017f0 con 0x556aafda98c0 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.071+0000 7f331eff5640 10 client.26903 handle_command_reply: tid=0 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 client.26903 shutdown 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 msgr2=0x556aafd96c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd96c60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3334003ed0 tx=0x7f3334011cb0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 shutdown_connections 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafda98c0 0x556aafdabcb0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd99d40 0x556aafd976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f331eff5640 0 client.26903 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8f480 0x556aafd971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 --2- 172.21.15.100:0/335286729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafd96c60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 >> 172.21.15.100:0/335286729 conn(0x556aafd8b0f0 msgr2=0x556aafd8a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 shutdown_connections 2024-09-12T02:51:28.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 1 -- 172.21.15.100:0/335286729 wait complete. 2024-09-12T02:51:28.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.072+0000 7f3343422740 20 client.26903 trim_cache size 0 max 16384 2024-09-12T02:51:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 Processor -- start 2024-09-12T02:51:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 -- start start 2024-09-12T02:51:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafdb14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafdb1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd93ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1bec40 con 0x556aafd8b0f0 2024-09-12T02:51:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1bc510 con 0x556aafd8eb60 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.096+0000 7f3343422740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1ba360 con 0x556aafd8f480 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafdb14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafdb14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56912/0 (socket says 172.21.15.100:56912) 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 -- 172.21.15.100:0/440980873 learned_addr learned my addr 172.21.15.100:0/440980873 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333ad9d640 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafdb1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 -- 172.21.15.100:0/440980873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 msgr2=0x556aafd93ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd93ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 -- 172.21.15.100:0/440980873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 msgr2=0x556aafdb1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafdb1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 -- 172.21.15.100:0/440980873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aafd9c470 con 0x556aafd8b0f0 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333ad9d640 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafdb1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f333b59e640 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafdb14c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f333401fed0 tx=0x7f333401fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4ed139a3dcaba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.097+0000 7f3320ff9640 1 -- 172.21.15.100:0/440980873 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334032070 con 0x556aafd8b0f0 2024-09-12T02:51:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.098+0000 7f3320ff9640 1 -- 172.21.15.100:0/440980873 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33340116a0 con 0x556aafd8b0f0 2024-09-12T02:51:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.098+0000 7f3320ff9640 1 -- 172.21.15.100:0/440980873 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33340043e0 con 0x556aafd8b0f0 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.098+0000 7f3343422740 1 -- 172.21.15.100:0/440980873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 msgr2=0x556aafdb14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.098+0000 7f3343422740 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafdb14c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f333401fed0 tx=0x7f333401fa60 comp rx=0 tx=0).stop 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 -- 172.21.15.100:0/440980873 shutdown_connections 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd93ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafdb1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 --2- 172.21.15.100:0/440980873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafdb14c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 -- 172.21.15.100:0/440980873 >> 172.21.15.100:0/440980873 conn(0x556aafdac020 msgr2=0x556aafd98bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 -- 172.21.15.100:0/440980873 shutdown_connections 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 -- 172.21.15.100:0/440980873 wait complete. 2024-09-12T02:51:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 -- start start 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.099+0000 7f3343422740 1 Processor -- start 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f3343422740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafda1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f3343422740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafda2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f3343422740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd9ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f333b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafda1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f333b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafda1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56916/0 (socket says 172.21.15.100:56916) 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f333b59e640 1 -- 172.21.15.100:0/2712729738 learned_addr learned my addr 172.21.15.100:0/2712729738 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f333ad9d640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafda2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1ba9d0 con 0x556aafd8b0f0 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1bbe40 con 0x556aafd8eb60 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1bb0a0 con 0x556aafd8f480 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f3343422740 10 client.0 _ll_register_callbacks cb 0x7f3334011a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.100+0000 7f333b59e640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd9ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f333ad9d640 1 -- 172.21.15.100:0/2712729738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 msgr2=0x556aafd9ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f333ad9d640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd9ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f333ad9d640 1 -- 172.21.15.100:0/2712729738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 msgr2=0x556aafda1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f333ad9d640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafda1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f333ad9d640 1 -- 172.21.15.100:0/2712729738 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aafd9f250 con 0x556aafd8eb60 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f333b59e640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd9ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f333ad9d640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafda2280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x556aafdac430 tx=0x7f332c0108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e279ca90c9e039b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f331eff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f331eff5640 1 -- 172.21.15.100:0/2712729738 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c022070 con 0x556aafd8eb60 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f331eff5640 1 -- 172.21.15.100:0/2712729738 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f332c01f8d0 con 0x556aafd8eb60 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33340116a0 con 0x556aafd8eb60 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f331eff5640 1 -- 172.21.15.100:0/2712729738 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f332c01fad0 con 0x556aafd8eb60 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f3343422740 10 client.26909 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.101+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556aafe14ce0 con 0x556aafd8eb60 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f331eff5640 1 -- 172.21.15.100:0/2712729738 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33340116a0 con 0x556aafd8eb60 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f331eff5640 1 -- 172.21.15.100:0/2712729738 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f332c026400 con 0x556aafd8eb60 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f3343422740 10 client.26909 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f3343422740 10 client.26909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f3343422740 20 client.26909 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f3343422740 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafd99d40 0x556aafe173f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f3343422740 4 client.26909 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556aafcfbd00 con 0x556aafd99d40 2024-09-12T02:51:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.102+0000 7f333b59e640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafd99d40 0x556aafe173f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.103+0000 7f333b59e640 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafd99d40 0x556aafe173f0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafb0491ffe8d530 server_cookie=f3e831b952941872 in_seq=0 out_seq=0 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.103+0000 7f331eff5640 10 client.26909 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f331eff5640 1 -- 172.21.15.100:0/2712729738 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556aafcfbd00 con 0x556aafd99d40 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f331eff5640 10 client.26909 handle_command_reply: tid=0 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f3343422740 1 client.26909 shutdown 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 msgr2=0x556aafda2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f3343422740 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafda2280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x556aafdac430 tx=0x7f332c0108c0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 shutdown_connections 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f3343422740 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x556aafd99d40 0x556aafe173f0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f3343422740 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556aafd8f480 0x556aafd9ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f331eff5640 0 client.26909 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.104+0000 7f3343422740 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556aafd8eb60 0x556aafda2280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.105+0000 7f3343422740 1 --2- 172.21.15.100:0/2712729738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aafd8b0f0 0x556aafda1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.105+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 >> 172.21.15.100:0/2712729738 conn(0x556aafdac020 msgr2=0x556aafd905b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.105+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 shutdown_connections 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.105+0000 7f3343422740 1 -- 172.21.15.100:0/2712729738 wait complete. 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.105+0000 7f3343422740 20 client.26909 trim_cache size 0 max 16384 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "59e5a1dc-633f-488b-b638-41a8db6f1127", 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:51:28.109 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:51:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33240a2c80 msgr2=0x7f33240a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33240a2c80 0x7f33240a5140 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f33300b8850 tx=0x7f33300d2040 comp rx=0 tx=0).stop 2024-09-12T02:51:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102570 msgr2=0x7f333c19e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102570 0x7f333c19e6e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f333002aa70 tx=0x7f3330003c10 comp rx=0 tx=0).stop 2024-09-12T02:51:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 shutdown_connections 2024-09-12T02:51:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f33240a2c80 0x7f33240a5140 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f333c102ef0 0x7f333c1964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f333c102570 0x7f333c19e6e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 --2- 172.21.15.100:0/2603255711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c100e20 0x7f333c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.106+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 >> 172.21.15.100:0/2603255711 conn(0x7f333c0fc7d0 msgr2=0x7f333c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.107+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 shutdown_connections 2024-09-12T02:51:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:28.107+0000 7f3341049640 1 -- 172.21.15.100:0/2603255711 wait complete. 2024-09-12T02:51:28.926 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:28 smithi100 ceph-mon[31390]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 643 op/s 2024-09-12T02:51:28.926 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:28 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:51:28.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:28 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:28.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:28 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:51:28.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:28 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:51:28.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:28 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:28.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:28 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:28.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:51:29.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:28 smithi189 ceph-mon[35196]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 643 op/s 2024-09-12T02:51:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:28 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:51:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:28 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:28 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:51:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:28 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:51:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:28 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:28 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:29.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:28 smithi117 ceph-mon[34898]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 643 op/s 2024-09-12T02:51:29.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:28 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:51:29.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:28 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:29.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:28 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:51:29.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:28 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:51:29.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:28 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:29.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:28 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:51:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:51:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 -- 172.21.15.100:0/74536230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc103650 msgr2=0x7fc5cc10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 --2- 172.21.15.100:0/74536230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc103650 0x7fc5cc10bb40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009900 tx=0x7fc5b402a480 comp rx=0 tx=0).stop 2024-09-12T02:51:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 -- 172.21.15.100:0/74536230 shutdown_connections 2024-09-12T02:51:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 --2- 172.21.15.100:0/74536230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc10c160 0x7fc5cc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 --2- 172.21.15.100:0/74536230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc103650 0x7fc5cc10bb40 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 --2- 172.21.15.100:0/74536230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5cc102d30 0x7fc5cc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 -- 172.21.15.100:0/74536230 >> 172.21.15.100:0/74536230 conn(0x7fc5cc0fc790 msgr2=0x7fc5cc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:29.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 -- 172.21.15.100:0/74536230 shutdown_connections 2024-09-12T02:51:29.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.876+0000 7fc5d2782640 1 -- 172.21.15.100:0/74536230 wait complete. 2024-09-12T02:51:29.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 Processor -- start 2024-09-12T02:51:29.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 -- start start 2024-09-12T02:51:29.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc102d30 0x7fc5cc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5cc103650 0x7fc5cc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc10c160 0x7fc5cc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc111fb0 con 0x7fc5cc10c160 2024-09-12T02:51:29.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc111e30 con 0x7fc5cc103650 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d2782640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc112130 con 0x7fc5cc102d30 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5cbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc102d30 0x7fc5cc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5cbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc102d30 0x7fc5cc198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:47556/0 (socket says 172.21.15.100:47556) 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5cbfff640 1 -- 172.21.15.100:0/3378297712 learned_addr learned my addr 172.21.15.100:0/3378297712 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.877+0000 7fc5d0d1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc10c160 0x7fc5cc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5cc103650 0x7fc5cc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5cbfff640 1 -- 172.21.15.100:0/3378297712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5cc103650 msgr2=0x7fc5cc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5cc103650 0x7fc5cc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5cbfff640 1 -- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc10c160 msgr2=0x7fc5cc19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc10c160 0x7fc5cc19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5cbfff640 1 -- 172.21.15.100:0/3378297712 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc19d3d0 con 0x7fc5cc102d30 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc10c160 0x7fc5cc19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:29.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc102d30 0x7fc5cc198420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00ea60 tx=0x7fc5bc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:29.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5c9ffb640 1 -- 172.21.15.100:0/3378297712 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00cde0 con 0x7fc5cc102d30 2024-09-12T02:51:29.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5cc19d6c0 con 0x7fc5cc102d30 2024-09-12T02:51:29.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5c9ffb640 1 -- 172.21.15.100:0/3378297712 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5bc0035f0 con 0x7fc5cc102d30 2024-09-12T02:51:29.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5c9ffb640 1 -- 172.21.15.100:0/3378297712 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc010670 con 0x7fc5cc102d30 2024-09-12T02:51:29.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.878+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5cc1a4fa0 con 0x7fc5cc102d30 2024-09-12T02:51:29.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.882+0000 7fc5c9ffb640 1 -- 172.21.15.100:0/3378297712 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fc5bc0037a0 con 0x7fc5cc102d30 2024-09-12T02:51:29.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5c9ffb640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc5b80a2b80 0x7fc5b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5c9ffb640 1 -- 172.21.15.100:0/3378297712 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc5bc0cf300 con 0x7fc5cc102d30 2024-09-12T02:51:29.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc5b80a2b80 0x7fc5b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 Processor -- start 2024-09-12T02:51:29.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 -- start start 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x56412339c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc5b80a2b80 0x7fc5b80a5040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4000c00 tx=0x7fc5b4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5641233022e0 con 0x56412339cdc0 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641232a9ce0 con 0x56412339c4a0 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.883+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5641232fe2a0 con 0x5641233a7680 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56942/0 (socket says 172.21.15.100:56942) 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5c3fff640 1 -- 172.21.15.100:0/732625814 learned_addr learned my addr 172.21.15.100:0/732625814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x56412339c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5d0d1f640 1 -- 172.21.15.100:0/732625814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 msgr2=0x56412339c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x56412339c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5d0d1f640 1 -- 172.21.15.100:0/732625814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 msgr2=0x5641233a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233a7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.884+0000 7fc5d0d1f640 1 -- 172.21.15.100:0/732625814 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412328e440 con 0x5641233a7680 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.885+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a9a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4005fd0 tx=0x7fc5c4011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62b63db7ca477ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.885+0000 7fc5c27fc640 1 -- 172.21.15.100:0/732625814 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4004d20 con 0x5641233a7680 2024-09-12T02:51:29.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.885+0000 7fc5c27fc640 1 -- 172.21.15.100:0/732625814 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c400f9a0 con 0x5641233a7680 2024-09-12T02:51:29.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.885+0000 7fc5c27fc640 1 -- 172.21.15.100:0/732625814 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4004d20 con 0x5641233a7680 2024-09-12T02:51:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/732625814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 msgr2=0x5641233a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a9a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4005fd0 tx=0x7fc5c4011bf0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/732625814 shutdown_connections 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a9a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/732625814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x56412339c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/732625814 >> 172.21.15.100:0/732625814 conn(0x564123398a30 msgr2=0x564123398e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/732625814 shutdown_connections 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.886+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/732625814 wait complete. 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.887+0000 7fc5d4b5b740 1 -- start start 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.887+0000 7fc5d4b5b740 1 Processor -- start 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.887+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339c4a0 0x5641233a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.887+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339cdc0 0x5641233a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5641233ae660 con 0x56412339c4a0 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641232bd050 con 0x56412339cdc0 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5641233ae7e0 con 0x5641233a7680 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339cdc0 0x5641233a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339cdc0 0x5641233a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:58008/0 (socket says 172.21.15.100:58008) 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 -- 172.21.15.100:0/3559226459 learned_addr learned my addr 172.21.15.100:0/3559226459 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5d4b5b740 10 client.0 _ll_register_callbacks cb 0x5641232fd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 -- 172.21.15.100:0/3559226459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 msgr2=0x5641233a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 -- 172.21.15.100:0/3559226459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339c4a0 msgr2=0x5641233a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339c4a0 0x5641233a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 -- 172.21.15.100:0/3559226459 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641230733c0 con 0x56412339cdc0 2024-09-12T02:51:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.888+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339cdc0 0x5641233a4140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009230 tx=0x7fc5b4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae4578abecd7a5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/3559226459 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b404e070 con 0x56412339cdc0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5c400f9a0 con 0x56412339cdc0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/3559226459 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc5b40048c0 con 0x56412339cdc0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/3559226459 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc5b405a050 con 0x56412339cdc0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5d4b5b740 10 client.26921 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5641233b9fb0 con 0x56412339cdc0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.889+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/3559226459 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c400f9a0 con 0x56412339cdc0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/3559226459 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc5b40035f0 con 0x56412339cdc0 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5d4b5b740 10 client.26921 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5d4b5b740 10 client.26921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5d4b5b740 20 client.26921 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233bb7d0 0x5641233bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5d4b5b740 4 client.26921 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56412330f850 con 0x5641233bb7d0 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.890+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233bb7d0 0x5641233bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.891+0000 7fc5ab7fe640 10 client.26921 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.891+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233bb7d0 0x5641233bdc90 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27d140191649fe5e server_cookie=a913a386ec5e14a5 in_seq=0 out_seq=0 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/3559226459 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56412330f850 con 0x5641233bb7d0 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5ab7fe640 10 client.26921 handle_command_reply: tid=0 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 client.26921 shutdown 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339cdc0 msgr2=0x5641233a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339cdc0 0x5641233a4140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009230 tx=0x7fc5b4009260 comp rx=0 tx=0).stop 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 shutdown_connections 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233bb7d0 0x5641233bdc90 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641233a7680 0x5641233a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339cdc0 0x5641233a4140 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/3559226459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339c4a0 0x5641233a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 >> 172.21.15.100:0/3559226459 conn(0x564123398a30 msgr2=0x56412339e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:29.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5ab7fe640 0 client.26921 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:29.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 shutdown_connections 2024-09-12T02:51:29.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.892+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/3559226459 wait complete. 2024-09-12T02:51:29.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.893+0000 7fc5d4b5b740 20 client.26921 trim_cache size 0 max 16384 2024-09-12T02:51:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 Processor -- start 2024-09-12T02:51:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 -- start start 2024-09-12T02:51:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564123398a30 0x5641233a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x5641233a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1adce0 con 0x56412339cdc0 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1ab5b0 con 0x56412339c4a0 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1a9400 con 0x564123398a30 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.917+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x5641233a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x5641233a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:58022/0 (socket says 172.21.15.100:58022) 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 -- 172.21.15.100:0/617241928 learned_addr learned my addr 172.21.15.100:0/617241928 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 -- 172.21.15.100:0/617241928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564123398a30 msgr2=0x5641233a2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564123398a30 0x5641233a2a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 -- 172.21.15.100:0/617241928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 msgr2=0x5641233c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 -- 172.21.15.100:0/617241928 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641233a30f0 con 0x56412339c4a0 2024-09-12T02:51:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.918+0000 7fc5c3fff640 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x5641233a60b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5b403f040 tx=0x7fc5b40038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8954b1028911caa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.919+0000 7fc5c1ffb640 1 -- 172.21.15.100:0/617241928 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b404e040 con 0x56412339c4a0 2024-09-12T02:51:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.919+0000 7fc5c1ffb640 1 -- 172.21.15.100:0/617241928 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5b4003e00 con 0x56412339c4a0 2024-09-12T02:51:29.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.919+0000 7fc5c1ffb640 1 -- 172.21.15.100:0/617241928 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4035040 con 0x56412339c4a0 2024-09-12T02:51:29.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/617241928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 msgr2=0x5641233a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x5641233a60b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5b403f040 tx=0x7fc5b40038a0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/617241928 shutdown_connections 2024-09-12T02:51:29.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56412339c4a0 0x5641233a60b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/617241928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564123398a30 0x5641233a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/617241928 >> 172.21.15.100:0/617241928 conn(0x5641233a47e0 msgr2=0x5641233a59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/617241928 shutdown_connections 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.920+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/617241928 wait complete. 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 -- start start 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 Processor -- start 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564123398a30 0x5641233b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56412339c4a0 0x5641233b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1a9a70 con 0x56412339cdc0 2024-09-12T02:51:29.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1aaee0 con 0x564123398a30 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5d4b5b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1aa140 con 0x56412339c4a0 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.921+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56412339c4a0 0x5641233b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d4b5b740 10 client.0 _ll_register_callbacks cb 0x7fc5b4040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56412339c4a0 0x5641233b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:47592/0 (socket says 172.21.15.100:47592) 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5c3fff640 1 -- 172.21.15.100:0/2840412806 learned_addr learned my addr 172.21.15.100:0/2840412806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564123398a30 0x5641233b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d0d1f640 1 -- 172.21.15.100:0/2840412806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56412339c4a0 msgr2=0x5641233b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56412339c4a0 0x5641233b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d0d1f640 1 -- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564123398a30 msgr2=0x5641233b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564123398a30 0x5641233b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d0d1f640 1 -- 172.21.15.100:0/2840412806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641233a7200 con 0x56412339cdc0 2024-09-12T02:51:29.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.922+0000 7fc5d0d1f640 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233aea60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4004130 tx=0x7fc5c400fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c1f689033b0b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:29.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.923+0000 7fc5ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:51:29.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.923+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/2840412806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4011050 con 0x56412339cdc0 2024-09-12T02:51:29.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.923+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/2840412806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc5c40111f0 con 0x56412339cdc0 2024-09-12T02:51:29.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.923+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b4003e00 con 0x56412339cdc0 2024-09-12T02:51:29.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.923+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/2840412806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc5c4011410 con 0x56412339cdc0 2024-09-12T02:51:29.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.923+0000 7fc5d4b5b740 10 client.17646 fetch_fsmap learned FSMap version 27 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.923+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5641233aa010 con 0x56412339cdc0 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/2840412806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5b4003e00 con 0x56412339cdc0 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/2840412806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc5c4018070 con 0x56412339cdc0 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5d4b5b740 10 client.17646 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5d4b5b740 10 client.17646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5d4b5b740 20 client.17646 populate_metadata read hostname 'smithi100' 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233a7680 0x5641233ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5d4b5b740 4 client.17646 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564123309d60 con 0x5641233a7680 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.924+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233a7680 0x5641233ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:29.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5cbfff640 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233a7680 0x5641233ac5e0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d64202fdb6b9654 server_cookie=8ba55ddc7cd75206 in_seq=0 out_seq=0 2024-09-12T02:51:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5ab7fe640 10 client.17646 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5ab7fe640 1 -- 172.21.15.100:0/2840412806 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564123309d60 con 0x5641233a7680 2024-09-12T02:51:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5ab7fe640 10 client.17646 handle_command_reply: tid=0 2024-09-12T02:51:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 client.17646 shutdown 2024-09-12T02:51:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 msgr2=0x5641233aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233aea60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4004130 tx=0x7fc5c400fbd0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 shutdown_connections 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5641233a7680 0x5641233ac5e0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56412339cdc0 0x5641233aea60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5ab7fe640 0 client.17646 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56412339c4a0 0x5641233b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 --2- 172.21.15.100:0/2840412806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564123398a30 0x5641233b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 >> 172.21.15.100:0/2840412806 conn(0x5641233a47e0 msgr2=0x5641233a59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.925+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 shutdown_connections 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d4b5b740 1 -- 172.21.15.100:0/2840412806 wait complete. 2024-09-12T02:51:29.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d4b5b740 20 client.17646 trim_cache size 0 max 16384 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout: "59e5a1dc-633f-488b-b638-41a8db6f1127": { 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "59e5a1dc-633f-488b-b638-41a8db6f1127", 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:51:29.936 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:51:29.937 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:51:29.937 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc5b80a2b80 msgr2=0x7fc5b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc5b80a2b80 0x7fc5b80a5040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4000c00 tx=0x7fc5b4005b50 comp rx=0 tx=0).stop 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc102d30 msgr2=0x7fc5cc198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc102d30 0x7fc5cc198420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00ea60 tx=0x7fc5bc00ef20 comp rx=0 tx=0).stop 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 shutdown_connections 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc5b80a2b80 0x7fc5b80a5040 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5cc10c160 0x7fc5cc19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5cc103650 0x7fc5cc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 --2- 172.21.15.100:0/3378297712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5cc102d30 0x7fc5cc198420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 >> 172.21.15.100:0/3378297712 conn(0x7fc5cc0fc790 msgr2=0x7fc5cc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:29.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 shutdown_connections 2024-09-12T02:51:29.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:51:29.926+0000 7fc5d2782640 1 -- 172.21.15.100:0/3378297712 wait complete. 2024-09-12T02:51:31.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:30 smithi100 ceph-mon[31390]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.2 MiB/s wr, 738 op/s 2024-09-12T02:51:31.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:30 smithi189 ceph-mon[35196]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.2 MiB/s wr, 738 op/s 2024-09-12T02:51:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 740.0 s, 2377.0 tps, lat 41.919 ms stddev 45.066 2024-09-12T02:51:31.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:30 smithi117 ceph-mon[34898]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.2 MiB/s wr, 738 op/s 2024-09-12T02:51:31.738 INFO:tasks.cephfs.filesystem:scrub status for tag:59e5a1dc-633f-488b-b638-41a8db6f1127 - {'path': '/', 'tag': '59e5a1dc-633f-488b-b638-41a8db6f1127', 'options': 'recursive,force'} 2024-09-12T02:51:33.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:32 smithi100 ceph-mon[31390]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:51:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:32 smithi189 ceph-mon[35196]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:51:33.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:32 smithi117 ceph-mon[34898]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:51:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:34 smithi100 ceph-mon[31390]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 MiB/s wr, 629 op/s 2024-09-12T02:51:35.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:34 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:51:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:34 smithi189 ceph-mon[35196]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 MiB/s wr, 629 op/s 2024-09-12T02:51:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:34 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:51:35.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:34 smithi117 ceph-mon[34898]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 MiB/s wr, 629 op/s 2024-09-12T02:51:35.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:34 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:51:36.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:35 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:51:36.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:35 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:51:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 745.0 s, 2424.0 tps, lat 41.335 ms stddev 44.637 2024-09-12T02:51:36.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:35 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:51:37.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:36 smithi100 ceph-mon[31390]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.7 MiB/s wr, 696 op/s 2024-09-12T02:51:37.244 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:36 smithi117 ceph-mon[34898]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.7 MiB/s wr, 696 op/s 2024-09-12T02:51:37.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:36 smithi189 ceph-mon[35196]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.7 MiB/s wr, 696 op/s 2024-09-12T02:51:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:38 smithi189 ceph-mon[35196]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-09-12T02:51:39.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:38 smithi117 ceph-mon[34898]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-09-12T02:51:39.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:38 smithi100 ceph-mon[31390]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-09-12T02:51:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:40 smithi189 ceph-mon[35196]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.0 MiB/s wr, 732 op/s 2024-09-12T02:51:41.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 750.0 s, 1902.0 tps, lat 52.169 ms stddev 54.958 2024-09-12T02:51:41.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:40 smithi117 ceph-mon[34898]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.0 MiB/s wr, 732 op/s 2024-09-12T02:51:41.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:40 smithi100 ceph-mon[31390]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.0 MiB/s wr, 732 op/s 2024-09-12T02:51:42.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:41 smithi189 ceph-mon[35196]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:51:42.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:41 smithi117 ceph-mon[34898]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:51:42.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:41 smithi100 ceph-mon[31390]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.2 MiB/s wr, 665 op/s 2024-09-12T02:51:45.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:44 smithi100 ceph-mon[31390]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 646 op/s 2024-09-12T02:51:45.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:44 smithi189 ceph-mon[35196]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 646 op/s 2024-09-12T02:51:45.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:44 smithi117 ceph-mon[34898]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 646 op/s 2024-09-12T02:51:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 755.0 s, 2455.0 tps, lat 40.899 ms stddev 44.634 2024-09-12T02:51:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:46 smithi100 ceph-mon[31390]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 769 op/s 2024-09-12T02:51:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:46 smithi189 ceph-mon[35196]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 769 op/s 2024-09-12T02:51:47.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:46 smithi117 ceph-mon[34898]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 769 op/s 2024-09-12T02:51:49.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:48 smithi100 ceph-mon[31390]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 749 op/s 2024-09-12T02:51:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:48 smithi189 ceph-mon[35196]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 749 op/s 2024-09-12T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:48 smithi117 ceph-mon[34898]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 749 op/s 2024-09-12T02:51:51.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:50 smithi100 ceph-mon[31390]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-09-12T02:51:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:50 smithi189 ceph-mon[35196]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-09-12T02:51:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 760.0 s, 2485.0 tps, lat 40.406 ms stddev 43.068 2024-09-12T02:51:51.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:50 smithi117 ceph-mon[34898]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-09-12T02:51:53.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:52 smithi100 ceph-mon[31390]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 835 op/s 2024-09-12T02:51:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:52 smithi189 ceph-mon[35196]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 835 op/s 2024-09-12T02:51:53.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:52 smithi117 ceph-mon[34898]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 835 op/s 2024-09-12T02:51:55.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:54 smithi100 ceph-mon[31390]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 779 op/s 2024-09-12T02:51:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:54 smithi189 ceph-mon[35196]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 779 op/s 2024-09-12T02:51:55.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:54 smithi117 ceph-mon[34898]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 779 op/s 2024-09-12T02:51:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 765.0 s, 2566.6 tps, lat 38.707 ms stddev 44.119 2024-09-12T02:51:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:56 smithi189 ceph-mon[35196]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 MiB/s wr, 843 op/s 2024-09-12T02:51:57.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:56 smithi117 ceph-mon[34898]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 MiB/s wr, 843 op/s 2024-09-12T02:51:57.373 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:56 smithi100 ceph-mon[31390]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 MiB/s wr, 843 op/s 2024-09-12T02:51:59.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:58 smithi189 ceph-mon[35196]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 770 op/s 2024-09-12T02:51:59.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:58 smithi117 ceph-mon[34898]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 770 op/s 2024-09-12T02:51:59.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:58 smithi100 ceph-mon[31390]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 770 op/s 2024-09-12T02:52:00.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:51:59 smithi189 ceph-mon[35196]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 24 MiB/s wr, 810 op/s 2024-09-12T02:52:00.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:51:59 smithi117 ceph-mon[34898]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 24 MiB/s wr, 810 op/s 2024-09-12T02:52:00.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:51:59 smithi100 ceph-mon[31390]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 24 MiB/s wr, 810 op/s 2024-09-12T02:52:00.535 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-12T02:52:00.535 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-12T02:52:00.536 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:52:00.887 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 770.0 s, 2448.2 tps, lat 40.897 ms stddev 49.253 2024-09-12T02:52:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 -- 172.21.15.100:0/4010305696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c10c170 msgr2=0x7f050c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 --2- 172.21.15.100:0/4010305696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c10c170 0x7f050c10e610 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0504009900 tx=0x7f050402a480 comp rx=0 tx=0).stop 2024-09-12T02:52:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 -- 172.21.15.100:0/4010305696 shutdown_connections 2024-09-12T02:52:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 --2- 172.21.15.100:0/4010305696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c10c170 0x7f050c10e610 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 --2- 172.21.15.100:0/4010305696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c103660 0x7f050c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 --2- 172.21.15.100:0/4010305696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c102d40 0x7f050c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 -- 172.21.15.100:0/4010305696 >> 172.21.15.100:0/4010305696 conn(0x7f050c0fc7a0 msgr2=0x7f050c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 -- 172.21.15.100:0/4010305696 shutdown_connections 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.434+0000 7f0511542640 1 -- 172.21.15.100:0/4010305696 wait complete. 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.435+0000 7f0511542640 1 Processor -- start 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.435+0000 7f0511542640 1 -- start start 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f0511542640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c102d40 0x7f050c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f0511542640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c103660 0x7f050c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f0511542640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c10c170 0x7f050c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f0511542640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f050c111f70 con 0x7f050c103660 2024-09-12T02:52:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f0511542640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f050c111df0 con 0x7f050c10c170 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f0511542640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f050c1120f0 con 0x7f050c102d40 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f050a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c103660 0x7f050c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f050a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c103660 0x7f050c1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38420/0 (socket says 172.21.15.100:38420) 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f050a7fc640 1 -- 172.21.15.100:0/938389849 learned_addr learned my addr 172.21.15.100:0/938389849 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.436+0000 7f050b7fe640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c10c170 0x7f050c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.437+0000 7f050a7fc640 1 -- 172.21.15.100:0/938389849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c102d40 msgr2=0x7f050c1983b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.437+0000 7f050a7fc640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c102d40 0x7f050c1983b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.437+0000 7f050a7fc640 1 -- 172.21.15.100:0/938389849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c10c170 msgr2=0x7f050c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.437+0000 7f050a7fc640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c10c170 0x7f050c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.437+0000 7f050a7fc640 1 -- 172.21.15.100:0/938389849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c19d360 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.437+0000 7f050a7fc640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c103660 0x7f050c1988f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f04f400e9f0 tx=0x7f04f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.438+0000 7f0503fff640 1 -- 172.21.15.100:0/938389849 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f400cd80 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.438+0000 7f0503fff640 1 -- 172.21.15.100:0/938389849 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04f40035f0 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.438+0000 7f0503fff640 1 -- 172.21.15.100:0/938389849 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4010690 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.438+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c19d650 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.438+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c1008d0 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.439+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c06b070 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.441+0000 7f0503fff640 1 -- 172.21.15.100:0/938389849 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f04f40037a0 con 0x7f050c103660 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.442+0000 7f0503fff640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f80a2c00 0x7f04f80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.442+0000 7f0503fff640 1 -- 172.21.15.100:0/938389849 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f04f40cf350 con 0x7f050c103660 2024-09-12T02:52:01.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.443+0000 7f050affd640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f80a2c00 0x7f04f80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:01.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.443+0000 7f050affd640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f80a2c00 0x7f04f80a50c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fd0 tx=0x7f04fc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:01.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.447+0000 7f0503fff640 1 -- 172.21.15.100:0/938389849 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04f401f340 con 0x7f050c103660 2024-09-12T02:52:01.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:52:01.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.745+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f050c103120 con 0x7f050c103660 2024-09-12T02:52:01.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.746+0000 7f0503fff640 1 -- 172.21.15.100:0/938389849 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f04f409c330 con 0x7f050c103660 2024-09-12T02:52:01.748 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:52:01.748 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:52:01.748 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.750+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f80a2c00 msgr2=0x7f04f80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f80a2c00 0x7f04f80a50c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fd0 tx=0x7f04fc009500 comp rx=0 tx=0).stop 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c103660 msgr2=0x7f050c1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c103660 0x7f050c1988f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f04f400e9f0 tx=0x7f04f400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 shutdown_connections 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f04f80a2c00 0x7f04f80a50c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f050c10c170 0x7f050c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050c103660 0x7f050c1988f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 --2- 172.21.15.100:0/938389849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c102d40 0x7f050c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:01.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.751+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 >> 172.21.15.100:0/938389849 conn(0x7f050c0fc7a0 msgr2=0x7f050c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:01.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.752+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 shutdown_connections 2024-09-12T02:52:01.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:01.752+0000 7f0511542640 1 -- 172.21.15.100:0/938389849 wait complete. 2024-09-12T02:52:02.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:01 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/938389849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:02.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:01 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/938389849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:02.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:01 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/938389849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:02.744 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-12T02:52:02.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-12T02:52:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:03.016 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:02 smithi100 ceph-mon[31390]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 702 op/s 2024-09-12T02:52:03.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:02 smithi117 ceph-mon[34898]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 702 op/s 2024-09-12T02:52:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:02 smithi189 ceph-mon[35196]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 702 op/s 2024-09-12T02:52:03.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.472+0000 7f819359e640 1 -- 172.21.15.100:0/1757416215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81941008d0 msgr2=0x7f8194100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.472+0000 7f819359e640 1 --2- 172.21.15.100:0/1757416215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81941008d0 0x7f8194100d30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f818c009c10 tx=0x7f818c02a720 comp rx=0 tx=0).stop 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.475+0000 7f819359e640 1 -- 172.21.15.100:0/1757416215 shutdown_connections 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.475+0000 7f819359e640 1 --2- 172.21.15.100:0/1757416215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 0x7f819410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.475+0000 7f819359e640 1 --2- 172.21.15.100:0/1757416215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81941008d0 0x7f8194100d30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.475+0000 7f819359e640 1 --2- 172.21.15.100:0/1757416215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81941068d0 0x7f8194106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.475+0000 7f819359e640 1 -- 172.21.15.100:0/1757416215 >> 172.21.15.100:0/1757416215 conn(0x7f81940fc610 msgr2=0x7f81940fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.475+0000 7f819359e640 1 -- 172.21.15.100:0/1757416215 shutdown_connections 2024-09-12T02:52:03.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.479+0000 7f819359e640 1 -- 172.21.15.100:0/1757416215 wait complete. 2024-09-12T02:52:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.480+0000 7f819359e640 1 Processor -- start 2024-09-12T02:52:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819359e640 1 -- start start 2024-09-12T02:52:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81941008d0 0x7f8194116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 0x7f8194116690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819359e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81941068d0 0x7f8194111270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819359e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f819410fc60 con 0x7f81941068d0 2024-09-12T02:52:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f819410fae0 con 0x7f8194101270 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819359e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f819410fde0 con 0x7f81941008d0 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f8191d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 0x7f8194116690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f8191d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 0x7f8194116690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:50508/0 (socket says 172.21.15.100:50508) 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f8191d9b640 1 -- 172.21.15.100:0/1787176386 learned_addr learned my addr 172.21.15.100:0/1787176386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.484+0000 7f819259c640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81941008d0 0x7f8194116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.485+0000 7f8191d9b640 1 -- 172.21.15.100:0/1787176386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81941008d0 msgr2=0x7f8194116150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.485+0000 7f8191d9b640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81941008d0 0x7f8194116150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.485+0000 7f8191d9b640 1 -- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81941068d0 msgr2=0x7f8194111270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.485+0000 7f8191d9b640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81941068d0 0x7f8194111270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.485+0000 7f8191d9b640 1 -- 172.21.15.100:0/1787176386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8194111b30 con 0x7f8194101270 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.485+0000 7f8191d9b640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 0x7f8194116690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f818c02ad10 tx=0x7f818c0305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.485+0000 7f81837fe640 1 -- 172.21.15.100:0/1787176386 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c041020 con 0x7f8194101270 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.486+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8194111dc0 con 0x7f8194101270 2024-09-12T02:52:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.486+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819411a030 con 0x7f8194101270 2024-09-12T02:52:03.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.486+0000 7f81837fe640 1 -- 172.21.15.100:0/1787176386 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f818c032e20 con 0x7f8194101270 2024-09-12T02:52:03.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.487+0000 7f81837fe640 1 -- 172.21.15.100:0/1787176386 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c036040 con 0x7f8194101270 2024-09-12T02:52:03.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.490+0000 7f81837fe640 1 -- 172.21.15.100:0/1787176386 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f818c044020 con 0x7f8194101270 2024-09-12T02:52:03.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.491+0000 7f81837fe640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f817c0a2c40 0x7f817c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.491+0000 7f81837fe640 1 -- 172.21.15.100:0/1787176386 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f818c0f08b0 con 0x7f8194101270 2024-09-12T02:52:03.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.493+0000 7f819259c640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f817c0a2c40 0x7f817c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.493+0000 7f819b24c740 1 Processor -- start 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.493+0000 7f819b24c740 1 -- start start 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819b24c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e21ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819b24c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e227310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819b24c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e229c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819b24c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b10e1822e0 con 0x55b10e21cf90 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819b24c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b10e129ce0 con 0x55b10e227850 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819b24c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b10e17e2a0 con 0x55b10e21c670 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f8191d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e227310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f8191d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e227310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38438/0 (socket says 172.21.15.100:38438) 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f8191d9b640 1 -- 172.21.15.100:0/2989900659 learned_addr learned my addr 172.21.15.100:0/2989900659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:03.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819259c640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f817c0a2c40 0x7f817c0a5100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f81880045f0 tx=0x7f818800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:03.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.494+0000 7f819259c640 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e21ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.496+0000 7f8192d9d640 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e229c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.496+0000 7f819259c640 1 -- 172.21.15.100:0/2989900659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 msgr2=0x55b10e229c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.496+0000 7f819259c640 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e229c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.496+0000 7f819259c640 1 -- 172.21.15.100:0/2989900659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 msgr2=0x55b10e227310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.496+0000 7f819259c640 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e227310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.496+0000 7f819259c640 1 -- 172.21.15.100:0/2989900659 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b10e10e440 con 0x55b10e21c670 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.497+0000 7f819259c640 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e21ca50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8188003c10 tx=0x7f8188013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec1f598c4bebad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.497+0000 7f8180ff9640 1 -- 172.21.15.100:0/2989900659 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188003e40 con 0x55b10e21c670 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.497+0000 7f8180ff9640 1 -- 172.21.15.100:0/2989900659 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f818801e900 con 0x55b10e21c670 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.498+0000 7f819b24c740 1 -- 172.21.15.100:0/2989900659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 msgr2=0x55b10e21ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.498+0000 7f819b24c740 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e21ca50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8188003c10 tx=0x7f8188013000 comp rx=0 tx=0).stop 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.499+0000 7f819b24c740 1 -- 172.21.15.100:0/2989900659 shutdown_connections 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.499+0000 7f819b24c740 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e229c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.499+0000 7f819b24c740 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e227310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.499+0000 7f819b24c740 1 --2- 172.21.15.100:0/2989900659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e21ca50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.499+0000 7f819b24c740 1 -- 172.21.15.100:0/2989900659 >> 172.21.15.100:0/2989900659 conn(0x55b10e218c00 msgr2=0x55b10e218fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.501+0000 7f819b24c740 1 -- 172.21.15.100:0/2989900659 shutdown_connections 2024-09-12T02:52:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.503+0000 7f819b24c740 1 -- 172.21.15.100:0/2989900659 wait complete. 2024-09-12T02:52:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.503+0000 7f819b24c740 1 -- start start 2024-09-12T02:52:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.503+0000 7f819b24c740 1 Processor -- start 2024-09-12T02:52:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.504+0000 7f819b24c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e2270c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.504+0000 7f819b24c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e224370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.504+0000 7f819b24c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e2248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.504+0000 7f819b24c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b10e22a4c0 con 0x55b10e21cf90 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.504+0000 7f819b24c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b10e13d050 con 0x55b10e227850 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.504+0000 7f819b24c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b10e22a640 con 0x55b10e21c670 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.504+0000 7f819b24c740 10 client.0 _ll_register_callbacks cb 0x55b10e17d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.505+0000 7f819259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e2270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.505+0000 7f819259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e2270c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51756/0 (socket says 172.21.15.100:51756) 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.505+0000 7f8192d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e2248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.505+0000 7f819259c640 1 -- 172.21.15.100:0/1519502118 learned_addr learned my addr 172.21.15.100:0/1519502118 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:03.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.506+0000 7f8191d9b640 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e224370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.507+0000 7f819259c640 1 -- 172.21.15.100:0/1519502118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 msgr2=0x55b10e2248b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.507+0000 7f819259c640 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e2248b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.507+0000 7f819259c640 1 -- 172.21.15.100:0/1519502118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 msgr2=0x55b10e224370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.507+0000 7f819259c640 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e224370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.507+0000 7f819259c640 1 -- 172.21.15.100:0/1519502118 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b10def33c0 con 0x55b10e21c670 2024-09-12T02:52:03.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.508+0000 7f819259c640 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e2270c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f818800bef0 tx=0x7f8188003e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88285a8401fe4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:03.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.508+0000 7f8179ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:52:03.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.509+0000 7f8179ffb640 1 -- 172.21.15.100:0/1519502118 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188036060 con 0x55b10e21c670 2024-09-12T02:52:03.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.509+0000 7f8179ffb640 1 -- 172.21.15.100:0/1519502118 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f818801db80 con 0x55b10e21c670 2024-09-12T02:52:03.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.510+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f818801e900 con 0x55b10e21c670 2024-09-12T02:52:03.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.510+0000 7f8179ffb640 1 -- 172.21.15.100:0/1519502118 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f818801ddc0 con 0x55b10e21c670 2024-09-12T02:52:03.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.510+0000 7f819b24c740 10 client.26872 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:03.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.510+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b10e235e90 con 0x55b10e21c670 2024-09-12T02:52:03.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.511+0000 7f8179ffb640 1 -- 172.21.15.100:0/1519502118 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f818801e900 con 0x55b10e21c670 2024-09-12T02:52:03.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.512+0000 7f8179ffb640 1 -- 172.21.15.100:0/1519502118 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f818801e420 con 0x55b10e21c670 2024-09-12T02:52:03.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.512+0000 7f819b24c740 10 client.26872 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:03.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.512+0000 7f819b24c740 10 client.26872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:03.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.512+0000 7f819b24c740 20 client.26872 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:03.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.512+0000 7f819b24c740 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2377c0 0x55b10e239c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.512+0000 7f819b24c740 4 client.26872 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:03.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.512+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b10e18f850 con 0x55b10e2377c0 2024-09-12T02:52:03.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.513+0000 7f8191d9b640 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2377c0 0x55b10e239c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.514+0000 7f8191d9b640 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2377c0 0x55b10e239c00 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72ee235b94efc915 server_cookie=225ae320f07fef6e in_seq=0 out_seq=0 2024-09-12T02:52:03.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.514+0000 7f8179ffb640 10 client.26872 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:03.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.514+0000 7f8179ffb640 1 -- 172.21.15.100:0/1519502118 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b10e18f850 con 0x55b10e2377c0 2024-09-12T02:52:03.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.514+0000 7f8179ffb640 10 client.26872 handle_command_reply: tid=0 2024-09-12T02:52:03.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.515+0000 7f819b24c740 1 client.26872 shutdown 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 msgr2=0x55b10e2270c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e2270c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f818800bef0 tx=0x7f8188003e70 comp rx=0 tx=0).stop 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 shutdown_connections 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2377c0 0x55b10e239c00 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e227850 0x55b10e2248b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e21cf90 0x55b10e224370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 --2- 172.21.15.100:0/1519502118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e21c670 0x55b10e2270c0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f818800bef0 tx=0x7f8188003e70 comp rx=0 tx=0).stop 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 >> 172.21.15.100:0/1519502118 conn(0x55b10e218c00 msgr2=0x55b10e21e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.519+0000 7f8179ffb640 0 client.26872 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.520+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 shutdown_connections 2024-09-12T02:52:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.520+0000 7f819b24c740 1 -- 172.21.15.100:0/1519502118 wait complete. 2024-09-12T02:52:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.520+0000 7f819b24c740 20 client.26872 trim_cache size 0 max 16384 2024-09-12T02:52:03.532 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.547+0000 7f819b24c740 1 Processor -- start 2024-09-12T02:52:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.547+0000 7f819b24c740 1 -- start start 2024-09-12T02:52:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819b24c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e217c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819b24c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e23f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819b24c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e23fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819b24c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8174010e60 con 0x55b10e223460 2024-09-12T02:52:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819b24c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f817400e730 con 0x55b10e21cf90 2024-09-12T02:52:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819b24c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f817400c580 con 0x55b10e227850 2024-09-12T02:52:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e217c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e217c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:50550/0 (socket says 172.21.15.100:50550) 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 -- 172.21.15.100:0/4013541479 learned_addr learned my addr 172.21.15.100:0/4013541479 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f8192d9d640 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e23fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f8191d9b640 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e23f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 -- 172.21.15.100:0/4013541479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 msgr2=0x55b10e23f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e23f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 -- 172.21.15.100:0/4013541479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 msgr2=0x55b10e23fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e23fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f819259c640 1 -- 172.21.15.100:0/4013541479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b10e218a30 con 0x55b10e21cf90 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.548+0000 7f8192d9d640 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e23fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.549+0000 7f819259c640 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e217c30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f818802d040 tx=0x7f8188011cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b4f5a3fe04b80f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.550+0000 7f817bfff640 1 -- 172.21.15.100:0/4013541479 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188040080 con 0x55b10e21cf90 2024-09-12T02:52:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.550+0000 7f817bfff640 1 -- 172.21.15.100:0/4013541479 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81880058f0 con 0x55b10e21cf90 2024-09-12T02:52:03.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.550+0000 7f817bfff640 1 -- 172.21.15.100:0/4013541479 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818803b900 con 0x55b10e21cf90 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.551+0000 7f819b24c740 1 -- 172.21.15.100:0/4013541479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 msgr2=0x55b10e217c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.551+0000 7f819b24c740 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e217c30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f818802d040 tx=0x7f8188011cc0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.551+0000 7f819b24c740 1 -- 172.21.15.100:0/4013541479 shutdown_connections 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.551+0000 7f819b24c740 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e23fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.551+0000 7f819b24c740 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e23f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.551+0000 7f819b24c740 1 --2- 172.21.15.100:0/4013541479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e217c30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.551+0000 7f819b24c740 1 -- 172.21.15.100:0/4013541479 >> 172.21.15.100:0/4013541479 conn(0x55b10e218c00 msgr2=0x55b10e217520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.552+0000 7f819b24c740 1 -- 172.21.15.100:0/4013541479 shutdown_connections 2024-09-12T02:52:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.552+0000 7f819b24c740 1 -- 172.21.15.100:0/4013541479 wait complete. 2024-09-12T02:52:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.552+0000 7f819b24c740 1 -- start start 2024-09-12T02:52:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.552+0000 7f819b24c740 1 Processor -- start 2024-09-12T02:52:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819b24c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e2300d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819b24c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e22d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819b24c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e22d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e2300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e2300d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:50556/0 (socket says 172.21.15.100:50556) 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819b24c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f817400cbf0 con 0x55b10e223460 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819259c640 1 -- 172.21.15.100:0/2825361169 learned_addr learned my addr 172.21.15.100:0/2825361169 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f8191d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e22d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f817400e060 con 0x55b10e21cf90 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f817400d2c0 con 0x55b10e227850 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f819b24c740 10 client.0 _ll_register_callbacks cb 0x7f818c009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.553+0000 7f8192d9d640 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e22d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819259c640 1 -- 172.21.15.100:0/2825361169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 msgr2=0x55b10e22d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819259c640 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e22d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819259c640 1 -- 172.21.15.100:0/2825361169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 msgr2=0x55b10e22d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819259c640 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e22d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819259c640 1 -- 172.21.15.100:0/2825361169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b10e219cb0 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819259c640 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e2300d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8188005780 tx=0x7f818800b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0f27526380c1845 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f8179ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f8179ffb640 1 -- 172.21.15.100:0/2825361169 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188049060 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f8179ffb640 1 -- 172.21.15.100:0/2825361169 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f818801d420 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81880058f0 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f8179ffb640 1 -- 172.21.15.100:0/2825361169 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8188005040 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819b24c740 10 client.26948 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.554+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b10e2a2350 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f8179ffb640 1 -- 172.21.15.100:0/2825361169 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81880058f0 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f8179ffb640 1 -- 172.21.15.100:0/2825361169 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8188004a00 con 0x55b10e21cf90 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f819b24c740 10 client.26948 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f819b24c740 10 client.26948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f819b24c740 20 client.26948 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f819b24c740 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2a2900 0x55b10e2a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f819b24c740 4 client.26948 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:52:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b10e189d60 con 0x55b10e2a2900 2024-09-12T02:52:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.555+0000 7f8191d9b640 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2a2900 0x55b10e2a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.556+0000 7f8191d9b640 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2a2900 0x55b10e2a4cf0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4987ecc54f7491f7 server_cookie=f68d000c6bcc3826 in_seq=0 out_seq=0 2024-09-12T02:52:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.556+0000 7f8179ffb640 10 client.26948 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.557+0000 7f8179ffb640 1 -- 172.21.15.100:0/2825361169 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b10e189d60 con 0x55b10e2a2900 2024-09-12T02:52:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.557+0000 7f8179ffb640 10 client.26948 handle_command_reply: tid=0 2024-09-12T02:52:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.557+0000 7f819b24c740 1 client.26948 shutdown 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.557+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 msgr2=0x55b10e2300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.557+0000 7f819b24c740 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e2300d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8188005780 tx=0x7f818800b420 comp rx=0 tx=0).stop 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 shutdown_connections 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b10e2a2900 0x55b10e2a4cf0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b10e227850 0x55b10e22d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b10e223460 0x55b10e22d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 --2- 172.21.15.100:0/2825361169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b10e21cf90 0x55b10e2300d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 >> 172.21.15.100:0/2825361169 conn(0x55b10e218c00 msgr2=0x55b10e217d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f8179ffb640 0 client.26948 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 shutdown_connections 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.558+0000 7f819b24c740 1 -- 172.21.15.100:0/2825361169 wait complete. 2024-09-12T02:52:03.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819b24c740 20 client.26948 trim_cache size 0 max 16384 2024-09-12T02:52:03.561 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:03.561 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:52:03.561 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:52:03.561 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f817c0a2c40 msgr2=0x7f817c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f817c0a2c40 0x7f817c0a5100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f81880045f0 tx=0x7f818800b390 comp rx=0 tx=0).stop 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 msgr2=0x7f8194116690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 0x7f8194116690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f818c02ad10 tx=0x7f818c0305d0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 shutdown_connections 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f817c0a2c40 0x7f817c0a5100 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81941068d0 0x7f8194111270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8194101270 0x7f8194116690 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 --2- 172.21.15.100:0/1787176386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81941008d0 0x7f8194116150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.559+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 >> 172.21.15.100:0/1787176386 conn(0x7f81940fc610 msgr2=0x7f81940fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.560+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 shutdown_connections 2024-09-12T02:52:03.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:03.560+0000 7f819359e640 1 -- 172.21.15.100:0/1787176386 wait complete. 2024-09-12T02:52:04.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.541+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/1571852568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7e41011e0 msgr2=0x7fb7e4105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.541+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/1571852568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7e41011e0 0x7fb7e4105980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009860 tx=0x7fb7d802a360 comp rx=0 tx=0).stop 2024-09-12T02:52:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.547+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/1571852568 shutdown_connections 2024-09-12T02:52:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.547+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/1571852568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7e4105ec0 0x7fb7e4106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.547+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/1571852568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7e41011e0 0x7fb7e4105980 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.547+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/1571852568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e41008c0 0x7fb7e4100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.547+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/1571852568 >> 172.21.15.100:0/1571852568 conn(0x7fb7e40fc7d0 msgr2=0x7fb7e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:04.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.559+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/1571852568 shutdown_connections 2024-09-12T02:52:04.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.559+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/1571852568 wait complete. 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.560+0000 7fb7e9a9f640 1 Processor -- start 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.560+0000 7fb7e9a9f640 1 -- start start 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.562+0000 7fb7e9a9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7e41008c0 0x7fb7e4114c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.562+0000 7fb7e9a9f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7e41011e0 0x7fb7e41151d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.562+0000 7fb7e9a9f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e4105ec0 0x7fb7e410df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.562+0000 7fb7e9a9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e4118720 con 0x7fb7e41008c0 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.562+0000 7fb7e9a9f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e41185a0 con 0x7fb7e41011e0 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.562+0000 7fb7e9a9f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e41188a0 con 0x7fb7e4105ec0 2024-09-12T02:52:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e4105ec0 0x7fb7e410df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e4105ec0 0x7fb7e410df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:59644/0 (socket says 172.21.15.100:59644) 2024-09-12T02:52:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 -- 172.21.15.100:0/3287104162 learned_addr learned my addr 172.21.15.100:0/3287104162 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7e41011e0 0x7fb7e41151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 -- 172.21.15.100:0/3287104162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7e41011e0 msgr2=0x7fb7e41151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7e41011e0 0x7fb7e41151d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 -- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7e41008c0 msgr2=0x7fb7e4114c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7e41008c0 0x7fb7e4114c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.563+0000 7fb7e3fff640 1 -- 172.21.15.100:0/3287104162 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e410e810 con 0x7fb7e4105ec0 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.564+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e4105ec0 0x7fb7e410df50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009fd0 tx=0x7fb7dc00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.564+0000 7fb7e0ff9640 1 -- 172.21.15.100:0/3287104162 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc004b20 con 0x7fb7e4105ec0 2024-09-12T02:52:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.564+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e410eb00 con 0x7fb7e4105ec0 2024-09-12T02:52:04.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.564+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e4112aa0 con 0x7fb7e4105ec0 2024-09-12T02:52:04.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.569+0000 7fb7e0ff9640 1 -- 172.21.15.100:0/3287104162 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7dc003e50 con 0x7fb7e4105ec0 2024-09-12T02:52:04.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.569+0000 7fb7e0ff9640 1 -- 172.21.15.100:0/3287104162 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc00b630 con 0x7fb7e4105ec0 2024-09-12T02:52:04.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.569+0000 7fb7e0ff9640 1 -- 172.21.15.100:0/3287104162 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb7dc01d020 con 0x7fb7e4105ec0 2024-09-12T02:52:04.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.575+0000 7fb7ebe78740 1 Processor -- start 2024-09-12T02:52:04.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.575+0000 7fb7e0ff9640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb7cc0a2cf0 0x7fb7cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.575+0000 7fb7e0ff9640 1 -- 172.21.15.100:0/3287104162 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb7dc0d0140 con 0x7fb7e4105ec0 2024-09-12T02:52:04.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.575+0000 7fb7ebe78740 1 -- start start 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695691b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x55969569ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695691b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695691b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38688/0 (socket says 172.21.15.100:38688) 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7e37fe640 1 -- 172.21.15.100:0/90422017 learned_addr learned my addr 172.21.15.100:0/90422017 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.576+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5596955f72a0 con 0x559695691760 2024-09-12T02:52:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.577+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x55969569ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.577+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55969559eb10 con 0x559695692080 2024-09-12T02:52:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.577+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5596955f3260 con 0x55969569c940 2024-09-12T02:52:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.578+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb7cc0a2cf0 0x7fb7cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.579+0000 7fb7e3fff640 1 -- 172.21.15.100:0/90422017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 msgr2=0x55969569c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.579+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.579+0000 7fb7e3fff640 1 -- 172.21.15.100:0/90422017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 msgr2=0x559695691b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.579+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695691b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.579+0000 7fb7e3fff640 1 -- 172.21.15.100:0/90422017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559695368b90 con 0x55969569c940 2024-09-12T02:52:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.580+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x55969569ed30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc09c940 tx=0x7fb7dc013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e6e6e86ae9c6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.580+0000 7fb7c9ffb640 1 -- 172.21.15.100:0/90422017 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc06ee60 con 0x55969569c940 2024-09-12T02:52:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.580+0000 7fb7c9ffb640 1 -- 172.21.15.100:0/90422017 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7dc06f0a0 con 0x55969569c940 2024-09-12T02:52:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.580+0000 7fb7c9ffb640 1 -- 172.21.15.100:0/90422017 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc09ad40 con 0x55969569c940 2024-09-12T02:52:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.581+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 msgr2=0x55969569ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.581+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x55969569ed30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc09c940 tx=0x7fb7dc013000 comp rx=0 tx=0).stop 2024-09-12T02:52:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.582+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 shutdown_connections 2024-09-12T02:52:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.582+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x55969569ed30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.582+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.582+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/90422017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695691b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.582+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 >> 172.21.15.100:0/90422017 conn(0x55969568dcf0 msgr2=0x55969568e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.584+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 shutdown_connections 2024-09-12T02:52:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.584+0000 7fb7ebe78740 1 -- 172.21.15.100:0/90422017 wait complete. 2024-09-12T02:52:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.585+0000 7fb7ebe78740 1 -- start start 2024-09-12T02:52:04.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.585+0000 7fb7ebe78740 1 Processor -- start 2024-09-12T02:52:04.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.586+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb7cc0a2cf0 0x7fb7cc0a51b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8000c00 tx=0x7fb7d802a360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:04.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.586+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695699800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.586+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695692080 0x559695699d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.586+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55969569c940 0x55969569a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.587+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695692080 0x559695699d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.587+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695692080 0x559695699d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:59648/0 (socket says 172.21.15.100:59648) 2024-09-12T02:52:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.587+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/1048749145 learned_addr learned my addr 172.21.15.100:0/1048749145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.587+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55969569f510 con 0x559695691760 2024-09-12T02:52:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.587+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55969557f6e0 con 0x55969569c940 2024-09-12T02:52:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.587+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55969569f690 con 0x559695692080 2024-09-12T02:52:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.588+0000 7fb7ebe78740 10 client.0 _ll_register_callbacks cb 0x5596955a3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.588+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55969569c940 0x55969569a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.590+0000 7fb7e37fe640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695699800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55969569c940 msgr2=0x55969569a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55969569c940 0x55969569a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/1048749145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 msgr2=0x559695699800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695699800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/1048749145 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596956a89d0 con 0x559695692080 2024-09-12T02:52:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55969569c940 0x55969569a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695692080 0x559695699d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8034000 tx=0x7fb7d8009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b97b858a530d44fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:52:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.591+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/1048749145 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8037070 con 0x559695692080 2024-09-12T02:52:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.592+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/1048749145 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb7d8030bc0 con 0x559695692080 2024-09-12T02:52:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.592+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7dc06f0a0 con 0x559695692080 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.592+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/1048749145 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb7d8030dc0 con 0x559695692080 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.592+0000 7fb7ebe78740 10 client.26887 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.592+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5596956ab390 con 0x559695692080 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/1048749145 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d8038040 con 0x559695692080 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/1048749145 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb7d804a020 con 0x559695692080 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7ebe78740 10 client.26887 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7ebe78740 10 client.26887 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:52:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7ebe78740 20 client.26887 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x5596956aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7ebe78740 4 client.26887 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.593+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb7dc06f0a0 con 0x5596956ac7a0 2024-09-12T02:52:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.594+0000 7fb7e37fe640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x5596956aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.594+0000 7fb7e37fe640 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x5596956aeb90 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd44a394958ffb87 server_cookie=80bab1d23ef82c4a in_seq=0 out_seq=0 2024-09-12T02:52:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.594+0000 7fb7c2ffd640 10 client.26887 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.596+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/1048749145 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb7dc06f0a0 con 0x5596956ac7a0 2024-09-12T02:52:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.596+0000 7fb7c2ffd640 10 client.26887 handle_command_reply: tid=0 2024-09-12T02:52:04.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.596+0000 7fb7ebe78740 1 client.26887 shutdown 2024-09-12T02:52:04.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.598+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695692080 msgr2=0x559695699d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.598+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695692080 0x559695699d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8034000 tx=0x7fb7d8009510 comp rx=0 tx=0).stop 2024-09-12T02:52:04.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 shutdown_connections 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x5596956aeb90 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55969569c940 0x55969569a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695692080 0x559695699d40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7c2ffd640 0 client.26887 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/1048749145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695691760 0x559695699800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 >> 172.21.15.100:0/1048749145 conn(0x55969568dcf0 msgr2=0x559695693a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 shutdown_connections 2024-09-12T02:52:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.599+0000 7fb7ebe78740 1 -- 172.21.15.100:0/1048749145 wait complete. 2024-09-12T02:52:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.600+0000 7fb7ebe78740 20 client.26887 trim_cache size 0 max 16384 2024-09-12T02:52:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.627+0000 7fb7ebe78740 1 Processor -- start 2024-09-12T02:52:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.627+0000 7fb7ebe78740 1 -- start start 2024-09-12T02:52:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.627+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695691760 0x55969569b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.627+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.627+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55969569c940 0x5596956b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7ebe78740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d0010e50 con 0x55969569c940 2024-09-12T02:52:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7ebe78740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d000e720 con 0x559695692080 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7ebe78740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d000c570 con 0x559695691760 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:35374/0 (socket says 172.21.15.100:35374) 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e37fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695691760 0x55969569b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55969569c940 0x5596956b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/639589527 learned_addr learned my addr 172.21.15.100:0/639589527 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/639589527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695691760 msgr2=0x55969569b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/639589527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695691760 0x55969569b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/639589527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55969569c940 msgr2=0x5596956b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/639589527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55969569c940 0x5596956b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.628+0000 7fb7e2ffd640 1 -- 172.21.15.100:0/639589527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559695691eb0 con 0x559695692080 2024-09-12T02:52:04.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.629+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/639589527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569a0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8004390 tx=0x7fb7d8030340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b265e88137723e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:04.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.629+0000 7fb7c97fa640 1 -- 172.21.15.100:0/639589527 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d805b030 con 0x559695692080 2024-09-12T02:52:04.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.629+0000 7fb7c97fa640 1 -- 172.21.15.100:0/639589527 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d8005850 con 0x559695692080 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.629+0000 7fb7c97fa640 1 -- 172.21.15.100:0/639589527 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8037050 con 0x559695692080 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 -- 172.21.15.100:0/639589527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 msgr2=0x55969569a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/639589527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569a0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8004390 tx=0x7fb7d8030340 comp rx=0 tx=0).stop 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 -- 172.21.15.100:0/639589527 shutdown_connections 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/639589527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55969569c940 0x5596956b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/639589527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695692080 0x55969569a0d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/639589527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559695691760 0x55969569b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 -- 172.21.15.100:0/639589527 >> 172.21.15.100:0/639589527 conn(0x55969568dcf0 msgr2=0x55969568ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 -- 172.21.15.100:0/639589527 shutdown_connections 2024-09-12T02:52:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 -- 172.21.15.100:0/639589527 wait complete. 2024-09-12T02:52:04.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.631+0000 7fb7ebe78740 1 -- start start 2024-09-12T02:52:04.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 1 Processor -- start 2024-09-12T02:52:04.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695691760 0x5596956a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695692080 0x5596956a1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x5596956a1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d000cbe0 con 0x559695692080 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d000e050 con 0x559695691760 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d000d2b0 con 0x55969569c940 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7e3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x5596956a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695692080 0x5596956a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7e3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x5596956a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:59678/0 (socket says 172.21.15.100:59678) 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7e3fff640 1 -- 172.21.15.100:0/2239673827 learned_addr learned my addr 172.21.15.100:0/2239673827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7e37fe640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695691760 0x5596956a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.632+0000 7fb7ebe78740 10 client.0 _ll_register_callbacks cb 0x7fb7d8005410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e3fff640 1 -- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695691760 msgr2=0x5596956a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695691760 0x5596956a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e3fff640 1 -- 172.21.15.100:0/2239673827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695692080 msgr2=0x5596956a1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695692080 0x5596956a1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e3fff640 1 -- 172.21.15.100:0/2239673827 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596956a1c00 con 0x55969569c940 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e2ffd640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695692080 0x5596956a1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e37fe640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695691760 0x5596956a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7e3fff640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x5596956a1640 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009fa0 tx=0x7fb7dc00ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313229de63edab94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.633+0000 7fb7c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/2239673827 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc01a040 con 0x55969569c940 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7d8005850 con 0x55969569c940 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/2239673827 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb7dc0bb200 con 0x55969569c940 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/2239673827 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb7dc0a5620 con 0x55969569c940 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 10 client.26893 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559695718170 con 0x55969569c940 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/2239673827 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d8005850 con 0x55969569c940 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/2239673827 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb7dc09dce0 con 0x55969569c940 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 10 client.26893 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 10 client.26893 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 20 client.26893 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x55969571a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 4 client.26893 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-12T02:52:04.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.634+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5596956049d0 con 0x5596956ac7a0 2024-09-12T02:52:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.635+0000 7fb7e37fe640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x55969571a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.636+0000 7fb7c2ffd640 10 client.26893 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.636+0000 7fb7e37fe640 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x55969571a540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a07c973725678cb5 server_cookie=5e9f6e16ef6cff4e in_seq=0 out_seq=0 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.938+0000 7fb7c2ffd640 1 -- 172.21.15.100:0/2239673827 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5596956049d0 con 0x5596956ac7a0 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.938+0000 7fb7c2ffd640 10 client.26893 handle_command_reply: tid=0 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.938+0000 7fb7ebe78740 1 client.26893 shutdown 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 msgr2=0x5596956a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x5596956a1640 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009fa0 tx=0x7fb7dc00ceb0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 shutdown_connections 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5596956ac7a0 0x55969571a540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55969569c940 0x5596956a1640 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559695692080 0x5596956a1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 --2- 172.21.15.100:0/2239673827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559695691760 0x5596956a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7c2ffd640 0 client.26893 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 >> 172.21.15.100:0/2239673827 conn(0x55969568dcf0 msgr2=0x55969568c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 shutdown_connections 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 1 -- 172.21.15.100:0/2239673827 wait complete. 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7ebe78740 20 client.26893 trim_cache size 0 max 16384 2024-09-12T02:52:04.941 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 50, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "825183f6": { 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 50, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 150.0, 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:52:04.942 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:04.943 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb7cc0a2cf0 msgr2=0x7fb7cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb7cc0a2cf0 0x7fb7cc0a51b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8000c00 tx=0x7fb7d802a360 comp rx=0 tx=0).stop 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e4105ec0 msgr2=0x7fb7e410df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.939+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e4105ec0 0x7fb7e410df50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009fd0 tx=0x7fb7dc00c800 comp rx=0 tx=0).stop 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 shutdown_connections 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb7cc0a2cf0 0x7fb7cc0a51b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7e4105ec0 0x7fb7e410df50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7e41011e0 0x7fb7e41151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 --2- 172.21.15.100:0/3287104162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7e41008c0 0x7fb7e4114c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 >> 172.21.15.100:0/3287104162 conn(0x7fb7e40fc7d0 msgr2=0x7fb7e4103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 shutdown_connections 2024-09-12T02:52:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:04.940+0000 7fb7e9a9f640 1 -- 172.21.15.100:0/3287104162 wait complete. 2024-09-12T02:52:04.988 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:52:04.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:52:05.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:04 smithi100 ceph-mon[31390]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 16 MiB/s wr, 611 op/s 2024-09-12T02:52:05.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:04 smithi117 ceph-mon[34898]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 16 MiB/s wr, 611 op/s 2024-09-12T02:52:05.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:04 smithi189 ceph-mon[35196]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 16 MiB/s wr, 611 op/s 2024-09-12T02:52:05.636 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '825183f6', quiesce took 5.1 seconds. Will release after: 24.9 2024-09-12T02:52:05.673 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:06.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 -- 172.21.15.100:0/4189521350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574100e20 msgr2=0x7f3574101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 --2- 172.21.15.100:0/4189521350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574100e20 0x7f3574101200 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3564009ca0 tx=0x7f356402a950 comp rx=0 tx=0).stop 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 -- 172.21.15.100:0/4189521350 shutdown_connections 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 --2- 172.21.15.100:0/4189521350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574102ef0 0x7f357410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 --2- 172.21.15.100:0/4189521350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3574102570 0x7f35741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 --2- 172.21.15.100:0/4189521350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574100e20 0x7f3574101200 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 -- 172.21.15.100:0/4189521350 >> 172.21.15.100:0/4189521350 conn(0x7f35740fc7d0 msgr2=0x7f35740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.116+0000 7f3578d92640 1 -- 172.21.15.100:0/4189521350 shutdown_connections 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 -- 172.21.15.100:0/4189521350 wait complete. 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 Processor -- start 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 -- start start 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3574100e20 0x7f3574197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:06.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574102570 0x7f35741976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574102ef0 0x7f3574197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3574110f80 con 0x7f3574102570 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3574110e00 con 0x7f3574102ef0 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.117+0000 7f3578d92640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3574111100 con 0x7f3574100e20 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574102570 0x7f35741976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574102570 0x7f35741976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38710/0 (socket says 172.21.15.100:38710) 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 -- 172.21.15.100:0/902019186 learned_addr learned my addr 172.21.15.100:0/902019186 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3572d9d640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574102ef0 0x7f3574197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f357259c640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3574100e20 0x7f3574197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 -- 172.21.15.100:0/902019186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3574100e20 msgr2=0x7f3574197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3574100e20 0x7f3574197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 -- 172.21.15.100:0/902019186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574102ef0 msgr2=0x7f3574197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:06.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574102ef0 0x7f3574197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 -- 172.21.15.100:0/902019186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35741a69e0 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f357259c640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3574100e20 0x7f3574197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3571d9b640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574102570 0x7f35741976b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f356800d770 tx=0x7f356800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f35637fe640 1 -- 172.21.15.100:0/902019186 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568017070 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35741a6cd0 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f35637fe640 1 -- 172.21.15.100:0/902019186 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3568005500 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f35637fe640 1 -- 172.21.15.100:0/902019186 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568004e00 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.118+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35741a71c0 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.119+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3574101200 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.120+0000 7f35637fe640 1 -- 172.21.15.100:0/902019186 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3568004fa0 con 0x7f3574102570 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.121+0000 7f35637fe640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f355c0a2b80 0x7f355c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.121+0000 7f357259c640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f355c0a2b80 0x7f355c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:06.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.121+0000 7f35637fe640 1 -- 172.21.15.100:0/902019186 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f35680cee80 con 0x7f3574102570 2024-09-12T02:52:06.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.121+0000 7f357259c640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f355c0a2b80 0x7f355c0a5040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3564006010 tx=0x7f3564005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:06.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.124+0000 7f35637fe640 1 -- 172.21.15.100:0/902019186 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f356809bdd0 con 0x7f3574102570 2024-09-12T02:52:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 775.0 s, 1493.3 tps, lat 45.553 ms stddev 52.167 2024-09-12T02:52:06.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.331+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f357406a560 con 0x7f3574102570 2024-09-12T02:52:06.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.331+0000 7f35637fe640 1 -- 172.21.15.100:0/902019186 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f357406a560 con 0x7f3574102570 2024-09-12T02:52:06.332 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:52:06.332 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:52:06.332 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:52:06.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.333+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f355c0a2b80 msgr2=0x7f355c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:06.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.333+0000 7f3578d92640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f355c0a2b80 0x7f355c0a5040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3564006010 tx=0x7f3564005f80 comp rx=0 tx=0).stop 2024-09-12T02:52:06.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.333+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574102570 msgr2=0x7f35741976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:06.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.333+0000 7f3578d92640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574102570 0x7f35741976b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f356800d770 tx=0x7f356800dc30 comp rx=0 tx=0).stop 2024-09-12T02:52:06.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 shutdown_connections 2024-09-12T02:52:06.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f355c0a2b80 0x7f355c0a5040 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3574102ef0 0x7f3574197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3574102570 0x7f35741976b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 --2- 172.21.15.100:0/902019186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3574100e20 0x7f3574197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:06.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 >> 172.21.15.100:0/902019186 conn(0x7f35740fc7d0 msgr2=0x7f35740fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:06.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 shutdown_connections 2024-09-12T02:52:06.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:06.334+0000 7f3578d92640 1 -- 172.21.15.100:0/902019186 wait complete. 2024-09-12T02:52:06.984 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:06 smithi100 ceph-mon[31390]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 677 op/s 2024-09-12T02:52:06.984 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:06 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/902019186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:07.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:52:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:06 smithi117 ceph-mon[34898]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 677 op/s 2024-09-12T02:52:07.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:06 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/902019186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:06 smithi189 ceph-mon[35196]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 677 op/s 2024-09-12T02:52:07.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:06 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/902019186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.855+0000 7fc8801bf640 1 -- 172.21.15.100:0/556457775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 msgr2=0x7fc878110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.855+0000 7fc8801bf640 1 --2- 172.21.15.100:0/556457775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc878110900 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc870009900 tx=0x7fc87002a410 comp rx=0 tx=0).stop 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.855+0000 7fc8801bf640 1 -- 172.21.15.100:0/556457775 shutdown_connections 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.855+0000 7fc8801bf640 1 --2- 172.21.15.100:0/556457775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc878110900 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.855+0000 7fc8801bf640 1 --2- 172.21.15.100:0/556457775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc878101380 0x7fc87810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.855+0000 7fc8801bf640 1 --2- 172.21.15.100:0/556457775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8781009d0 0x7fc878100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.855+0000 7fc8801bf640 1 -- 172.21.15.100:0/556457775 >> 172.21.15.100:0/556457775 conn(0x7fc8780fc7d0 msgr2=0x7fc8780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 -- 172.21.15.100:0/556457775 shutdown_connections 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 -- 172.21.15.100:0/556457775 wait complete. 2024-09-12T02:52:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 Processor -- start 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 -- start start 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8781009d0 0x7fc87819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc878101380 0x7fc87819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc87819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8781142a0 con 0x7fc87810e4f0 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc878114120 con 0x7fc878101380 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.856+0000 7fc8801bf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc878114420 con 0x7fc8781009d0 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc87819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc87819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38734/0 (socket says 172.21.15.100:38734) 2024-09-12T02:52:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 -- 172.21.15.100:0/3430172114 learned_addr learned my addr 172.21.15.100:0/3430172114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87df5b640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8781009d0 0x7fc87819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 -- 172.21.15.100:0/3430172114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8781009d0 msgr2=0x7fc87819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8781009d0 0x7fc87819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87d75a640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc878101380 0x7fc87819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 -- 172.21.15.100:0/3430172114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc878101380 msgr2=0x7fc87819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc878101380 0x7fc87819ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 -- 172.21.15.100:0/3430172114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87819f670 con 0x7fc87810e4f0 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87df5b640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8781009d0 0x7fc87819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc87e75c640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc87819ef90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc870005ab0 tx=0x7fc8700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc876ffd640 1 -- 172.21.15.100:0/3430172114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87003f030 con 0x7fc87810e4f0 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc876ffd640 1 -- 172.21.15.100:0/3430172114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc870003ce0 con 0x7fc87810e4f0 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87819f900 con 0x7fc87810e4f0 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc876ffd640 1 -- 172.21.15.100:0/3430172114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870035070 con 0x7fc87810e4f0 2024-09-12T02:52:07.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.857+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8781a7240 con 0x7fc87810e4f0 2024-09-12T02:52:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc876ffd640 1 -- 172.21.15.100:0/3430172114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fc870042030 con 0x7fc87810e4f0 2024-09-12T02:52:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 Processor -- start 2024-09-12T02:52:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 -- start start 2024-09-12T02:52:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d75d0 0x55a0010d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a00103d2f0 con 0x55a0010e2370 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a000fe4cf0 con 0x55a0010d75d0 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.860+0000 7fc882598740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a0010392b0 con 0x55a0010d8b40 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc876ffd640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8600a2c00 0x7fc8600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38748/0 (socket says 172.21.15.100:38748) 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 -- 172.21.15.100:0/2864869897 learned_addr learned my addr 172.21.15.100:0/2864869897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87df5b640 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d75d0 0x55a0010d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87e75c640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8600a2c00 0x7fc8600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 -- 172.21.15.100:0/2864869897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 msgr2=0x55a0010d7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc876ffd640 1 -- 172.21.15.100:0/3430172114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc8700ef680 con 0x7fc87810e4f0 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010d7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 -- 172.21.15.100:0/2864869897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d75d0 msgr2=0x55a0010d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d75d0 0x55a0010d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 -- 172.21.15.100:0/2864869897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a000fc93a0 con 0x55a0010e2370 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010e4760 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cf60 tx=0x7fc86c00c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f0ad99e06b1665 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc87e75c640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8600a2c00 0x7fc8600a50c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc8700c45b0 tx=0x7fc87002a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.861+0000 7fc85ffff640 1 -- 172.21.15.100:0/2864869897 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c01d070 con 0x55a0010e2370 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc85ffff640 1 -- 172.21.15.100:0/2864869897 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86c018b50 con 0x55a0010e2370 2024-09-12T02:52:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc85ffff640 1 -- 172.21.15.100:0/2864869897 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f040 con 0x55a0010e2370 2024-09-12T02:52:07.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 -- 172.21.15.100:0/2864869897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 msgr2=0x55a0010e4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010e4760 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cf60 tx=0x7fc86c00c170 comp rx=0 tx=0).stop 2024-09-12T02:52:07.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 -- 172.21.15.100:0/2864869897 shutdown_connections 2024-09-12T02:52:07.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010e4760 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d75d0 0x55a0010d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 --2- 172.21.15.100:0/2864869897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 -- 172.21.15.100:0/2864869897 >> 172.21.15.100:0/2864869897 conn(0x55a0010a0310 msgr2=0x55a0010d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 -- 172.21.15.100:0/2864869897 shutdown_connections 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.862+0000 7fc882598740 1 -- 172.21.15.100:0/2864869897 wait complete. 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 -- start start 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 Processor -- start 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010d75d0 0x55a0010e1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010e2370 0x55a0010df840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a0010e5070 con 0x55a0010d75d0 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a000ff8060 con 0x55a0010e2370 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a0010e51f0 con 0x55a0010d8b40 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc882598740 10 client.0 _ll_register_callbacks cb 0x55a000d4b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010d75d0 0x55a0010e1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010d75d0 0x55a0010e1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38754/0 (socket says 172.21.15.100:38754) 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.863+0000 7fc87d75a640 1 -- 172.21.15.100:0/2749422036 learned_addr learned my addr 172.21.15.100:0/2749422036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87df5b640 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010e2370 0x55a0010df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87d75a640 1 -- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 msgr2=0x55a0010df0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010df0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87d75a640 1 -- 172.21.15.100:0/2749422036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010e2370 msgr2=0x55a0010df840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010e2370 0x55a0010df840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87d75a640 1 -- 172.21.15.100:0/2749422036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a000dae3c0 con 0x55a0010d75d0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010d75d0 0x55a0010e1e00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc86c006bd0 tx=0x7fc86c006b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeedc6723d620b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc85d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc85d7fa640 1 -- 172.21.15.100:0/2749422036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c01d070 con 0x55a0010d75d0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc86c018b50 con 0x55a0010d75d0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc85d7fa640 1 -- 172.21.15.100:0/2749422036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc86c016920 con 0x55a0010d75d0 2024-09-12T02:52:07.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc85d7fa640 1 -- 172.21.15.100:0/2749422036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc86c018990 con 0x55a0010d75d0 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc882598740 10 client.17700 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a0010f0bc0 con 0x55a0010d75d0 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.864+0000 7fc85d7fa640 1 -- 172.21.15.100:0/2749422036 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86c018b50 con 0x55a0010d75d0 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc85d7fa640 1 -- 172.21.15.100:0/2749422036 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc86c015050 con 0x55a0010d75d0 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc882598740 10 client.17700 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc882598740 10 client.17700 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc882598740 20 client.17700 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc882598740 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a0010f1f10 0x55a0010f4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc882598740 4 client.17700 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a00104a860 con 0x55a0010f1f10 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc87df5b640 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a0010f1f10 0x55a0010f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc85d7fa640 10 client.17700 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.865+0000 7fc87df5b640 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a0010f1f10 0x55a0010f4300 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ee22ecbab544c4d server_cookie=23d712096a698d8 in_seq=0 out_seq=0 2024-09-12T02:52:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc85d7fa640 1 -- 172.21.15.100:0/2749422036 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a00104a860 con 0x55a0010f1f10 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc85d7fa640 10 client.17700 handle_command_reply: tid=0 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 client.17700 shutdown 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010d75d0 msgr2=0x55a0010e1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010d75d0 0x55a0010e1e00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc86c006bd0 tx=0x7fc86c006b20 comp rx=0 tx=0).stop 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 shutdown_connections 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a0010f1f10 0x55a0010f4300 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010e2370 0x55a0010df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d8b40 0x55a0010df0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 --2- 172.21.15.100:0/2749422036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010d75d0 0x55a0010e1e00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc85d7fa640 0 client.17700 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 >> 172.21.15.100:0/2749422036 conn(0x55a0010a0310 msgr2=0x55a0010d9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 shutdown_connections 2024-09-12T02:52:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 1 -- 172.21.15.100:0/2749422036 wait complete. 2024-09-12T02:52:07.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.866+0000 7fc882598740 20 client.17700 trim_cache size 0 max 16384 2024-09-12T02:52:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 Processor -- start 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 -- start start 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 0x55a0010d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8781b2010 con 0x55a0010e2370 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8781af8e0 con 0x55a0010d8b40 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc882598740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8781ad730 con 0x55a0010d75d0 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.879+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38768/0 (socket says 172.21.15.100:38768) 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 -- 172.21.15.100:0/2255385481 learned_addr learned my addr 172.21.15.100:0/2255385481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 -- 172.21.15.100:0/2255385481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 msgr2=0x55a0010d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87df5b640 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 0x55a0010d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 -- 172.21.15.100:0/2255385481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 msgr2=0x55a0010de0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010de0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 -- 172.21.15.100:0/2255385481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0010dfbb0 con 0x55a0010e2370 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87df5b640 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010de0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc87d75a640 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f7320 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc86c006af0 tx=0x7fc86c02f860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b5b9f286af7e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc85f7fe640 1 -- 172.21.15.100:0/2255385481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c01d040 con 0x55a0010e2370 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc85f7fe640 1 -- 172.21.15.100:0/2255385481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86c00a070 con 0x55a0010e2370 2024-09-12T02:52:07.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.880+0000 7fc85f7fe640 1 -- 172.21.15.100:0/2255385481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00ca40 con 0x55a0010e2370 2024-09-12T02:52:07.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 -- 172.21.15.100:0/2255385481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 msgr2=0x55a0010f7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f7320 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc86c006af0 tx=0x7fc86c02f860 comp rx=0 tx=0).stop 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 -- 172.21.15.100:0/2255385481 shutdown_connections 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f7320 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010de0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 --2- 172.21.15.100:0/2255385481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 0x55a0010d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 -- 172.21.15.100:0/2255385481 >> 172.21.15.100:0/2255385481 conn(0x55a0010a0310 msgr2=0x55a0010dd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 -- 172.21.15.100:0/2255385481 shutdown_connections 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 -- 172.21.15.100:0/2255385481 wait complete. 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 -- start start 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.881+0000 7fc882598740 1 Processor -- start 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 0x55a0010f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8781adda0 con 0x55a0010e2370 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8781af210 con 0x55a0010d8b40 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8781ae470 con 0x55a0010d75d0 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 10 client.0 _ll_register_callbacks cb 0x7fc86c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38774/0 (socket says 172.21.15.100:38774) 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 -- 172.21.15.100:0/3149350231 learned_addr learned my addr 172.21.15.100:0/3149350231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87df5b640 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 0x55a0010f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 -- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 msgr2=0x55a0010f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 0x55a0010f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 -- 172.21.15.100:0/3149350231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 msgr2=0x55a0010f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 -- 172.21.15.100:0/3149350231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0010f5a90 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc87d75a640 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f5260 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc86c018040 tx=0x7fc86c015420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a13dbccf360305 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc85d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc85d7fa640 1 -- 172.21.15.100:0/3149350231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c01d070 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc85d7fa640 1 -- 172.21.15.100:0/3149350231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc86c00f040 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc86c00a070 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc85d7fa640 1 -- 172.21.15.100:0/3149350231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc86c00c5f0 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 10 client.17706 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.882+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a00115c730 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc85d7fa640 1 -- 172.21.15.100:0/3149350231 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86c00a070 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc85d7fa640 1 -- 172.21.15.100:0/3149350231 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc86c015040 con 0x55a0010e2370 2024-09-12T02:52:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc882598740 10 client.17706 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc882598740 10 client.17706 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc882598740 20 client.17706 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc882598740 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a00115cd30 0x55a00115f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc882598740 4 client.17706 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a001044d70 con 0x55a00115cd30 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.883+0000 7fc87df5b640 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a00115cd30 0x55a00115f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc85d7fa640 10 client.17706 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc87df5b640 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a00115cd30 0x55a00115f120 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a231fd6c773fead server_cookie=ee5f5ca8b3fec8da in_seq=0 out_seq=0 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc85d7fa640 1 -- 172.21.15.100:0/3149350231 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a001044d70 con 0x55a00115cd30 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc85d7fa640 10 client.17706 handle_command_reply: tid=0 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 client.17706 shutdown 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 msgr2=0x55a0010f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f5260 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc86c018040 tx=0x7fc86c015420 comp rx=0 tx=0).stop 2024-09-12T02:52:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 shutdown_connections 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55a00115cd30 0x55a00115f120 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0010e2370 0x55a0010f5260 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc85d7fa640 0 client.17706 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a0010d8b40 0x55a0010f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 --2- 172.21.15.100:0/3149350231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0010d75d0 0x55a0010f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 >> 172.21.15.100:0/3149350231 conn(0x55a0010a0310 msgr2=0x55a0010de1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 shutdown_connections 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 1 -- 172.21.15.100:0/3149350231 wait complete. 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.884+0000 7fc882598740 20 client.17706 trim_cache size 0 max 16384 2024-09-12T02:52:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:52:07.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8600a2c00 msgr2=0x7fc8600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8600a2c00 0x7fc8600a50c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc8700c45b0 tx=0x7fc87002a410 comp rx=0 tx=0).stop 2024-09-12T02:52:07.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 msgr2=0x7fc87819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:07.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc87819ef90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc870005ab0 tx=0x7fc8700042f0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 shutdown_connections 2024-09-12T02:52:07.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8600a2c00 0x7fc8600a50c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc87810e4f0 0x7fc87819ef90 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc878101380 0x7fc87819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 --2- 172.21.15.100:0/3430172114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8781009d0 0x7fc87819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:07.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 >> 172.21.15.100:0/3430172114 conn(0x7fc8780fc7d0 msgr2=0x7fc8780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:07.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 shutdown_connections 2024-09-12T02:52:07.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:07.885+0000 7fc8801bf640 1 -- 172.21.15.100:0/3430172114 wait complete. 2024-09-12T02:52:08.742 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:52:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:09.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:08 smithi117 ceph-mon[34898]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 624 op/s 2024-09-12T02:52:09.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:08 smithi100 ceph-mon[31390]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 624 op/s 2024-09-12T02:52:09.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:08 smithi189 ceph-mon[35196]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 14 MiB/s wr, 624 op/s 2024-09-12T02:52:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 -- 172.21.15.100:0/3152317057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f10 msgr2=0x7fc4f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 --2- 172.21.15.100:0/3152317057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f10 0x7fc4f010ea90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009ca0 tx=0x7fc4e802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 -- 172.21.15.100:0/3152317057 shutdown_connections 2024-09-12T02:52:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 --2- 172.21.15.100:0/3152317057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f10 0x7fc4f010ea90 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 --2- 172.21.15.100:0/3152317057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4f0102790 0x7fc4f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 --2- 172.21.15.100:0/3152317057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f0101de0 0x7fc4f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 -- 172.21.15.100:0/3152317057 >> 172.21.15.100:0/3152317057 conn(0x7fc4f00fd8c0 msgr2=0x7fc4f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 -- 172.21.15.100:0/3152317057 shutdown_connections 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 -- 172.21.15.100:0/3152317057 wait complete. 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.454+0000 7fc4f8734640 1 Processor -- start 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f8734640 1 -- start start 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f8734640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4f0101de0 0x7fc4f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f8734640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0102790 0x7fc4f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f8734640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f0106f10 0x7fc4f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f8734640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0111f70 con 0x7fc4f0102790 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f8734640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0111df0 con 0x7fc4f0101de0 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f8734640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01120f0 con 0x7fc4f0106f10 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0102790 0x7fc4f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0102790 0x7fc4f0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38788/0 (socket says 172.21.15.100:38788) 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 -- 172.21.15.100:0/914181151 learned_addr learned my addr 172.21.15.100:0/914181151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f0106f10 0x7fc4f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4f0101de0 0x7fc4f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 -- 172.21.15.100:0/914181151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f0106f10 msgr2=0x7fc4f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f0106f10 0x7fc4f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 -- 172.21.15.100:0/914181151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4f0101de0 msgr2=0x7fc4f00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4f0101de0 0x7fc4f00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 -- 172.21.15.100:0/914181151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f01a6800 con 0x7fc4f0102790 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4f0101de0 0x7fc4f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.455+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0102790 0x7fc4f0074a30 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000c920 tx=0x7fc4e000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.456+0000 7fc4e77fe640 1 -- 172.21.15.100:0/914181151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0007c70 con 0x7fc4f0102790 2024-09-12T02:52:09.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.456+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f01a6af0 con 0x7fc4f0102790 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.456+0000 7fc4e77fe640 1 -- 172.21.15.100:0/914181151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e0007e10 con 0x7fc4f0102790 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.456+0000 7fc4e77fe640 1 -- 172.21.15.100:0/914181151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0018890 con 0x7fc4f0102790 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.456+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f01a7030 con 0x7fc4f0102790 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4e77fe640 1 -- 172.21.15.100:0/914181151 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fc4e0018a70 con 0x7fc4f0102790 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 Processor -- start 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 -- start start 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae669090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae669a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae674370 0x558eae676760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558eae5cf2f0 con 0x558eae6695d0 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558eae576cf0 con 0x558eae674370 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.458+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558eae5cb2b0 con 0x558eae66ab40 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae669a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae669a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38796/0 (socket says 172.21.15.100:38796) 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 -- 172.21.15.100:0/49370166 learned_addr learned my addr 172.21.15.100:0/49370166 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae674370 0x558eae676760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae669090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 -- 172.21.15.100:0/49370166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 msgr2=0x558eae669090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae669090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 -- 172.21.15.100:0/49370166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae674370 msgr2=0x558eae676760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae674370 0x558eae676760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 -- 172.21.15.100:0/49370166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eae55b3a0 con 0x558eae6695d0 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae669090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4e77fe640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae669a10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00bd40 tx=0x7fc4ec00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355891c93e34fac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4e77fe640 1 -- 172.21.15.100:0/914181151 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc4e00cf120 con 0x7fc4f0102790 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4e4ff9640 1 -- 172.21.15.100:0/49370166 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec015070 con 0x558eae6695d0 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4e4ff9640 1 -- 172.21.15.100:0/49370166 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec00be30 con 0x558eae6695d0 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.459+0000 7fc4e4ff9640 1 -- 172.21.15.100:0/49370166 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0107f0 con 0x558eae6695d0 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 -- 172.21.15.100:0/49370166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 msgr2=0x558eae669a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8004af0 tx=0x7fc4e8004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae669a10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00bd40 tx=0x7fc4ec00f730 comp rx=0 tx=0).stop 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 -- 172.21.15.100:0/49370166 shutdown_connections 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae674370 0x558eae676760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae669a10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/49370166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae669090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 -- 172.21.15.100:0/49370166 >> 172.21.15.100:0/49370166 conn(0x558eae632310 msgr2=0x558eae665c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 -- 172.21.15.100:0/49370166 shutdown_connections 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.460+0000 7fc4fab0d740 1 -- 172.21.15.100:0/49370166 wait complete. 2024-09-12T02:52:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 -- start start 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 Processor -- start 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae6695d0 0x558eae673d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae671040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae671650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558eae677070 con 0x558eae674370 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558eae58a060 con 0x558eae66ab40 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558eae6771f0 con 0x558eae6695d0 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4fab0d740 10 client.0 _ll_register_callbacks cb 0x558eae2dd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae671650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae671650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38812/0 (socket says 172.21.15.100:38812) 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/3074438422 learned_addr learned my addr 172.21.15.100:0/3074438422 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae6695d0 0x558eae673d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae671040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae6695d0 msgr2=0x558eae673d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae6695d0 0x558eae673d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/3074438422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 msgr2=0x558eae671040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae671040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/3074438422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eae3403c0 con 0x558eae674370 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.461+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae671040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae671650 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8035000 tx=0x7fc4e802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec3be2fceeca9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/3074438422 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8004250 con 0x558eae674370 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4ec00be30 con 0x558eae674370 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/3074438422 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc4e80043f0 con 0x558eae674370 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/3074438422 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc4e80045f0 con 0x558eae674370 2024-09-12T02:52:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 10 client.17718 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558eae682b30 con 0x558eae674370 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/3074438422 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec00be30 con 0x558eae674370 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/3074438422 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc4e80305c0 con 0x558eae674370 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 10 client.17718 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 10 client.17718 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 20 client.17718 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae684320 0x558eae6867c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 4 client.17718 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.462+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eae5dc860 con 0x558eae684320 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.463+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae684320 0x558eae6867c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.463+0000 7fc4d9ffb640 10 client.17718 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.463+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae684320 0x558eae6867c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2701b6b7a6ff62da server_cookie=73d2a910c76a50f7 in_seq=0 out_seq=0 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/3074438422 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558eae5dc860 con 0x558eae684320 2024-09-12T02:52:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4d9ffb640 10 client.17718 handle_command_reply: tid=0 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 client.17718 shutdown 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 msgr2=0x558eae671650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae671650 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8035000 tx=0x7fc4e802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 shutdown_connections 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae684320 0x558eae6867c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae671650 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae671040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/3074438422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae6695d0 0x558eae673d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 >> 172.21.15.100:0/3074438422 conn(0x558eae632310 msgr2=0x558eae66b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4d9ffb640 0 client.17718 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 shutdown_connections 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 1 -- 172.21.15.100:0/3074438422 wait complete. 2024-09-12T02:52:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.464+0000 7fc4fab0d740 20 client.17718 trim_cache size 0 max 16384 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 Processor -- start 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 -- start start 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae680340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae670900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae674370 0x558eae665700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01b1f60 con 0x558eae6695d0 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01af830 con 0x558eae66ab40 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01ad680 con 0x558eae674370 2024-09-12T02:52:09.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae680340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae680340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38820/0 (socket says 172.21.15.100:38820) 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 -- 172.21.15.100:0/337763885 learned_addr learned my addr 172.21.15.100:0/337763885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae674370 0x558eae665700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae670900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 -- 172.21.15.100:0/337763885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae674370 msgr2=0x558eae665700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae674370 0x558eae665700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 -- 172.21.15.100:0/337763885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 msgr2=0x558eae670900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae670900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.477+0000 7fc4f64d0640 1 -- 172.21.15.100:0/337763885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eae66c940 con 0x558eae6695d0 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae680340 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec011f80 tx=0x7fc4ec00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcd53d94f44423f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4dbfff640 1 -- 172.21.15.100:0/337763885 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec015040 con 0x558eae6695d0 2024-09-12T02:52:09.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4dbfff640 1 -- 172.21.15.100:0/337763885 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec005520 con 0x558eae6695d0 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4dbfff640 1 -- 172.21.15.100:0/337763885 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec004880 con 0x558eae6695d0 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 -- 172.21.15.100:0/337763885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 msgr2=0x558eae680340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae680340 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec011f80 tx=0x7fc4ec00b660 comp rx=0 tx=0).stop 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 -- 172.21.15.100:0/337763885 shutdown_connections 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae674370 0x558eae665700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae66ab40 0x558eae670900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/337763885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae6695d0 0x558eae680340 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 -- 172.21.15.100:0/337763885 >> 172.21.15.100:0/337763885 conn(0x558eae632310 msgr2=0x558eae66f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.478+0000 7fc4fab0d740 1 -- 172.21.15.100:0/337763885 shutdown_connections 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 -- 172.21.15.100:0/337763885 wait complete. 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 -- start start 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 Processor -- start 2024-09-12T02:52:09.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae6695d0 0x558eae67c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae67c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae66d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01adcf0 con 0x558eae674370 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01af160 con 0x558eae6695d0 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01ae3c0 con 0x558eae66ab40 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4fab0d740 10 client.0 _ll_register_callbacks cb 0x7fc4e802f4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4f6cd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae66d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4f6cd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae66d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38824/0 (socket says 172.21.15.100:38824) 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/1374519484 learned_addr learned my addr 172.21.15.100:0/1374519484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4f5ccf640 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae67c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.479+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae6695d0 0x558eae67c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 msgr2=0x558eae67c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae67c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/1374519484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae6695d0 msgr2=0x558eae67c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae6695d0 0x558eae67c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4f6cd1640 1 -- 172.21.15.100:0/1374519484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eae674100 con 0x558eae674370 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4f6cd1640 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae66d490 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8030a60 tx=0x7fc4e8031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8600c1ad1f7c90f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/1374519484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8030e60 con 0x558eae674370 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4ec005520 con 0x558eae674370 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/1374519484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc4e802f610 con 0x558eae674370 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/1374519484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc4e80307c0 con 0x558eae674370 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 10 client.17724 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558eae6ee630 con 0x558eae674370 2024-09-12T02:52:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/1374519484 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec005520 con 0x558eae674370 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/1374519484 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc4e805c810 con 0x558eae674370 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 10 client.17724 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 10 client.17724 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 20 client.17724 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae6eecf0 0x558eae6f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 4 client.17724 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.480+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558eae5d6d70 con 0x558eae6eecf0 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae6eecf0 0x558eae6f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4f64d0640 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae6eecf0 0x558eae6f10e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9f74353e8f04eb server_cookie=bb9f1de6284e65c6 in_seq=0 out_seq=0 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4d9ffb640 10 client.17724 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4d9ffb640 1 -- 172.21.15.100:0/1374519484 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558eae5d6d70 con 0x558eae6eecf0 2024-09-12T02:52:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4d9ffb640 10 client.17724 handle_command_reply: tid=0 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 client.17724 shutdown 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 msgr2=0x558eae66d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae66d490 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8030a60 tx=0x7fc4e8031820 comp rx=0 tx=0).stop 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 shutdown_connections 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x558eae6eecf0 0x558eae6f10e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4d9ffb640 0 client.17724 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558eae674370 0x558eae66d490 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558eae66ab40 0x558eae67c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 --2- 172.21.15.100:0/1374519484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558eae6695d0 0x558eae67c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.481+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 >> 172.21.15.100:0/1374519484 conn(0x558eae632310 msgr2=0x558eae6656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 shutdown_connections 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4fab0d740 1 -- 172.21.15.100:0/1374519484 wait complete. 2024-09-12T02:52:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4fab0d740 20 client.17724 trim_cache size 0 max 16384 2024-09-12T02:52:09.495 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:52:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4dc0a2b80 msgr2=0x7fc4dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8004af0 tx=0x7fc4e8004a80 comp rx=0 tx=0).stop 2024-09-12T02:52:09.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0102790 msgr2=0x7fc4f0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0102790 0x7fc4f0074a30 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000c920 tx=0x7fc4e000cde0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 shutdown_connections 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc4dc0a2b80 0x7fc4dc0a5040 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f0106f10 0x7fc4f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0102790 0x7fc4f0074a30 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 --2- 172.21.15.100:0/914181151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4f0101de0 0x7fc4f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 >> 172.21.15.100:0/914181151 conn(0x7fc4f00fd8c0 msgr2=0x7fc4f00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 shutdown_connections 2024-09-12T02:52:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:09.482+0000 7fc4f8734640 1 -- 172.21.15.100:0/914181151 wait complete. 2024-09-12T02:52:10.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:52:10.537 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:10.936 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:10 smithi100 ceph-mon[31390]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 556 op/s 2024-09-12T02:52:11.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 -- 172.21.15.100:0/252820963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0101de0 msgr2=0x7f70d01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/252820963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0101de0 0x7f70d01021c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009900 tx=0x7f70c002a410 comp rx=0 tx=0).stop 2024-09-12T02:52:11.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 -- 172.21.15.100:0/252820963 shutdown_connections 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/252820963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70d0106f10 0x7f70d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/252820963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d0102790 0x7f70d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/252820963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0101de0 0x7f70d01021c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 -- 172.21.15.100:0/252820963 >> 172.21.15.100:0/252820963 conn(0x7f70d00fd8c0 msgr2=0x7f70d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 -- 172.21.15.100:0/252820963 shutdown_connections 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.017+0000 7f70d4a1e640 1 -- 172.21.15.100:0/252820963 wait complete. 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 Processor -- start 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 -- start start 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d0101de0 0x7f70d01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0102790 0x7f70d0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70d0106f10 0x7f70d019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0111f70 con 0x7f70d0102790 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0111df0 con 0x7f70d0101de0 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70d4a1e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01120f0 con 0x7f70d0106f10 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0102790 0x7f70d0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0102790 0x7f70d0198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38850/0 (socket says 172.21.15.100:38850) 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 -- 172.21.15.100:0/1394190093 learned_addr learned my addr 172.21.15.100:0/1394190093 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70ce59c640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d0101de0 0x7f70d01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70ced9d640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70d0106f10 0x7f70d019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 -- 172.21.15.100:0/1394190093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70d0106f10 msgr2=0x7f70d019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70d0106f10 0x7f70d019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 -- 172.21.15.100:0/1394190093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d0101de0 msgr2=0x7f70d01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d0101de0 0x7f70d01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 -- 172.21.15.100:0/1394190093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d019d480 con 0x7f70d0102790 2024-09-12T02:52:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.018+0000 7f70c7fff640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0102790 0x7f70d0198a10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f70b800e9f0 tx=0x7f70b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.019+0000 7f70c77fe640 1 -- 172.21.15.100:0/1394190093 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b800cd80 con 0x7f70d0102790 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.019+0000 7f70c77fe640 1 -- 172.21.15.100:0/1394190093 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70b8010910 con 0x7f70d0102790 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.019+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d019d770 con 0x7f70d0102790 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.019+0000 7f70c77fe640 1 -- 172.21.15.100:0/1394190093 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b80188f0 con 0x7f70d0102790 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.019+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d01a5050 con 0x7f70d0102790 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70c77fe640 1 -- 172.21.15.100:0/1394190093 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f70b8010ac0 con 0x7f70d0102790 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 Processor -- start 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 -- start start 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a17b40 0x5593c6a16090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70c77fe640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f70bc0a2b80 0x7f70bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a16a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a27b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5593c697c2f0 con 0x5593c6a17b40 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5593c6923cf0 con 0x5593c6a25780 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.021+0000 7f70d6df7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5593c69782b0 con 0x5593c6a165d0 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a17b40 0x5593c6a16090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ce59c640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f70bc0a2b80 0x7f70bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a17b40 0x5593c6a16090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38856/0 (socket says 172.21.15.100:38856) 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 -- 172.21.15.100:0/2415506436 learned_addr learned my addr 172.21.15.100:0/2415506436 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a27b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70c77fe640 1 -- 172.21.15.100:0/1394190093 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f70b80cf440 con 0x7f70d0102790 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70c7fff640 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a16a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 -- 172.21.15.100:0/2415506436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 msgr2=0x5593c6a16a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a16a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 -- 172.21.15.100:0/2415506436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 msgr2=0x5593c6a27b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a27b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 -- 172.21.15.100:0/2415506436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593c69083a0 con 0x5593c6a17b40 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ce59c640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f70bc0a2b80 0x7f70bc0a5040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009230 tx=0x7f70c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70ced9d640 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a17b40 0x5593c6a16090 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f70c8005c20 tx=0x7f70c8009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab3f20c6ce31967 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70c4ff9640 1 -- 172.21.15.100:0/2415506436 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80150f0 con 0x5593c6a17b40 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70c4ff9640 1 -- 172.21.15.100:0/2415506436 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70c8015290 con 0x5593c6a17b40 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.022+0000 7f70c4ff9640 1 -- 172.21.15.100:0/2415506436 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8005520 con 0x5593c6a17b40 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 -- 172.21.15.100:0/2415506436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a17b40 msgr2=0x5593c6a16090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a17b40 0x5593c6a16090 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f70c8005c20 tx=0x7f70c8009a00 comp rx=0 tx=0).stop 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 -- 172.21.15.100:0/2415506436 shutdown_connections 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a27b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a16a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2415506436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a17b40 0x5593c6a16090 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 -- 172.21.15.100:0/2415506436 >> 172.21.15.100:0/2415506436 conn(0x5593c69df310 msgr2=0x5593c6a12c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 -- 172.21.15.100:0/2415506436 shutdown_connections 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.023+0000 7f70d6df7740 1 -- 172.21.15.100:0/2415506436 wait complete. 2024-09-12T02:52:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 -- start start 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 Processor -- start 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a25100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a22930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5593c6a28420 con 0x5593c6a165d0 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5593c6937060 con 0x5593c6a25780 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5593c6a285a0 con 0x5593c6a17b40 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70d6df7740 10 client.0 _ll_register_callbacks cb 0x5593c668a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a25100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a25100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38858/0 (socket says 172.21.15.100:38858) 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 -- 172.21.15.100:0/3325849055 learned_addr learned my addr 172.21.15.100:0/3325849055 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70c7fff640 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 -- 172.21.15.100:0/3325849055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 msgr2=0x5593c6a223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 -- 172.21.15.100:0/3325849055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 msgr2=0x5593c6a22930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a22930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.024+0000 7f70ce59c640 1 -- 172.21.15.100:0/3325849055 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593c66ed3c0 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70ce59c640 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a25100 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009900 tx=0x7f70c0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc65874129930fff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3325849055 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c004d020 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3325849055 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f70c0004450 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70c8015290 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3325849055 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f70c0058050 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 10 client.17736 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5593c6a33ea0 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3325849055 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70c8015290 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3325849055 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f70c0049780 con 0x5593c6a165d0 2024-09-12T02:52:11.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 10 client.17736 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 10 client.17736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 20 client.17736 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6a353b0 0x5593c6a37840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 4 client.17736 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.025+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593c6989860 con 0x5593c6a353b0 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.026+0000 7f70c7fff640 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6a353b0 0x5593c6a37840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.026+0000 7f70b5ffb640 10 client.17736 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.026+0000 7f70c7fff640 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6a353b0 0x5593c6a37840 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99c54e986a6c32a server_cookie=6e7b79771edabaf8 in_seq=0 out_seq=0 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3325849055 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593c6989860 con 0x5593c6a353b0 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70b5ffb640 10 client.17736 handle_command_reply: tid=0 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 client.17736 shutdown 2024-09-12T02:52:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 msgr2=0x5593c6a25100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a25100 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009900 tx=0x7f70c0009260 comp rx=0 tx=0).stop 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 shutdown_connections 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6a353b0 0x5593c6a37840 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a22930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70b5ffb640 0 client.17736 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3325849055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a25100 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 >> 172.21.15.100:0/3325849055 conn(0x5593c69df310 msgr2=0x5593c6a18960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 shutdown_connections 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 1 -- 172.21.15.100:0/3325849055 wait complete. 2024-09-12T02:52:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.027+0000 7f70d6df7740 20 client.17736 trim_cache size 0 max 16384 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 Processor -- start 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 -- start start 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a17b40 0x5593c6a3d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a25780 0x5593c6a3d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01adc90 con 0x5593c6a25780 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01ab560 con 0x5593c6a17b40 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70d6df7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01a93b0 con 0x5593c6a165d0 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a25780 0x5593c6a3d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a25780 0x5593c6a3d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38868/0 (socket says 172.21.15.100:38868) 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 -- 172.21.15.100:0/2714658008 learned_addr learned my addr 172.21.15.100:0/2714658008 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ce59c640 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70c7fff640 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a17b40 0x5593c6a3d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 -- 172.21.15.100:0/2714658008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 msgr2=0x5593c6a316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 -- 172.21.15.100:0/2714658008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a17b40 msgr2=0x5593c6a3d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a17b40 0x5593c6a3d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 -- 172.21.15.100:0/2714658008 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593c6a13960 con 0x5593c6a25780 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ce59c640 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.040+0000 7f70ced9d640 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a25780 0x5593c6a3d650 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f70c8015a30 tx=0x7f70c8009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87aab0718fccf71 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70b7fff640 1 -- 172.21.15.100:0/2714658008 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8024070 con 0x5593c6a25780 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70b7fff640 1 -- 172.21.15.100:0/2714658008 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70c8015270 con 0x5593c6a25780 2024-09-12T02:52:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70b7fff640 1 -- 172.21.15.100:0/2714658008 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8020850 con 0x5593c6a25780 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 -- 172.21.15.100:0/2714658008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a25780 msgr2=0x5593c6a3d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a25780 0x5593c6a3d650 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f70c8015a30 tx=0x7f70c8009a70 comp rx=0 tx=0).stop 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 -- 172.21.15.100:0/2714658008 shutdown_connections 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a25780 0x5593c6a3d650 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a17b40 0x5593c6a3d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 --2- 172.21.15.100:0/2714658008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a165d0 0x5593c6a316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 -- 172.21.15.100:0/2714658008 >> 172.21.15.100:0/2714658008 conn(0x5593c69df310 msgr2=0x5593c6a1d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 -- 172.21.15.100:0/2714658008 shutdown_connections 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 -- 172.21.15.100:0/2714658008 wait complete. 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 -- start start 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.041+0000 7f70d6df7740 1 Processor -- start 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a298c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a29e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a2a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01a9a20 con 0x5593c6a165d0 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01aae90 con 0x5593c6a25780 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01aa0f0 con 0x5593c6a17b40 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 10 client.0 _ll_register_callbacks cb 0x7f70c0040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a298c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ced9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a2a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a298c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38878/0 (socket says 172.21.15.100:38878) 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 -- 172.21.15.100:0/3210337371 learned_addr learned my addr 172.21.15.100:0/3210337371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70c7fff640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a29e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 -- 172.21.15.100:0/3210337371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 msgr2=0x5593c6a29e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a29e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 -- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 msgr2=0x5593c6a2a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a2a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 -- 172.21.15.100:0/3210337371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593c6a124f0 con 0x5593c6a165d0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ced9d640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a2a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70c7fff640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a29e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70ce59c640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a298c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f70c002a450 tx=0x7f70c0004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766cbb1fdf3138f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3210337371 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c004d040 con 0x5593c6a165d0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3210337371 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f70c0049680 con 0x5593c6a165d0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.042+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70c8015270 con 0x5593c6a165d0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3210337371 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f70c0035040 con 0x5593c6a165d0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 10 client.17742 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5593c6aa04e0 con 0x5593c6a165d0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3210337371 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70c8015270 con 0x5593c6a165d0 2024-09-12T02:52:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3210337371 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f70c006f050 con 0x5593c6a165d0 2024-09-12T02:52:11.060 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:52:11.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 10 client.17742 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 10 client.17742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 20 client.17742 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6aa0c00 0x5593c6aa3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 4 client.17742 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593c6983d70 con 0x5593c6aa0c00 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70c7fff640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6aa0c00 0x5593c6aa3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70b5ffb640 10 client.17742 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.043+0000 7f70c7fff640 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6aa0c00 0x5593c6aa3010 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1482b18ecea3d707 server_cookie=d59d3ecb3699b4ee in_seq=0 out_seq=0 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70b5ffb640 1 -- 172.21.15.100:0/3210337371 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593c6983d70 con 0x5593c6aa0c00 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70b5ffb640 10 client.17742 handle_command_reply: tid=0 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 client.17742 shutdown 2024-09-12T02:52:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 msgr2=0x5593c6a298c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a298c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f70c002a450 tx=0x7f70c0004500 comp rx=0 tx=0).stop 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 shutdown_connections 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5593c6aa0c00 0x5593c6aa3010 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5593c6a25780 0x5593c6a2a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70b5ffb640 0 client.17742 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593c6a17b40 0x5593c6a29e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 --2- 172.21.15.100:0/3210337371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593c6a165d0 0x5593c6a298c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 >> 172.21.15.100:0/3210337371 conn(0x5593c69df310 msgr2=0x5593c6a114e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 shutdown_connections 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 1 -- 172.21.15.100:0/3210337371 wait complete. 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.044+0000 7f70d6df7740 20 client.17742 trim_cache size 0 max 16384 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f70bc0a2b80 msgr2=0x7f70bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f70bc0a2b80 0x7f70bc0a5040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009230 tx=0x7f70c00058d0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0102790 msgr2=0x7f70d0198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0102790 0x7f70d0198a10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f70b800e9f0 tx=0x7f70b800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 shutdown_connections 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f70bc0a2b80 0x7f70bc0a5040 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70d0106f10 0x7f70d019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0102790 0x7f70d0198a10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 --2- 172.21.15.100:0/1394190093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d0101de0 0x7f70d01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 >> 172.21.15.100:0/1394190093 conn(0x7f70d00fd8c0 msgr2=0x7f70d00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 shutdown_connections 2024-09-12T02:52:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:11.045+0000 7f70d4a1e640 1 -- 172.21.15.100:0/1394190093 wait complete. 2024-09-12T02:52:11.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:10 smithi117 ceph-mon[34898]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 556 op/s 2024-09-12T02:52:11.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:10 smithi189 ceph-mon[35196]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 556 op/s 2024-09-12T02:52:11.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:12.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:11 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:52:12.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:11 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:52:12.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:11 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:52:12.824 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:52:12.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:52:13.075 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:13.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:12 smithi100 ceph-mon[31390]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.2 MiB/s wr, 460 op/s 2024-09-12T02:52:13.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:52:13.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:52:13.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:52:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:12 smithi189 ceph-mon[35196]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.2 MiB/s wr, 460 op/s 2024-09-12T02:52:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:52:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:52:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:52:13.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:12 smithi117 ceph-mon[34898]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.2 MiB/s wr, 460 op/s 2024-09-12T02:52:13.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:52:13.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:52:13.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 -- 172.21.15.100:0/2360415822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80106a80 msgr2=0x7f2f80106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2360415822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80106a80 0x7f2f80106e60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009930 tx=0x7f2f7002a420 comp rx=0 tx=0).stop 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 -- 172.21.15.100:0/2360415822 shutdown_connections 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2360415822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80101420 0x7f2f8010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2360415822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f80100a80 0x7f2f80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2360415822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80106a80 0x7f2f80106e60 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 -- 172.21.15.100:0/2360415822 >> 172.21.15.100:0/2360415822 conn(0x7f2f800fc7a0 msgr2=0x7f2f800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:13.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 -- 172.21.15.100:0/2360415822 shutdown_connections 2024-09-12T02:52:13.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.876+0000 7f2f84fae640 1 -- 172.21.15.100:0/2360415822 wait complete. 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.877+0000 7f2f84fae640 1 Processor -- start 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.877+0000 7f2f84fae640 1 -- start start 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f84fae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80100a80 0x7f2f80198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f84fae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80101420 0x7f2f801989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f84fae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f80106a80 0x7f2f8019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f84fae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80110e40 con 0x7f2f80100a80 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f84fae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80110cc0 con 0x7f2f80101420 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f84fae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80110fc0 con 0x7f2f80106a80 2024-09-12T02:52:13.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80100a80 0x7f2f80198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80100a80 0x7f2f80198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38896/0 (socket says 172.21.15.100:38896) 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 -- 172.21.15.100:0/2925912906 learned_addr learned my addr 172.21.15.100:0/2925912906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f80106a80 0x7f2f8019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f77fff640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80101420 0x7f2f801989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 -- 172.21.15.100:0/2925912906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f80106a80 msgr2=0x7f2f8019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f80106a80 0x7f2f8019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 -- 172.21.15.100:0/2925912906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80101420 msgr2=0x7f2f801989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80101420 0x7f2f801989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f7e59c640 1 -- 172.21.15.100:0/2925912906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8019d440 con 0x7f2f80100a80 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.878+0000 7f2f77fff640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80101420 0x7f2f801989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:13.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.879+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80100a80 0x7f2f80198490 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009230 tx=0x7f2f70004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:13.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.879+0000 7f2f777fe640 1 -- 172.21.15.100:0/2925912906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7003f030 con 0x7f2f80100a80 2024-09-12T02:52:13.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.879+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8019d6d0 con 0x7f2f80100a80 2024-09-12T02:52:13.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.879+0000 7f2f777fe640 1 -- 172.21.15.100:0/2925912906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f70003ad0 con 0x7f2f80100a80 2024-09-12T02:52:13.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.879+0000 7f2f777fe640 1 -- 172.21.15.100:0/2925912906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70035070 con 0x7f2f80100a80 2024-09-12T02:52:13.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.879+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f801a5010 con 0x7f2f80100a80 2024-09-12T02:52:13.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.882+0000 7f2f777fe640 1 -- 172.21.15.100:0/2925912906 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2f70042030 con 0x7f2f80100a80 2024-09-12T02:52:13.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.882+0000 7f2f87387740 1 Processor -- start 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f87387740 1 -- start start 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f777fe640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f6c0a2b80 0x7f2f6c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f87387740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9ceb60 0x5638eb9cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f87387740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f87387740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f87387740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5638eb934280 con 0x5638eb9ceb60 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f87387740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5638eb8dbb10 con 0x5638eb9cf480 2024-09-12T02:52:13.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f87387740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5638eb930240 con 0x5638eb9d9d40 2024-09-12T02:52:13.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f6c0a2b80 0x7f2f6c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.883+0000 7f2f777fe640 1 -- 172.21.15.100:0/2925912906 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2f700ef5c0 con 0x7f2f80100a80 2024-09-12T02:52:13.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f7e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9ceb60 0x5638eb9cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:35582/0 (socket says 172.21.15.100:35582) 2024-09-12T02:52:13.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 -- 172.21.15.100:0/3965376684 learned_addr learned my addr 172.21.15.100:0/3965376684 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:13.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 -- 172.21.15.100:0/3965376684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 msgr2=0x5638eb9dc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9dc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 -- 172.21.15.100:0/3965376684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9ceb60 msgr2=0x5638eb9cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9ceb60 0x5638eb9cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 -- 172.21.15.100:0/3965376684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638eb8e81f0 con 0x5638eb9cf480 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f6c0a2b80 0x7f2f6c0a5040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009fd0 tx=0x7f2f78013b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f77fff640 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d9800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800bfd0 tx=0x7f2f68014cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31d77a09abf1eef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.884+0000 7f2f74ff9640 1 -- 172.21.15.100:0/3965376684 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800eab0 con 0x5638eb9cf480 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f74ff9640 1 -- 172.21.15.100:0/3965376684 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f68005500 con 0x5638eb9cf480 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f74ff9640 1 -- 172.21.15.100:0/3965376684 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68004e10 con 0x5638eb9cf480 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f87387740 1 -- 172.21.15.100:0/3965376684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 msgr2=0x5638eb9d9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f87387740 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d9800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800bfd0 tx=0x7f2f68014cf0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f87387740 1 -- 172.21.15.100:0/3965376684 shutdown_connections 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f87387740 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9dc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f87387740 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d9800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f87387740 1 --2- 172.21.15.100:0/3965376684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9ceb60 0x5638eb9cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.885+0000 7f2f87387740 1 -- 172.21.15.100:0/3965376684 >> 172.21.15.100:0/3965376684 conn(0x5638eb9cb0f0 msgr2=0x5638eb9cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:13.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 -- 172.21.15.100:0/3965376684 shutdown_connections 2024-09-12T02:52:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 -- 172.21.15.100:0/3965376684 wait complete. 2024-09-12T02:52:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 -- start start 2024-09-12T02:52:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 Processor -- start 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9ceb60 0x5638eb9d6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9d7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5638eb9dc910 con 0x5638eb9d9d40 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5638eb8eef10 con 0x5638eb9cf480 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5638eb9dca90 con 0x5638eb9ceb60 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.886+0000 7f2f87387740 10 client.0 _ll_register_callbacks cb 0x5638eb8b7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9d7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9d7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38908/0 (socket says 172.21.15.100:38908) 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/1346115589 learned_addr learned my addr 172.21.15.100:0/1346115589 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9ceb60 0x5638eb9d6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f77fff640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/1346115589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9ceb60 msgr2=0x5638eb9d6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9ceb60 0x5638eb9d6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 msgr2=0x5638eb9d7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/1346115589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638eb6a56a0 con 0x5638eb9d9d40 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f77fff640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9d7650 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800ff80 tx=0x7f2f78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6901cbde474c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1346115589 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78010430 con 0x5638eb9d9d40 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f68005500 con 0x5638eb9d9d40 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.887+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1346115589 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2f780105d0 con 0x5638eb9d9d40 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1346115589 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2f780107d0 con 0x5638eb9d9d40 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 10 client.17754 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5638eb9e8510 con 0x5638eb9d9d40 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1346115589 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f68005500 con 0x5638eb9d9d40 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1346115589 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2f78031050 con 0x5638eb9d9d40 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 10 client.17754 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 10 client.17754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 20 client.17754 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eb9e9920 0x5638eb9ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 4 client.17754 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638eb9417f0 con 0x5638eb9e9920 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.888+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eb9e9920 0x5638eb9ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.889+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eb9e9920 0x5638eb9ebd90 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde5e56828dbebc0 server_cookie=b0f24b1a227ac635 in_seq=0 out_seq=0 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.889+0000 7f2f65ffb640 10 client.17754 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1346115589 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638eb9417f0 con 0x5638eb9e9920 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f65ffb640 10 client.17754 handle_command_reply: tid=0 2024-09-12T02:52:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 client.17754 shutdown 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 msgr2=0x5638eb9d7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9d7650 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800ff80 tx=0x7f2f78004ab0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 shutdown_connections 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eb9e9920 0x5638eb9ebd90 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9d7650 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9cf480 0x5638eb9d7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 --2- 172.21.15.100:0/1346115589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9ceb60 0x5638eb9d6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 >> 172.21.15.100:0/1346115589 conn(0x5638eb9cb0f0 msgr2=0x5638eb9ca270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f65ffb640 0 client.17754 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 shutdown_connections 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 1 -- 172.21.15.100:0/1346115589 wait complete. 2024-09-12T02:52:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.890+0000 7f2f87387740 20 client.17754 trim_cache size 0 max 16384 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.908+0000 7f2f87387740 1 Processor -- start 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.908+0000 7f2f87387740 1 -- start start 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.908+0000 7f2f87387740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9d8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f87387740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9cf480 0x5638eb9f1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f87387740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f87387740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801adce0 con 0x5638eb9d9d40 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f87387740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801ab5b0 con 0x5638eb9ceb60 2024-09-12T02:52:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f87387740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801a9400 con 0x5638eb9cf480 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38914/0 (socket says 172.21.15.100:38914) 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/3875069816 learned_addr learned my addr 172.21.15.100:0/3875069816 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f77fff640 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9cf480 0x5638eb9f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9d8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/3875069816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9cf480 msgr2=0x5638eb9f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9cf480 0x5638eb9f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/3875069816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 msgr2=0x5638eb9d8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9d8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 -- 172.21.15.100:0/3875069816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638eb9ec100 con 0x5638eb9d9d40 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9d8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9f1ba0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2f78032fd0 tx=0x7f2f78009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e65c7f61efc7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f67fff640 1 -- 172.21.15.100:0/3875069816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78037030 con 0x5638eb9d9d40 2024-09-12T02:52:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f67fff640 1 -- 172.21.15.100:0/3875069816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f78010430 con 0x5638eb9d9d40 2024-09-12T02:52:13.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.909+0000 7f2f67fff640 1 -- 172.21.15.100:0/3875069816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78003bd0 con 0x5638eb9d9d40 2024-09-12T02:52:13.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 -- 172.21.15.100:0/3875069816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 msgr2=0x5638eb9f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9f1ba0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2f78032fd0 tx=0x7f2f78009480 comp rx=0 tx=0).stop 2024-09-12T02:52:13.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 -- 172.21.15.100:0/3875069816 shutdown_connections 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9d9d40 0x5638eb9f1ba0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9cf480 0x5638eb9f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 --2- 172.21.15.100:0/3875069816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9d8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 -- 172.21.15.100:0/3875069816 >> 172.21.15.100:0/3875069816 conn(0x5638eb9cb0f0 msgr2=0x5638eb9d8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 -- 172.21.15.100:0/3875069816 shutdown_connections 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 -- 172.21.15.100:0/3875069816 wait complete. 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.910+0000 7f2f87387740 1 -- start start 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 1 Processor -- start 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9cf480 0x5638eb9ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801a9a70 con 0x5638eb9cf480 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801aaee0 con 0x5638eb9ceb60 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801aa140 con 0x5638eb9d9d40 2024-09-12T02:52:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f87387740 10 client.0 _ll_register_callbacks cb 0x7f2f78009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9cf480 0x5638eb9ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9cf480 0x5638eb9ddeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38922/0 (socket says 172.21.15.100:38922) 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 -- 172.21.15.100:0/1626166894 learned_addr learned my addr 172.21.15.100:0/1626166894 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 -- 172.21.15.100:0/1626166894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 msgr2=0x5638eb9de3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9de3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 -- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 msgr2=0x5638eb9dd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9dd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.911+0000 7f2f77fff640 1 -- 172.21.15.100:0/1626166894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638eba53630 con 0x5638eb9cf480 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f7ed9d640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9de3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f77fff640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9cf480 0x5638eb9ddeb0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800bfa0 tx=0x7f2f6800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0328af80bcf73c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1626166894 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6802a070 con 0x5638eb9cf480 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1626166894 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2f68005230 con 0x5638eb9cf480 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f78010430 con 0x5638eb9cf480 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1626166894 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2f6800ede0 con 0x5638eb9cf480 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f87387740 10 client.17760 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5638eba54800 con 0x5638eb9cf480 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.912+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1626166894 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f78010430 con 0x5638eb9cf480 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1626166894 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2f6801b030 con 0x5638eb9cf480 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f87387740 10 client.17760 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f87387740 10 client.17760 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f87387740 20 client.17760 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f87387740 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eba54d30 0x5638eba57120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f87387740 4 client.17760 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:52:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5638eb93bd00 con 0x5638eba54d30 2024-09-12T02:52:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eba54d30 0x5638eba57120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f7e59c640 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eba54d30 0x5638eba57120 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da9d600539a402d3 server_cookie=85c0098eee694513 in_seq=0 out_seq=0 2024-09-12T02:52:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.913+0000 7f2f65ffb640 10 client.17760 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.914+0000 7f2f65ffb640 1 -- 172.21.15.100:0/1626166894 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5638eb93bd00 con 0x5638eba54d30 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.914+0000 7f2f65ffb640 10 client.17760 handle_command_reply: tid=0 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.914+0000 7f2f87387740 1 client.17760 shutdown 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.914+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9cf480 msgr2=0x5638eb9ddeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.914+0000 7f2f87387740 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9cf480 0x5638eb9ddeb0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800bfa0 tx=0x7f2f6800eae0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 shutdown_connections 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5638eba54d30 0x5638eba57120 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f65ffb640 0 client.17760 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5638eb9d9d40 0x5638eb9de3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638eb9cf480 0x5638eb9ddeb0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 --2- 172.21.15.100:0/1626166894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5638eb9ceb60 0x5638eb9dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 >> 172.21.15.100:0/1626166894 conn(0x5638eb9cb0f0 msgr2=0x5638eb9d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 shutdown_connections 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 1 -- 172.21.15.100:0/1626166894 wait complete. 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f87387740 20 client.17760 trim_cache size 0 max 16384 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:52:13.920 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "503c107d-8d8f-4c56-8331-18264cab116e", 2024-09-12T02:52:13.921 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:52:13.921 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f6c0a2b80 msgr2=0x7f2f6c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f6c0a2b80 0x7f2f6c0a5040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009fd0 tx=0x7f2f78013b00 comp rx=0 tx=0).stop 2024-09-12T02:52:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80100a80 msgr2=0x7f2f80198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.915+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80100a80 0x7f2f80198490 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009230 tx=0x7f2f70004270 comp rx=0 tx=0).stop 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 shutdown_connections 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2f6c0a2b80 0x7f2f6c0a5040 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f80106a80 0x7f2f8019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80101420 0x7f2f801989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 --2- 172.21.15.100:0/2925912906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80100a80 0x7f2f80198490 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 >> 172.21.15.100:0/2925912906 conn(0x7f2f800fc7a0 msgr2=0x7f2f8006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 shutdown_connections 2024-09-12T02:52:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:13.916+0000 7f2f84fae640 1 -- 172.21.15.100:0/2925912906 wait complete. 2024-09-12T02:52:14.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:52:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:15.057 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:14 smithi100 ceph-mon[31390]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 353 op/s 2024-09-12T02:52:15.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:14 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:52:15.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:14 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:14 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:52:15.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:14 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:52:15.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:14 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:14 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:14 smithi189 ceph-mon[35196]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 353 op/s 2024-09-12T02:52:15.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:14 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:52:15.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:14 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:14 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:52:15.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:14 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:52:15.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:14 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:14 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:14 smithi117 ceph-mon[34898]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 353 op/s 2024-09-12T02:52:15.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:14 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:52:15.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:14 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:14 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:52:15.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:14 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:52:15.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:14 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:14 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:15.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 -- 172.21.15.100:0/45466708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4100e20 msgr2=0x7ffbe4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/45466708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4100e20 0x7ffbe4101200 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009900 tx=0x7ffbd402a480 comp rx=0 tx=0).stop 2024-09-12T02:52:15.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 -- 172.21.15.100:0/45466708 shutdown_connections 2024-09-12T02:52:15.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/45466708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbe4102ef0 0x7ffbe410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/45466708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbe4102570 0x7ffbe41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/45466708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4100e20 0x7ffbe4101200 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 -- 172.21.15.100:0/45466708 >> 172.21.15.100:0/45466708 conn(0x7ffbe40fc7d0 msgr2=0x7ffbe40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 -- 172.21.15.100:0/45466708 shutdown_connections 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 -- 172.21.15.100:0/45466708 wait complete. 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.413+0000 7ffbebbc8640 1 Processor -- start 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbebbc8640 1 -- start start 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbebbc8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbe4100e20 0x7ffbe41986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbebbc8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbe4102570 0x7ffbe4198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbebbc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4102ef0 0x7ffbe419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbebbc8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4111020 con 0x7ffbe4102ef0 2024-09-12T02:52:15.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbebbc8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4110ea0 con 0x7ffbe4102570 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbebbc8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41111a0 con 0x7ffbe4100e20 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4102ef0 0x7ffbe419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4102ef0 0x7ffbe419cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33446/0 (socket says 172.21.15.100:33446) 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 -- 172.21.15.100:0/3703589613 learned_addr learned my addr 172.21.15.100:0/3703589613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbe9964640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbe4100e20 0x7ffbe41986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbe9163640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbe4102570 0x7ffbe4198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 -- 172.21.15.100:0/3703589613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbe4100e20 msgr2=0x7ffbe41986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbe4100e20 0x7ffbe41986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 -- 172.21.15.100:0/3703589613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbe4102570 msgr2=0x7ffbe4198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbe4102570 0x7ffbe4198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 -- 172.21.15.100:0/3703589613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe419d650 con 0x7ffbe4102ef0 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbe9163640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbe4102570 0x7ffbe4198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbea165640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4102ef0 0x7ffbe419cf70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00b970 tx=0x7ffbdc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.414+0000 7ffbdaffd640 1 -- 172.21.15.100:0/3703589613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc019070 con 0x7ffbe4102ef0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.415+0000 7ffbdaffd640 1 -- 172.21.15.100:0/3703589613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbdc00cb40 con 0x7ffbe4102ef0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.415+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe419d940 con 0x7ffbe4102ef0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.415+0000 7ffbdaffd640 1 -- 172.21.15.100:0/3703589613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc007650 con 0x7ffbe4102ef0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.415+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe41a5220 con 0x7ffbe4102ef0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.417+0000 7ffbdaffd640 1 -- 172.21.15.100:0/3703589613 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7ffbdc01c070 con 0x7ffbe4102ef0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.417+0000 7ffbedfa1740 1 Processor -- start 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.417+0000 7ffbedfa1740 1 -- start start 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.417+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aa4a0 0x5612ff3aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3b5680 0x5612ff3b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5612ff3102e0 con 0x5612ff3aadc0 2024-09-12T02:52:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5612ff2b7ce0 con 0x5612ff3aa4a0 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5612ff30c2a0 con 0x5612ff3b5680 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33452/0 (socket says 172.21.15.100:33452) 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 -- 172.21.15.100:0/270695318 learned_addr learned my addr 172.21.15.100:0/270695318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9163640 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aa4a0 0x5612ff3aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbdaffd640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffbd00a2c00 0x7ffbd00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9163640 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3b5680 0x5612ff3b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 -- 172.21.15.100:0/270695318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3b5680 msgr2=0x5612ff3b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3b5680 0x5612ff3b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbea165640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffbd00a2c00 0x7ffbd00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 -- 172.21.15.100:0/270695318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aa4a0 msgr2=0x5612ff3aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aa4a0 0x5612ff3aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 -- 172.21.15.100:0/270695318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ff29c440 con 0x5612ff3aadc0 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbdaffd640 1 -- 172.21.15.100:0/3703589613 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffbdc0ce5e0 con 0x7ffbe4102ef0 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.418+0000 7ffbe9964640 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b5140 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009900 tx=0x7ffbd4004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb08aafb6039bca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbcffff640 1 -- 172.21.15.100:0/270695318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4035030 con 0x5612ff3aadc0 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbea165640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffbd00a2c00 0x7ffbd00a50c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc09ae10 tx=0x7ffbdc00e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbcffff640 1 -- 172.21.15.100:0/270695318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbd4040070 con 0x5612ff3aadc0 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbcffff640 1 -- 172.21.15.100:0/270695318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4031ba0 con 0x5612ff3aadc0 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 -- 172.21.15.100:0/270695318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 msgr2=0x5612ff3b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b5140 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009900 tx=0x7ffbd4004200 comp rx=0 tx=0).stop 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 -- 172.21.15.100:0/270695318 shutdown_connections 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3b5680 0x5612ff3b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b5140 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/270695318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aa4a0 0x5612ff3aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 -- 172.21.15.100:0/270695318 >> 172.21.15.100:0/270695318 conn(0x5612ff3a6a30 msgr2=0x5612ff3a6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 -- 172.21.15.100:0/270695318 shutdown_connections 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.419+0000 7ffbedfa1740 1 -- 172.21.15.100:0/270695318 wait complete. 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 -- start start 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 Processor -- start 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aadc0 0x5612ff3b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3b5680 0x5612ff3b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5612ff3b8250 con 0x5612ff3b5680 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5612ff2cb050 con 0x5612ff3aadc0 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5612ff3b83d0 con 0x5612ff3aa4a0 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbedfa1740 10 client.0 _ll_register_callbacks cb 0x5612ff30b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbe9163640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3b5680 0x5612ff3b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbe9163640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3b5680 0x5612ff3b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33464/0 (socket says 172.21.15.100:33464) 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbe9163640 1 -- 172.21.15.100:0/3141481538 learned_addr learned my addr 172.21.15.100:0/3141481538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.420+0000 7ffbe9163640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9163640 1 -- 172.21.15.100:0/3141481538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 msgr2=0x5612ff3b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9163640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9163640 1 -- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aadc0 msgr2=0x5612ff3b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9964640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aadc0 0x5612ff3b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9163640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aadc0 0x5612ff3b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9163640 1 -- 172.21.15.100:0/3141481538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612ff0813c0 con 0x5612ff3b5680 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9964640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aadc0 0x5612ff3b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbe9163640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3b5680 0x5612ff3b2760 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0019ea0 tx=0x7ffbe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88a96fc4356ab91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/3141481538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe000f040 con 0x5612ff3b5680 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/3141481538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffbe00173e0 con 0x5612ff3b5680 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbd4040070 con 0x5612ff3b5680 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/3141481538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffbe0014e80 con 0x5612ff3b5680 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbedfa1740 10 client.17772 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5612ff3c3c20 con 0x5612ff3b5680 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/3141481538 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbd4040070 con 0x5612ff3b5680 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/3141481538 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ffbe0015040 con 0x5612ff3b5680 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbedfa1740 10 client.17772 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.421+0000 7ffbedfa1740 10 client.17772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.422+0000 7ffbedfa1740 20 client.17772 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.422+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff3c50e0 0x5612ff3c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.422+0000 7ffbedfa1740 4 client.17772 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:15.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.422+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612ff31d850 con 0x5612ff3c50e0 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.422+0000 7ffbe9964640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff3c50e0 0x5612ff3c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.422+0000 7ffbcd7fa640 10 client.17772 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.422+0000 7ffbe9964640 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff3c50e0 0x5612ff3c7560 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=107e2492512ddc6b server_cookie=92ffff82fdc24732 in_seq=0 out_seq=0 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/3141481538 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612ff31d850 con 0x5612ff3c50e0 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbcd7fa640 10 client.17772 handle_command_reply: tid=0 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 client.17772 shutdown 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3b5680 msgr2=0x5612ff3b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3b5680 0x5612ff3b2760 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0019ea0 tx=0x7ffbe0008040 comp rx=0 tx=0).stop 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 shutdown_connections 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff3c50e0 0x5612ff3c7560 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3b5680 0x5612ff3b2760 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3aadc0 0x5612ff3b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/3141481538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbcd7fa640 0 client.17772 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:15.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 >> 172.21.15.100:0/3141481538 conn(0x5612ff3a6a30 msgr2=0x5612ff3a5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:15.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 shutdown_connections 2024-09-12T02:52:15.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 1 -- 172.21.15.100:0/3141481538 wait complete. 2024-09-12T02:52:15.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.423+0000 7ffbedfa1740 20 client.17772 trim_cache size 0 max 16384 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 Processor -- start 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 -- start start 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aa4a0 0x5612ff3c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aadc0 0x5612ff3cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 0x5612ff3cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41b0020 con 0x5612ff3aa4a0 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41ad8f0 con 0x5612ff3b5680 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.440+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41ab740 con 0x5612ff3aadc0 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aa4a0 0x5612ff3c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aa4a0 0x5612ff3c14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33474/0 (socket says 172.21.15.100:33474) 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 -- 172.21.15.100:0/1781675815 learned_addr learned my addr 172.21.15.100:0/1781675815 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 -- 172.21.15.100:0/1781675815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aadc0 msgr2=0x5612ff3cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 --2- 172.21.15.100:0/1781675815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aadc0 0x5612ff3cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 -- 172.21.15.100:0/1781675815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 msgr2=0x5612ff3cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 --2- 172.21.15.100:0/1781675815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 0x5612ff3cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 -- 172.21.15.100:0/1781675815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ff3c7be0 con 0x5612ff3aa4a0 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbe9163640 1 --2- 172.21.15.100:0/1781675815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aa4a0 0x5612ff3c14b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0001eb0 tx=0x7ffbe0019ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a254bec6ca216c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbcf7fe640 1 -- 172.21.15.100:0/1781675815 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0006ba0 con 0x5612ff3aa4a0 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbcf7fe640 1 -- 172.21.15.100:0/1781675815 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbe001f070 con 0x5612ff3aa4a0 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.441+0000 7ffbcf7fe640 1 -- 172.21.15.100:0/1781675815 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0017d40 con 0x5612ff3aa4a0 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 -- 172.21.15.100:0/1781675815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aa4a0 msgr2=0x5612ff3c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/1781675815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aa4a0 0x5612ff3c14b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0001eb0 tx=0x7ffbe0019ac0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 -- 172.21.15.100:0/1781675815 shutdown_connections 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/1781675815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 0x5612ff3cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/1781675815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aadc0 0x5612ff3cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/1781675815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aa4a0 0x5612ff3c14b0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 -- 172.21.15.100:0/1781675815 >> 172.21.15.100:0/1781675815 conn(0x5612ff3a6a30 msgr2=0x5612ff3b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 -- 172.21.15.100:0/1781675815 shutdown_connections 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 -- 172.21.15.100:0/1781675815 wait complete. 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 -- start start 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.442+0000 7ffbedfa1740 1 Processor -- start 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbedfa1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 0x5612ff3b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41abdb0 con 0x5612ff3aadc0 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41ad220 con 0x5612ff3b5680 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbedfa1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41ac480 con 0x5612ff3aa4a0 2024-09-12T02:52:15.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbedfa1740 10 client.0 _ll_register_callbacks cb 0x7ffbe000c550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33480/0 (socket says 172.21.15.100:33480) 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 -- 172.21.15.100:0/4189603500 learned_addr learned my addr 172.21.15.100:0/4189603500 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9163640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9163640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 0x5612ff3b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 -- 172.21.15.100:0/4189603500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 msgr2=0x5612ff3b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 -- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 msgr2=0x5612ff3b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 0x5612ff3b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 -- 172.21.15.100:0/4189603500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612ff42ee00 con 0x5612ff3aadc0 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9163640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:15.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbe9964640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b9860 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4000c00 tx=0x7ffbd4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c03aee15bb2268 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.443+0000 7ffbcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/4189603500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4035040 con 0x5612ff3aadc0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/4189603500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ffbd4031c00 con 0x5612ff3aadc0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe001f070 con 0x5612ff3aadc0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/4189603500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffbd4031e00 con 0x5612ff3aadc0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 10 client.17778 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5612ff430120 con 0x5612ff3aadc0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/4189603500 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbe001f070 con 0x5612ff3aadc0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/4189603500 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ffbd405a030 con 0x5612ff3aadc0 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 10 client.17778 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 10 client.17778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 20 client.17778 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:15.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff430460 0x5612ff432850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 4 client.17778 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.444+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5612ff3b2af0 con 0x5612ff430460 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbe9163640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff430460 0x5612ff432850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbe9163640 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff430460 0x5612ff432850 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8aa36d55b46995c server_cookie=16b8804b7afc1148 in_seq=0 out_seq=0 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbcd7fa640 10 client.17778 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbcd7fa640 1 -- 172.21.15.100:0/4189603500 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5612ff3b2af0 con 0x5612ff430460 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbcd7fa640 10 client.17778 handle_command_reply: tid=0 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 client.17778 shutdown 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 msgr2=0x5612ff3b9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b9860 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4000c00 tx=0x7ffbd4005fd0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 shutdown_connections 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5612ff430460 0x5612ff432850 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612ff3b5680 0x5612ff3b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612ff3aadc0 0x5612ff3b9860 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 --2- 172.21.15.100:0/4189603500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5612ff3aa4a0 0x5612ff3b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbcd7fa640 0 client.17778 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 >> 172.21.15.100:0/4189603500 conn(0x5612ff3a6a30 msgr2=0x5612ff3abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 shutdown_connections 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.445+0000 7ffbedfa1740 1 -- 172.21.15.100:0/4189603500 wait complete. 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbedfa1740 20 client.17778 trim_cache size 0 max 16384 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "503c107d-8d8f-4c56-8331-18264cab116e": { 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "503c107d-8d8f-4c56-8331-18264cab116e", 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:15.455 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:15.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffbd00a2c00 msgr2=0x7ffbd00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffbd00a2c00 0x7ffbd00a50c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc09ae10 tx=0x7ffbdc00e040 comp rx=0 tx=0).stop 2024-09-12T02:52:15.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4102ef0 msgr2=0x7ffbe419cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4102ef0 0x7ffbe419cf70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00b970 tx=0x7ffbdc00be30 comp rx=0 tx=0).stop 2024-09-12T02:52:15.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 shutdown_connections 2024-09-12T02:52:15.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7ffbd00a2c00 0x7ffbd00a50c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbe4102ef0 0x7ffbe419cf70 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbe4102570 0x7ffbe4198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 --2- 172.21.15.100:0/3703589613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbe4100e20 0x7ffbe41986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 >> 172.21.15.100:0/3703589613 conn(0x7ffbe40fc7d0 msgr2=0x7ffbe406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:15.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 shutdown_connections 2024-09-12T02:52:15.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:15.446+0000 7ffbebbc8640 1 -- 172.21.15.100:0/3703589613 wait complete. 2024-09-12T02:52:16.157 INFO:tasks.cephfs.filesystem:scrub status for tag:503c107d-8d8f-4c56-8331-18264cab116e - {'path': '/', 'tag': '503c107d-8d8f-4c56-8331-18264cab116e', 'options': 'recursive,force'} 2024-09-12T02:52:16.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:17.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:16 smithi100 ceph-mon[31390]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.3 MiB/s wr, 341 op/s 2024-09-12T02:52:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:16 smithi189 ceph-mon[35196]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.3 MiB/s wr, 341 op/s 2024-09-12T02:52:17.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:16 smithi117 ceph-mon[34898]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.3 MiB/s wr, 341 op/s 2024-09-12T02:52:19.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:18 smithi100 ceph-mon[31390]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 221 op/s 2024-09-12T02:52:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:18 smithi189 ceph-mon[35196]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 221 op/s 2024-09-12T02:52:19.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:18 smithi117 ceph-mon[34898]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 221 op/s 2024-09-12T02:52:20.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:19 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:52:20.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:19 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:52:20.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:19 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:52:21.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:20 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:52:21.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:20 smithi100 ceph-mon[31390]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.7 MiB/s wr, 142 op/s 2024-09-12T02:52:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:20 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:52:21.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:20 smithi189 ceph-mon[35196]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.7 MiB/s wr, 142 op/s 2024-09-12T02:52:21.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:21.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:20 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:52:21.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:20 smithi117 ceph-mon[34898]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.7 MiB/s wr, 142 op/s 2024-09-12T02:52:23.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:22 smithi100 ceph-mon[31390]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.5 MiB/s wr, 196 op/s 2024-09-12T02:52:23.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:22 smithi189 ceph-mon[35196]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.5 MiB/s wr, 196 op/s 2024-09-12T02:52:23.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:22 smithi117 ceph-mon[34898]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.5 MiB/s wr, 196 op/s 2024-09-12T02:52:25.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:24 smithi100 ceph-mon[31390]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 205 op/s 2024-09-12T02:52:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:24 smithi189 ceph-mon[35196]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 205 op/s 2024-09-12T02:52:25.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:24 smithi117 ceph-mon[34898]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 205 op/s 2024-09-12T02:52:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:27.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:26 smithi189 ceph-mon[35196]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.6 MiB/s wr, 329 op/s 2024-09-12T02:52:27.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:26 smithi117 ceph-mon[34898]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.6 MiB/s wr, 329 op/s 2024-09-12T02:52:27.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:26 smithi100 ceph-mon[31390]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.6 MiB/s wr, 329 op/s 2024-09-12T02:52:29.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:28 smithi189 ceph-mon[35196]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 300 op/s 2024-09-12T02:52:29.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:28 smithi117 ceph-mon[34898]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 300 op/s 2024-09-12T02:52:29.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:28 smithi100 ceph-mon[31390]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 300 op/s 2024-09-12T02:52:30.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:52:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:31.209 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:30 smithi100 ceph-mon[31390]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 297 op/s 2024-09-12T02:52:31.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:30 smithi189 ceph-mon[35196]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 297 op/s 2024-09-12T02:52:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.289+0000 7fcb211f8640 1 -- 172.21.15.100:0/242582591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 msgr2=0x7fcb1c101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.289+0000 7fcb211f8640 1 --2- 172.21.15.100:0/242582591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c101850 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009900 tx=0x7fcb0c02a410 comp rx=0 tx=0).stop 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 -- 172.21.15.100:0/242582591 shutdown_connections 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 --2- 172.21.15.100:0/242582591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c105de0 0x7fcb1c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 --2- 172.21.15.100:0/242582591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1c101e20 0x7fcb1c1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 --2- 172.21.15.100:0/242582591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c101850 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 -- 172.21.15.100:0/242582591 >> 172.21.15.100:0/242582591 conn(0x7fcb1c077230 msgr2=0x7fcb1c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 -- 172.21.15.100:0/242582591 shutdown_connections 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 -- 172.21.15.100:0/242582591 wait complete. 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.290+0000 7fcb211f8640 1 Processor -- start 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb211f8640 1 -- start start 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb211f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb211f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c101e20 0x7fcb1c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb211f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1c105de0 0x7fcb1c1a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb211f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c110e40 con 0x7fcb1c101470 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb211f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c110cc0 con 0x7fcb1c105de0 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb211f8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c110fc0 con 0x7fcb1c101e20 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51018/0 (socket says 172.21.15.100:51018) 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 -- 172.21.15.100:0/2738917287 learned_addr learned my addr 172.21.15.100:0/2738917287 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1b59e640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1c105de0 0x7fcb1c1a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1a59c640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c101e20 0x7fcb1c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 -- 172.21.15.100:0/2738917287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c101e20 msgr2=0x7fcb1c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c101e20 0x7fcb1c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 -- 172.21.15.100:0/2738917287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1c105de0 msgr2=0x7fcb1c1a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1c105de0 0x7fcb1c1a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 -- 172.21.15.100:0/2738917287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c1a4810 con 0x7fcb1c101470 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb1ad9d640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c199250 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006010 tx=0x7fcb0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.291+0000 7fcb03fff640 1 -- 172.21.15.100:0/2738917287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c03f030 con 0x7fcb1c101470 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.292+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c1a49e0 con 0x7fcb1c101470 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.292+0000 7fcb03fff640 1 -- 172.21.15.100:0/2738917287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb0c003ce0 con 0x7fcb1c101470 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.292+0000 7fcb03fff640 1 -- 172.21.15.100:0/2738917287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c035070 con 0x7fcb1c101470 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.292+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c1a4e90 con 0x7fcb1c101470 2024-09-12T02:52:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.293+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c101850 con 0x7fcb1c101470 2024-09-12T02:52:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.294+0000 7fcb03fff640 1 -- 172.21.15.100:0/2738917287 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fcb0c042030 con 0x7fcb1c101470 2024-09-12T02:52:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.294+0000 7fcb03fff640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb040a2b80 0x7fcb040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.294+0000 7fcb1a59c640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb040a2b80 0x7fcb040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.294+0000 7fcb03fff640 1 -- 172.21.15.100:0/2738917287 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcb0c0ef710 con 0x7fcb1c101470 2024-09-12T02:52:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.295+0000 7fcb1a59c640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb040a2b80 0x7fcb040a5040 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c100c50 tx=0x7fcb1000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.299+0000 7fcb03fff640 1 -- 172.21.15.100:0/2738917287 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb0c0bc720 con 0x7fcb1c101470 2024-09-12T02:52:31.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:30 smithi117 ceph-mon[34898]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 297 op/s 2024-09-12T02:52:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.498+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb1c108fc0 con 0x7fcb1c101470 2024-09-12T02:52:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.498+0000 7fcb03fff640 1 -- 172.21.15.100:0/2738917287 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fcb0c0bc020 con 0x7fcb1c101470 2024-09-12T02:52:31.500 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:52:31.500 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:52:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:52:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.500+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb040a2b80 msgr2=0x7fcb040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.500+0000 7fcb211f8640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb040a2b80 0x7fcb040a5040 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c100c50 tx=0x7fcb1000a4c0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.500+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 msgr2=0x7fcb1c199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.500+0000 7fcb211f8640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c199250 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006010 tx=0x7fcb0c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 shutdown_connections 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fcb040a2b80 0x7fcb040a5040 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1c105de0 0x7fcb1c1a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c101e20 0x7fcb1c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 --2- 172.21.15.100:0/2738917287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb1c101470 0x7fcb1c199250 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 >> 172.21.15.100:0/2738917287 conn(0x7fcb1c077230 msgr2=0x7fcb1c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 shutdown_connections 2024-09-12T02:52:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:31.501+0000 7fcb211f8640 1 -- 172.21.15.100:0/2738917287 wait complete. 2024-09-12T02:52:32.215 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:31 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2738917287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:32.245 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 825183f6 --release --await' 2024-09-12T02:52:32.245 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 825183f6 --release --await 2024-09-12T02:52:32.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:31 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2738917287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:32.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:31 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2738917287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:32.491 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 -- 172.21.15.100:0/293014206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 msgr2=0x7f248c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 --2- 172.21.15.100:0/293014206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c100ee0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2474009930 tx=0x7f247402a420 comp rx=0 tx=0).stop 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 -- 172.21.15.100:0/293014206 shutdown_connections 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 --2- 172.21.15.100:0/293014206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f248c101420 0x7f248c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 --2- 172.21.15.100:0/293014206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c100ee0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 --2- 172.21.15.100:0/293014206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f248c106a80 0x7f248c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 -- 172.21.15.100:0/293014206 >> 172.21.15.100:0/293014206 conn(0x7f248c0fc7a0 msgr2=0x7f248c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 -- 172.21.15.100:0/293014206 shutdown_connections 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.007+0000 7f249124b640 1 -- 172.21.15.100:0/293014206 wait complete. 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 Processor -- start 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 -- start start 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f248c101420 0x7f248c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f248c106a80 0x7f248c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f248c110e40 con 0x7f248c100a80 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f248c110cc0 con 0x7f248c106a80 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f249124b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f248c110fc0 con 0x7f248c101420 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51042/0 (socket says 172.21.15.100:51042) 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 -- 172.21.15.100:0/1276461996 learned_addr learned my addr 172.21.15.100:0/1276461996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248b59e640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f248c106a80 0x7f248c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f2483fff640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f248c101420 0x7f248c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 -- 172.21.15.100:0/1276461996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f248c101420 msgr2=0x7f248c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f248c101420 0x7f248c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 -- 172.21.15.100:0/1276461996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f248c106a80 msgr2=0x7f248c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f248c106a80 0x7f248c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 -- 172.21.15.100:0/1276461996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c19d420 con 0x7f248c100a80 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.008+0000 7f248ad9d640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c198470 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d950 tx=0x7f247c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.009+0000 7f2488d99640 1 -- 172.21.15.100:0/1276461996 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c017030 con 0x7f248c100a80 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.009+0000 7f2488d99640 1 -- 172.21.15.100:0/1276461996 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f247c004020 con 0x7f248c100a80 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.009+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c19d710 con 0x7f248c100a80 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.009+0000 7f2488d99640 1 -- 172.21.15.100:0/1276461996 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c0047a0 con 0x7f248c100a80 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.009+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c1a4ff0 con 0x7f248c100a80 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2488d99640 1 -- 172.21.15.100:0/1276461996 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f247c0041d0 con 0x7f248c100a80 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 Processor -- start 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 -- start start 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x563161717850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717d90 0x563161722110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161722650 0x563161724a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563161678620 con 0x563161717d90 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56316161fe50 con 0x563161722650 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.011+0000 7f2493624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631616745e0 con 0x563161717470 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717d90 0x563161722110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2483fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161722650 0x563161724a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717d90 0x563161722110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51056/0 (socket says 172.21.15.100:51056) 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f248ad9d640 1 -- 172.21.15.100:0/3770808746 learned_addr learned my addr 172.21.15.100:0/3770808746 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f248b59e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x563161717850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2488d99640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f24780a2b80 0x7f24780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2483fff640 1 -- 172.21.15.100:0/3770808746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 msgr2=0x563161717850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2483fff640 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x563161717850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2483fff640 1 -- 172.21.15.100:0/3770808746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717d90 msgr2=0x563161722110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2483fff640 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717d90 0x563161722110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2488d99640 1 -- 172.21.15.100:0/1276461996 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f247c0cea60 con 0x7f248c100a80 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2483fff640 1 -- 172.21.15.100:0/3770808746 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563161610d40 con 0x563161722650 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f248ad9d640 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717d90 0x563161722110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f248b59e640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f24780a2b80 0x7f24780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f2483fff640 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161722650 0x563161724a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2474009230 tx=0x7f2474005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70a85a0fb6c1b2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f248b59e640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f24780a2b80 0x7f24780a5040 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2484008ea0 tx=0x7f2484004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.012+0000 7f24817fa640 1 -- 172.21.15.100:0/3770808746 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247403f030 con 0x563161722650 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f24817fa640 1 -- 172.21.15.100:0/3770808746 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474032db0 con 0x563161722650 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f24817fa640 1 -- 172.21.15.100:0/3770808746 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474035070 con 0x563161722650 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 -- 172.21.15.100:0/3770808746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161722650 msgr2=0x563161724a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161722650 0x563161724a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2474009230 tx=0x7f2474005e80 comp rx=0 tx=0).stop 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 -- 172.21.15.100:0/3770808746 shutdown_connections 2024-09-12T02:52:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161722650 0x563161724a40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717d90 0x563161722110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 --2- 172.21.15.100:0/3770808746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x563161717850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 -- 172.21.15.100:0/3770808746 >> 172.21.15.100:0/3770808746 conn(0x563161713a00 msgr2=0x563161713de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 -- 172.21.15.100:0/3770808746 shutdown_connections 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.013+0000 7f2493624740 1 -- 172.21.15.100:0/3770808746 wait complete. 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 -- start start 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 Processor -- start 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x56316171f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x56316171fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x56316171ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563161725220 con 0x563161722650 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563161600f10 con 0x563161717d90 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631617253a0 con 0x563161717470 2024-09-12T02:52:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2493624740 10 client.0 _ll_register_callbacks cb 0x563161624db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x56316171ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x56316171ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51066/0 (socket says 172.21.15.100:51066) 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x56316171f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 -- 172.21.15.100:0/183865911 learned_addr learned my addr 172.21.15.100:0/183865911 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f2483fff640 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x56316171fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 -- 172.21.15.100:0/183865911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 msgr2=0x56316171f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x56316171f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 -- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 msgr2=0x56316171fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x56316171fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.014+0000 7f248b59e640 1 -- 172.21.15.100:0/183865911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563161387580 con 0x563161722650 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f248b59e640 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x56316171ff70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2484012e80 tx=0x7f2484004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b482918afe3b7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f24727fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f24727fc640 1 -- 172.21.15.100:0/183865911 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484027670 con 0x563161722650 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f24727fc640 1 -- 172.21.15.100:0/183865911 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2484027810 con 0x563161722650 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2474032db0 con 0x563161722650 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f24727fc640 1 -- 172.21.15.100:0/183865911 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2484027a10 con 0x563161722650 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 10 client.17796 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563161451960 con 0x563161722650 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f24727fc640 1 -- 172.21.15.100:0/183865911 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474032db0 con 0x563161722650 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f24727fc640 1 -- 172.21.15.100:0/183865911 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f248401b540 con 0x563161722650 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 10 client.17796 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 10 client.17796 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 20 client.17796 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631617321d0 0x5631617345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 4 client.17796 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563161685b90 con 0x5631617321d0 2024-09-12T02:52:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.015+0000 7f248ad9d640 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631617321d0 0x5631617345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.016+0000 7f24727fc640 10 client.17796 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.016+0000 7f248ad9d640 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631617321d0 0x5631617345e0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28f52626c96367f0 server_cookie=780e51f10813c60e in_seq=0 out_seq=0 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.016+0000 7f24727fc640 1 -- 172.21.15.100:0/183865911 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563161685b90 con 0x5631617321d0 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.016+0000 7f24727fc640 10 client.17796 handle_command_reply: tid=0 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.016+0000 7f2493624740 1 client.17796 shutdown 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.016+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 msgr2=0x56316171ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.016+0000 7f2493624740 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x56316171ff70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2484012e80 tx=0x7f2484004ab0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 shutdown_connections 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5631617321d0 0x5631617345e0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x56316171ff70 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x56316171fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 --2- 172.21.15.100:0/183865911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x56316171f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 >> 172.21.15.100:0/183865911 conn(0x563161713a00 msgr2=0x563161719730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f24727fc640 0 client.17796 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 shutdown_connections 2024-09-12T02:52:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 1 -- 172.21.15.100:0/183865911 wait complete. 2024-09-12T02:52:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.017+0000 7f2493624740 20 client.17796 trim_cache size 0 max 16384 2024-09-12T02:52:33.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.033+0000 7f2493624740 1 Processor -- start 2024-09-12T02:52:33.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2493624740 1 -- start start 2024-09-12T02:52:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2493624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717470 0x563161721460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2493624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161739eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2493624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161722650 0x56316173a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2493624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1adcf0 con 0x563161717470 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2493624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1ab5c0 con 0x563161717d90 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2493624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1a9410 con 0x563161722650 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717470 0x563161721460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717470 0x563161721460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51070/0 (socket says 172.21.15.100:51070) 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 -- 172.21.15.100:0/2360018220 learned_addr learned my addr 172.21.15.100:0/2360018220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f2483fff640 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161739eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248b59e640 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161722650 0x56316173a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 -- 172.21.15.100:0/2360018220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161722650 msgr2=0x56316173a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161722650 0x56316173a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 -- 172.21.15.100:0/2360018220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 msgr2=0x563161739eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161739eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.034+0000 7f248ad9d640 1 -- 172.21.15.100:0/2360018220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316171e4a0 con 0x563161717470 2024-09-12T02:52:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.035+0000 7f248ad9d640 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717470 0x563161721460 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f247c009fd0 tx=0x7f247c0cc420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6b7cd0a3f26ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.035+0000 7f2480ff9640 1 -- 172.21.15.100:0/2360018220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c09adf0 con 0x563161717470 2024-09-12T02:52:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.035+0000 7f2480ff9640 1 -- 172.21.15.100:0/2360018220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f247c09b9b0 con 0x563161717470 2024-09-12T02:52:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.035+0000 7f2480ff9640 1 -- 172.21.15.100:0/2360018220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c09ac10 con 0x563161717470 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.035+0000 7f2493624740 1 -- 172.21.15.100:0/2360018220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717470 msgr2=0x563161721460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.035+0000 7f2493624740 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717470 0x563161721460 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f247c009fd0 tx=0x7f247c0cc420 comp rx=0 tx=0).stop 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- 172.21.15.100:0/2360018220 shutdown_connections 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161722650 0x56316173a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161739eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 --2- 172.21.15.100:0/2360018220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161717470 0x563161721460 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- 172.21.15.100:0/2360018220 >> 172.21.15.100:0/2360018220 conn(0x563161713a00 msgr2=0x563161720d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- 172.21.15.100:0/2360018220 shutdown_connections 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- 172.21.15.100:0/2360018220 wait complete. 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- start start 2024-09-12T02:52:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 Processor -- start 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x5631617263d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161726910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x563161726e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1a9a80 con 0x563161722650 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1aaef0 con 0x563161717d90 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1aa150 con 0x563161717470 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2493624740 10 client.0 _ll_register_callbacks cb 0x7f2484012ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f248b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x563161726e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f248b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x563161726e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51082/0 (socket says 172.21.15.100:51082) 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f2483fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161726910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.036+0000 7f248b59e640 1 -- 172.21.15.100:0/3048489745 learned_addr learned my addr 172.21.15.100:0/3048489745 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f248ad9d640 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x5631617263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f248b59e640 1 -- 172.21.15.100:0/3048489745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 msgr2=0x5631617263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f248b59e640 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x5631617263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f248b59e640 1 -- 172.21.15.100:0/3048489745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 msgr2=0x563161726910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f248b59e640 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161726910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f248b59e640 1 -- 172.21.15.100:0/3048489745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631617145b0 con 0x563161722650 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f248b59e640 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x563161726e50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f248401b960 tx=0x7f2484027ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786dc92c7dafb023 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f24727fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f24727fc640 1 -- 172.21.15.100:0/3048489745 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248401dc40 con 0x563161722650 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f24727fc640 1 -- 172.21.15.100:0/3048489745 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2484027470 con 0x563161722650 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f247c09b9b0 con 0x563161722650 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f24727fc640 1 -- 172.21.15.100:0/3048489745 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2484008c20 con 0x563161722650 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f2493624740 10 client.17802 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.037+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56316179d050 con 0x563161722650 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f24727fc640 1 -- 172.21.15.100:0/3048489745 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f247c09b9b0 con 0x563161722650 2024-09-12T02:52:33.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f24727fc640 1 -- 172.21.15.100:0/3048489745 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2484042050 con 0x563161722650 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f2493624740 10 client.17802 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f2493624740 10 client.17802 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f2493624740 20 client.17802 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f2493624740 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56316179d6b0 0x56316179fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f2493624740 4 client.17802 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "825183f6", "release": true, "await": true}] 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "825183f6", "release": true, "await": true}) -- 0x5631616800a0 con 0x56316179d6b0 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f248ad9d640 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56316179d6b0 0x56316179fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f24727fc640 10 client.17802 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.038+0000 7f248ad9d640 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56316179d6b0 0x56316179fad0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81038db81c8e6f11 server_cookie=62fa9573d6eafba8 in_seq=0 out_seq=0 2024-09-12T02:52:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f24727fc640 1 -- 172.21.15.100:0/3048489745 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5631616800a0 con 0x56316179d6b0 2024-09-12T02:52:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f24727fc640 10 client.17802 handle_command_reply: tid=0 2024-09-12T02:52:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 client.17802 shutdown 2024-09-12T02:52:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 msgr2=0x563161726e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x563161726e50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f248401b960 tx=0x7f2484027ee0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 shutdown_connections 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56316179d6b0 0x56316179fad0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563161722650 0x563161726e50 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f24727fc640 0 client.17802 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563161717d90 0x563161726910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 --2- 172.21.15.100:0/3048489745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563161717470 0x5631617263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 >> 172.21.15.100:0/3048489745 conn(0x563161713a00 msgr2=0x56316171fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 shutdown_connections 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.096+0000 7f2493624740 1 -- 172.21.15.100:0/3048489745 wait complete. 2024-09-12T02:52:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f2493624740 20 client.17802 trim_cache size 0 max 16384 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 52, 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout: "825183f6": { 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 52, 2024-09-12T02:52:33.100 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 150.0, 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:33.101 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:33.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:33.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:33.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:33.102 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f24780a2b80 msgr2=0x7f24780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f249124b640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f24780a2b80 0x7f24780a5040 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2484008ea0 tx=0x7f2484004a40 comp rx=0 tx=0).stop 2024-09-12T02:52:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 msgr2=0x7f248c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f249124b640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c198470 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d950 tx=0x7f247c00de10 comp rx=0 tx=0).stop 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 shutdown_connections 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f249124b640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f24780a2b80 0x7f24780a5040 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.097+0000 7f249124b640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f248c106a80 0x7f248c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.098+0000 7f249124b640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f248c101420 0x7f248c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.098+0000 7f249124b640 1 --2- 172.21.15.100:0/1276461996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f248c100a80 0x7f248c198470 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.098+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 >> 172.21.15.100:0/1276461996 conn(0x7f248c0fc7a0 msgr2=0x7f248c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.098+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 shutdown_connections 2024-09-12T02:52:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:33.098+0000 7f249124b640 1 -- 172.21.15.100:0/1276461996 wait complete. 2024-09-12T02:52:33.167 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:32 smithi100 ceph-mon[31390]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 297 op/s 2024-09-12T02:52:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:32 smithi189 ceph-mon[35196]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 297 op/s 2024-09-12T02:52:33.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:32 smithi117 ceph-mon[34898]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 297 op/s 2024-09-12T02:52:34.054 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '825183f6', total seconds elapsed: 33.5 2024-09-12T02:52:34.054 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-12T02:52:34.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:52:34.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:33 smithi189 ceph-mon[35196]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.4 MiB/s wr, 204 op/s 2024-09-12T02:52:34.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:33 smithi117 ceph-mon[34898]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.4 MiB/s wr, 204 op/s 2024-09-12T02:52:34.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:33 smithi100 ceph-mon[31390]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.4 MiB/s wr, 204 op/s 2024-09-12T02:52:34.408 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 -- 172.21.15.100:0/1250919972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 msgr2=0x7f78981150b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 --2- 172.21.15.100:0/1250919972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 0x7f78981150b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f7890009900 tx=0x7f789002a410 comp rx=0 tx=0).stop 2024-09-12T02:52:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 -- 172.21.15.100:0/1250919972 shutdown_connections 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 --2- 172.21.15.100:0/1250919972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 0x7f78981150b0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 --2- 172.21.15.100:0/1250919972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7898108e00 0x7f789810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 --2- 172.21.15.100:0/1250919972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7898108450 0x7f7898108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 -- 172.21.15.100:0/1250919972 >> 172.21.15.100:0/1250919972 conn(0x7f7898077ba0 msgr2=0x7f7898079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 -- 172.21.15.100:0/1250919972 shutdown_connections 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.921+0000 7f789d056640 1 -- 172.21.15.100:0/1250919972 wait complete. 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.922+0000 7f789d056640 1 Processor -- start 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.923+0000 7f789d056640 1 -- start start 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f789d056640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7898108450 0x7f78981a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f789d056640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7898108e00 0x7f78981a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f789d056640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 0x7f789819e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f789d056640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7898118540 con 0x7f789810d530 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f789d056640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78981183c0 con 0x7f7898108450 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f789d056640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78981186c0 con 0x7f7898108e00 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f7896d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7898108450 0x7f78981a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f7896d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7898108450 0x7f78981a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54080/0 (socket says 172.21.15.100:54080) 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f7896d9d640 1 -- 172.21.15.100:0/4234947926 learned_addr learned my addr 172.21.15.100:0/4234947926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f788ffff640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7898108e00 0x7f78981a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.924+0000 7f789759e640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 0x7f789819e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f788ffff640 1 -- 172.21.15.100:0/4234947926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7898108450 msgr2=0x7f78981a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f788ffff640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7898108450 0x7f78981a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f788ffff640 1 -- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 msgr2=0x7f789819e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f788ffff640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 0x7f789819e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f788ffff640 1 -- 172.21.15.100:0/4234947926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789819efe0 con 0x7f7898108e00 2024-09-12T02:52:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f788ffff640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7898108e00 0x7f78981a4be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7880005fd0 tx=0x7f788000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f7894d99640 1 -- 172.21.15.100:0/4234947926 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880009c30 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789819f2d0 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78981ab620 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f7894d99640 1 -- 172.21.15.100:0/4234947926 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7880009dd0 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.925+0000 7f7894d99640 1 -- 172.21.15.100:0/4234947926 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880020060 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.927+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78981098e0 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.928+0000 7f7894d99640 1 -- 172.21.15.100:0/4234947926 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7880003e50 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.928+0000 7f7894d99640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f78840a2b80 0x7f78840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.929+0000 7f7896d9d640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f78840a2b80 0x7f78840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.929+0000 7f7894d99640 1 -- 172.21.15.100:0/4234947926 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f78800ce7d0 con 0x7f7898108e00 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.929+0000 7f7896d9d640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f78840a2b80 0x7f78840a5040 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7888007f80 tx=0x7f7888007670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:34.935+0000 7f7894d99640 1 -- 172.21.15.100:0/4234947926 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7880017020 con 0x7f7898108e00 2024-09-12T02:52:35.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.253+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f789819fca0 con 0x7f7898108e00 2024-09-12T02:52:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.254+0000 7f7894d99640 1 -- 172.21.15.100:0/4234947926 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f788009b0d0 con 0x7f7898108e00 2024-09-12T02:52:35.255 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:52:35.256 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:52:35.256 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:52:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f78840a2b80 msgr2=0x7f78840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f78840a2b80 0x7f78840a5040 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7888007f80 tx=0x7f7888007670 comp rx=0 tx=0).stop 2024-09-12T02:52:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7898108e00 msgr2=0x7f78981a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7898108e00 0x7f78981a4be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7880005fd0 tx=0x7f788000dde0 comp rx=0 tx=0).stop 2024-09-12T02:52:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 shutdown_connections 2024-09-12T02:52:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f78840a2b80 0x7f78840a5040 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f789810d530 0x7f789819e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:35.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7898108e00 0x7f78981a4be0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:35.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 --2- 172.21.15.100:0/4234947926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7898108450 0x7f78981a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:35.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.257+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 >> 172.21.15.100:0/4234947926 conn(0x7f7898077ba0 msgr2=0x7f78980785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:35.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.258+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 shutdown_connections 2024-09-12T02:52:35.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:35.258+0000 7f789d056640 1 -- 172.21.15.100:0/4234947926 wait complete. 2024-09-12T02:52:35.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:35 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/4234947926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:35.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:35 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/4234947926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:35.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:35 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/4234947926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:36.052 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-12T02:52:36.052 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-12T02:52:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 805.0 s, 1535.0 tps, lat 412.324 ms stddev 3233.898 2024-09-12T02:52:36.411 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:36.593 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:36 smithi117 ceph-mon[34898]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 MiB/s wr, 161 op/s 2024-09-12T02:52:36.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:36 smithi100 ceph-mon[31390]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 MiB/s wr, 161 op/s 2024-09-12T02:52:36.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:36 smithi189 ceph-mon[35196]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 MiB/s wr, 161 op/s 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 -- 172.21.15.100:0/2437271299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14105560 msgr2=0x7f3a1410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/2437271299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14105560 0x7f3a1410d0e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00adb0 tx=0x7f3a0c02b7a0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 -- 172.21.15.100:0/2437271299 shutdown_connections 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/2437271299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14105560 0x7f3a1410d0e0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/2437271299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14100de0 0x7f3a14104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/2437271299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a14100430 0x7f3a14100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 -- 172.21.15.100:0/2437271299 >> 172.21.15.100:0/2437271299 conn(0x7f3a14077230 msgr2=0x7f3a140fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 -- 172.21.15.100:0/2437271299 shutdown_connections 2024-09-12T02:52:37.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.004+0000 7f3a18d7d640 1 -- 172.21.15.100:0/2437271299 wait complete. 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.005+0000 7f3a18d7d640 1 Processor -- start 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.005+0000 7f3a18d7d640 1 -- start start 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.005+0000 7f3a18d7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14100430 0x7f3a141983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.005+0000 7f3a18d7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a14100de0 0x7f3a14198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.005+0000 7f3a18d7d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14105560 0x7f3a1419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a18d7d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410fd90 con 0x7f3a14100430 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a18d7d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410fc10 con 0x7f3a14105560 2024-09-12T02:52:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a18d7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410ff10 con 0x7f3a14100de0 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a12d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14105560 0x7f3a1419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a12d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14105560 0x7f3a1419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54102/0 (socket says 172.21.15.100:54102) 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a12d9d640 1 -- 172.21.15.100:0/761382354 learned_addr learned my addr 172.21.15.100:0/761382354 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a1259c640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14100430 0x7f3a141983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.006+0000 7f3a0bfff640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a14100de0 0x7f3a14198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a12d9d640 1 -- 172.21.15.100:0/761382354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a14100de0 msgr2=0x7f3a14198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a14100de0 0x7f3a14198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a12d9d640 1 -- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14100430 msgr2=0x7f3a141983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14100430 0x7f3a141983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a12d9d640 1 -- 172.21.15.100:0/761382354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1419d3a0 con 0x7f3a14105560 2024-09-12T02:52:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14105560 0x7f3a1419ccc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c005e30 tx=0x7f3a0c003e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a0b7fe640 1 -- 172.21.15.100:0/761382354 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0328b0 con 0x7f3a14105560 2024-09-12T02:52:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a0b7fe640 1 -- 172.21.15.100:0/761382354 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a0c03fc90 con 0x7f3a14105560 2024-09-12T02:52:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a0b7fe640 1 -- 172.21.15.100:0/761382354 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c004040 con 0x7f3a14105560 2024-09-12T02:52:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.007+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1419d630 con 0x7f3a14105560 2024-09-12T02:52:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.008+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1419da00 con 0x7f3a14105560 2024-09-12T02:52:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.011+0000 7f3a0b7fe640 1 -- 172.21.15.100:0/761382354 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3a0c03f7b0 con 0x7f3a14105560 2024-09-12T02:52:37.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.012+0000 7f3a0b7fe640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3a000a2d50 0x7f3a000a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.012+0000 7f3a1b156740 1 Processor -- start 2024-09-12T02:52:37.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.012+0000 7f3a0b7fe640 1 -- 172.21.15.100:0/761382354 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3a0c0f4430 con 0x7f3a14105560 2024-09-12T02:52:37.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1259c640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3a000a2d50 0x7f3a000a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1b156740 1 -- start start 2024-09-12T02:52:37.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 0x55b99383cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993847400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993849d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1b156740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b9937a22a0 con 0x55b99383c760 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1b156740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b993749b10 con 0x55b99383d080 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1b156740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b99379e260 con 0x55b993847940 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993847400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993847400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54118/0 (socket says 172.21.15.100:54118) 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a0bfff640 1 -- 172.21.15.100:0/3261171945 learned_addr learned my addr 172.21.15.100:0/3261171945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1259c640 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 0x55b99383cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993849d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.013+0000 7f3a1259c640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3a000a2d50 0x7f3a000a5210 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a04005fd0 tx=0x7f3a0400f730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a0bfff640 1 -- 172.21.15.100:0/3261171945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 msgr2=0x55b993849d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a0bfff640 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993849d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a0bfff640 1 -- 172.21.15.100:0/3261171945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 msgr2=0x55b99383cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a0bfff640 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 0x55b99383cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a0bfff640 1 -- 172.21.15.100:0/3261171945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b993513b90 con 0x55b99383d080 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a0bfff640 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993847400 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00bc10 tx=0x7f39fc00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed4d895f45b91802 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a08ff9640 1 -- 172.21.15.100:0/3261171945 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc018be0 con 0x55b99383d080 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a08ff9640 1 -- 172.21.15.100:0/3261171945 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39fc018d80 con 0x55b99383d080 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.014+0000 7f3a08ff9640 1 -- 172.21.15.100:0/3261171945 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc01f5e0 con 0x55b99383d080 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 -- 172.21.15.100:0/3261171945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 msgr2=0x55b993847400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993847400 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00bc10 tx=0x7f39fc00f730 comp rx=0 tx=0).stop 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 -- 172.21.15.100:0/3261171945 shutdown_connections 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993849d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993847400 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3261171945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 0x55b99383cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 -- 172.21.15.100:0/3261171945 >> 172.21.15.100:0/3261171945 conn(0x55b993838cf0 msgr2=0x55b9938390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:37.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 -- 172.21.15.100:0/3261171945 shutdown_connections 2024-09-12T02:52:37.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.015+0000 7f3a1b156740 1 -- 172.21.15.100:0/3261171945 wait complete. 2024-09-12T02:52:37.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.016+0000 7f3a1b156740 1 -- start start 2024-09-12T02:52:37.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.016+0000 7f3a1b156740 1 Processor -- start 2024-09-12T02:52:37.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.017+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 0x55b993844800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993844d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993845280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993844d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993844d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54132/0 (socket says 172.21.15.100:54132) 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a0bfff640 1 -- 172.21.15.100:0/2604268226 learned_addr learned my addr 172.21.15.100:0/2604268226 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b99384a510 con 0x55b99383c760 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b99372a6e0 con 0x55b99383d080 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b99384a690 con 0x55b993847940 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a1b156740 10 client.0 _ll_register_callbacks cb 0x55b99374ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.018+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993845280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.019+0000 7f3a12d9d640 1 -- 172.21.15.100:0/2604268226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 msgr2=0x55b993844d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.019+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993844d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.019+0000 7f3a12d9d640 1 -- 172.21.15.100:0/2604268226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 msgr2=0x55b993844800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.019+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 0x55b993844800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.019+0000 7f3a12d9d640 1 -- 172.21.15.100:0/2604268226 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9938539d0 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.019+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993845280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0c0920 tx=0x7f3a0c0c0ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=941fbe708fa30180 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.019+0000 7f39f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f39f9ffb640 1 -- 172.21.15.100:0/2604268226 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c03fe40 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39fc018d80 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f39f9ffb640 1 -- 172.21.15.100:0/2604268226 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3a0c0f1fd0 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f39f9ffb640 1 -- 172.21.15.100:0/2604268226 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a0c00a9d0 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 10 client.26995 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b99384a570 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f39f9ffb640 1 -- 172.21.15.100:0/2604268226 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39fc018d80 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f39f9ffb640 1 -- 172.21.15.100:0/2604268226 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3a0c0bd290 con 0x55b993847940 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 10 client.26995 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:37.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 10 client.26995 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 20 client.26995 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b993857780 0x55b993859bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 4 client.26995 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.020+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9937af9d0 con 0x55b993857780 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.021+0000 7f3a1259c640 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b993857780 0x55b993859bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.021+0000 7f3a1259c640 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b993857780 0x55b993859bb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e651c1d86a444c server_cookie=64f7f10610036d8c in_seq=0 out_seq=0 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.021+0000 7f39f9ffb640 10 client.26995 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f39f9ffb640 1 -- 172.21.15.100:0/2604268226 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9937af9d0 con 0x55b993857780 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f39f9ffb640 10 client.26995 handle_command_reply: tid=0 2024-09-12T02:52:37.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 client.26995 shutdown 2024-09-12T02:52:37.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 msgr2=0x55b993845280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993845280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0c0920 tx=0x7f3a0c0c0ab0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 shutdown_connections 2024-09-12T02:52:37.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b993857780 0x55b993859bb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993845280 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383d080 0x55b993844d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 --2- 172.21.15.100:0/2604268226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383c760 0x55b993844800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.022+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 >> 172.21.15.100:0/2604268226 conn(0x55b993838cf0 msgr2=0x55b993837e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.023+0000 7f39f9ffb640 0 client.26995 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.023+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 shutdown_connections 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.023+0000 7f3a1b156740 1 -- 172.21.15.100:0/2604268226 wait complete. 2024-09-12T02:52:37.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.023+0000 7f3a1b156740 20 client.26995 trim_cache size 0 max 16384 2024-09-12T02:52:37.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 Processor -- start 2024-09-12T02:52:37.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 -- start start 2024-09-12T02:52:37.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383c760 0x55b99385f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99385f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993841a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141adbe0 con 0x55b99383d080 2024-09-12T02:52:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141ab4b0 con 0x55b99383c760 2024-09-12T02:52:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.049+0000 7f3a1b156740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141a9300 con 0x55b993847940 2024-09-12T02:52:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.050+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383c760 0x55b99385f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.050+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99385f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.050+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383c760 0x55b99385f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:54140/0 (socket says 172.21.15.100:54140) 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.050+0000 7f3a1259c640 1 -- 172.21.15.100:0/828652005 learned_addr learned my addr 172.21.15.100:0/828652005 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.051+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993841a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.051+0000 7f3a1259c640 1 -- 172.21.15.100:0/828652005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 msgr2=0x55b993841a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.051+0000 7f3a1259c640 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993841a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.051+0000 7f3a1259c640 1 -- 172.21.15.100:0/828652005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 msgr2=0x55b99385f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.051+0000 7f3a1259c640 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99385f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.051+0000 7f3a1259c640 1 -- 172.21.15.100:0/828652005 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99383c590 con 0x55b99383c760 2024-09-12T02:52:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.051+0000 7f3a1259c640 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383c760 0x55b99385f430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400ffd0 tx=0x7f3a04014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3ca45e03a3d7e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.052+0000 7f39fbfff640 1 -- 172.21.15.100:0/828652005 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a040266b0 con 0x55b99383c760 2024-09-12T02:52:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.052+0000 7f39fbfff640 1 -- 172.21.15.100:0/828652005 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a04012450 con 0x55b99383c760 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.052+0000 7f39fbfff640 1 -- 172.21.15.100:0/828652005 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a040116d0 con 0x55b99383c760 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 -- 172.21.15.100:0/828652005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383c760 msgr2=0x55b99385f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383c760 0x55b99385f430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400ffd0 tx=0x7f3a04014000 comp rx=0 tx=0).stop 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 -- 172.21.15.100:0/828652005 shutdown_connections 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b993847940 0x55b993841a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99385f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 --2- 172.21.15.100:0/828652005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b99383c760 0x55b99385f430 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 -- 172.21.15.100:0/828652005 >> 172.21.15.100:0/828652005 conn(0x55b993838cf0 msgr2=0x55b993846880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 -- 172.21.15.100:0/828652005 shutdown_connections 2024-09-12T02:52:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 -- 172.21.15.100:0/828652005 wait complete. 2024-09-12T02:52:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 -- start start 2024-09-12T02:52:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.053+0000 7f3a1b156740 1 Processor -- start 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b99383c760 0x55b99384fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99384ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1b156740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b993847940 0x55b99384be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1b156740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141a9970 con 0x55b99383d080 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1b156740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141aade0 con 0x55b993847940 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1b156740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141aa040 con 0x55b99383c760 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1b156740 10 client.0 _ll_register_callbacks cb 0x7f3a0c0bcec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99384ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99384ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52316/0 (socket says 172.21.15.100:52316) 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a0bfff640 1 -- 172.21.15.100:0/3060459236 learned_addr learned my addr 172.21.15.100:0/3060459236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b993847940 0x55b99384be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a1259c640 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b99383c760 0x55b99384fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a12d9d640 1 -- 172.21.15.100:0/3060459236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b99383c760 msgr2=0x55b99384fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b99383c760 0x55b99384fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a12d9d640 1 -- 172.21.15.100:0/3060459236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 msgr2=0x55b99384ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99384ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.055+0000 7f3a12d9d640 1 -- 172.21.15.100:0/3060459236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99383f5d0 con 0x55b993847940 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f3a12d9d640 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b993847940 0x55b99384be10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0beed0 tx=0x7f3a0c0c0b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f836b673bf418ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f39f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f39f9ffb640 1 -- 172.21.15.100:0/3060459236 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0c0580 con 0x55b993847940 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f39f9ffb640 1 -- 172.21.15.100:0/3060459236 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3a0c0c9600 con 0x55b993847940 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a04012450 con 0x55b993847940 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f39f9ffb640 1 -- 172.21.15.100:0/3060459236 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a0c03fe40 con 0x55b993847940 2024-09-12T02:52:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f3a1b156740 10 client.27065 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.056+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b993834260 con 0x55b993847940 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f39f9ffb640 1 -- 172.21.15.100:0/3060459236 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a04012450 con 0x55b993847940 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f39f9ffb640 1 -- 172.21.15.100:0/3060459236 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3a0c004b40 con 0x55b993847940 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f3a1b156740 10 client.27065 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f3a1b156740 10 client.27065 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f3a1b156740 20 client.27065 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b9938c3010 0x55b9938c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f3a1b156740 4 client.27065 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.057+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55b9937a9d20 con 0x55b9938c3010 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.058+0000 7f3a1259c640 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b9938c3010 0x55b9938c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.058+0000 7f3a1259c640 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b9938c3010 0x55b9938c5400 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54818f22b9b3a666 server_cookie=357b5dcd16a9be6a in_seq=0 out_seq=0 2024-09-12T02:52:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.058+0000 7f39f9ffb640 10 client.27065 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f39f9ffb640 1 -- 172.21.15.100:0/3060459236 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b9937a9d20 con 0x55b9938c3010 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f39f9ffb640 10 client.27065 handle_command_reply: tid=0 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 client.27065 shutdown 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b993847940 msgr2=0x55b99384be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b993847940 0x55b99384be10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0beed0 tx=0x7f3a0c0c0b20 comp rx=0 tx=0).stop 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 shutdown_connections 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55b9938c3010 0x55b9938c5400 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b993847940 0x55b99384be10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b99383d080 0x55b99384ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 --2- 172.21.15.100:0/3060459236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b99383c760 0x55b99384fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f39f9ffb640 0 client.27065 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 >> 172.21.15.100:0/3060459236 conn(0x55b993838cf0 msgr2=0x55b993837650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 shutdown_connections 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 1 -- 172.21.15.100:0/3060459236 wait complete. 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.364+0000 7f3a1b156740 20 client.27065 trim_cache size 0 max 16384 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 54, 2024-09-12T02:52:37.368 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "ab8b4e95": { 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 54, 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 150.0, 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:52:37.369 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:37.370 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3a000a2d50 msgr2=0x7f3a000a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3a000a2d50 0x7f3a000a5210 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a04005fd0 tx=0x7f3a0400f730 comp rx=0 tx=0).stop 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14105560 msgr2=0x7f3a1419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14105560 0x7f3a1419ccc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c005e30 tx=0x7f3a0c003e20 comp rx=0 tx=0).stop 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 shutdown_connections 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f3a000a2d50 0x7f3a000a5210 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14105560 0x7f3a1419ccc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a14100de0 0x7f3a14198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 --2- 172.21.15.100:0/761382354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a14100430 0x7f3a141983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 >> 172.21.15.100:0/761382354 conn(0x7f3a14077230 msgr2=0x7f3a14103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:37.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 shutdown_connections 2024-09-12T02:52:37.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:37.365+0000 7f3a18d7d640 1 -- 172.21.15.100:0/761382354 wait complete. 2024-09-12T02:52:38.128 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ab8b4e95', quiesce took 4.1 seconds. Will release after: 25.9 2024-09-12T02:52:39.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:38 smithi100 ceph-mon[31390]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-12T02:52:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:38 smithi189 ceph-mon[35196]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-12T02:52:39.296 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:38 smithi117 ceph-mon[34898]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-12T02:52:41.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:40 smithi100 ceph-mon[31390]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 222 op/s 2024-09-12T02:52:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:40 smithi189 ceph-mon[35196]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 222 op/s 2024-09-12T02:52:41.302 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 810.0 s, 412.9 tps, lat 38.222 ms stddev 43.700 2024-09-12T02:52:41.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:40 smithi117 ceph-mon[34898]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 222 op/s 2024-09-12T02:52:43.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:42 smithi100 ceph-mon[31390]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 252 op/s 2024-09-12T02:52:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:42 smithi189 ceph-mon[35196]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 252 op/s 2024-09-12T02:52:43.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:42 smithi117 ceph-mon[34898]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 252 op/s 2024-09-12T02:52:45.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:44 smithi189 ceph-mon[35196]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 255 op/s 2024-09-12T02:52:45.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:44 smithi117 ceph-mon[34898]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 255 op/s 2024-09-12T02:52:45.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:44 smithi100 ceph-mon[31390]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 255 op/s 2024-09-12T02:52:46.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:52:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.883+0000 7f6d13c33640 1 -- 172.21.15.100:0/359928656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 msgr2=0x7f6d0c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.883+0000 7f6d13c33640 1 --2- 172.21.15.100:0/359928656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c10da40 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009900 tx=0x7f6d0402a480 comp rx=0 tx=0).stop 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.883+0000 7f6d13c33640 1 -- 172.21.15.100:0/359928656 shutdown_connections 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.883+0000 7f6d13c33640 1 --2- 172.21.15.100:0/359928656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c10da40 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.883+0000 7f6d13c33640 1 --2- 172.21.15.100:0/359928656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d0c102570 0x7f6d0c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.883+0000 7f6d13c33640 1 --2- 172.21.15.100:0/359928656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d0c100e20 0x7f6d0c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.883+0000 7f6d13c33640 1 -- 172.21.15.100:0/359928656 >> 172.21.15.100:0/359928656 conn(0x7f6d0c0fc7d0 msgr2=0x7f6d0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 -- 172.21.15.100:0/359928656 shutdown_connections 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 -- 172.21.15.100:0/359928656 wait complete. 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 Processor -- start 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 -- start start 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d0c100e20 0x7f6d0c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d0c102570 0x7f6d0c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c110f80 con 0x7f6d0c102ef0 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c110e00 con 0x7f6d0c102570 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.884+0000 7f6d13c33640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c111100 con 0x7f6d0c100e20 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57130/0 (socket says 172.21.15.100:57130) 2024-09-12T02:52:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 -- 172.21.15.100:0/3806300386 learned_addr learned my addr 172.21.15.100:0/3806300386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d111ce640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d0c102570 0x7f6d0c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d119cf640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d0c100e20 0x7f6d0c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 -- 172.21.15.100:0/3806300386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d0c100e20 msgr2=0x7f6d0c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d0c100e20 0x7f6d0c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 -- 172.21.15.100:0/3806300386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d0c102570 msgr2=0x7f6d0c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d0c102570 0x7f6d0c19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 -- 172.21.15.100:0/3806300386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c19f600 con 0x7f6d0c102ef0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d121d0640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c19ef20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6d04004770 tx=0x7f6d04003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d02ffd640 1 -- 172.21.15.100:0/3806300386 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0403f070 con 0x7f6d0c102ef0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d02ffd640 1 -- 172.21.15.100:0/3806300386 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d04031c30 con 0x7f6d0c102ef0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0c19f890 con 0x7f6d0c102ef0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d02ffd640 1 -- 172.21.15.100:0/3806300386 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04035030 con 0x7f6d0c102ef0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.885+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0c1a71d0 con 0x7f6d0c102ef0 2024-09-12T02:52:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.887+0000 7f6d02ffd640 1 -- 172.21.15.100:0/3806300386 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6d04042070 con 0x7f6d0c102ef0 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 Processor -- start 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 -- start start 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 0x55f88643e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886449140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f88644ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f8863a42e0 con 0x55f886449680 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f88634bce0 con 0x55f88643edc0 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d1600c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f8863a02a0 con 0x55f88643e4a0 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d02ffd640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6cf80a2b80 0x7f6cf80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f88644ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f88644ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57132/0 (socket says 172.21.15.100:57132) 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d111ce640 1 -- 172.21.15.100:0/2584336133 learned_addr learned my addr 172.21.15.100:0/2584336133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:46.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d121d0640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6cf80a2b80 0x7f6cf80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.888+0000 7f6d111ce640 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 0x55f88643e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d119cf640 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886449140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d02ffd640 1 -- 172.21.15.100:0/3806300386 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6d040ef800 con 0x7f6d0c102ef0 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d111ce640 1 -- 172.21.15.100:0/2584336133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 msgr2=0x55f88643e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d111ce640 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 0x55f88643e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d111ce640 1 -- 172.21.15.100:0/2584336133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 msgr2=0x55f886449140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d111ce640 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886449140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d111ce640 1 -- 172.21.15.100:0/2584336133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f886330440 con 0x55f886449680 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d119cf640 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886449140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d121d0640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6cf80a2b80 0x7f6cf80a5040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6d040ed660 tx=0x7f6d0408bfb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6d111ce640 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f88644ba70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00b6c0 tx=0x7f6cfc00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16457c1ffec56d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6cf7fff640 1 -- 172.21.15.100:0/2584336133 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc012d00 con 0x55f886449680 2024-09-12T02:52:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6cf7fff640 1 -- 172.21.15.100:0/2584336133 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc010770 con 0x55f886449680 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.889+0000 7f6cf7fff640 1 -- 172.21.15.100:0/2584336133 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc003850 con 0x55f886449680 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 -- 172.21.15.100:0/2584336133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 msgr2=0x55f88644ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f88644ba70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00b6c0 tx=0x7f6cfc00b650 comp rx=0 tx=0).stop 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 -- 172.21.15.100:0/2584336133 shutdown_connections 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f88644ba70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886449140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 --2- 172.21.15.100:0/2584336133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 0x55f88643e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 -- 172.21.15.100:0/2584336133 >> 172.21.15.100:0/2584336133 conn(0x55f88643aa30 msgr2=0x55f88643ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 -- 172.21.15.100:0/2584336133 shutdown_connections 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 -- 172.21.15.100:0/2584336133 wait complete. 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 -- start start 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.890+0000 7f6d1600c740 1 Processor -- start 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 0x55f8864490e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886446390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f886446b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d1600c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f88644c250 con 0x55f886449680 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d1600c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f88635f050 con 0x55f88643edc0 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d1600c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f88644c3d0 con 0x55f88643e4a0 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d1600c740 10 client.0 _ll_register_callbacks cb 0x55f88639f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f886446b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f886446b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57144/0 (socket says 172.21.15.100:57144) 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 -- 172.21.15.100:0/839427016 learned_addr learned my addr 172.21.15.100:0/839427016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d119cf640 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886446390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 -- 172.21.15.100:0/839427016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 msgr2=0x55f8864490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 0x55f8864490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 -- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 msgr2=0x55f886446390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886446390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.891+0000 7f6d111ce640 1 -- 172.21.15.100:0/839427016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8861153c0 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d111ce640 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f886446b20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc005e00 tx=0x7f6cfc012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31dc66be32818ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6cf57fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6cf57fa640 1 -- 172.21.15.100:0/839427016 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc005270 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cfc010770 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6cf57fa640 1 -- 172.21.15.100:0/839427016 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6cfc005410 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6cf57fa640 1 -- 172.21.15.100:0/839427016 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6cfc005610 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 10 client.17835 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f886457d30 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6cf57fa640 1 -- 172.21.15.100:0/839427016 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc010770 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6cf57fa640 1 -- 172.21.15.100:0/839427016 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6cfc01f840 con 0x55f886449680 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 10 client.17835 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 10 client.17835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:46.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 20 client.17835 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f886459130 0x55f88645b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 4 client.17835 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.892+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8863b1850 con 0x55f886459130 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.893+0000 7f6d119cf640 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f886459130 0x55f88645b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.893+0000 7f6cf57fa640 10 client.17835 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.893+0000 7f6d119cf640 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f886459130 0x55f88645b520 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47836e47ed6e08c4 server_cookie=af44308c0e906d70 in_seq=0 out_seq=0 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6cf57fa640 1 -- 172.21.15.100:0/839427016 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8863b1850 con 0x55f886459130 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6cf57fa640 10 client.17835 handle_command_reply: tid=0 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 client.17835 shutdown 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 msgr2=0x55f886446b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f886446b20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc005e00 tx=0x7f6cfc012f30 comp rx=0 tx=0).stop 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 shutdown_connections 2024-09-12T02:52:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f886459130 0x55f88645b520 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f886449680 0x55f886446b20 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f886446390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 --2- 172.21.15.100:0/839427016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643e4a0 0x55f8864490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 >> 172.21.15.100:0/839427016 conn(0x55f88643aa30 msgr2=0x55f886440710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6cf57fa640 0 client.17835 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 shutdown_connections 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 1 -- 172.21.15.100:0/839427016 wait complete. 2024-09-12T02:52:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.894+0000 7f6d1600c740 20 client.17835 trim_cache size 0 max 16384 2024-09-12T02:52:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 Processor -- start 2024-09-12T02:52:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 -- start start 2024-09-12T02:52:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886445c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f88643ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f886449680 0x55f886448410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1b1f30 con 0x55f88643e4a0 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1af800 con 0x55f88643edc0 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d1600c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1ad650 con 0x55f886449680 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886445c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886445c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57160/0 (socket says 172.21.15.100:57160) 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.911+0000 7f6d111ce640 1 -- 172.21.15.100:0/275500668 learned_addr learned my addr 172.21.15.100:0/275500668 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6d119cf640 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f88643ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6d111ce640 1 -- 172.21.15.100:0/275500668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f886449680 msgr2=0x55f886448410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6d111ce640 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f886449680 0x55f886448410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6d111ce640 1 -- 172.21.15.100:0/275500668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 msgr2=0x55f88643ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6d111ce640 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f88643ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6d111ce640 1 -- 172.21.15.100:0/275500668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f88643b350 con 0x55f88643e4a0 2024-09-12T02:52:46.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6d111ce640 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886445c50 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc011010 tx=0x7f6cfc00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9fef4471ad016e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6cf77fe640 1 -- 172.21.15.100:0/275500668 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc032070 con 0x55f88643e4a0 2024-09-12T02:52:46.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6cf77fe640 1 -- 172.21.15.100:0/275500668 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc016030 con 0x55f88643e4a0 2024-09-12T02:52:46.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.912+0000 7f6cf77fe640 1 -- 172.21.15.100:0/275500668 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc01f6d0 con 0x55f88643e4a0 2024-09-12T02:52:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- 172.21.15.100:0/275500668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 msgr2=0x55f886445c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886445c50 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc011010 tx=0x7f6cfc00b5d0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- 172.21.15.100:0/275500668 shutdown_connections 2024-09-12T02:52:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f886449680 0x55f886448410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f88643edc0 0x55f88643ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 --2- 172.21.15.100:0/275500668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886445c50 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- 172.21.15.100:0/275500668 >> 172.21.15.100:0/275500668 conn(0x55f88643aa30 msgr2=0x55f886445510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- 172.21.15.100:0/275500668 shutdown_connections 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- 172.21.15.100:0/275500668 wait complete. 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- start start 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 Processor -- start 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886451c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643edc0 0x55f88644cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f886449680 0x55f88644d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1adcc0 con 0x55f88643e4a0 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1af130 con 0x55f886449680 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1ae390 con 0x55f88643edc0 2024-09-12T02:52:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.913+0000 7f6d1600c740 10 client.0 _ll_register_callbacks cb 0x7f6cfc00bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886451c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886451c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57162/0 (socket says 172.21.15.100:57162) 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 -- 172.21.15.100:0/4014920665 learned_addr learned my addr 172.21.15.100:0/4014920665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d119cf640 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643edc0 0x55f88644cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f886449680 0x55f88644d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 -- 172.21.15.100:0/4014920665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643edc0 msgr2=0x55f88644cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643edc0 0x55f88644cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 -- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f886449680 msgr2=0x55f88644d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f886449680 0x55f88644d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 -- 172.21.15.100:0/4014920665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f88644dba0 con 0x55f88643e4a0 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d111ce640 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886451c40 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000c00 tx=0x7f6cfc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc91f033301d9e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6cf57fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6cf57fa640 1 -- 172.21.15.100:0/4014920665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc041060 con 0x55f88643e4a0 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6cf57fa640 1 -- 172.21.15.100:0/4014920665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6cfc01f470 con 0x55f88643e4a0 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.914+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cfc016030 con 0x55f88643e4a0 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6cf57fa640 1 -- 172.21.15.100:0/4014920665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6cfc032040 con 0x55f88643e4a0 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 10 client.17841 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8864cc2f0 con 0x55f88643e4a0 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6cf57fa640 1 -- 172.21.15.100:0/4014920665 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc016030 con 0x55f88643e4a0 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6cf57fa640 1 -- 172.21.15.100:0/4014920665 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6cfc003c90 con 0x55f88643e4a0 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 10 client.17841 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 10 client.17841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 20 client.17841 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f8864cc8f0 0x55f8864cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 4 client.17841 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:52:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8863abd60 con 0x55f8864cc8f0 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.915+0000 7f6d119cf640 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f8864cc8f0 0x55f8864cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6cf57fa640 10 client.17841 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d119cf640 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f8864cc8f0 0x55f8864cece0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88064c3a0ad60dd6 server_cookie=9ccc8ea28020ceda in_seq=0 out_seq=0 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6cf57fa640 1 -- 172.21.15.100:0/4014920665 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f8863abd60 con 0x55f8864cc8f0 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6cf57fa640 10 client.17841 handle_command_reply: tid=0 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 client.17841 shutdown 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 msgr2=0x55f886451c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886451c40 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000c00 tx=0x7f6cfc005850 comp rx=0 tx=0).stop 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 shutdown_connections 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55f8864cc8f0 0x55f8864cece0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f886449680 0x55f88644d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f88643edc0 0x55f88644cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6cf57fa640 0 client.17841 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 --2- 172.21.15.100:0/4014920665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f88643e4a0 0x55f886451c40 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 >> 172.21.15.100:0/4014920665 conn(0x55f88643aa30 msgr2=0x55f886439b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 shutdown_connections 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 1 -- 172.21.15.100:0/4014920665 wait complete. 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.916+0000 7f6d1600c740 20 client.17841 trim_cache size 0 max 16384 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:52:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6cf80a2b80 msgr2=0x7f6cf80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6cf80a2b80 0x7f6cf80a5040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6d040ed660 tx=0x7f6d0408bfb0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 msgr2=0x7f6d0c19ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c19ef20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6d04004770 tx=0x7f6d04003c10 comp rx=0 tx=0).stop 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 shutdown_connections 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f6cf80a2b80 0x7f6cf80a5040 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d0c102ef0 0x7f6d0c19ef20 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d0c102570 0x7f6d0c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 --2- 172.21.15.100:0/3806300386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d0c100e20 0x7f6d0c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 >> 172.21.15.100:0/3806300386 conn(0x7f6d0c0fc7d0 msgr2=0x7f6d0c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 shutdown_connections 2024-09-12T02:52:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:46.917+0000 7f6d13c33640 1 -- 172.21.15.100:0/3806300386 wait complete. 2024-09-12T02:52:47.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:46 smithi100 ceph-mon[31390]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-12T02:52:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:46 smithi189 ceph-mon[35196]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-12T02:52:47.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:46 smithi117 ceph-mon[34898]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-12T02:52:47.713 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:52:47.713 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:52:47.959 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 -- 172.21.15.100:0/3936854847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990100e20 msgr2=0x7fb990101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 --2- 172.21.15.100:0/3936854847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990100e20 0x7fb990101200 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb988009900 tx=0x7fb98802a480 comp rx=0 tx=0).stop 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 -- 172.21.15.100:0/3936854847 shutdown_connections 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 --2- 172.21.15.100:0/3936854847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb990102ef0 0x7fb99010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 --2- 172.21.15.100:0/3936854847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb990102570 0x7fb9901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 --2- 172.21.15.100:0/3936854847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990100e20 0x7fb990101200 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 -- 172.21.15.100:0/3936854847 >> 172.21.15.100:0/3936854847 conn(0x7fb9900fc7d0 msgr2=0x7fb9900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 -- 172.21.15.100:0/3936854847 shutdown_connections 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.416+0000 7fb997786640 1 -- 172.21.15.100:0/3936854847 wait complete. 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 Processor -- start 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 -- start start 2024-09-12T02:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb990100e20 0x7fb9901984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990102570 0x7fb9901989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb990102ef0 0x7fb99019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb990110f50 con 0x7fb990102570 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb990110dd0 con 0x7fb990100e20 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb997786640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb9901110d0 con 0x7fb990102ef0 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990102570 0x7fb9901989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990102570 0x7fb9901989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57184/0 (socket says 172.21.15.100:57184) 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 -- 172.21.15.100:0/3875604762 learned_addr learned my addr 172.21.15.100:0/3875604762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb995522640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb990100e20 0x7fb9901984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb995d23640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb990102ef0 0x7fb99019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 -- 172.21.15.100:0/3875604762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb990102ef0 msgr2=0x7fb99019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb990102ef0 0x7fb99019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 -- 172.21.15.100:0/3875604762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb990100e20 msgr2=0x7fb9901984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb990100e20 0x7fb9901984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.417+0000 7fb994d21640 1 -- 172.21.15.100:0/3875604762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99019d450 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.418+0000 7fb994d21640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990102570 0x7fb9901989e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb98000d950 tx=0x7fb98000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.418+0000 7fb9867fc640 1 -- 172.21.15.100:0/3875604762 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980017070 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.418+0000 7fb9867fc640 1 -- 172.21.15.100:0/3875604762 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb980009c30 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.418+0000 7fb9867fc640 1 -- 172.21.15.100:0/3875604762 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98000f6b0 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.418+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99019d740 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.418+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9901a5020 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.419+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb990101200 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.420+0000 7fb9867fc640 1 -- 172.21.15.100:0/3875604762 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb9800109d0 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.421+0000 7fb9867fc640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb97c0a2c00 0x7fb97c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.421+0000 7fb995522640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb97c0a2c00 0x7fb97c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.421+0000 7fb9867fc640 1 -- 172.21.15.100:0/3875604762 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb9800ceb90 con 0x7fb990102570 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.421+0000 7fb995522640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb97c0a2c00 0x7fb97c0a50c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb988009230 tx=0x7fb9880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.425+0000 7fb9867fc640 1 -- 172.21.15.100:0/3875604762 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb980009de0 con 0x7fb990102570 2024-09-12T02:52:48.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.624+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9901a5220 con 0x7fb990102570 2024-09-12T02:52:48.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.625+0000 7fb9867fc640 1 -- 172.21.15.100:0/3875604762 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fb98009b490 con 0x7fb990102570 2024-09-12T02:52:48.627 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:52:48.627 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:52:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:52:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb97c0a2c00 msgr2=0x7fb97c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb97c0a2c00 0x7fb97c0a50c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb988009230 tx=0x7fb9880058d0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990102570 msgr2=0x7fb9901989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990102570 0x7fb9901989e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb98000d950 tx=0x7fb98000de10 comp rx=0 tx=0).stop 2024-09-12T02:52:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 shutdown_connections 2024-09-12T02:52:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb97c0a2c00 0x7fb97c0a50c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb990102ef0 0x7fb99019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb990102570 0x7fb9901989e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 --2- 172.21.15.100:0/3875604762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb990100e20 0x7fb9901984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 >> 172.21.15.100:0/3875604762 conn(0x7fb9900fc7d0 msgr2=0x7fb990069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 shutdown_connections 2024-09-12T02:52:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:48.627+0000 7fb997786640 1 -- 172.21.15.100:0/3875604762 wait complete. 2024-09-12T02:52:49.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:48 smithi189 ceph-mon[35196]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 266 op/s 2024-09-12T02:52:49.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:48 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3875604762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:49.275 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:48 smithi100 ceph-mon[31390]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 266 op/s 2024-09-12T02:52:49.275 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:48 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3875604762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:49.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:52:49.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:48 smithi117 ceph-mon[34898]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 266 op/s 2024-09-12T02:52:49.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:48 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3875604762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:52:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 -- 172.21.15.100:0/916368114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 msgr2=0x7f981c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 --2- 172.21.15.100:0/916368114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c1029b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9804009900 tx=0x7f980402a480 comp rx=0 tx=0).stop 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 -- 172.21.15.100:0/916368114 shutdown_connections 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 --2- 172.21.15.100:0/916368114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102ef0 0x7f981c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 --2- 172.21.15.100:0/916368114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c1029b0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 --2- 172.21.15.100:0/916368114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c100e20 0x7f981c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 -- 172.21.15.100:0/916368114 >> 172.21.15.100:0/916368114 conn(0x7f981c0fc7d0 msgr2=0x7f981c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 -- 172.21.15.100:0/916368114 shutdown_connections 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 -- 172.21.15.100:0/916368114 wait complete. 2024-09-12T02:52:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.043+0000 7f9821f68640 1 Processor -- start 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9821f68640 1 -- start start 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9821f68640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c100e20 0x7f981c1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9821f68640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9821f68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102ef0 0x7f981c19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9821f68640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f981c110f80 con 0x7f981c102570 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9821f68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f981c110e00 con 0x7f981c102ef0 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9821f68640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f981c111100 con 0x7f981c100e20 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57198/0 (socket says 172.21.15.100:57198) 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 -- 172.21.15.100:0/1635113326 learned_addr learned my addr 172.21.15.100:0/1635113326 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f981b7fe640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c100e20 0x7f981c1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f981bfff640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102ef0 0x7f981c19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 -- 172.21.15.100:0/1635113326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c100e20 msgr2=0x7f981c1973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c100e20 0x7f981c1973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 -- 172.21.15.100:0/1635113326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102ef0 msgr2=0x7f981c19bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102ef0 0x7f981c19bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 -- 172.21.15.100:0/1635113326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c19c390 con 0x7f981c102570 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f981bfff640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102ef0 0x7f981c19bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.044+0000 7f9813fff640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c197920 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f9804006010 tx=0x7f9804003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.045+0000 7f98197fa640 1 -- 172.21.15.100:0/1635113326 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980403f070 con 0x7f981c102570 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.045+0000 7f98197fa640 1 -- 172.21.15.100:0/1635113326 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9804031e30 con 0x7f981c102570 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.045+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c19c620 con 0x7f981c102570 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.045+0000 7f98197fa640 1 -- 172.21.15.100:0/1635113326 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804035030 con 0x7f981c102570 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.045+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c1a3f60 con 0x7f981c102570 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.047+0000 7f98197fa640 1 -- 172.21.15.100:0/1635113326 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f9804042070 con 0x7f981c102570 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.047+0000 7f9824341740 1 Processor -- start 2024-09-12T02:52:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.047+0000 7f9824341740 1 -- start start 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.047+0000 7f9824341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad1b40 0x560f44ad0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.047+0000 7f9824341740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad05d0 0x560f44ad0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.047+0000 7f9824341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44add760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f9824341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560f44a362f0 con 0x560f44ad1b40 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f9824341740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560f449ddcf0 con 0x560f44ad05d0 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f9824341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f44a322b0 con 0x560f44adb370 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f98197fa640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98080a2b80 0x7f98080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad1b40 0x560f44ad0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad1b40 0x560f44ad0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57214/0 (socket says 172.21.15.100:57214) 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 -- 172.21.15.100:0/1032782982 learned_addr learned my addr 172.21.15.100:0/1032782982 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f9813fff640 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44add760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981b7fe640 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad05d0 0x560f44ad0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98080a2b80 0x7f98080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f98197fa640 1 -- 172.21.15.100:0/1635113326 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f98040efa50 con 0x7f981c102570 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 -- 172.21.15.100:0/1032782982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 msgr2=0x560f44add760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44add760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 -- 172.21.15.100:0/1032782982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad05d0 msgr2=0x560f44ad0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad05d0 0x560f44ad0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 -- 172.21.15.100:0/1032782982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f449c23a0 con 0x560f44ad1b40 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f981bfff640 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad1b40 0x560f44ad0090 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f98140129e0 tx=0x7f9814012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c94edb5d8b3345b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f9811ffb640 1 -- 172.21.15.100:0/1032782982 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814022070 con 0x560f44ad1b40 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f9811ffb640 1 -- 172.21.15.100:0/1032782982 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9814003c30 con 0x560f44ad1b40 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.048+0000 7f9811ffb640 1 -- 172.21.15.100:0/1032782982 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814005310 con 0x560f44ad1b40 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 -- 172.21.15.100:0/1032782982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad1b40 msgr2=0x560f44ad0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f981bfff640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98080a2b80 0x7f98080a5040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9814020000 tx=0x7f981401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad1b40 0x560f44ad0090 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f98140129e0 tx=0x7f9814012ea0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 -- 172.21.15.100:0/1032782982 shutdown_connections 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44add760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad05d0 0x560f44ad0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 --2- 172.21.15.100:0/1032782982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad1b40 0x560f44ad0090 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 -- 172.21.15.100:0/1032782982 >> 172.21.15.100:0/1032782982 conn(0x560f44a99310 msgr2=0x560f44accc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 -- 172.21.15.100:0/1032782982 shutdown_connections 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 -- 172.21.15.100:0/1032782982 wait complete. 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.049+0000 7f9824341740 1 -- start start 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 1 Processor -- start 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad05d0 0x560f44adada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44ad8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44ad87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560f44ade070 con 0x560f44ad05d0 2024-09-12T02:52:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560f449f1060 con 0x560f44ad1b40 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f44ade1f0 con 0x560f44adb370 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9824341740 10 client.0 _ll_register_callbacks cb 0x560f447448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad05d0 0x560f44adada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad05d0 0x560f44adada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57228/0 (socket says 172.21.15.100:57228) 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 -- 172.21.15.100:0/1298886665 learned_addr learned my addr 172.21.15.100:0/1298886665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f9813fff640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44ad8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981bfff640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44ad87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 -- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 msgr2=0x560f44ad87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44ad87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 -- 172.21.15.100:0/1298886665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 msgr2=0x560f44ad8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44ad8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981b7fe640 1 -- 172.21.15.100:0/1298886665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f447a73c0 con 0x560f44ad05d0 2024-09-12T02:52:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.050+0000 7f981bfff640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44ad87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f981b7fe640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad05d0 0x560f44adada0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f980c00a950 tx=0x7f980c00ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba7f2e26fd78196 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f97faffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f97faffd640 1 -- 172.21.15.100:0/1298886665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c01d060 con 0x560f44ad05d0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f97faffd640 1 -- 172.21.15.100:0/1298886665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f980c008c20 con 0x560f44ad05d0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9814003c30 con 0x560f44ad05d0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f97faffd640 1 -- 172.21.15.100:0/1298886665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f980c008e20 con 0x560f44ad05d0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 10 client.17859 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560f44ae9bb0 con 0x560f44ad05d0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f97faffd640 1 -- 172.21.15.100:0/1298886665 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9814003c30 con 0x560f44ad05d0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f97faffd640 1 -- 172.21.15.100:0/1298886665 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f980c022510 con 0x560f44ad05d0 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 10 client.17859 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 10 client.17859 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:52:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 20 client.17859 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44aeb070 0x560f44aed460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 4 client.17859 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.051+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f44a43860 con 0x560f44aeb070 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.052+0000 7f9813fff640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44aeb070 0x560f44aed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.052+0000 7f97faffd640 10 client.17859 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.052+0000 7f9813fff640 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44aeb070 0x560f44aed460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=75ea5ac8823498a7 server_cookie=747b88e262c338b3 in_seq=0 out_seq=0 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.053+0000 7f97faffd640 1 -- 172.21.15.100:0/1298886665 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f44a43860 con 0x560f44aeb070 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.053+0000 7f97faffd640 10 client.17859 handle_command_reply: tid=0 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.053+0000 7f9824341740 1 client.17859 shutdown 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.053+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad05d0 msgr2=0x560f44adada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.053+0000 7f9824341740 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad05d0 0x560f44adada0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f980c00a950 tx=0x7f980c00ae10 comp rx=0 tx=0).stop 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 shutdown_connections 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44aeb070 0x560f44aed460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44adb370 0x560f44ad87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44ad8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 --2- 172.21.15.100:0/1298886665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad05d0 0x560f44adada0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 >> 172.21.15.100:0/1298886665 conn(0x560f44a99310 msgr2=0x560f44ad2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f97faffd640 0 client.17859 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 shutdown_connections 2024-09-12T02:52:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 1 -- 172.21.15.100:0/1298886665 wait complete. 2024-09-12T02:52:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.054+0000 7f9824341740 20 client.17859 trim_cache size 0 max 16384 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 Processor -- start 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 -- start start 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44acce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44adb370 0x560f44ad3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad7140 0x560f44ad3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f981c1adbb0 con 0x560f44adb370 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f981c1ab480 con 0x560f44ad1b40 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.067+0000 7f9824341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f981c1a92d0 con 0x560f44ad7140 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44adb370 0x560f44ad3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44adb370 0x560f44ad3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57244/0 (socket says 172.21.15.100:57244) 2024-09-12T02:52:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 -- 172.21.15.100:0/3726616906 learned_addr learned my addr 172.21.15.100:0/3726616906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f981bfff640 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad7140 0x560f44ad3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f981b7fe640 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44acce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 -- 172.21.15.100:0/3726616906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad7140 msgr2=0x560f44ad3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad7140 0x560f44ad3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 -- 172.21.15.100:0/3726616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 msgr2=0x560f44acce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44acce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 -- 172.21.15.100:0/3726616906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f44ad8b50 con 0x560f44adb370 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f981b7fe640 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44acce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f9813fff640 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44adb370 0x560f44ad3120 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f9804000c00 tx=0x7f9804086e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562b73b0a4c42181 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f98117fa640 1 -- 172.21.15.100:0/3726616906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804049040 con 0x560f44adb370 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f98117fa640 1 -- 172.21.15.100:0/3726616906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98040bc9a0 con 0x560f44adb370 2024-09-12T02:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.068+0000 7f98117fa640 1 -- 172.21.15.100:0/3726616906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804049e40 con 0x560f44adb370 2024-09-12T02:52:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 -- 172.21.15.100:0/3726616906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44adb370 msgr2=0x560f44ad3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44adb370 0x560f44ad3120 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f9804000c00 tx=0x7f9804086e70 comp rx=0 tx=0).stop 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 -- 172.21.15.100:0/3726616906 shutdown_connections 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad7140 0x560f44ad3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44adb370 0x560f44ad3120 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 --2- 172.21.15.100:0/3726616906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44ad1b40 0x560f44acce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 -- 172.21.15.100:0/3726616906 >> 172.21.15.100:0/3726616906 conn(0x560f44a99310 msgr2=0x560f44acc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 -- 172.21.15.100:0/3726616906 shutdown_connections 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.069+0000 7f9824341740 1 -- 172.21.15.100:0/3726616906 wait complete. 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 -- start start 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 Processor -- start 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad1b40 0x560f44ad5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad7140 0x560f44ad5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44adb370 0x560f44ad5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f981c1a9940 con 0x560f44ad7140 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f981c1aadb0 con 0x560f44adb370 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f981c1aa010 con 0x560f44ad1b40 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9824341740 10 client.0 _ll_register_callbacks cb 0x7f980c00d550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9813fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad7140 0x560f44ad5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9813fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad7140 0x560f44ad5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57252/0 (socket says 172.21.15.100:57252) 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f9813fff640 1 -- 172.21.15.100:0/3530311313 learned_addr learned my addr 172.21.15.100:0/3530311313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.070+0000 7f981b7fe640 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad1b40 0x560f44ad5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f981bfff640 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44adb370 0x560f44ad5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9813fff640 1 -- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad1b40 msgr2=0x560f44ad5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9813fff640 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad1b40 0x560f44ad5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9813fff640 1 -- 172.21.15.100:0/3530311313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44adb370 msgr2=0x560f44ad5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9813fff640 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44adb370 0x560f44ad5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9813fff640 1 -- 172.21.15.100:0/3530311313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f44b54e40 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9813fff640 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad7140 0x560f44ad5740 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f98040bc230 tx=0x7f98040bbc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6185831202abc57b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f97faffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f97faffd640 1 -- 172.21.15.100:0/3530311313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804049040 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f97faffd640 1 -- 172.21.15.100:0/3530311313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f98040d5170 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98040bc9a0 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f97faffd640 1 -- 172.21.15.100:0/3530311313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f98040c0650 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9824341740 10 client.17865 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.071+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560f44b5a480 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f97faffd640 1 -- 172.21.15.100:0/3530311313 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98040bc9a0 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f97faffd640 1 -- 172.21.15.100:0/3530311313 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f980403b5f0 con 0x560f44ad7140 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f9824341740 10 client.17865 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f9824341740 10 client.17865 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:52:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f9824341740 20 client.17865 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f9824341740 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44b5aaf0 0x560f44b5cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f9824341740 4 client.17865 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f44a3dd70 con 0x560f44b5aaf0 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f981b7fe640 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44b5aaf0 0x560f44b5cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f97faffd640 10 client.17865 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.072+0000 7f981b7fe640 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44b5aaf0 0x560f44b5cf10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9fcc600446387e42 server_cookie=3b7b164badfe1648 in_seq=0 out_seq=0 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f97faffd640 1 -- 172.21.15.100:0/3530311313 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f44a3dd70 con 0x560f44b5aaf0 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f97faffd640 10 client.17865 handle_command_reply: tid=0 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 client.17865 shutdown 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad7140 msgr2=0x560f44ad5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad7140 0x560f44ad5740 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f98040bc230 tx=0x7f98040bbc80 comp rx=0 tx=0).stop 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 shutdown_connections 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x560f44b5aaf0 0x560f44b5cf10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560f44adb370 0x560f44ad5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f44ad7140 0x560f44ad5740 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 --2- 172.21.15.100:0/3530311313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f44ad1b40 0x560f44ad5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 >> 172.21.15.100:0/3530311313 conn(0x560f44a99310 msgr2=0x560f44acb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f97faffd640 0 client.17865 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 shutdown_connections 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 1 -- 172.21.15.100:0/3530311313 wait complete. 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.073+0000 7f9824341740 20 client.17865 trim_cache size 0 max 16384 2024-09-12T02:52:50.079 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98080a2b80 msgr2=0x7f98080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98080a2b80 0x7f98080a5040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9814020000 tx=0x7f981401f000 comp rx=0 tx=0).stop 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 msgr2=0x7f981c197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c197920 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f9804006010 tx=0x7f9804003c80 comp rx=0 tx=0).stop 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 shutdown_connections 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f98080a2b80 0x7f98080a5040 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102ef0 0x7f981c19bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c102570 0x7f981c197920 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 --2- 172.21.15.100:0/1635113326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c100e20 0x7f981c1973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 >> 172.21.15.100:0/1635113326 conn(0x7f981c0fc7d0 msgr2=0x7f981c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 shutdown_connections 2024-09-12T02:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:50.074+0000 7f9821f68640 1 -- 172.21.15.100:0/1635113326 wait complete. 2024-09-12T02:52:50.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:52:50.964 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:50 smithi100 ceph-mon[31390]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 198 op/s 2024-09-12T02:52:51.188 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:50 smithi189 ceph-mon[35196]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 198 op/s 2024-09-12T02:52:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:51.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:50 smithi117 ceph-mon[34898]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 198 op/s 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 -- 172.21.15.100:0/1367358325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 msgr2=0x7f6320114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 --2- 172.21.15.100:0/1367358325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f6320114f80 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6318009ca0 tx=0x7f631802a950 comp rx=0 tx=0).stop 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 -- 172.21.15.100:0/1367358325 shutdown_connections 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 --2- 172.21.15.100:0/1367358325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f6320114f80 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 --2- 172.21.15.100:0/1367358325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6320074eb0 0x7f6320112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 --2- 172.21.15.100:0/1367358325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6320074590 0x7f6320074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 -- 172.21.15.100:0/1367358325 >> 172.21.15.100:0/1367358325 conn(0x7f63200fd8c0 msgr2=0x7f63200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 -- 172.21.15.100:0/1367358325 shutdown_connections 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.660+0000 7f6327eb7640 1 -- 172.21.15.100:0/1367358325 wait complete. 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 Processor -- start 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 -- start start 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6320074590 0x7f63201a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6320074eb0 0x7f63201a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f632019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63201185c0 con 0x7f6320112b90 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6320118440 con 0x7f6320074590 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6327eb7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6320118740 con 0x7f6320074eb0 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6326454640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f632019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6326454640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f632019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57270/0 (socket says 172.21.15.100:57270) 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6326454640 1 -- 172.21.15.100:0/2494587312 learned_addr learned my addr 172.21.15.100:0/2494587312 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6325c53640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6320074590 0x7f63201a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.661+0000 7f6325452640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6320074eb0 0x7f63201a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6326454640 1 -- 172.21.15.100:0/2494587312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6320074eb0 msgr2=0x7f63201a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6326454640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6320074eb0 0x7f63201a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6326454640 1 -- 172.21.15.100:0/2494587312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6320074590 msgr2=0x7f63201a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6326454640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6320074590 0x7f63201a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6326454640 1 -- 172.21.15.100:0/2494587312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632019f000 con 0x7f6320112b90 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6326454640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f632019e8d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6318006010 tx=0x7f631802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6316ffd640 1 -- 172.21.15.100:0/2494587312 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318034040 con 0x7f6320112b90 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6316ffd640 1 -- 172.21.15.100:0/2494587312 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6318003e00 con 0x7f6320112b90 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632019f290 con 0x7f6320112b90 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6316ffd640 1 -- 172.21.15.100:0/2494587312 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180456e0 con 0x7f6320112b90 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.662+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63201ab5e0 con 0x7f6320112b90 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.664+0000 7f6316ffd640 1 -- 172.21.15.100:0/2494587312 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6318037020 con 0x7f6320112b90 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 Processor -- start 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 -- start start 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af3fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af3fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af409760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5576af3622f0 con 0x5576af3fdb40 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5576af309cf0 con 0x5576af407370 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f632a290740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5576af35e2b0 con 0x5576af3fc5d0 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f6325452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af3fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f6325452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af3fc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57276/0 (socket says 172.21.15.100:57276) 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f6325452640 1 -- 172.21.15.100:0/3637009237 learned_addr learned my addr 172.21.15.100:0/3637009237 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.665+0000 7f6316ffd640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f630c0a2b80 0x7f630c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325c53640 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af3fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6326454640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f630c0a2b80 0x7f630c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325452640 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af409760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325452640 1 -- 172.21.15.100:0/3637009237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 msgr2=0x5576af3fca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325452640 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af3fca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325452640 1 -- 172.21.15.100:0/3637009237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 msgr2=0x5576af409760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325452640 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af409760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325452640 1 -- 172.21.15.100:0/3637009237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576af2ee3a0 con 0x5576af3fdb40 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325c53640 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af3fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6316ffd640 1 -- 172.21.15.100:0/2494587312 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f63180f0260 con 0x7f6320112b90 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6325452640 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af3fc090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6310005d90 tx=0x7f631000c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d8ffc0679adc29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f630bfff640 1 -- 172.21.15.100:0/3637009237 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310018030 con 0x5576af3fdb40 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f6326454640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f630c0a2b80 0x7f630c0a5040 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6318009dc0 tx=0x7f631808ba60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f630bfff640 1 -- 172.21.15.100:0/3637009237 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6310005020 con 0x5576af3fdb40 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.666+0000 7f630bfff640 1 -- 172.21.15.100:0/3637009237 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310004a90 con 0x5576af3fdb40 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 -- 172.21.15.100:0/3637009237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 msgr2=0x5576af3fc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af3fc090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6310005d90 tx=0x7f631000c5a0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 -- 172.21.15.100:0/3637009237 shutdown_connections 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af409760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af3fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 --2- 172.21.15.100:0/3637009237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af3fc090 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 -- 172.21.15.100:0/3637009237 >> 172.21.15.100:0/3637009237 conn(0x5576af3c5310 msgr2=0x5576af3f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 -- 172.21.15.100:0/3637009237 shutdown_connections 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 -- 172.21.15.100:0/3637009237 wait complete. 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 -- start start 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.667+0000 7f632a290740 1 Processor -- start 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f632a290740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af406d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f632a290740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af403fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f632a290740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af4045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f632a290740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5576af40a070 con 0x5576af3fdb40 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f632a290740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5576af31d060 con 0x5576af407370 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f632a290740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5576af40a1f0 con 0x5576af3fc5d0 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f632a290740 10 client.0 _ll_register_callbacks cb 0x5576af0708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af403fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af403fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57286/0 (socket says 172.21.15.100:57286) 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 -- 172.21.15.100:0/177985594 learned_addr learned my addr 172.21.15.100:0/177985594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325452640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af406d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325452640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af4045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 -- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 msgr2=0x5576af406d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af406d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 -- 172.21.15.100:0/177985594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 msgr2=0x5576af4045d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af4045d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 -- 172.21.15.100:0/177985594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576af0d33c0 con 0x5576af3fdb40 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325452640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af4045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f6325c53640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af403fe0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f631c00bf90 tx=0x7f631c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca5d949e62582ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.668+0000 7f63097fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f63097fa640 1 -- 172.21.15.100:0/177985594 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c018020 con 0x5576af3fdb40 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f63097fa640 1 -- 172.21.15.100:0/177985594 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f631c014870 con 0x5576af3fdb40 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6310005020 con 0x5576af3fdb40 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f63097fa640 1 -- 172.21.15.100:0/177985594 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f631c023050 con 0x5576af3fdb40 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 10 client.17877 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576af415b30 con 0x5576af3fdb40 2024-09-12T02:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f63097fa640 1 -- 172.21.15.100:0/177985594 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6310005020 con 0x5576af3fdb40 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f63097fa640 1 -- 172.21.15.100:0/177985594 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f631c013ac0 con 0x5576af3fdb40 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 10 client.17877 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 10 client.17877 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 20 client.17877 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af417090 0x5576af4194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 4 client.17877 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.669+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576af36f860 con 0x5576af417090 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.670+0000 7f6325452640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af417090 0x5576af4194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.670+0000 7f63097fa640 10 client.17877 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.670+0000 7f6325452640 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af417090 0x5576af4194b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5bf41b547ec5b1e server_cookie=d25ffb096d37d587 in_seq=0 out_seq=0 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f63097fa640 1 -- 172.21.15.100:0/177985594 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576af36f860 con 0x5576af417090 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f63097fa640 10 client.17877 handle_command_reply: tid=0 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 client.17877 shutdown 2024-09-12T02:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 msgr2=0x5576af403fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af403fe0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f631c00bf90 tx=0x7f631c00f670 comp rx=0 tx=0).stop 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 shutdown_connections 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af417090 0x5576af4194b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af4045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fdb40 0x5576af403fe0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f63097fa640 0 client.17877 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 --2- 172.21.15.100:0/177985594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af406d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 >> 172.21.15.100:0/177985594 conn(0x5576af3c5310 msgr2=0x5576af3fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 shutdown_connections 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 1 -- 172.21.15.100:0/177985594 wait complete. 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.671+0000 7f632a290740 20 client.17877 trim_cache size 0 max 16384 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.683+0000 7f632a290740 1 Processor -- start 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f632a290740 1 -- start start 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f632a290740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af413310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f632a290740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af3fdb40 0x5576af402fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f632a290740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af407370 0x5576af41ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f632a290740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63201b64a0 con 0x5576af407370 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f632a290740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f63201b3d70 con 0x5576af3fdb40 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f632a290740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63201b1bc0 con 0x5576af3fc5d0 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af407370 0x5576af41ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af407370 0x5576af41ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57300/0 (socket says 172.21.15.100:57300) 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 -- 172.21.15.100:0/1904542234 learned_addr learned my addr 172.21.15.100:0/1904542234 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 -- 172.21.15.100:0/1904542234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 msgr2=0x5576af413310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 --2- 172.21.15.100:0/1904542234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af413310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 -- 172.21.15.100:0/1904542234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af3fdb40 msgr2=0x5576af402fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 --2- 172.21.15.100:0/1904542234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af3fdb40 0x5576af402fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 -- 172.21.15.100:0/1904542234 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576af3ff120 con 0x5576af407370 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f6325452640 1 --2- 172.21.15.100:0/1904542234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af407370 0x5576af41ed60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6310012fd0 tx=0x7f63100046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdedfcadaf45f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f630b7fe640 1 -- 172.21.15.100:0/1904542234 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310018040 con 0x5576af407370 2024-09-12T02:52:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f630b7fe640 1 -- 172.21.15.100:0/1904542234 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6310004220 con 0x5576af407370 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.684+0000 7f630b7fe640 1 -- 172.21.15.100:0/1904542234 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631000d7b0 con 0x5576af407370 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 -- 172.21.15.100:0/1904542234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af407370 msgr2=0x5576af41ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 --2- 172.21.15.100:0/1904542234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af407370 0x5576af41ed60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6310012fd0 tx=0x7f63100046e0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 -- 172.21.15.100:0/1904542234 shutdown_connections 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 --2- 172.21.15.100:0/1904542234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af407370 0x5576af41ed60 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 --2- 172.21.15.100:0/1904542234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af3fdb40 0x5576af402fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 --2- 172.21.15.100:0/1904542234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fc5d0 0x5576af413310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 -- 172.21.15.100:0/1904542234 >> 172.21.15.100:0/1904542234 conn(0x5576af3c5310 msgr2=0x5576af4028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 -- 172.21.15.100:0/1904542234 shutdown_connections 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 -- 172.21.15.100:0/1904542234 wait complete. 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 -- start start 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.685+0000 7f632a290740 1 Processor -- start 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f632a290740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fc5d0 0x5576af40b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f632a290740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fdb40 0x5576af40b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f632a290740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af40bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f632a290740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63201b2230 con 0x5576af3fc5d0 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f632a290740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f63201b36a0 con 0x5576af407370 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f632a290740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63201b2900 con 0x5576af3fdb40 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f632a290740 10 client.0 _ll_register_callbacks cb 0x7f631c00b2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fc5d0 0x5576af40b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fc5d0 0x5576af40b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57316/0 (socket says 172.21.15.100:57316) 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 -- 172.21.15.100:0/190701715 learned_addr learned my addr 172.21.15.100:0/190701715 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af40bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325c53640 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fdb40 0x5576af40b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 -- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fdb40 msgr2=0x5576af40b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fdb40 0x5576af40b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 -- 172.21.15.100:0/190701715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 msgr2=0x5576af40bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af40bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 -- 172.21.15.100:0/190701715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576af480e30 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f6325452640 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fc5d0 0x5576af40b2c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6310003fd0 tx=0x7f6310001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46be7d32ed2298e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f63097fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f63097fa640 1 -- 172.21.15.100:0/190701715 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310018040 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.686+0000 7f63097fa640 1 -- 172.21.15.100:0/190701715 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6310003730 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6310004220 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f63097fa640 1 -- 172.21.15.100:0/190701715 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6310003930 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 10 client.17883 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576af4820f0 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f63097fa640 1 -- 172.21.15.100:0/190701715 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6310004220 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f63097fa640 1 -- 172.21.15.100:0/190701715 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f631000d550 con 0x5576af3fc5d0 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 10 client.17883 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 10 client.17883 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 20 client.17883 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af4825c0 0x5576af4849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 4 client.17883 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576af369d70 con 0x5576af4825c0 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.687+0000 7f6325c53640 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af4825c0 0x5576af4849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f63097fa640 10 client.17883 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f6325c53640 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af4825c0 0x5576af4849b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd520ba0b5ae9585 server_cookie=d65ceade830f2c30 in_seq=0 out_seq=0 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f63097fa640 1 -- 172.21.15.100:0/190701715 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576af369d70 con 0x5576af4825c0 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f63097fa640 10 client.17883 handle_command_reply: tid=0 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 client.17883 shutdown 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fc5d0 msgr2=0x5576af40b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fc5d0 0x5576af40b2c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6310003fd0 tx=0x7f6310001e50 comp rx=0 tx=0).stop 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 shutdown_connections 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x5576af4825c0 0x5576af4849b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5576af407370 0x5576af40bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5576af3fdb40 0x5576af40b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 --2- 172.21.15.100:0/190701715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576af3fc5d0 0x5576af40b2c0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 >> 172.21.15.100:0/190701715 conn(0x5576af3c5310 msgr2=0x5576af4030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f63097fa640 0 client.17883 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:52:51.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 shutdown_connections 2024-09-12T02:52:51.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 1 -- 172.21.15.100:0/190701715 wait complete. 2024-09-12T02:52:51.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.688+0000 7f632a290740 20 client.17883 trim_cache size 0 max 16384 2024-09-12T02:52:51.705 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f630c0a2b80 msgr2=0x7f630c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f630c0a2b80 0x7f630c0a5040 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6318009dc0 tx=0x7f631808ba60 comp rx=0 tx=0).stop 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 msgr2=0x7f632019e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f632019e8d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6318006010 tx=0x7f631802f710 comp rx=0 tx=0).stop 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 shutdown_connections 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f630c0a2b80 0x7f630c0a5040 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6320112b90 0x7f632019e8d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6320074eb0 0x7f63201a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 --2- 172.21.15.100:0/2494587312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6320074590 0x7f63201a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 >> 172.21.15.100:0/2494587312 conn(0x7f63200fd8c0 msgr2=0x7f63200fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 shutdown_connections 2024-09-12T02:52:51.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:51.689+0000 7f6327eb7640 1 -- 172.21.15.100:0/2494587312 wait complete. 2024-09-12T02:52:52.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:52:52.614 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:53.006 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:52 smithi100 ceph-mon[31390]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-12T02:52:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 -- 172.21.15.100:0/3560595535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 msgr2=0x7f5ae41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 --2- 172.21.15.100:0/3560595535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41067e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009900 tx=0x7f5ad402a410 comp rx=0 tx=0).stop 2024-09-12T02:52:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 -- 172.21.15.100:0/3560595535 shutdown_connections 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 --2- 172.21.15.100:0/3560595535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ae4106f10 0x7f5ae410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 --2- 172.21.15.100:0/3560595535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41067e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 --2- 172.21.15.100:0/3560595535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ae4101de0 0x7f5ae41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 -- 172.21.15.100:0/3560595535 >> 172.21.15.100:0/3560595535 conn(0x7f5ae40fd8c0 msgr2=0x7f5ae40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 -- 172.21.15.100:0/3560595535 shutdown_connections 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 -- 172.21.15.100:0/3560595535 wait complete. 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.086+0000 7f5ae9069640 1 Processor -- start 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae9069640 1 -- start start 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae9069640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ae4101de0 0x7f5ae41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae9069640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae9069640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ae4106f10 0x7f5ae419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae9069640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4111f90 con 0x7f5ae4102790 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae9069640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4111e10 con 0x7f5ae4101de0 2024-09-12T02:52:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae9069640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4112110 con 0x7f5ae4106f10 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57336/0 (socket says 172.21.15.100:57336) 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 -- 172.21.15.100:0/2926178071 learned_addr learned my addr 172.21.15.100:0/2926178071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae359e640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ae4106f10 0x7f5ae419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ae4101de0 0x7f5ae41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 -- 172.21.15.100:0/2926178071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ae4106f10 msgr2=0x7f5ae419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ae4106f10 0x7f5ae419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 -- 172.21.15.100:0/2926178071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ae4101de0 msgr2=0x7f5ae41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ae4101de0 0x7f5ae41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 -- 172.21.15.100:0/2926178071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae419d460 con 0x7f5ae4102790 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ae4101de0 0x7f5ae41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae359e640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ae4106f10 0x7f5ae419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.087+0000 7f5ae259c640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41989f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4005ab0 tx=0x7f5ad40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.088+0000 7f5acbfff640 1 -- 172.21.15.100:0/2926178071 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad403f030 con 0x7f5ae4102790 2024-09-12T02:52:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.088+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae419d6f0 con 0x7f5ae4102790 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.088+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae41a5030 con 0x7f5ae4102790 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.088+0000 7f5acbfff640 1 -- 172.21.15.100:0/2926178071 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ad4003ce0 con 0x7f5ae4102790 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.088+0000 7f5acbfff640 1 -- 172.21.15.100:0/2926178071 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4049060 con 0x7f5ae4102790 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 Processor -- start 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5acbfff640 1 -- 172.21.15.100:0/2926178071 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f5ad4042030 con 0x7f5ae4102790 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 -- start start 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafe2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafe2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582daff3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5582daf482f0 con 0x5582dafe3b40 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5582daeefcf0 con 0x5582daff1780 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5aeb442740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5582daf442b0 con 0x5582dafe25d0 2024-09-12T02:52:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafe2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafe2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57340/0 (socket says 172.21.15.100:57340) 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 -- 172.21.15.100:0/2971089166 learned_addr learned my addr 172.21.15.100:0/2971089166 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae259c640 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582daff3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafe2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 -- 172.21.15.100:0/2971089166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 msgr2=0x5582dafe2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafe2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 -- 172.21.15.100:0/2971089166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 msgr2=0x5582daff3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582daff3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 -- 172.21.15.100:0/2971089166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582daed43a0 con 0x5582dafe3b40 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.091+0000 7f5ae359e640 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafe2090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c450 tx=0x7f5adc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5165080c3a80f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5acbfff640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5acc0a2c00 0x7f5acc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5ac97fa640 1 -- 172.21.15.100:0/2971089166 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc007430 con 0x5582dafe3b40 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5acc0a2c00 0x7f5acc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5ac97fa640 1 -- 172.21.15.100:0/2971089166 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5adc007ab0 con 0x5582dafe3b40 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5ac97fa640 1 -- 172.21.15.100:0/2971089166 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00aa30 con 0x5582dafe3b40 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5acbfff640 1 -- 172.21.15.100:0/2926178071 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5ad40ef690 con 0x7f5ae4102790 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5aeb442740 1 -- 172.21.15.100:0/2971089166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 msgr2=0x5582dafe2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5acc0a2c00 0x7f5acc0a50c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8005fd0 tx=0x7f5ad800b650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafe2090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c450 tx=0x7f5adc00c910 comp rx=0 tx=0).stop 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5aeb442740 1 -- 172.21.15.100:0/2971089166 shutdown_connections 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582daff3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafe2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2971089166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafe2090 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.092+0000 7f5aeb442740 1 -- 172.21.15.100:0/2971089166 >> 172.21.15.100:0/2971089166 conn(0x5582dafab310 msgr2=0x5582dafdec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 -- 172.21.15.100:0/2971089166 shutdown_connections 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 -- 172.21.15.100:0/2971089166 wait complete. 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 -- start start 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 Processor -- start 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe25d0 0x5582daff11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe3b40 0x5582dafee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582dafeea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5582daff4480 con 0x5582dafe25d0 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5582daf03060 con 0x5582daff1780 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5582daff4600 con 0x5582dafe3b40 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5aeb442740 10 client.0 _ll_register_callbacks cb 0x5582dac568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5ae2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe25d0 0x5582daff11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5ae2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe25d0 0x5582daff11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57348/0 (socket says 172.21.15.100:57348) 2024-09-12T02:52:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5ae2d9d640 1 -- 172.21.15.100:0/2221339738 learned_addr learned my addr 172.21.15.100:0/2221339738 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.093+0000 7f5ae359e640 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582dafeea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ae259c640 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe3b40 0x5582dafee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ae2d9d640 1 -- 172.21.15.100:0/2221339738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe3b40 msgr2=0x5582dafee450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe3b40 0x5582dafee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ae2d9d640 1 -- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 msgr2=0x5582dafeea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582dafeea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ae2d9d640 1 -- 172.21.15.100:0/2221339738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582dacb93c0 con 0x5582dafe25d0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe25d0 0x5582daff11a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8010b10 tx=0x7f5ad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45bb5fbd0a5f929 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ac6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/2221339738 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800dd90 con 0x5582dafe25d0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/2221339738 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5ad801d420 con 0x5582dafe25d0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5adc007ab0 con 0x5582dafe25d0 2024-09-12T02:52:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/2221339738 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5ad801d620 con 0x5582dafe25d0 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5aeb442740 10 client.17895 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5582daffffb0 con 0x5582dafe25d0 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/2221339738 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5adc007ab0 con 0x5582dafe25d0 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.094+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/2221339738 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5ad80258e0 con 0x5582dafe25d0 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5aeb442740 10 client.17895 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5aeb442740 10 client.17895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5aeb442740 20 client.17895 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db001470 0x5582db003860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5aeb442740 4 client.17895 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582daf55860 con 0x5582db001470 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5ae259c640 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db001470 0x5582db003860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5ac6ff5640 10 client.17895 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:53.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.095+0000 7f5ae259c640 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db001470 0x5582db003860 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7336150bfaa641e server_cookie=c860dddd7d8bd88e in_seq=0 out_seq=0 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/2221339738 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582daf55860 con 0x5582db001470 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5ac6ff5640 10 client.17895 handle_command_reply: tid=0 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 client.17895 shutdown 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe25d0 msgr2=0x5582daff11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe25d0 0x5582daff11a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8010b10 tx=0x7f5ad80046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 shutdown_connections 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db001470 0x5582db003860 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582daff1780 0x5582dafeea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe3b40 0x5582dafee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5ac6ff5640 0 client.17895 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 --2- 172.21.15.100:0/2221339738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe25d0 0x5582daff11a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 >> 172.21.15.100:0/2221339738 conn(0x5582dafab310 msgr2=0x5582dafe4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 shutdown_connections 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 1 -- 172.21.15.100:0/2221339738 wait complete. 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.096+0000 7f5aeb442740 20 client.17895 trim_cache size 0 max 16384 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 Processor -- start 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 -- start start 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe25d0 0x5582daffd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafedd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582daff1780 0x5582dafddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae41adc30 con 0x5582dafe3b40 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae41ab500 con 0x5582dafe25d0 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5aeb442740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae41a9350 con 0x5582daff1780 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafedd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafedd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57352/0 (socket says 172.21.15.100:57352) 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 -- 172.21.15.100:0/1841781159 learned_addr learned my addr 172.21.15.100:0/1841781159 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae359e640 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582daff1780 0x5582dafddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 -- 172.21.15.100:0/1841781159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582daff1780 msgr2=0x5582dafddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe25d0 0x5582daffd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582daff1780 0x5582dafddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 -- 172.21.15.100:0/1841781159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe25d0 msgr2=0x5582daffd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe25d0 0x5582daffd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.109+0000 7f5ae259c640 1 -- 172.21.15.100:0/1841781159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582dafed400 con 0x5582dafe3b40 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5ae359e640 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582daff1780 0x5582dafddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe25d0 0x5582daffd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5ae259c640 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafedd10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006010 tx=0x7f5ad402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952f2ec8c496c5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5ac8ff9640 1 -- 172.21.15.100:0/1841781159 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4035040 con 0x5582dafe3b40 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5ac8ff9640 1 -- 172.21.15.100:0/1841781159 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ad40bc5e0 con 0x5582dafe3b40 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5ac8ff9640 1 -- 172.21.15.100:0/1841781159 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad403bd00 con 0x5582dafe3b40 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 -- 172.21.15.100:0/1841781159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 msgr2=0x5582dafedd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafedd10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006010 tx=0x7f5ad402a410 comp rx=0 tx=0).stop 2024-09-12T02:52:53.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 -- 172.21.15.100:0/1841781159 shutdown_connections 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582daff1780 0x5582dafddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582dafe3b40 0x5582dafedd10 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1841781159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe25d0 0x5582daffd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 -- 172.21.15.100:0/1841781159 >> 172.21.15.100:0/1841781159 conn(0x5582dafab310 msgr2=0x5582dafdd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 -- 172.21.15.100:0/1841781159 shutdown_connections 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.110+0000 7f5aeb442740 1 -- 172.21.15.100:0/1841781159 wait complete. 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 -- start start 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 Processor -- start 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafeb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe3b40 0x5582dafeb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582daff1780 0x5582dafebec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae41a99c0 con 0x5582daff1780 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae41aae30 con 0x5582dafe3b40 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae41aa090 con 0x5582dafe25d0 2024-09-12T02:52:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5aeb442740 10 client.0 _ll_register_callbacks cb 0x7f5ad800b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5ae359e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582daff1780 0x5582dafebec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5ae359e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582daff1780 0x5582dafebec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57354/0 (socket says 172.21.15.100:57354) 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5ae359e640 1 -- 172.21.15.100:0/1128083448 learned_addr learned my addr 172.21.15.100:0/1128083448 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5ae259c640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe3b40 0x5582dafeb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5ae359e640 1 -- 172.21.15.100:0/1128083448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 msgr2=0x5582dafeb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafeb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.111+0000 7f5ae359e640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafeb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ae359e640 1 -- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe3b40 msgr2=0x5582dafeb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ae359e640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe3b40 0x5582dafeb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ae359e640 1 -- 172.21.15.100:0/1128083448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582db06b0b0 con 0x5582daff1780 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ae259c640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe3b40 0x5582dafeb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ae359e640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582daff1780 0x5582dafebec0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5adc004b90 tx=0x7f5adc016650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e0971a1640b1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ac6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/1128083448 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc01b040 con 0x5582daff1780 2024-09-12T02:52:53.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/1128083448 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5adc0167c0 con 0x5582daff1780 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ad40bc5e0 con 0x5582daff1780 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/1128083448 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5adc0169c0 con 0x5582daff1780 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 10 client.17901 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5582db06c2a0 con 0x5582daff1780 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/1128083448 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ad40bc5e0 con 0x5582daff1780 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/1128083448 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5adc01e070 con 0x5582daff1780 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 10 client.17901 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 10 client.17901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 20 client.17901 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db06c6e0 0x5582db06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 4 client.17901 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.112+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5582daf4fd70 con 0x5582db06c6e0 2024-09-12T02:52:53.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db06c6e0 0x5582db06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5ae2d9d640 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db06c6e0 0x5582db06ead0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b32753aee93d413 server_cookie=5381f27a22a5e185 in_seq=0 out_seq=0 2024-09-12T02:52:53.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5ac6ff5640 10 client.17901 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:53.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5ac6ff5640 1 -- 172.21.15.100:0/1128083448 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5582daf4fd70 con 0x5582db06c6e0 2024-09-12T02:52:53.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5ac6ff5640 10 client.17901 handle_command_reply: tid=0 2024-09-12T02:52:53.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 client.17901 shutdown 2024-09-12T02:52:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:52:53.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582daff1780 msgr2=0x5582dafebec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582daff1780 0x5582dafebec0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5adc004b90 tx=0x7f5adc016650 comp rx=0 tx=0).stop 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 shutdown_connections 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x5582db06c6e0 0x5582db06ead0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582daff1780 0x5582dafebec0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5582dafe3b40 0x5582dafeb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5ac6ff5640 0 client.17901 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 --2- 172.21.15.100:0/1128083448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582dafe25d0 0x5582dafeb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.113+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 >> 172.21.15.100:0/1128083448 conn(0x5582dafab310 msgr2=0x5582dafddd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 shutdown_connections 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5aeb442740 1 -- 172.21.15.100:0/1128083448 wait complete. 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5aeb442740 20 client.17901 trim_cache size 0 max 16384 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5acc0a2c00 msgr2=0x7f5acc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5acc0a2c00 0x7f5acc0a50c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8005fd0 tx=0x7f5ad800b650 comp rx=0 tx=0).stop 2024-09-12T02:52:53.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 msgr2=0x7f5ae41989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41989f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4005ab0 tx=0x7f5ad40042f0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 shutdown_connections 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5acc0a2c00 0x7f5acc0a50c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ae4106f10 0x7f5ae419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4102790 0x7f5ae41989f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 --2- 172.21.15.100:0/2926178071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ae4101de0 0x7f5ae41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 >> 172.21.15.100:0/2926178071 conn(0x7f5ae40fd8c0 msgr2=0x7f5ae40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 shutdown_connections 2024-09-12T02:52:53.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:53.114+0000 7f5ae9069640 1 -- 172.21.15.100:0/2926178071 wait complete. 2024-09-12T02:52:53.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:52 smithi189 ceph-mon[35196]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-12T02:52:53.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:52 smithi117 ceph-mon[34898]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-12T02:52:54.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:53 smithi100 ceph-mon[31390]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.0 MiB/s wr, 44 op/s 2024-09-12T02:52:54.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:53 smithi189 ceph-mon[35196]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.0 MiB/s wr, 44 op/s 2024-09-12T02:52:54.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:53 smithi117 ceph-mon[34898]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.0 MiB/s wr, 44 op/s 2024-09-12T02:52:54.875 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:52:54.875 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:52:55.128 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 -- 172.21.15.100:0/3176973413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 msgr2=0x7f7d6c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 --2- 172.21.15.100:0/3176973413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c103110 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009930 tx=0x7f7d5c02a420 comp rx=0 tx=0).stop 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 -- 172.21.15.100:0/3176973413 shutdown_connections 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 --2- 172.21.15.100:0/3176973413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d6c1082a0 0x7f7d6c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 --2- 172.21.15.100:0/3176973413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d6c1036e0 0x7f7d6c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 --2- 172.21.15.100:0/3176973413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c103110 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 -- 172.21.15.100:0/3176973413 >> 172.21.15.100:0/3176973413 conn(0x7f7d6c0fc7d0 msgr2=0x7f7d6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 -- 172.21.15.100:0/3176973413 shutdown_connections 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 -- 172.21.15.100:0/3176973413 wait complete. 2024-09-12T02:52:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.584+0000 7f7d71048640 1 Processor -- start 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d71048640 1 -- start start 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d71048640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d71048640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d6c1036e0 0x7f7d6c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d71048640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d6c1082a0 0x7f7d6c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d71048640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1120a0 con 0x7f7d6c102d30 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d71048640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c111f20 con 0x7f7d6c1082a0 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d71048640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c112220 con 0x7f7d6c1036e0 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57752/0 (socket says 172.21.15.100:57752) 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/3402498815 learned_addr learned my addr 172.21.15.100:0/3402498815 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6b59e640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d6c1082a0 0x7f7d6c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d6c1036e0 0x7f7d6c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/3402498815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d6c1036e0 msgr2=0x7f7d6c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d6c1036e0 0x7f7d6c198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/3402498815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d6c1082a0 msgr2=0x7f7d6c19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d6c1082a0 0x7f7d6c19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/3402498815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c19d5a0 con 0x7f7d6c102d30 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.585+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c1985f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009230 tx=0x7f7d5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.586+0000 7f7d63fff640 1 -- 172.21.15.100:0/3402498815 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c03f030 con 0x7f7d6c102d30 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.586+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c19d830 con 0x7f7d6c102d30 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.586+0000 7f7d63fff640 1 -- 172.21.15.100:0/3402498815 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d5c003ad0 con 0x7f7d6c102d30 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.586+0000 7f7d63fff640 1 -- 172.21.15.100:0/3402498815 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c035070 con 0x7f7d6c102d30 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.586+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c1a5170 con 0x7f7d6c102d30 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.588+0000 7f7d63fff640 1 -- 172.21.15.100:0/3402498815 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7d5c042030 con 0x7f7d6c102d30 2024-09-12T02:52:55.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.588+0000 7f7d73421740 1 Processor -- start 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.588+0000 7f7d73421740 1 -- start start 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.588+0000 7f7d73421740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc55ea40 0x55abbc55ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d73421740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d73421740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc56e150 0x55abbc570540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d73421740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55abbc4c4280 con 0x55abbc56e150 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d73421740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55abbc46bb10 con 0x55abbc55ea40 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d73421740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abbc4c0240 con 0x55abbc55f360 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc56e150 0x55abbc570540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc56e150 0x55abbc570540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57768/0 (socket says 172.21.15.100:57768) 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 -- 172.21.15.100:0/2241699560 learned_addr learned my addr 172.21.15.100:0/2241699560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6b59e640 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc55ea40 0x55abbc55ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 -- 172.21.15.100:0/2241699560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 msgr2=0x55abbc56dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 -- 172.21.15.100:0/2241699560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc55ea40 msgr2=0x55abbc55ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc55ea40 0x55abbc55ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 -- 172.21.15.100:0/2241699560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abbc4781f0 con 0x55abbc56e150 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc56e150 0x55abbc570540 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009ec0 tx=0x7f7d5400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e26f122a4d0472 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d63fff640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d580a2b80 0x7f7d580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d617fa640 1 -- 172.21.15.100:0/2241699560 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54003b70 con 0x55abbc56e150 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d617fa640 1 -- 172.21.15.100:0/2241699560 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d54003d10 con 0x55abbc56e150 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.589+0000 7f7d617fa640 1 -- 172.21.15.100:0/2241699560 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d540119d0 con 0x55abbc56e150 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d6b59e640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d580a2b80 0x7f7d580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d63fff640 1 -- 172.21.15.100:0/3402498815 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7d5c0ef780 con 0x7f7d6c102d30 2024-09-12T02:52:55.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d6b59e640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d580a2b80 0x7f7d580a5040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005fd0 tx=0x7f7d6400d5b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 -- 172.21.15.100:0/2241699560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc56e150 msgr2=0x55abbc570540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc56e150 0x55abbc570540 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009ec0 tx=0x7f7d5400f730 comp rx=0 tx=0).stop 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 -- 172.21.15.100:0/2241699560 shutdown_connections 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc56e150 0x55abbc570540 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 --2- 172.21.15.100:0/2241699560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc55ea40 0x55abbc55ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 -- 172.21.15.100:0/2241699560 >> 172.21.15.100:0/2241699560 conn(0x55abbc55b0f0 msgr2=0x55abbc55b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 -- 172.21.15.100:0/2241699560 shutdown_connections 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.590+0000 7f7d73421740 1 -- 172.21.15.100:0/2241699560 wait complete. 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 -- start start 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 Processor -- start 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc56b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc56bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55abbc570d20 con 0x55abbc55ea40 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55abbc47ef10 con 0x55abbc56e150 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abbc570ea0 con 0x55abbc55f360 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d73421740 10 client.0 _ll_register_callbacks cb 0x55abbc447a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc56b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc56b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57780/0 (socket says 172.21.15.100:57780) 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1690184689 learned_addr learned my addr 172.21.15.100:0/1690184689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1690184689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 msgr2=0x55abbc56b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1690184689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 msgr2=0x55abbc56bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc56bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.591+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1690184689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abbc2356a0 con 0x55abbc55ea40 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc56b030 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009900 tx=0x7f7d5c0bbb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de097c01093bf72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d527fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d527fc640 1 -- 172.21.15.100:0/1690184689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c049050 con 0x55abbc55ea40 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d527fc640 1 -- 172.21.15.100:0/1690184689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7d5c03bd60 con 0x55abbc55ea40 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d54003d10 con 0x55abbc55ea40 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d527fc640 1 -- 172.21.15.100:0/1690184689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7d5c0bc6d0 con 0x55abbc55ea40 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 10 client.17913 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abbc57c960 con 0x55abbc55ea40 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d527fc640 1 -- 172.21.15.100:0/1690184689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d54003d10 con 0x55abbc55ea40 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d527fc640 1 -- 172.21.15.100:0/1690184689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7d5c0035f0 con 0x55abbc55ea40 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 10 client.17913 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 10 client.17913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 20 client.17913 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc57dd50 0x55abbc5801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 4 client.17913 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:55.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.592+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abbc4d17f0 con 0x55abbc57dd50 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.593+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc57dd50 0x55abbc5801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.593+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc57dd50 0x55abbc5801a0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e9f114b7fd565db server_cookie=6dcf25833e1499bf in_seq=0 out_seq=0 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.593+0000 7f7d527fc640 10 client.17913 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d527fc640 1 -- 172.21.15.100:0/1690184689 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55abbc4d17f0 con 0x55abbc57dd50 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d527fc640 10 client.17913 handle_command_reply: tid=0 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 client.17913 shutdown 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 msgr2=0x55abbc56b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc56b030 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009900 tx=0x7f7d5c0bbb10 comp rx=0 tx=0).stop 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 shutdown_connections 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc57dd50 0x55abbc5801a0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc56bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc56b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d527fc640 0 client.17913 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:55.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 --2- 172.21.15.100:0/1690184689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc56b030 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 >> 172.21.15.100:0/1690184689 conn(0x55abbc55b0f0 msgr2=0x55abbc560e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 shutdown_connections 2024-09-12T02:52:55.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 1 -- 172.21.15.100:0/1690184689 wait complete. 2024-09-12T02:52:55.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.594+0000 7f7d73421740 20 client.17913 trim_cache size 0 max 16384 2024-09-12T02:52:55.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.611+0000 7f7d73421740 1 Processor -- start 2024-09-12T02:52:55.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.611+0000 7f7d73421740 1 -- start start 2024-09-12T02:52:55.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d73421740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55ea40 0x55abbc585a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d73421740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55f360 0x55abbc585fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d73421740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc568290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d73421740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1adcf0 con 0x55abbc55f360 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d73421740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1ab5c0 con 0x55abbc56e150 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d73421740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1a9410 con 0x55abbc55ea40 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55f360 0x55abbc585fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6ad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55ea40 0x55abbc585a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55f360 0x55abbc585fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57794/0 (socket says 172.21.15.100:57794) 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 -- 172.21.15.100:0/454664764 learned_addr learned my addr 172.21.15.100:0/454664764 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6b59e640 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc568290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 -- 172.21.15.100:0/454664764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55ea40 msgr2=0x55abbc585a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55ea40 0x55abbc585a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 -- 172.21.15.100:0/454664764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 msgr2=0x55abbc568290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc568290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6a59c640 1 -- 172.21.15.100:0/454664764 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abbc55f880 con 0x55abbc55f360 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.612+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55ea40 0x55abbc585a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.613+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55f360 0x55abbc585fc0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009de0 tx=0x7f7d540092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3481cf091a782cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.613+0000 7f7d60ff9640 1 -- 172.21.15.100:0/454664764 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54004ba0 con 0x55abbc55f360 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.613+0000 7f7d60ff9640 1 -- 172.21.15.100:0/454664764 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d54004d40 con 0x55abbc55f360 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.613+0000 7f7d60ff9640 1 -- 172.21.15.100:0/454664764 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d540287a0 con 0x55abbc55f360 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.613+0000 7f7d73421740 1 -- 172.21.15.100:0/454664764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55f360 msgr2=0x55abbc585fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.613+0000 7f7d73421740 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55f360 0x55abbc585fc0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009de0 tx=0x7f7d540092a0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- 172.21.15.100:0/454664764 shutdown_connections 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc568290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55f360 0x55abbc585fc0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 --2- 172.21.15.100:0/454664764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55ea40 0x55abbc585a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- 172.21.15.100:0/454664764 >> 172.21.15.100:0/454664764 conn(0x55abbc55b0f0 msgr2=0x55abbc55a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- 172.21.15.100:0/454664764 shutdown_connections 2024-09-12T02:52:55.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- 172.21.15.100:0/454664764 wait complete. 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- start start 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 Processor -- start 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc576620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc572960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc572ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1a9a80 con 0x55abbc55ea40 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1aaef0 con 0x55abbc56e150 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1aa150 con 0x55abbc55f360 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d73421740 10 client.0 _ll_register_callbacks cb 0x7f7d5c0b8270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc576620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.614+0000 7f7d6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc576620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57796/0 (socket says 172.21.15.100:57796) 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1535283593 learned_addr learned my addr 172.21.15.100:0/1535283593 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc572960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1535283593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 msgr2=0x55abbc572960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc572960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6b59e640 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc572ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 msgr2=0x55abbc572ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc572ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6ad9d640 1 -- 172.21.15.100:0/1535283593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abbc55af20 con 0x55abbc55ea40 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d6ad9d640 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc576620 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b8430 tx=0x7f7d5c0bbfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7ff2e74a490e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d527fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d527fc640 1 -- 172.21.15.100:0/1535283593 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c049070 con 0x55abbc55ea40 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d527fc640 1 -- 172.21.15.100:0/1535283593 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7d5c03bd60 con 0x55abbc55ea40 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d54004d40 con 0x55abbc55ea40 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d527fc640 1 -- 172.21.15.100:0/1535283593 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7d5c0c4c40 con 0x55abbc55ea40 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d73421740 10 client.17919 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:55.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abbc5e9660 con 0x55abbc55ea40 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.615+0000 7f7d527fc640 1 -- 172.21.15.100:0/1535283593 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d54004d40 con 0x55abbc55ea40 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d527fc640 1 -- 172.21.15.100:0/1535283593 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7d5c0b6b40 con 0x55abbc55ea40 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d73421740 10 client.17919 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d73421740 10 client.17919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d73421740 20 client.17919 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d73421740 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc5e9bf0 0x55abbc5ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d73421740 4 client.17919 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55abbc4cbd00 con 0x55abbc5e9bf0 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc5e9bf0 0x55abbc5ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d6a59c640 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc5e9bf0 0x55abbc5ebfe0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60f5eb3c5e775f0b server_cookie=7733eebb082e7592 in_seq=0 out_seq=0 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.616+0000 7f7d527fc640 10 client.17919 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d527fc640 1 -- 172.21.15.100:0/1535283593 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55abbc4cbd00 con 0x55abbc5e9bf0 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d527fc640 10 client.17919 handle_command_reply: tid=0 2024-09-12T02:52:55.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 client.17919 shutdown 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 msgr2=0x55abbc576620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc576620 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b8430 tx=0x7f7d5c0bbfd0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 shutdown_connections 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55abbc5e9bf0 0x55abbc5ebfe0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55abbc56e150 0x55abbc572ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abbc55f360 0x55abbc572960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 --2- 172.21.15.100:0/1535283593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abbc55ea40 0x55abbc576620 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 >> 172.21.15.100:0/1535283593 conn(0x55abbc55b0f0 msgr2=0x55abbc56c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d527fc640 0 client.17919 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 shutdown_connections 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.617+0000 7f7d73421740 1 -- 172.21.15.100:0/1535283593 wait complete. 2024-09-12T02:52:55.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d73421740 20 client.17919 trim_cache size 0 max 16384 2024-09-12T02:52:55.629 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:55.629 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:52:55.629 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "ec042056-02aa-47ae-aa34-de40f2d888e6", 2024-09-12T02:52:55.629 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:52:55.629 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:55.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d580a2b80 msgr2=0x7f7d580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d580a2b80 0x7f7d580a5040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005fd0 tx=0x7f7d6400d5b0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 msgr2=0x7f7d6c1985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c1985f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009230 tx=0x7f7d5c004270 comp rx=0 tx=0).stop 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 shutdown_connections 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7d580a2b80 0x7f7d580a5040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d6c1082a0 0x7f7d6c19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d6c1036e0 0x7f7d6c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 --2- 172.21.15.100:0/3402498815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c102d30 0x7f7d6c1985f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 >> 172.21.15.100:0/3402498815 conn(0x7f7d6c0fc7d0 msgr2=0x7f7d6c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 shutdown_connections 2024-09-12T02:52:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:55.618+0000 7f7d71048640 1 -- 172.21.15.100:0/3402498815 wait complete. 2024-09-12T02:52:55.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:55 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:52:55.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:55 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:55.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:55 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:52:56.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:55 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:52:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:55 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:56.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:55 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:52:56.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:55 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:52:56.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:55 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:56.096 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:55 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:52:56.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:52:56.356 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:52:56.599 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:52:57.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:56 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:52:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:56 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:56 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:57.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:56 smithi189 ceph-mon[35196]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 912 KiB/s wr, 40 op/s 2024-09-12T02:52:57.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:56 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:52:57.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:56 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:57.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:56 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:57.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:56 smithi100 ceph-mon[31390]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 912 KiB/s wr, 40 op/s 2024-09-12T02:52:57.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:56 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:52:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:56 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:56 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:52:57.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:56 smithi117 ceph-mon[34898]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 912 KiB/s wr, 40 op/s 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.115+0000 7f84311fa640 1 -- 172.21.15.100:0/1937395045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c102790 msgr2=0x7f842c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.115+0000 7f84311fa640 1 --2- 172.21.15.100:0/1937395045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c102790 0x7f842c1067e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8414009900 tx=0x7f841402a410 comp rx=0 tx=0).stop 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.115+0000 7f84311fa640 1 -- 172.21.15.100:0/1937395045 shutdown_connections 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.115+0000 7f84311fa640 1 --2- 172.21.15.100:0/1937395045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c106f10 0x7f842c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.115+0000 7f84311fa640 1 --2- 172.21.15.100:0/1937395045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c102790 0x7f842c1067e0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.115+0000 7f84311fa640 1 --2- 172.21.15.100:0/1937395045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842c101de0 0x7f842c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.115+0000 7f84311fa640 1 -- 172.21.15.100:0/1937395045 >> 172.21.15.100:0/1937395045 conn(0x7f842c0fd8c0 msgr2=0x7f842c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.116+0000 7f84311fa640 1 -- 172.21.15.100:0/1937395045 shutdown_connections 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.116+0000 7f84311fa640 1 -- 172.21.15.100:0/1937395045 wait complete. 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.116+0000 7f84311fa640 1 Processor -- start 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.116+0000 7f84311fa640 1 -- start start 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.116+0000 7f84311fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842c101de0 0x7f842c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.116+0000 7f84311fa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102790 0x7f842c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f84311fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c106f10 0x7f842c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f84311fa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f842c111fc0 con 0x7f842c106f10 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f84311fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f842c111e40 con 0x7f842c101de0 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f84311fa640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f842c112140 con 0x7f842c102790 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c106f10 0x7f842c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c106f10 0x7f842c19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57814/0 (socket says 172.21.15.100:57814) 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 -- 172.21.15.100:0/140884335 learned_addr learned my addr 172.21.15.100:0/140884335 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f8423fff640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102790 0x7f842c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842ad9d640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842c101de0 0x7f842c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 -- 172.21.15.100:0/140884335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102790 msgr2=0x7f842c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102790 0x7f842c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 -- 172.21.15.100:0/140884335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842c101de0 msgr2=0x7f842c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842c101de0 0x7f842c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 -- 172.21.15.100:0/140884335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c19f670 con 0x7f842c106f10 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f842b59e640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c106f10 0x7f842c19ef90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f842400eaa0 tx=0x7f842400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f8428d99640 1 -- 172.21.15.100:0/140884335 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842400cdb0 con 0x7f842c106f10 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f8428d99640 1 -- 172.21.15.100:0/140884335 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8424005020 con 0x7f842c106f10 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f8428d99640 1 -- 172.21.15.100:0/140884335 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84240116b0 con 0x7f842c106f10 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c19f960 con 0x7f842c106f10 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.117+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c1a7240 con 0x7f842c106f10 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.119+0000 7f8428d99640 1 -- 172.21.15.100:0/140884335 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f8424005560 con 0x7f842c106f10 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 Processor -- start 2024-09-12T02:52:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 -- start start 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621430344a0 0x562143034880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143034dc0 0x56214303f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56214303f680 0x562143041a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562142f9a2e0 con 0x56214303f680 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f8428d99640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84180a2b80 0x7f84180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562142f41ce0 con 0x562143034dc0 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f84335d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562142f962a0 con 0x5621430344a0 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f8423fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56214303f680 0x562143041a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.120+0000 7f842b59e640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84180a2b80 0x7f84180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56214303f680 0x562143041a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57820/0 (socket says 172.21.15.100:57820) 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 -- 172.21.15.100:0/657150921 learned_addr learned my addr 172.21.15.100:0/657150921 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f842ad9d640 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143034dc0 0x56214303f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8428d99640 1 -- 172.21.15.100:0/140884335 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f84240cf190 con 0x7f842c106f10 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621430344a0 0x562143034880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 -- 172.21.15.100:0/657150921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621430344a0 msgr2=0x562143034880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621430344a0 0x562143034880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 -- 172.21.15.100:0/657150921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143034dc0 msgr2=0x56214303f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143034dc0 0x56214303f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 -- 172.21.15.100:0/657150921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562142f26440 con 0x56214303f680 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f842ad9d640 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143034dc0 0x56214303f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f842b59e640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84180a2b80 0x7f84180a5040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f84240ccff0 tx=0x7f8424090f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f8423fff640 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56214303f680 0x562143041a70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8414009900 tx=0x7f8414009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9666c78e91d60082 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f84217fa640 1 -- 172.21.15.100:0/657150921 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414035040 con 0x56214303f680 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f84217fa640 1 -- 172.21.15.100:0/657150921 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8414005520 con 0x56214303f680 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.121+0000 7f84217fa640 1 -- 172.21.15.100:0/657150921 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414003810 con 0x56214303f680 2024-09-12T02:52:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 -- 172.21.15.100:0/657150921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56214303f680 msgr2=0x562143041a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56214303f680 0x562143041a70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8414009900 tx=0x7f8414009560 comp rx=0 tx=0).stop 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 -- 172.21.15.100:0/657150921 shutdown_connections 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56214303f680 0x562143041a70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143034dc0 0x56214303f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 --2- 172.21.15.100:0/657150921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621430344a0 0x562143034880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 -- 172.21.15.100:0/657150921 >> 172.21.15.100:0/657150921 conn(0x562143030a30 msgr2=0x562143030e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 -- 172.21.15.100:0/657150921 shutdown_connections 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 -- 172.21.15.100:0/657150921 wait complete. 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 -- start start 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.122+0000 7f84335d3740 1 Processor -- start 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x56214303ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x56214303c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56214303f680 0x56214303c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562143042250 con 0x5621430344a0 2024-09-12T02:52:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562142f55050 con 0x56214303f680 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5621430423d0 con 0x562143034dc0 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 10 client.0 _ll_register_callbacks cb 0x562142f95160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x56214303ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x56214303ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57834/0 (socket says 172.21.15.100:57834) 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 -- 172.21.15.100:0/1749111079 learned_addr learned my addr 172.21.15.100:0/1749111079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f842ad9d640 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x56214303c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56214303f680 0x56214303c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 -- 172.21.15.100:0/1749111079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 msgr2=0x56214303c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x56214303c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 -- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56214303f680 msgr2=0x56214303c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56214303f680 0x56214303c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 -- 172.21.15.100:0/1749111079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562142d0b3c0 con 0x5621430344a0 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f8423fff640 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x56214303ef50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8414001eb0 tx=0x7f8414004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c98c796d24e5269 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84127fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84127fc640 1 -- 172.21.15.100:0/1749111079 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414035070 con 0x5621430344a0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84127fc640 1 -- 172.21.15.100:0/1749111079 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8414005040 con 0x5621430344a0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.123+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8414005520 con 0x5621430344a0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84127fc640 1 -- 172.21.15.100:0/1749111079 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8414005240 con 0x5621430344a0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 10 client.17931 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56214304dba0 con 0x5621430344a0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84127fc640 1 -- 172.21.15.100:0/1749111079 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8414005520 con 0x5621430344a0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84127fc640 1 -- 172.21.15.100:0/1749111079 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8414003780 con 0x5621430344a0 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 10 client.17931 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 10 client.17931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 20 client.17931 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214304eef0 0x5621430512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 4 client.17931 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562142fa7850 con 0x56214304eef0 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.124+0000 7f842ad9d640 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214304eef0 0x5621430512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.125+0000 7f842ad9d640 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214304eef0 0x5621430512e0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c940afad469badee server_cookie=efd0164f4d94e99b in_seq=0 out_seq=0 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.125+0000 7f84127fc640 10 client.17931 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.125+0000 7f84127fc640 1 -- 172.21.15.100:0/1749111079 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562142fa7850 con 0x56214304eef0 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.125+0000 7f84127fc640 10 client.17931 handle_command_reply: tid=0 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.125+0000 7f84335d3740 1 client.17931 shutdown 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.125+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 msgr2=0x56214303ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.125+0000 7f84335d3740 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x56214303ef50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8414001eb0 tx=0x7f8414004dd0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 shutdown_connections 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214304eef0 0x5621430512e0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56214303f680 0x56214303c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x56214303c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84127fc640 0 client.17931 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 --2- 172.21.15.100:0/1749111079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x56214303ef50 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 >> 172.21.15.100:0/1749111079 conn(0x562143030a30 msgr2=0x562143036710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 shutdown_connections 2024-09-12T02:52:57.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 1 -- 172.21.15.100:0/1749111079 wait complete. 2024-09-12T02:52:57.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.126+0000 7f84335d3740 20 client.17931 trim_cache size 0 max 16384 2024-09-12T02:52:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.143+0000 7f84335d3740 1 Processor -- start 2024-09-12T02:52:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.143+0000 7f84335d3740 1 -- start start 2024-09-12T02:52:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f84335d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143030a30 0x56214303c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f84335d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x5621430377a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f84335d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x562143054300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f84335d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1b1fd0 con 0x5621430344a0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f84335d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1af8a0 con 0x562143030a30 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f84335d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1ad6f0 con 0x562143034dc0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x5621430377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x5621430377a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57848/0 (socket says 172.21.15.100:57848) 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 -- 172.21.15.100:0/1914452842 learned_addr learned my addr 172.21.15.100:0/1914452842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f8423fff640 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143030a30 0x56214303c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 -- 172.21.15.100:0/1914452842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 msgr2=0x562143054300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x562143054300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 -- 172.21.15.100:0/1914452842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143030a30 msgr2=0x56214303c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143030a30 0x56214303c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 -- 172.21.15.100:0/1914452842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56214303f2c0 con 0x5621430344a0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f842ad9d640 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x5621430377a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f841c005d00 tx=0x7f841c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d357a580710a01eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f8420ff9640 1 -- 172.21.15.100:0/1914452842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c004220 con 0x5621430344a0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f8420ff9640 1 -- 172.21.15.100:0/1914452842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f841c0043c0 con 0x5621430344a0 2024-09-12T02:52:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.144+0000 7f8420ff9640 1 -- 172.21.15.100:0/1914452842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c01db50 con 0x5621430344a0 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 -- 172.21.15.100:0/1914452842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 msgr2=0x5621430377a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x5621430377a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f841c005d00 tx=0x7f841c00b410 comp rx=0 tx=0).stop 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 -- 172.21.15.100:0/1914452842 shutdown_connections 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x562143054300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621430344a0 0x5621430377a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 --2- 172.21.15.100:0/1914452842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562143030a30 0x56214303c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 -- 172.21.15.100:0/1914452842 >> 172.21.15.100:0/1914452842 conn(0x56214303c8a0 msgr2=0x562143037090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 -- 172.21.15.100:0/1914452842 shutdown_connections 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.145+0000 7f84335d3740 1 -- 172.21.15.100:0/1914452842 wait complete. 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 -- start start 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 Processor -- start 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562143030a30 0x562143054a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621430344a0 0x562143051dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x562143052310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1add60 con 0x562143030a30 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1af1d0 con 0x5621430344a0 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1ae430 con 0x562143034dc0 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84335d3740 10 client.0 _ll_register_callbacks cb 0x7f841c00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562143030a30 0x562143054a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562143030a30 0x562143054a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57850/0 (socket says 172.21.15.100:57850) 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 -- 172.21.15.100:0/466798067 learned_addr learned my addr 172.21.15.100:0/466798067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f842ad9d640 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621430344a0 0x562143051dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 -- 172.21.15.100:0/466798067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 msgr2=0x562143052310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x562143052310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 -- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621430344a0 msgr2=0x562143051dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621430344a0 0x562143051dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 -- 172.21.15.100:0/466798067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562143052b60 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f8423fff640 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562143030a30 0x562143054a80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f84140092a0 tx=0x7f8414004140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bd74d2478defd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.146+0000 7f84127fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84127fc640 1 -- 172.21.15.100:0/466798067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414035040 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84127fc640 1 -- 172.21.15.100:0/466798067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8414004dd0 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f841c0043c0 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84127fc640 1 -- 172.21.15.100:0/466798067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8414004fd0 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 10 client.17937 fetch_fsmap learned FSMap version 27 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5621430b9870 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84127fc640 1 -- 172.21.15.100:0/466798067 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84140474f0 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84127fc640 1 -- 172.21.15.100:0/466798067 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8414058470 con 0x562143030a30 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 10 client.17937 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 10 client.17937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 20 client.17937 populate_metadata read hostname 'smithi100' 2024-09-12T02:52:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214303f680 0x5621430bbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 4 client.17937 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f841c0043c0 con 0x56214303f680 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.147+0000 7f842ad9d640 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214303f680 0x5621430bbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84127fc640 10 client.17937 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f842ad9d640 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214303f680 0x5621430bbee0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d47cd5894f09fd server_cookie=225b3a231d1f5da8 in_seq=0 out_seq=0 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84127fc640 1 -- 172.21.15.100:0/466798067 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f841c0043c0 con 0x56214303f680 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84127fc640 10 client.17937 handle_command_reply: tid=0 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 client.17937 shutdown 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562143030a30 msgr2=0x562143054a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562143030a30 0x562143054a80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f84140092a0 tx=0x7f8414004140 comp rx=0 tx=0).stop 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 shutdown_connections 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x56214303f680 0x5621430bbee0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562143034dc0 0x562143052310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5621430344a0 0x562143051dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 --2- 172.21.15.100:0/466798067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562143030a30 0x562143054a80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 >> 172.21.15.100:0/466798067 conn(0x56214303c8a0 msgr2=0x562143037870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84127fc640 0 client.17937 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 shutdown_connections 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 1 -- 172.21.15.100:0/466798067 wait complete. 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.148+0000 7f84335d3740 20 client.17937 trim_cache size 0 max 16384 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:52:57.156 INFO:teuthology.orchestra.run.smithi100.stdout: "ec042056-02aa-47ae-aa34-de40f2d888e6": { 2024-09-12T02:52:57.157 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:52:57.157 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "ec042056-02aa-47ae-aa34-de40f2d888e6", 2024-09-12T02:52:57.157 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:52:57.157 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:57.157 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:52:57.157 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84180a2b80 msgr2=0x7f84180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84180a2b80 0x7f84180a5040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f84240ccff0 tx=0x7f8424090f70 comp rx=0 tx=0).stop 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c106f10 msgr2=0x7f842c19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c106f10 0x7f842c19ef90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f842400eaa0 tx=0x7f842400ef60 comp rx=0 tx=0).stop 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 shutdown_connections 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f84180a2b80 0x7f84180a5040 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f842c106f10 0x7f842c19ef90 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102790 0x7f842c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 --2- 172.21.15.100:0/140884335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842c101de0 0x7f842c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 >> 172.21.15.100:0/140884335 conn(0x7f842c0fd8c0 msgr2=0x7f842c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 shutdown_connections 2024-09-12T02:52:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:52:57.149+0000 7f84311fa640 1 -- 172.21.15.100:0/140884335 wait complete. 2024-09-12T02:52:57.858 INFO:tasks.cephfs.filesystem:scrub status for tag:ec042056-02aa-47ae-aa34-de40f2d888e6 - {'path': '/', 'tag': 'ec042056-02aa-47ae-aa34-de40f2d888e6', 'options': 'recursive,force'} 2024-09-12T02:52:59.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:52:58 smithi100 ceph-mon[31390]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 841 KiB/s wr, 39 op/s 2024-09-12T02:52:59.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:52:58 smithi189 ceph-mon[35196]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 841 KiB/s wr, 39 op/s 2024-09-12T02:52:59.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:52:58 smithi117 ceph-mon[34898]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 841 KiB/s wr, 39 op/s 2024-09-12T02:53:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:00 smithi189 ceph-mon[35196]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-12T02:53:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:53:01.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:00 smithi117 ceph-mon[34898]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-12T02:53:01.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:00 smithi100 ceph-mon[31390]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-12T02:53:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:02 smithi189 ceph-mon[35196]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 96 op/s 2024-09-12T02:53:03.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:02 smithi117 ceph-mon[34898]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 96 op/s 2024-09-12T02:53:03.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:02 smithi100 ceph-mon[31390]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 96 op/s 2024-09-12T02:53:04.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:53:04.292 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:04.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3706529994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 msgr2=0x7fdb301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3706529994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb301029b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009900 tx=0x7fdb1c02a480 comp rx=0 tx=0).stop 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3706529994 shutdown_connections 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3706529994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb30102ef0 0x7fdb3010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3706529994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb301029b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3706529994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb30100e20 0x7fdb30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3706529994 >> 172.21.15.100:0/3706529994 conn(0x7fdb300fc7d0 msgr2=0x7fdb300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3706529994 shutdown_connections 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3706529994 wait complete. 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 Processor -- start 2024-09-12T02:53:04.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.790+0000 7fdb36f4d640 1 -- start start 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb36f4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb30100e20 0x7fdb30197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb36f4d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb30197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb36f4d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb30102ef0 0x7fdb3019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb36f4d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30110fa0 con 0x7fdb30102570 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb36f4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30110e20 con 0x7fdb30100e20 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb36f4d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30111120 con 0x7fdb30102ef0 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb30197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb30197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56666/0 (socket says 172.21.15.100:56666) 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 -- 172.21.15.100:0/3630154562 learned_addr learned my addr 172.21.15.100:0/3630154562 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb34ce9640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb30100e20 0x7fdb30197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb354ea640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb30102ef0 0x7fdb3019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 -- 172.21.15.100:0/3630154562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb30102ef0 msgr2=0x7fdb3019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb30102ef0 0x7fdb3019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 -- 172.21.15.100:0/3630154562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb30100e20 msgr2=0x7fdb30197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb30100e20 0x7fdb30197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 -- 172.21.15.100:0/3630154562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3019c3b0 con 0x7fdb30102570 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb354ea640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb30102ef0 0x7fdb3019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2ffff640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb30197940 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c006010 tx=0x7fdb1c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.791+0000 7fdb2dffb640 1 -- 172.21.15.100:0/3630154562 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c03f070 con 0x7fdb30102570 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.792+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3019c640 con 0x7fdb30102570 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.792+0000 7fdb2dffb640 1 -- 172.21.15.100:0/3630154562 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb1c031e30 con 0x7fdb30102570 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.792+0000 7fdb2dffb640 1 -- 172.21.15.100:0/3630154562 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c035030 con 0x7fdb30102570 2024-09-12T02:53:04.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.792+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb301a3f80 con 0x7fdb30102570 2024-09-12T02:53:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.793+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb30101200 con 0x7fdb30102570 2024-09-12T02:53:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.794+0000 7fdb2dffb640 1 -- 172.21.15.100:0/3630154562 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fdb1c042070 con 0x7fdb30102570 2024-09-12T02:53:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.795+0000 7fdb2dffb640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdb200a2b80 0x7fdb200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.795+0000 7fdb34ce9640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdb200a2b80 0x7fdb200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.795+0000 7fdb2dffb640 1 -- 172.21.15.100:0/3630154562 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdb1c0ef940 con 0x7fdb30102570 2024-09-12T02:53:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.795+0000 7fdb34ce9640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdb200a2b80 0x7fdb200a5040 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009990 tx=0x7fdb24009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:04.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:04.799+0000 7fdb2dffb640 1 -- 172.21.15.100:0/3630154562 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb1c0bc890 con 0x7fdb30102570 2024-09-12T02:53:04.986 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:04 smithi100 ceph-mon[31390]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 101 op/s 2024-09-12T02:53:04.986 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:04 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:53:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.012+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb301a4150 con 0x7fdb30102570 2024-09-12T02:53:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.013+0000 7fdb2dffb640 1 -- 172.21.15.100:0/3630154562 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fdb1c0bc190 con 0x7fdb30102570 2024-09-12T02:53:05.015 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:53:05.016 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:53:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:53:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdb200a2b80 msgr2=0x7fdb200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdb200a2b80 0x7fdb200a5040 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009990 tx=0x7fdb24009110 comp rx=0 tx=0).stop 2024-09-12T02:53:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 msgr2=0x7fdb30197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb30197940 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c006010 tx=0x7fdb1c003c80 comp rx=0 tx=0).stop 2024-09-12T02:53:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 shutdown_connections 2024-09-12T02:53:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fdb200a2b80 0x7fdb200a5040 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb30102ef0 0x7fdb3019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb30102570 0x7fdb30197940 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 --2- 172.21.15.100:0/3630154562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb30100e20 0x7fdb30197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.015+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 >> 172.21.15.100:0/3630154562 conn(0x7fdb300fc7d0 msgr2=0x7fdb301068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:05.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.016+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 shutdown_connections 2024-09-12T02:53:05.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:05.016+0000 7fdb36f4d640 1 -- 172.21.15.100:0/3630154562 wait complete. 2024-09-12T02:53:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:04 smithi189 ceph-mon[35196]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 101 op/s 2024-09-12T02:53:05.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:04 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:53:05.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:04 smithi117 ceph-mon[34898]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 101 op/s 2024-09-12T02:53:05.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:04 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:53:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id ab8b4e95 --release --await' 2024-09-12T02:53:05.662 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id ab8b4e95 --release --await 2024-09-12T02:53:05.915 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:06.188 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:05 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:53:06.189 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:05 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3630154562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:53:06.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:05 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:53:06.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:05 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3630154562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:53:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-12T02:53:06.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:05 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:53:06.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:05 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3630154562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:53:06.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 -- 172.21.15.100:0/2447047800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 msgr2=0x7f675410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2447047800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f675410bbb0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6744009900 tx=0x7f674402a480 comp rx=0 tx=0).stop 2024-09-12T02:53:06.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 -- 172.21.15.100:0/2447047800 shutdown_connections 2024-09-12T02:53:06.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2447047800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f675410c180 0x7f675410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2447047800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f675410bbb0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2447047800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6754102da0 0x7f6754103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 -- 172.21.15.100:0/2447047800 >> 172.21.15.100:0/2447047800 conn(0x7f67540fc7a0 msgr2=0x7f67540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 -- 172.21.15.100:0/2447047800 shutdown_connections 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.414+0000 7f675c7c0640 1 -- 172.21.15.100:0/2447047800 wait complete. 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 Processor -- start 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 -- start start 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6754102da0 0x7f6754100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f6754100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f675410c180 0x7f6754101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6754111fa0 con 0x7f67541036c0 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6754111e20 con 0x7f6754102da0 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675c7c0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6754112120 con 0x7f675410c180 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f6759d5b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f6754100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f6759d5b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f6754100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56696/0 (socket says 172.21.15.100:56696) 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f6759d5b640 1 -- 172.21.15.100:0/2482473728 learned_addr learned my addr 172.21.15.100:0/2482473728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.415+0000 7f675a55c640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6754102da0 0x7f6754100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f675ad5d640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f675410c180 0x7f6754101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f6759d5b640 1 -- 172.21.15.100:0/2482473728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f675410c180 msgr2=0x7f6754101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f6759d5b640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f675410c180 0x7f6754101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f6759d5b640 1 -- 172.21.15.100:0/2482473728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6754102da0 msgr2=0x7f6754100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f6759d5b640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6754102da0 0x7f6754100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f6759d5b640 1 -- 172.21.15.100:0/2482473728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67541a68e0 con 0x7f67541036c0 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f6759d5b640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f6754100f40 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6744005ab0 tx=0x7f67440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f674b7fe640 1 -- 172.21.15.100:0/2482473728 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674403f030 con 0x7f67541036c0 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67541a6b70 con 0x7f67541036c0 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f674b7fe640 1 -- 172.21.15.100:0/2482473728 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6744003ce0 con 0x7f67541036c0 2024-09-12T02:53:06.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f674b7fe640 1 -- 172.21.15.100:0/2482473728 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744035070 con 0x7f67541036c0 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.416+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67541a70a0 con 0x7f67541036c0 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f674b7fe640 1 -- 172.21.15.100:0/2482473728 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f6744042030 con 0x7f67541036c0 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 Processor -- start 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 -- start start 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66060 0x555a4ca66440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca70d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca73630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555a4c9cb620 con 0x555a4ca66980 2024-09-12T02:53:06.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555a4c972e50 con 0x555a4ca71240 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675eb99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555a4c9c75e0 con 0x555a4ca66060 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675a55c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca70d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675a55c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca70d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56702/0 (socket says 172.21.15.100:56702) 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675a55c640 1 -- 172.21.15.100:0/2323290910 learned_addr learned my addr 172.21.15.100:0/2323290910 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f6759d5b640 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca73630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.419+0000 7f675ad5d640 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66060 0x555a4ca66440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675a55c640 1 -- 172.21.15.100:0/2323290910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66060 msgr2=0x555a4ca66440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675a55c640 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66060 0x555a4ca66440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675a55c640 1 -- 172.21.15.100:0/2323290910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 msgr2=0x555a4ca73630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675a55c640 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca73630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675a55c640 1 -- 172.21.15.100:0/2323290910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4c963d40 con 0x555a4ca66980 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675ad5d640 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66060 0x555a4ca66440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f674b7fe640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f67400a2b80 0x7f67400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675ad5d640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f67400a2b80 0x7f67400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f675a55c640 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca70d00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f675000b820 tx=0x7f675000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be83c01f7d687837 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f674b7fe640 1 -- 172.21.15.100:0/2482473728 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f67440efa10 con 0x7f67541036c0 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f6748ff9640 1 -- 172.21.15.100:0/2323290910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675000d950 con 0x555a4ca66980 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f6748ff9640 1 -- 172.21.15.100:0/2323290910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6750019070 con 0x555a4ca66980 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.420+0000 7f6748ff9640 1 -- 172.21.15.100:0/2323290910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67500123e0 con 0x555a4ca66980 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 -- 172.21.15.100:0/2323290910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 msgr2=0x555a4ca70d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675ad5d640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f67400a2b80 0x7f67400a5040 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f674c009e10 tx=0x7f674c009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca70d00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f675000b820 tx=0x7f675000bce0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 -- 172.21.15.100:0/2323290910 shutdown_connections 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca73630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca70d00 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 --2- 172.21.15.100:0/2323290910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66060 0x555a4ca66440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 -- 172.21.15.100:0/2323290910 >> 172.21.15.100:0/2323290910 conn(0x555a4ca625f0 msgr2=0x555a4ca629d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 -- 172.21.15.100:0/2323290910 shutdown_connections 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 -- 172.21.15.100:0/2323290910 wait complete. 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 -- start start 2024-09-12T02:53:06.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.421+0000 7f675eb99740 1 Processor -- start 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66060 0x555a4ca6e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca6e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca6eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555a4ca73e10 con 0x555a4ca66060 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555a4c953f10 con 0x555a4ca71240 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555a4ca73f90 con 0x555a4ca66980 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 10 client.0 _ll_register_callbacks cb 0x555a4c977db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66060 0x555a4ca6e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66060 0x555a4ca6e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56708/0 (socket says 172.21.15.100:56708) 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 -- 172.21.15.100:0/197850473 learned_addr learned my addr 172.21.15.100:0/197850473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675ad5d640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca6eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f6759d5b640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca6e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 -- 172.21.15.100:0/197850473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 msgr2=0x555a4ca6e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca6e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 -- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 msgr2=0x555a4ca6eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca6eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 -- 172.21.15.100:0/197850473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a4c6da580 con 0x555a4ca66060 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675ad5d640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca6eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675a55c640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66060 0x555a4ca6e0d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6750004700 tx=0x7f6750014660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15185c92906a1123 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f673dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f673dffb640 1 -- 172.21.15.100:0/197850473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750023070 con 0x555a4ca66060 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f673dffb640 1 -- 172.21.15.100:0/197850473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f675000dd60 con 0x555a4ca66060 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6750019070 con 0x555a4ca66060 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f673dffb640 1 -- 172.21.15.100:0/197850473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f675002f050 con 0x555a4ca66060 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 10 client.17955 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.422+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a4c7a4960 con 0x555a4ca66060 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f673dffb640 1 -- 172.21.15.100:0/197850473 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6750019070 con 0x555a4ca66060 2024-09-12T02:53:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f673dffb640 1 -- 172.21.15.100:0/197850473 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6750013070 con 0x555a4ca66060 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f675eb99740 10 client.17955 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f675eb99740 10 client.17955 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f675eb99740 20 client.17955 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f675eb99740 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4ca80b70 0x555a4ca82f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f675eb99740 4 client.17955 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a4c9d8b90 con 0x555a4ca80b70 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f6759d5b640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4ca80b70 0x555a4ca82f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f673dffb640 10 client.17955 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.423+0000 7f6759d5b640 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4ca80b70 0x555a4ca82f60 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f675bc0dfd4754fd server_cookie=941630eca9758d4e in_seq=0 out_seq=0 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f673dffb640 1 -- 172.21.15.100:0/197850473 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a4c9d8b90 con 0x555a4ca80b70 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f673dffb640 10 client.17955 handle_command_reply: tid=0 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 client.17955 shutdown 2024-09-12T02:53:06.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66060 msgr2=0x555a4ca6e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66060 0x555a4ca6e0d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6750004700 tx=0x7f6750014660 comp rx=0 tx=0).stop 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 shutdown_connections 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4ca80b70 0x555a4ca82f60 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca71240 0x555a4ca6eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca6e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 --2- 172.21.15.100:0/197850473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66060 0x555a4ca6e0d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 >> 172.21.15.100:0/197850473 conn(0x555a4ca625f0 msgr2=0x555a4ca682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f673dffb640 0 client.17955 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 shutdown_connections 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.424+0000 7f675eb99740 1 -- 172.21.15.100:0/197850473 wait complete. 2024-09-12T02:53:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.425+0000 7f675eb99740 20 client.17955 trim_cache size 0 max 16384 2024-09-12T02:53:06.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.441+0000 7f675eb99740 1 Processor -- start 2024-09-12T02:53:06.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675eb99740 1 -- start start 2024-09-12T02:53:06.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675eb99740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca68ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675eb99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca7c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675eb99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca71240 0x555a4ca7cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675eb99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67541b1f70 con 0x555a4ca71240 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675eb99740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67541af840 con 0x555a4ca66060 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675eb99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67541ad690 con 0x555a4ca66980 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca71240 0x555a4ca7cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca71240 0x555a4ca7cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56718/0 (socket says 172.21.15.100:56718) 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 -- 172.21.15.100:0/3906552388 learned_addr learned my addr 172.21.15.100:0/3906552388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f6759d5b640 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca7c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675a55c640 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca68ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 -- 172.21.15.100:0/3906552388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 msgr2=0x555a4ca7c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca7c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 -- 172.21.15.100:0/3906552388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 msgr2=0x555a4ca68ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca68ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 -- 172.21.15.100:0/3906552388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4ca62420 con 0x555a4ca71240 2024-09-12T02:53:06.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.442+0000 7f675ad5d640 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca71240 0x555a4ca7cce0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f674c00f7c0 tx=0x7f674c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baed0981d4651282 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:06.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f673ffff640 1 -- 172.21.15.100:0/3906552388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c01cb40 con 0x555a4ca71240 2024-09-12T02:53:06.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f673ffff640 1 -- 172.21.15.100:0/3906552388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f674c01cce0 con 0x555a4ca71240 2024-09-12T02:53:06.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f673ffff640 1 -- 172.21.15.100:0/3906552388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c01a7d0 con 0x555a4ca71240 2024-09-12T02:53:06.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f675eb99740 1 -- 172.21.15.100:0/3906552388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca71240 msgr2=0x555a4ca7cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f675eb99740 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca71240 0x555a4ca7cce0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f674c00f7c0 tx=0x7f674c011000 comp rx=0 tx=0).stop 2024-09-12T02:53:06.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f675eb99740 1 -- 172.21.15.100:0/3906552388 shutdown_connections 2024-09-12T02:53:06.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f675eb99740 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca71240 0x555a4ca7cce0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f675eb99740 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca66980 0x555a4ca7c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f675eb99740 1 --2- 172.21.15.100:0/3906552388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca68ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.443+0000 7f675eb99740 1 -- 172.21.15.100:0/3906552388 >> 172.21.15.100:0/3906552388 conn(0x555a4ca625f0 msgr2=0x555a4ca7c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:06.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 -- 172.21.15.100:0/3906552388 shutdown_connections 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 -- 172.21.15.100:0/3906552388 wait complete. 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 -- start start 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 Processor -- start 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca76110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca71240 0x555a4cae34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67541add00 con 0x555a4ca66980 2024-09-12T02:53:06.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67541af170 con 0x555a4ca66060 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67541ae3d0 con 0x555a4ca71240 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f675eb99740 10 client.0 _ll_register_callbacks cb 0x7f675000b4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f6759d5b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca76110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.444+0000 7f6759d5b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca76110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56726/0 (socket says 172.21.15.100:56726) 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f6759d5b640 1 -- 172.21.15.100:0/3258332281 learned_addr learned my addr 172.21.15.100:0/3258332281 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f675a55c640 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f675ad5d640 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca71240 0x555a4cae34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f6759d5b640 1 -- 172.21.15.100:0/3258332281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca71240 msgr2=0x555a4cae34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f6759d5b640 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca71240 0x555a4cae34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f6759d5b640 1 -- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 msgr2=0x555a4ca75bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f6759d5b640 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca75bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f6759d5b640 1 -- 172.21.15.100:0/3258332281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a4cae3d00 con 0x555a4ca66980 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f6759d5b640 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca76110 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f67440bbf60 tx=0x7f67440f5550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9945a6777253adce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f673dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f673dffb640 1 -- 172.21.15.100:0/3258332281 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744049040 con 0x555a4ca66980 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f673dffb640 1 -- 172.21.15.100:0/3258332281 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f674403bd70 con 0x555a4ca66980 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f674c01cce0 con 0x555a4ca66980 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f673dffb640 1 -- 172.21.15.100:0/3258332281 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67440bbda0 con 0x555a4ca66980 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f675eb99740 10 client.17961 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a4caec0f0 con 0x555a4ca66980 2024-09-12T02:53:06.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.445+0000 7f673dffb640 1 -- 172.21.15.100:0/3258332281 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f674c01cce0 con 0x555a4ca66980 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f673dffb640 1 -- 172.21.15.100:0/3258332281 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f67440b88d0 con 0x555a4ca66980 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675eb99740 10 client.17961 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675eb99740 10 client.17961 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675eb99740 20 client.17961 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675eb99740 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4caec820 0x555a4caeec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675eb99740 4 client.17961 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ab8b4e95", "release": true, "await": true}] 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ab8b4e95", "release": true, "await": true}) -- 0x555a4ca69cf0 con 0x555a4caec820 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675a55c640 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4caec820 0x555a4caeec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f675a55c640 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4caec820 0x555a4caeec40 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afec3a60bc2b0309 server_cookie=db25dfd0ba7e16b2 in_seq=0 out_seq=0 2024-09-12T02:53:06.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.446+0000 7f673dffb640 10 client.17961 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.505+0000 7f673dffb640 1 -- 172.21.15.100:0/3258332281 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555a4ca69cf0 con 0x555a4caec820 2024-09-12T02:53:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.505+0000 7f673dffb640 10 client.17961 handle_command_reply: tid=0 2024-09-12T02:53:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.505+0000 7f675eb99740 1 client.17961 shutdown 2024-09-12T02:53:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.505+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 msgr2=0x555a4ca76110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.505+0000 7f675eb99740 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca76110 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f67440bbf60 tx=0x7f67440f5550 comp rx=0 tx=0).stop 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 shutdown_connections 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555a4caec820 0x555a4caeec40 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a4ca71240 0x555a4cae34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555a4ca66980 0x555a4ca76110 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 --2- 172.21.15.100:0/3258332281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a4ca66060 0x555a4ca75bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 >> 172.21.15.100:0/3258332281 conn(0x555a4ca625f0 msgr2=0x555a4ca7c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f673dffb640 0 client.17961 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 shutdown_connections 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 1 -- 172.21.15.100:0/3258332281 wait complete. 2024-09-12T02:53:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.506+0000 7f675eb99740 20 client.17961 trim_cache size 0 max 16384 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 56, 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "ab8b4e95": { 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 56, 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:53:06.510 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 150.0, 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:53:06.511 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f67400a2b80 msgr2=0x7f67400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f67400a2b80 0x7f67400a5040 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f674c009e10 tx=0x7f674c009340 comp rx=0 tx=0).stop 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 msgr2=0x7f6754100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f6754100f40 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6744005ab0 tx=0x7f67440042f0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 shutdown_connections 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f67400a2b80 0x7f67400a5040 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f675410c180 0x7f6754101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67541036c0 0x7f6754100f40 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 --2- 172.21.15.100:0/2482473728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6754102da0 0x7f6754100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:06.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 >> 172.21.15.100:0/2482473728 conn(0x7f67540fc7a0 msgr2=0x7f67540fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:06.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 shutdown_connections 2024-09-12T02:53:06.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:06.507+0000 7f675c7c0640 1 -- 172.21.15.100:0/2482473728 wait complete. 2024-09-12T02:53:07.166 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:06 smithi100 ceph-mon[31390]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 102 op/s 2024-09-12T02:53:07.214 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ab8b4e95', total seconds elapsed: 33.2 2024-09-12T02:53:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:06 smithi189 ceph-mon[35196]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 102 op/s 2024-09-12T02:53:07.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:06 smithi117 ceph-mon[34898]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 102 op/s 2024-09-12T02:53:08.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:07 smithi189 ceph-mon[35196]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.3 MiB/s wr, 104 op/s 2024-09-12T02:53:08.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:07 smithi117 ceph-mon[34898]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.3 MiB/s wr, 104 op/s 2024-09-12T02:53:08.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:07 smithi100 ceph-mon[31390]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.3 MiB/s wr, 104 op/s 2024-09-12T02:53:11.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:10 smithi189 ceph-mon[35196]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.7 MiB/s wr, 180 op/s 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 840.0 s, 2013.7 tps, lat 340.122 ms stddev 2924.666 2024-09-12T02:53:11.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:10 smithi117 ceph-mon[34898]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.7 MiB/s wr, 180 op/s 2024-09-12T02:53:11.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:10 smithi100 ceph-mon[31390]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.7 MiB/s wr, 180 op/s 2024-09-12T02:53:13.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:12 smithi189 ceph-mon[35196]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 13 MiB/s wr, 604 op/s 2024-09-12T02:53:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:53:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:53:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:53:13.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:53:13.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:12 smithi117 ceph-mon[34898]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 13 MiB/s wr, 604 op/s 2024-09-12T02:53:13.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:53:13.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:53:13.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:53:13.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:53:13.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:12 smithi100 ceph-mon[31390]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 13 MiB/s wr, 604 op/s 2024-09-12T02:53:13.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:53:13.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:53:13.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:53:13.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:53:15.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:14 smithi189 ceph-mon[35196]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 909 op/s 2024-09-12T02:53:15.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:14 smithi117 ceph-mon[34898]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 909 op/s 2024-09-12T02:53:15.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:14 smithi100 ceph-mon[31390]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 909 op/s 2024-09-12T02:53:16.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 845.0 s, 2354.4 tps, lat 42.008 ms stddev 50.483 2024-09-12T02:53:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:16 smithi189 ceph-mon[35196]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 29 MiB/s wr, 1.35k op/s 2024-09-12T02:53:17.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:16 smithi117 ceph-mon[34898]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 29 MiB/s wr, 1.35k op/s 2024-09-12T02:53:17.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:16 smithi100 ceph-mon[31390]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 29 MiB/s wr, 1.35k op/s 2024-09-12T02:53:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:18 smithi189 ceph-mon[35196]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 1.53k op/s 2024-09-12T02:53:19.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:18 smithi117 ceph-mon[34898]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 1.53k op/s 2024-09-12T02:53:19.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:18 smithi100 ceph-mon[31390]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 1.53k op/s 2024-09-12T02:53:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:20 smithi189 ceph-mon[35196]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 34 MiB/s wr, 1.67k op/s 2024-09-12T02:53:21.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 850.0 s, 2089.6 tps, lat 48.302 ms stddev 56.577 2024-09-12T02:53:21.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:20 smithi117 ceph-mon[34898]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 34 MiB/s wr, 1.67k op/s 2024-09-12T02:53:21.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:20 smithi100 ceph-mon[31390]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 34 MiB/s wr, 1.67k op/s 2024-09-12T02:53:22.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:21 smithi189 ceph-mon[35196]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 34 MiB/s wr, 1.68k op/s 2024-09-12T02:53:22.272 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:21 smithi100 ceph-mon[31390]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 34 MiB/s wr, 1.68k op/s 2024-09-12T02:53:22.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:21 smithi117 ceph-mon[34898]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 34 MiB/s wr, 1.68k op/s 2024-09-12T02:53:25.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:24 smithi189 ceph-mon[35196]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 24 MiB/s wr, 1.28k op/s 2024-09-12T02:53:25.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:24 smithi117 ceph-mon[34898]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 24 MiB/s wr, 1.28k op/s 2024-09-12T02:53:25.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:24 smithi100 ceph-mon[31390]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 24 MiB/s wr, 1.28k op/s 2024-09-12T02:53:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 855.0 s, 2371.2 tps, lat 42.349 ms stddev 44.986 2024-09-12T02:53:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:26 smithi189 ceph-mon[35196]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 20 MiB/s wr, 1.07k op/s 2024-09-12T02:53:27.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:26 smithi117 ceph-mon[34898]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 20 MiB/s wr, 1.07k op/s 2024-09-12T02:53:27.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:26 smithi100 ceph-mon[31390]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 20 MiB/s wr, 1.07k op/s 2024-09-12T02:53:27.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:53:28.202 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 -- 172.21.15.100:0/866265933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc102790 msgr2=0x7f08fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 --2- 172.21.15.100:0/866265933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc102790 0x7f08fc1067e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009860 tx=0x7f08f002a340 comp rx=0 tx=0).stop 2024-09-12T02:53:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 -- 172.21.15.100:0/866265933 shutdown_connections 2024-09-12T02:53:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 --2- 172.21.15.100:0/866265933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08fc106f10 0x7f08fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 --2- 172.21.15.100:0/866265933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc102790 0x7f08fc1067e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 --2- 172.21.15.100:0/866265933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 0x7f08fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 -- 172.21.15.100:0/866265933 >> 172.21.15.100:0/866265933 conn(0x7f08fc0fd880 msgr2=0x7f08fc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:28.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 -- 172.21.15.100:0/866265933 shutdown_connections 2024-09-12T02:53:28.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.778+0000 7f0902165640 1 -- 172.21.15.100:0/866265933 wait complete. 2024-09-12T02:53:28.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.779+0000 7f0902165640 1 Processor -- start 2024-09-12T02:53:28.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.779+0000 7f0902165640 1 -- start start 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.779+0000 7f0902165640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 0x7f08fc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f0902165640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08fc102790 0x7f08fc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f0902165640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc106f10 0x7f08fc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f0902165640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc111f70 con 0x7f08fc106f10 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f0902165640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc111df0 con 0x7f08fc101de0 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f0902165640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1120f0 con 0x7f08fc102790 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 0x7f08fc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 0x7f08fc198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42274/0 (socket says 172.21.15.100:42274) 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f08fb7fe640 1 -- 172.21.15.100:0/4079865507 learned_addr learned my addr 172.21.15.100:0/4079865507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.780+0000 7f08faffd640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08fc102790 0x7f08fc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fbfff640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc106f10 0x7f08fc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fb7fe640 1 -- 172.21.15.100:0/4079865507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08fc102790 msgr2=0x7f08fc198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08fc102790 0x7f08fc198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fb7fe640 1 -- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc106f10 msgr2=0x7f08fc19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc106f10 0x7f08fc19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fb7fe640 1 -- 172.21.15.100:0/4079865507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08fc19d3c0 con 0x7f08fc101de0 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fbfff640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc106f10 0x7f08fc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08faffd640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08fc102790 0x7f08fc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 0x7f08fc198410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00e9c0 tx=0x7f08ec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f08f8ff9640 1 -- 172.21.15.100:0/4079865507 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00ccc0 con 0x7f08fc101de0 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08fc19d6b0 con 0x7f08fc101de0 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.781+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08fc1a4f90 con 0x7f08fc101de0 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.782+0000 7f08f8ff9640 1 -- 172.21.15.100:0/4079865507 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08ec005500 con 0x7f08fc101de0 2024-09-12T02:53:28.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.782+0000 7f08f8ff9640 1 -- 172.21.15.100:0/4079865507 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec018430 con 0x7f08fc101de0 2024-09-12T02:53:28.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.784+0000 7f090453e740 1 Processor -- start 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.784+0000 7f090453e740 1 -- start start 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08f8ff9640 1 -- 172.21.15.100:0/4079865507 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f08ec0046c0 con 0x7f08fc101de0 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f090453e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216360 0x55be9c216740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f090453e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216c80 0x55be9c225550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f090453e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c225a90 0x55be9c227e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f090453e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55be9c17c2e0 con 0x55be9c216c80 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f090453e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55be9c123ce0 con 0x55be9c225a90 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f090453e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55be9c1782a0 con 0x55be9c216360 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216c80 0x55be9c225550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216c80 0x55be9c225550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41584/0 (socket says 172.21.15.100:41584) 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c225a90 0x55be9c227e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08fb7fe640 1 -- 172.21.15.100:0/3945109273 learned_addr learned my addr 172.21.15.100:0/3945109273 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08fbfff640 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216360 0x55be9c216740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08faffd640 1 -- 172.21.15.100:0/3945109273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216360 msgr2=0x55be9c216740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08faffd640 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216360 0x55be9c216740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08faffd640 1 -- 172.21.15.100:0/3945109273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216c80 msgr2=0x55be9c225550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08faffd640 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216c80 0x55be9c225550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.785+0000 7f08faffd640 1 -- 172.21.15.100:0/3945109273 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be9c108440 con 0x55be9c225a90 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.786+0000 7f08f8ff9640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08e40a2c00 0x7f08e40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.786+0000 7f08faffd640 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c225a90 0x55be9c227e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009830 tx=0x7f08f00303c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a65e9d78835288 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.786+0000 7f08fbfff640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08e40a2c00 0x7f08e40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.786+0000 7f08f8ff9640 1 -- 172.21.15.100:0/4079865507 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f08ec0cf590 con 0x7f08fc101de0 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.786+0000 7f08e1ffb640 1 -- 172.21.15.100:0/3945109273 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0037040 con 0x55be9c225a90 2024-09-12T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.786+0000 7f08e1ffb640 1 -- 172.21.15.100:0/3945109273 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08f0030550 con 0x55be9c225a90 2024-09-12T02:53:28.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.786+0000 7f08e1ffb640 1 -- 172.21.15.100:0/3945109273 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0005470 con 0x55be9c225a90 2024-09-12T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.787+0000 7f090453e740 1 -- 172.21.15.100:0/3945109273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c225a90 msgr2=0x55be9c227e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.787+0000 7f090453e740 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c225a90 0x55be9c227e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009830 tx=0x7f08f00303c0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f08fbfff640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08e40a2c00 0x7f08e40a50c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005fd0 tx=0x7f08f4009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 -- 172.21.15.100:0/3945109273 shutdown_connections 2024-09-12T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c225a90 0x55be9c227e80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216c80 0x55be9c225550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 --2- 172.21.15.100:0/3945109273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216360 0x55be9c216740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 -- 172.21.15.100:0/3945109273 >> 172.21.15.100:0/3945109273 conn(0x55be9c212a30 msgr2=0x55be9c212e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 -- 172.21.15.100:0/3945109273 shutdown_connections 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 -- 172.21.15.100:0/3945109273 wait complete. 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.788+0000 7f090453e740 1 -- start start 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 1 Processor -- start 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c225430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c2226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c222c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55be9c228600 con 0x55be9c216360 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55be9c137050 con 0x55be9c216c80 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55be9c228780 con 0x55be9c225a90 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f090453e740 10 client.0 _ll_register_callbacks cb 0x55be9c177160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f08faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c2226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f08faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c2226e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42290/0 (socket says 172.21.15.100:42290) 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f08faffd640 1 -- 172.21.15.100:0/542270629 learned_addr learned my addr 172.21.15.100:0/542270629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c225430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.789+0000 7f08fbfff640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c222c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08faffd640 1 -- 172.21.15.100:0/542270629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 msgr2=0x55be9c222c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08faffd640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c222c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08faffd640 1 -- 172.21.15.100:0/542270629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 msgr2=0x55be9c225430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08faffd640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c225430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08faffd640 1 -- 172.21.15.100:0/542270629 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9beed3c0 con 0x55be9c216c80 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08fbfff640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c222c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08faffd640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c2226e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f08f002a860 tx=0x7f08f0030b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637bd5e8a0437cff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08daffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08daffd640 1 -- 172.21.15.100:0/542270629 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f004b070 con 0x55be9c216c80 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f0030550 con 0x55be9c216c80 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08daffd640 1 -- 172.21.15.100:0/542270629 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f08f00053b0 con 0x55be9c216c80 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08daffd640 1 -- 172.21.15.100:0/542270629 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f08f0037040 con 0x55be9c216c80 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f090453e740 10 client.27173 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55be9c234050 con 0x55be9c216c80 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.790+0000 7f08daffd640 1 -- 172.21.15.100:0/542270629 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08f0030550 con 0x55be9c216c80 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f08daffd640 1 -- 172.21.15.100:0/542270629 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f08f0045560 con 0x55be9c216c80 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f090453e740 10 client.27173 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f090453e740 10 client.27173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f090453e740 20 client.27173 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f090453e740 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2354b0 0x55be9c2378c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f090453e740 4 client.27173 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:28.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be9c189850 con 0x55be9c2354b0 2024-09-12T02:53:28.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2354b0 0x55be9c2378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f08daffd640 10 client.27173 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:28.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.791+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2354b0 0x55be9c2378c0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a486a492f5258172 server_cookie=80f4e2409692b7f7 in_seq=0 out_seq=0 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.792+0000 7f08daffd640 1 -- 172.21.15.100:0/542270629 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be9c189850 con 0x55be9c2354b0 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.792+0000 7f08daffd640 10 client.27173 handle_command_reply: tid=0 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 client.27173 shutdown 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 msgr2=0x55be9c2226e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c2226e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f08f002a860 tx=0x7f08f0030b20 comp rx=0 tx=0).stop 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 shutdown_connections 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2354b0 0x55be9c2378c0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c222c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c2226e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 --2- 172.21.15.100:0/542270629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c225430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 >> 172.21.15.100:0/542270629 conn(0x55be9c212a30 msgr2=0x55be9c218790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:28.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f08daffd640 0 client.27173 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:28.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 shutdown_connections 2024-09-12T02:53:28.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 1 -- 172.21.15.100:0/542270629 wait complete. 2024-09-12T02:53:28.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.793+0000 7f090453e740 20 client.27173 trim_cache size 0 max 16384 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.813+0000 7f090453e740 1 Processor -- start 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.813+0000 7f090453e740 1 -- start start 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.813+0000 7f090453e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c2318a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f090453e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c23d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f090453e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c23d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f090453e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1adc70 con 0x55be9c216360 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f090453e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1ab540 con 0x55be9c216c80 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f090453e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1a9390 con 0x55be9c225a90 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c2318a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c2318a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41596/0 (socket says 172.21.15.100:41596) 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 -- 172.21.15.100:0/1640621283 learned_addr learned my addr 172.21.15.100:0/1640621283 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08faffd640 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c23d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 -- 172.21.15.100:0/1640621283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 msgr2=0x55be9c23d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c23d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 -- 172.21.15.100:0/1640621283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 msgr2=0x55be9c23d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c23d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 -- 172.21.15.100:0/1640621283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be9c216ab0 con 0x55be9c216360 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c2318a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f08ec098240 tx=0x7f08ec0ccf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e247921e087ca66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08e17fa640 1 -- 172.21.15.100:0/1640621283 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec09b740 con 0x55be9c216360 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08e17fa640 1 -- 172.21.15.100:0/1640621283 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08ec09c4e0 con 0x55be9c216360 2024-09-12T02:53:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.814+0000 7f08e17fa640 1 -- 172.21.15.100:0/1640621283 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0056b0 con 0x55be9c216360 2024-09-12T02:53:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.815+0000 7f090453e740 1 -- 172.21.15.100:0/1640621283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 msgr2=0x55be9c2318a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.815+0000 7f090453e740 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c2318a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f08ec098240 tx=0x7f08ec0ccf50 comp rx=0 tx=0).stop 2024-09-12T02:53:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.816+0000 7f090453e740 1 -- 172.21.15.100:0/1640621283 shutdown_connections 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.816+0000 7f090453e740 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c225a90 0x55be9c23d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.816+0000 7f090453e740 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216c80 0x55be9c23d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.816+0000 7f090453e740 1 --2- 172.21.15.100:0/1640621283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c216360 0x55be9c2318a0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.816+0000 7f090453e740 1 -- 172.21.15.100:0/1640621283 >> 172.21.15.100:0/1640621283 conn(0x55be9c212a30 msgr2=0x55be9c211b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.816+0000 7f090453e740 1 -- 172.21.15.100:0/1640621283 shutdown_connections 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.816+0000 7f090453e740 1 -- 172.21.15.100:0/1640621283 wait complete. 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.817+0000 7f090453e740 1 -- start start 2024-09-12T02:53:28.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.817+0000 7f090453e740 1 Processor -- start 2024-09-12T02:53:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.817+0000 7f090453e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216360 0x55be9c2299c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.817+0000 7f090453e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216c80 0x55be9c229f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f090453e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c225a90 0x55be9c22a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f090453e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1a9a00 con 0x55be9c225a90 2024-09-12T02:53:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216360 0x55be9c2299c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f090453e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1aae70 con 0x55be9c216360 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f090453e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1aa0d0 con 0x55be9c216c80 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216360 0x55be9c2299c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42308/0 (socket says 172.21.15.100:42308) 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 -- 172.21.15.100:0/3259846235 learned_addr learned my addr 172.21.15.100:0/3259846235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f090453e740 10 client.0 _ll_register_callbacks cb 0x7f08ec005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08faffd640 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216c80 0x55be9c229f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fbfff640 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c225a90 0x55be9c22a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 -- 172.21.15.100:0/3259846235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216c80 msgr2=0x55be9c229f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216c80 0x55be9c229f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 -- 172.21.15.100:0/3259846235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c225a90 msgr2=0x55be9c22a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c225a90 0x55be9c22a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 -- 172.21.15.100:0/3259846235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9c29f360 con 0x55be9c216360 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08fb7fe640 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216360 0x55be9c2299c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0cd0d0 tx=0x7f08ec005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f0e9bacb3e34afd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08daffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08daffd640 1 -- 172.21.15.100:0/3259846235 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec09bde0 con 0x55be9c216360 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f08daffd640 1 -- 172.21.15.100:0/3259846235 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f08ec09b230 con 0x55be9c216360 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.818+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08ec09c4e0 con 0x55be9c216360 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f08daffd640 1 -- 172.21.15.100:0/3259846235 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f08ec0a0190 con 0x55be9c216360 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 10 client.27179 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55be9c2a0650 con 0x55be9c216360 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f08daffd640 1 -- 172.21.15.100:0/3259846235 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08ec09c4e0 con 0x55be9c216360 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f08daffd640 1 -- 172.21.15.100:0/3259846235 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f08ec097b30 con 0x55be9c216360 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 10 client.27179 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 10 client.27179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 20 client.27179 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2a0c70 0x55be9c2a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:28.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 4 client.27179 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:53:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be9c183d60 con 0x55be9c2a0c70 2024-09-12T02:53:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.819+0000 7f08faffd640 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2a0c70 0x55be9c2a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.820+0000 7f08daffd640 10 client.27179 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.820+0000 7f08faffd640 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2a0c70 0x55be9c2a3060 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba33a83642054f71 server_cookie=77a63193216a921d in_seq=0 out_seq=0 2024-09-12T02:53:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f08daffd640 1 -- 172.21.15.100:0/3259846235 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55be9c183d60 con 0x55be9c2a0c70 2024-09-12T02:53:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f08daffd640 10 client.27179 handle_command_reply: tid=0 2024-09-12T02:53:28.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 client.27179 shutdown 2024-09-12T02:53:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216360 msgr2=0x55be9c2299c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216360 0x55be9c2299c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0cd0d0 tx=0x7f08ec005880 comp rx=0 tx=0).stop 2024-09-12T02:53:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 shutdown_connections 2024-09-12T02:53:28.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55be9c2a0c70 0x55be9c2a3060 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f08daffd640 0 client.27179 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55be9c225a90 0x55be9c22a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55be9c216c80 0x55be9c229f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 --2- 172.21.15.100:0/3259846235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55be9c216360 0x55be9c2299c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 >> 172.21.15.100:0/3259846235 conn(0x55be9c212a30 msgr2=0x55be9c211350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 shutdown_connections 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.821+0000 7f090453e740 1 -- 172.21.15.100:0/3259846235 wait complete. 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f090453e740 20 client.27179 trim_cache size 0 max 16384 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:53:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:53:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:53:28.827 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08e40a2c00 msgr2=0x7f08e40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08e40a2c00 0x7f08e40a50c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005fd0 tx=0x7f08f4009530 comp rx=0 tx=0).stop 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 msgr2=0x7f08fc198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 0x7f08fc198410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00e9c0 tx=0x7f08ec00ee80 comp rx=0 tx=0).stop 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 shutdown_connections 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08e40a2c00 0x7f08e40a50c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08fc106f10 0x7f08fc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08fc102790 0x7f08fc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 --2- 172.21.15.100:0/4079865507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08fc101de0 0x7f08fc198410 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 >> 172.21.15.100:0/4079865507 conn(0x7f08fc0fd880 msgr2=0x7f08fc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:28.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 shutdown_connections 2024-09-12T02:53:28.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:28.822+0000 7f0902165640 1 -- 172.21.15.100:0/4079865507 wait complete. 2024-09-12T02:53:29.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:28 smithi100 ceph-mon[31390]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 702 op/s 2024-09-12T02:53:29.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:28 smithi189 ceph-mon[35196]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 702 op/s 2024-09-12T02:53:29.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:28 smithi117 ceph-mon[34898]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 702 op/s 2024-09-12T02:53:29.716 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:53:29.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:53:30.070 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:30.198 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:29 smithi100 ceph-mon[31390]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.7 MiB/s wr, 685 op/s 2024-09-12T02:53:30.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:29 smithi189 ceph-mon[35196]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.7 MiB/s wr, 685 op/s 2024-09-12T02:53:30.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:29 smithi117 ceph-mon[34898]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.7 MiB/s wr, 685 op/s 2024-09-12T02:53:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.618+0000 7f08eabf3640 1 -- 172.21.15.100:0/1212691088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e411b140 msgr2=0x7f08e411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.618+0000 7f08eabf3640 1 --2- 172.21.15.100:0/1212691088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e411b140 0x7f08e411d530 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009ca0 tx=0x7f08dc02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.619+0000 7f08eabf3640 1 -- 172.21.15.100:0/1212691088 shutdown_connections 2024-09-12T02:53:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.619+0000 7f08eabf3640 1 --2- 172.21.15.100:0/1212691088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e411b140 0x7f08e411d530 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.619+0000 7f08eabf3640 1 --2- 172.21.15.100:0/1212691088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e406ea30 0x7f08e406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.619+0000 7f08eabf3640 1 --2- 172.21.15.100:0/1212691088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e4110190 0x7f08e406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.619+0000 7f08eabf3640 1 -- 172.21.15.100:0/1212691088 >> 172.21.15.100:0/1212691088 conn(0x7f08e4073180 msgr2=0x7f08e4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.629+0000 7f08eabf3640 1 -- 172.21.15.100:0/1212691088 shutdown_connections 2024-09-12T02:53:30.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.629+0000 7f08eabf3640 1 -- 172.21.15.100:0/1212691088 wait complete. 2024-09-12T02:53:30.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.630+0000 7f08eabf3640 1 Processor -- start 2024-09-12T02:53:30.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.631+0000 7f08eabf3640 1 -- start start 2024-09-12T02:53:30.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.631+0000 7f08eabf3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e406ea30 0x7f08e41a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.631+0000 7f08eabf3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e4110190 0x7f08e41a7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.631+0000 7f08eabf3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e41ab6d0 0x7f08e41abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.631+0000 7f08eabf3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08e4120c40 con 0x7f08e4110190 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.631+0000 7f08eabf3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08e4120ac0 con 0x7f08e406ea30 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.631+0000 7f08eabf3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08e4120dc0 con 0x7f08e41ab6d0 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e9bf1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e406ea30 0x7f08e41a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e9bf1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e406ea30 0x7f08e41a6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42326/0 (socket says 172.21.15.100:42326) 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e9bf1640 1 -- 172.21.15.100:0/3136282669 learned_addr learned my addr 172.21.15.100:0/3136282669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e93f0640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e4110190 0x7f08e41a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08ea3f2640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e41ab6d0 0x7f08e41abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e93f0640 1 -- 172.21.15.100:0/3136282669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e41ab6d0 msgr2=0x7f08e41abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e93f0640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e41ab6d0 0x7f08e41abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e93f0640 1 -- 172.21.15.100:0/3136282669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e406ea30 msgr2=0x7f08e41a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e93f0640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e406ea30 0x7f08e41a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08e93f0640 1 -- 172.21.15.100:0/3136282669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e41ac220 con 0x7f08e4110190 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.632+0000 7f08ea3f2640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e41ab6d0 0x7f08e41abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.633+0000 7f08e93f0640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e4110190 0x7f08e41a7340 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009fd0 tx=0x7f08e000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.633+0000 7f08daffd640 1 -- 172.21.15.100:0/3136282669 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0015020 con 0x7f08e4110190 2024-09-12T02:53:30.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.633+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e41ac510 con 0x7f08e4110190 2024-09-12T02:53:30.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.633+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e4110ce0 con 0x7f08e4110190 2024-09-12T02:53:30.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.633+0000 7f08daffd640 1 -- 172.21.15.100:0/3136282669 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08e0011d10 con 0x7f08e4110190 2024-09-12T02:53:30.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.634+0000 7f08daffd640 1 -- 172.21.15.100:0/3136282669 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e000f2e0 con 0x7f08e4110190 2024-09-12T02:53:30.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.635+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c8005290 con 0x7f08e4110190 2024-09-12T02:53:30.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.637+0000 7f08daffd640 1 -- 172.21.15.100:0/3136282669 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f08e0018020 con 0x7f08e4110190 2024-09-12T02:53:30.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.638+0000 7f08daffd640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08d00a2cc0 0x7f08d00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.638+0000 7f08daffd640 1 -- 172.21.15.100:0/3136282669 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f08e00ce780 con 0x7f08e4110190 2024-09-12T02:53:30.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.639+0000 7f08e9bf1640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08d00a2cc0 0x7f08d00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.640+0000 7f08e9bf1640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08d00a2cc0 0x7f08d00a5180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f08d40058c0 tx=0x7f08d400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.648+0000 7f08daffd640 1 -- 172.21.15.100:0/3136282669 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08e001f020 con 0x7f08e4110190 2024-09-12T02:53:30.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.943+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08c8005580 con 0x7f08e4110190 2024-09-12T02:53:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.944+0000 7f08daffd640 1 -- 172.21.15.100:0/3136282669 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f08e009b670 con 0x7f08e4110190 2024-09-12T02:53:30.945 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:53:30.945 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:53:30.945 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:53:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.946+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08d00a2cc0 msgr2=0x7f08d00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.946+0000 7f08eabf3640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08d00a2cc0 0x7f08d00a5180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f08d40058c0 tx=0x7f08d400a380 comp rx=0 tx=0).stop 2024-09-12T02:53:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.946+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e4110190 msgr2=0x7f08e41a7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.946+0000 7f08eabf3640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e4110190 0x7f08e41a7340 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009fd0 tx=0x7f08e000b870 comp rx=0 tx=0).stop 2024-09-12T02:53:30.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 shutdown_connections 2024-09-12T02:53:30.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f08d00a2cc0 0x7f08d00a5180 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e41ab6d0 0x7f08e41abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e4110190 0x7f08e41a7340 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 --2- 172.21.15.100:0/3136282669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e406ea30 0x7f08e41a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 >> 172.21.15.100:0/3136282669 conn(0x7f08e4073180 msgr2=0x7f08e406b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:30.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 shutdown_connections 2024-09-12T02:53:30.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:30.947+0000 7f08eabf3640 1 -- 172.21.15.100:0/3136282669 wait complete. 2024-09-12T02:53:31.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:31 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3136282669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:53:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 860.0 s, 1903.0 tps, lat 52.064 ms stddev 57.816 2024-09-12T02:53:31.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:31 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3136282669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:53:31.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:31 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3136282669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:53:31.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:53:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:32.279 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:32 smithi100 ceph-mon[31390]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 625 op/s 2024-09-12T02:53:32.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:32 smithi117 ceph-mon[34898]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 625 op/s 2024-09-12T02:53:32.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:32 smithi189 ceph-mon[35196]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 625 op/s 2024-09-12T02:53:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.712+0000 7f35117b5640 1 -- 172.21.15.100:0/3759628639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c109450 msgr2=0x7f350c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.712+0000 7f35117b5640 1 --2- 172.21.15.100:0/3759628639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c109450 0x7f350c110250 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f350401acb0 tx=0x7f350403b900 comp rx=0 tx=0).stop 2024-09-12T02:53:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.715+0000 7f35117b5640 1 -- 172.21.15.100:0/3759628639 shutdown_connections 2024-09-12T02:53:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.715+0000 7f35117b5640 1 --2- 172.21.15.100:0/3759628639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c11b140 0x7f350c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.715+0000 7f35117b5640 1 --2- 172.21.15.100:0/3759628639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f350c109830 0x7f350c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.715+0000 7f35117b5640 1 --2- 172.21.15.100:0/3759628639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c109450 0x7f350c110250 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.715+0000 7f35117b5640 1 -- 172.21.15.100:0/3759628639 >> 172.21.15.100:0/3759628639 conn(0x7f350c06e140 msgr2=0x7f350c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.720+0000 7f35117b5640 1 -- 172.21.15.100:0/3759628639 shutdown_connections 2024-09-12T02:53:32.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.720+0000 7f35117b5640 1 -- 172.21.15.100:0/3759628639 wait complete. 2024-09-12T02:53:32.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.721+0000 7f35117b5640 1 Processor -- start 2024-09-12T02:53:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.733+0000 7f35117b5640 1 -- start start 2024-09-12T02:53:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.733+0000 7f35117b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c109450 0x7f350c11a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.733+0000 7f35117b5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f350c109830 0x7f350c116940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.733+0000 7f35117b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c11b140 0x7f350c116e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.733+0000 7f35117b5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f350c113360 con 0x7f350c11b140 2024-09-12T02:53:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.733+0000 7f35117b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1131e0 con 0x7f350c109450 2024-09-12T02:53:32.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.733+0000 7f35117b5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1134e0 con 0x7f350c109830 2024-09-12T02:53:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.734+0000 7f350affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c109450 0x7f350c11a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.734+0000 7f350affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c109450 0x7f350c11a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42332/0 (socket says 172.21.15.100:42332) 2024-09-12T02:53:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.734+0000 7f350affd640 1 -- 172.21.15.100:0/2277248976 learned_addr learned my addr 172.21.15.100:0/2277248976 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.735+0000 7f350b7fe640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c11b140 0x7f350c116e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.735+0000 7f350affd640 1 -- 172.21.15.100:0/2277248976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f350c109830 msgr2=0x7f350c116940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.735+0000 7f350affd640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f350c109830 0x7f350c116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.735+0000 7f350affd640 1 -- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c11b140 msgr2=0x7f350c116e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.735+0000 7f350affd640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c11b140 0x7f350c116e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.735+0000 7f350affd640 1 -- 172.21.15.100:0/2277248976 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c1175b0 con 0x7f350c109450 2024-09-12T02:53:32.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.737+0000 7f350affd640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c109450 0x7f350c11a8a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f350403be20 tx=0x7f3504040740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.740+0000 7f34f3fff640 1 -- 172.21.15.100:0/2277248976 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504011070 con 0x7f350c109450 2024-09-12T02:53:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.740+0000 7f34f3fff640 1 -- 172.21.15.100:0/2277248976 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3504003e00 con 0x7f350c109450 2024-09-12T02:53:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.740+0000 7f34f3fff640 1 -- 172.21.15.100:0/2277248976 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504045070 con 0x7f350c109450 2024-09-12T02:53:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.741+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c1cd180 con 0x7f350c109450 2024-09-12T02:53:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.741+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c1cd520 con 0x7f350c109450 2024-09-12T02:53:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.745+0000 7f3513b8e740 1 Processor -- start 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.746+0000 7f3513b8e740 1 -- start start 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 0x55b9ba8fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba90b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f3513b8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b9ba8642f0 con 0x55b9ba8fe5d0 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f3513b8e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b9ba80bcf0 con 0x55b9ba8ffb40 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f3513b8e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b9ba8602b0 con 0x55b9ba909370 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f350a7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba90b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f350a7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba90b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:37380/0 (socket says 172.21.15.100:37380) 2024-09-12T02:53:32.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.747+0000 7f350a7fc640 1 -- 172.21.15.100:0/4055216199 learned_addr learned my addr 172.21.15.100:0/4055216199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.748+0000 7f350a7fc640 1 -- 172.21.15.100:0/4055216199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 msgr2=0x55b9ba8fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.748+0000 7f350a7fc640 1 --2- 172.21.15.100:0/4055216199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 0x55b9ba8fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.748+0000 7f350a7fc640 1 -- 172.21.15.100:0/4055216199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 msgr2=0x55b9ba8fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.748+0000 7f350a7fc640 1 --2- 172.21.15.100:0/4055216199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.748+0000 7f350a7fc640 1 -- 172.21.15.100:0/4055216199 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ba7f03a0 con 0x55b9ba909370 2024-09-12T02:53:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.748+0000 7f34f3fff640 1 -- 172.21.15.100:0/2277248976 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f3504014070 con 0x7f350c109450 2024-09-12T02:53:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.749+0000 7f34f3fff640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34f40a2d50 0x7f34f40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.750+0000 7f34f3fff640 1 -- 172.21.15.100:0/2277248976 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f35040efae0 con 0x7f350c109450 2024-09-12T02:53:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.751+0000 7f350a7fc640 1 --2- 172.21.15.100:0/4055216199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba90b760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009bb0 tx=0x7f34fc00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d3d142274f63b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.751+0000 7f34f17fa640 1 -- 172.21.15.100:0/4055216199 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc005020 con 0x55b9ba909370 2024-09-12T02:53:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.752+0000 7f34f17fa640 1 -- 172.21.15.100:0/4055216199 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34fc0047a0 con 0x55b9ba909370 2024-09-12T02:53:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.753+0000 7f3513b8e740 1 -- 172.21.15.100:0/4055216199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 msgr2=0x55b9ba90b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.753+0000 7f3513b8e740 1 --2- 172.21.15.100:0/4055216199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba90b760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009bb0 tx=0x7f34fc00e720 comp rx=0 tx=0).stop 2024-09-12T02:53:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.753+0000 7f350b7fe640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34f40a2d50 0x7f34f40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.754+0000 7f3513b8e740 1 -- 172.21.15.100:0/4055216199 shutdown_connections 2024-09-12T02:53:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.754+0000 7f3513b8e740 1 --2- 172.21.15.100:0/4055216199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba90b760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.754+0000 7f3513b8e740 1 --2- 172.21.15.100:0/4055216199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.754+0000 7f3513b8e740 1 --2- 172.21.15.100:0/4055216199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 0x55b9ba8fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.754+0000 7f3513b8e740 1 -- 172.21.15.100:0/4055216199 >> 172.21.15.100:0/4055216199 conn(0x55b9ba8c7310 msgr2=0x55b9ba8fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.755+0000 7f350b7fe640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34f40a2d50 0x7f34f40a5210 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3500006fd0 tx=0x7f3500008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.755+0000 7f3513b8e740 1 -- 172.21.15.100:0/4055216199 shutdown_connections 2024-09-12T02:53:32.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.755+0000 7f3513b8e740 1 -- 172.21.15.100:0/4055216199 wait complete. 2024-09-12T02:53:32.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 -- start start 2024-09-12T02:53:32.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 Processor -- start 2024-09-12T02:53:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba908d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 0x55b9ba905fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba909370 0x55b9ba906530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b9ba90c0c0 con 0x55b9ba909370 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b9ba81f060 con 0x55b9ba8ffb40 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b9ba90c240 con 0x55b9ba8fe5d0 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.756+0000 7f3513b8e740 10 client.0 _ll_register_callbacks cb 0x55b9ba5728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.757+0000 7f350b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba909370 0x55b9ba906530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.757+0000 7f350b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba909370 0x55b9ba906530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41644/0 (socket says 172.21.15.100:41644) 2024-09-12T02:53:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.757+0000 7f350b7fe640 1 -- 172.21.15.100:0/1548199998 learned_addr learned my addr 172.21.15.100:0/1548199998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:32.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.758+0000 7f350b7fe640 1 -- 172.21.15.100:0/1548199998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8fe5d0 msgr2=0x55b9ba908d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:32.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.758+0000 7f350b7fe640 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba908d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.758+0000 7f350b7fe640 1 -- 172.21.15.100:0/1548199998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 msgr2=0x55b9ba905fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.758+0000 7f350b7fe640 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 0x55b9ba905fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.758+0000 7f350b7fe640 1 -- 172.21.15.100:0/1548199998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ba5d53c0 con 0x55b9ba909370 2024-09-12T02:53:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.759+0000 7f350b7fe640 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba909370 0x55b9ba906530 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f350000dd60 tx=0x7f3500014800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e6cfa1d2f9a8ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.759+0000 7f34eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:53:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.759+0000 7f34eeff5640 1 -- 172.21.15.100:0/1548199998 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500024060 con 0x55b9ba909370 2024-09-12T02:53:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.759+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34fc0047a0 con 0x55b9ba909370 2024-09-12T02:53:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.760+0000 7f34eeff5640 1 -- 172.21.15.100:0/1548199998 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f350001f400 con 0x55b9ba909370 2024-09-12T02:53:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.764+0000 7f34eeff5640 1 -- 172.21.15.100:0/1548199998 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f350001f600 con 0x55b9ba909370 2024-09-12T02:53:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.764+0000 7f3513b8e740 10 client.17988 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.764+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b9ba917c20 con 0x55b9ba909370 2024-09-12T02:53:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f34eeff5640 1 -- 172.21.15.100:0/1548199998 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34fc0047a0 con 0x55b9ba909370 2024-09-12T02:53:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f34eeff5640 1 -- 172.21.15.100:0/1548199998 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3500013070 con 0x55b9ba909370 2024-09-12T02:53:32.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f3513b8e740 10 client.17988 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f3513b8e740 10 client.17988 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f3513b8e740 20 client.17988 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f3513b8e740 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba919550 0x55b9ba91ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f3513b8e740 4 client.17988 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ba871860 con 0x55b9ba919550 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.765+0000 7f350affd640 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba919550 0x55b9ba91ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.766+0000 7f34eeff5640 10 client.17988 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:53:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.766+0000 7f350affd640 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba919550 0x55b9ba91ba10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb4d81e74de4d754 server_cookie=9c4e4e4640b31fc1 in_seq=0 out_seq=0 2024-09-12T02:53:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f34eeff5640 1 -- 172.21.15.100:0/1548199998 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9ba871860 con 0x55b9ba919550 2024-09-12T02:53:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f34eeff5640 10 client.17988 handle_command_reply: tid=0 2024-09-12T02:53:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 client.17988 shutdown 2024-09-12T02:53:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba909370 msgr2=0x55b9ba906530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba909370 0x55b9ba906530 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f350000dd60 tx=0x7f3500014800 comp rx=0 tx=0).stop 2024-09-12T02:53:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 shutdown_connections 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba919550 0x55b9ba91ba10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba909370 0x55b9ba906530 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8ffb40 0x55b9ba905fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 --2- 172.21.15.100:0/1548199998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba908d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 >> 172.21.15.100:0/1548199998 conn(0x55b9ba8c7310 msgr2=0x55b9ba900960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f34eeff5640 0 client.17988 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.767+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 shutdown_connections 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.768+0000 7f3513b8e740 1 -- 172.21.15.100:0/1548199998 wait complete. 2024-09-12T02:53:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.768+0000 7f3513b8e740 20 client.17988 trim_cache size 0 max 16384 2024-09-12T02:53:32.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.784+0000 7f3513b8e740 1 Processor -- start 2024-09-12T02:53:32.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.784+0000 7f3513b8e740 1 -- start start 2024-09-12T02:53:32.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8ffb40 0x55b9ba9153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba901120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f3513b8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1d84f0 con 0x55b9ba8ffb40 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f3513b8e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1d5dc0 con 0x55b9ba8fe5d0 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f3513b8e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1d3c10 con 0x55b9ba909370 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f350affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f350affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42346/0 (socket says 172.21.15.100:42346) 2024-09-12T02:53:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f350affd640 1 -- 172.21.15.100:0/357803532 learned_addr learned my addr 172.21.15.100:0/357803532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f350a7fc640 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8ffb40 0x55b9ba9153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.785+0000 7f350b7fe640 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba901120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.786+0000 7f350b7fe640 1 -- 172.21.15.100:0/357803532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8fe5d0 msgr2=0x55b9ba8fae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.786+0000 7f350b7fe640 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.786+0000 7f350b7fe640 1 -- 172.21.15.100:0/357803532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8ffb40 msgr2=0x55b9ba9153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.786+0000 7f350b7fe640 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8ffb40 0x55b9ba9153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.786+0000 7f350b7fe640 1 -- 172.21.15.100:0/357803532 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ba904500 con 0x55b9ba909370 2024-09-12T02:53:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.786+0000 7f350b7fe640 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba901120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35000126c0 tx=0x7f35000096b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627f2263875b8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.786+0000 7f34f0ff9640 1 -- 172.21.15.100:0/357803532 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350000d5b0 con 0x55b9ba909370 2024-09-12T02:53:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.787+0000 7f34f0ff9640 1 -- 172.21.15.100:0/357803532 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f350001f400 con 0x55b9ba909370 2024-09-12T02:53:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.787+0000 7f34f0ff9640 1 -- 172.21.15.100:0/357803532 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350001f7a0 con 0x55b9ba909370 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 -- 172.21.15.100:0/357803532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 msgr2=0x55b9ba901120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba901120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35000126c0 tx=0x7f35000096b0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 -- 172.21.15.100:0/357803532 shutdown_connections 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba909370 0x55b9ba901120 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8ffb40 0x55b9ba9153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 --2- 172.21.15.100:0/357803532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba8fae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 -- 172.21.15.100:0/357803532 >> 172.21.15.100:0/357803532 conn(0x55b9ba8c7310 msgr2=0x55b9ba8fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 -- 172.21.15.100:0/357803532 shutdown_connections 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.788+0000 7f3513b8e740 1 -- 172.21.15.100:0/357803532 wait complete. 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 -- start start 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 Processor -- start 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba90ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8ffb40 0x55b9ba90d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba909370 0x55b9ba97c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1d4280 con 0x55b9ba8fe5d0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1d56f0 con 0x55b9ba909370 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1d4950 con 0x55b9ba8ffb40 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f3513b8e740 10 client.0 _ll_register_callbacks cb 0x7f350c110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f350b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba909370 0x55b9ba97c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f350affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba90ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.789+0000 7f350b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba909370 0x55b9ba97c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42362/0 (socket says 172.21.15.100:42362) 2024-09-12T02:53:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350b7fe640 1 -- 172.21.15.100:0/3319470600 learned_addr learned my addr 172.21.15.100:0/3319470600 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350a7fc640 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8ffb40 0x55b9ba90d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350b7fe640 1 -- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8ffb40 msgr2=0x55b9ba90d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350b7fe640 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8ffb40 0x55b9ba90d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350b7fe640 1 -- 172.21.15.100:0/3319470600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 msgr2=0x55b9ba90ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350b7fe640 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba90ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350b7fe640 1 -- 172.21.15.100:0/3319470600 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ba97cac0 con 0x55b9ba909370 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350a7fc640 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8ffb40 0x55b9ba90d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f350b7fe640 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba909370 0x55b9ba97c2b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3500012690 tx=0x7f3500012b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37aa087019787cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f34eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.790+0000 7f34eeff5640 1 -- 172.21.15.100:0/3319470600 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500037020 con 0x55b9ba909370 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f350001f400 con 0x55b9ba909370 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f34eeff5640 1 -- 172.21.15.100:0/3319470600 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3500005c30 con 0x55b9ba909370 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f34eeff5640 1 -- 172.21.15.100:0/3319470600 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3500005e30 con 0x55b9ba909370 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 10 client.27191 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b9ba983cd0 con 0x55b9ba909370 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f34eeff5640 1 -- 172.21.15.100:0/3319470600 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f350001f400 con 0x55b9ba909370 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f34eeff5640 1 -- 172.21.15.100:0/3319470600 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f350003c030 con 0x55b9ba909370 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 10 client.27191 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 10 client.27191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 20 client.27191 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba984330 0x55b9ba986750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 4 client.27191 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9ba86bd70 con 0x55b9ba984330 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.791+0000 7f350affd640 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba984330 0x55b9ba986750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f34eeff5640 10 client.27191 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f350affd640 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba984330 0x55b9ba986750 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83c5bcbac6be501e server_cookie=7fb1a784d215886 in_seq=0 out_seq=0 2024-09-12T02:53:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f34eeff5640 1 -- 172.21.15.100:0/3319470600 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9ba86bd70 con 0x55b9ba984330 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f34eeff5640 10 client.27191 handle_command_reply: tid=0 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 client.27191 shutdown 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba909370 msgr2=0x55b9ba97c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba909370 0x55b9ba97c2b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3500012690 tx=0x7f3500012b10 comp rx=0 tx=0).stop 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 shutdown_connections 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55b9ba984330 0x55b9ba986750 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f34eeff5640 0 client.27191 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b9ba909370 0x55b9ba97c2b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b9ba8ffb40 0x55b9ba90d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 --2- 172.21.15.100:0/3319470600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b9ba8fe5d0 0x55b9ba90ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 >> 172.21.15.100:0/3319470600 conn(0x55b9ba8c7310 msgr2=0x55b9ba907810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 shutdown_connections 2024-09-12T02:53:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.792+0000 7f3513b8e740 1 -- 172.21.15.100:0/3319470600 wait complete. 2024-09-12T02:53:32.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f3513b8e740 20 client.27191 trim_cache size 0 max 16384 2024-09-12T02:53:32.798 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34f40a2d50 msgr2=0x7f34f40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34f40a2d50 0x7f34f40a5210 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3500006fd0 tx=0x7f3500008040 comp rx=0 tx=0).stop 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c109450 msgr2=0x7f350c11a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c109450 0x7f350c11a8a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f350403be20 tx=0x7f3504040740 comp rx=0 tx=0).stop 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 shutdown_connections 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f34f40a2d50 0x7f34f40a5210 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f350c11b140 0x7f350c116e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f350c109830 0x7f350c116940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 --2- 172.21.15.100:0/2277248976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f350c109450 0x7f350c11a8a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 >> 172.21.15.100:0/2277248976 conn(0x7f350c06e140 msgr2=0x7f350c070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.793+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 shutdown_connections 2024-09-12T02:53:32.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:32.794+0000 7f35117b5640 1 -- 172.21.15.100:0/2277248976 wait complete. 2024-09-12T02:53:33.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:53:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:34.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 -- 172.21.15.100:0/2016236611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 msgr2=0x7effa410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 --2- 172.21.15.100:0/2016236611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 0x7effa410da40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009ca0 tx=0x7eff9c02a950 comp rx=0 tx=0).stop 2024-09-12T02:53:34.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 -- 172.21.15.100:0/2016236611 shutdown_connections 2024-09-12T02:53:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 --2- 172.21.15.100:0/2016236611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 0x7effa410da40 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 --2- 172.21.15.100:0/2016236611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effa4102570 0x7effa41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 --2- 172.21.15.100:0/2016236611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa4100e20 0x7effa4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 -- 172.21.15.100:0/2016236611 >> 172.21.15.100:0/2016236611 conn(0x7effa40fc7d0 msgr2=0x7effa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 -- 172.21.15.100:0/2016236611 shutdown_connections 2024-09-12T02:53:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.910+0000 7effabd2a640 1 -- 172.21.15.100:0/2016236611 wait complete. 2024-09-12T02:53:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 Processor -- start 2024-09-12T02:53:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 -- start start 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effa4100e20 0x7effa41962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa4102570 0x7effa4196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 0x7effa419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effa410fec0 con 0x7effa4102ef0 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa410fd40 con 0x7effa4102570 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effabd2a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effa4110040 con 0x7effa4100e20 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effa9ac6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effa4100e20 0x7effa41962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effa9ac6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effa4100e20 0x7effa41962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51314/0 (socket says 172.21.15.100:51314) 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.911+0000 7effa9ac6640 1 -- 172.21.15.100:0/3837208869 learned_addr learned my addr 172.21.15.100:0/3837208869 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effa92c5640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa4102570 0x7effa4196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effa92c5640 1 -- 172.21.15.100:0/3837208869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effa4100e20 msgr2=0x7effa41962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effa92c5640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effa4100e20 0x7effa41962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effa92c5640 1 -- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 msgr2=0x7effa419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effaa2c7640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 0x7effa419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effa92c5640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 0x7effa419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effa92c5640 1 -- 172.21.15.100:0/3837208869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa419b290 con 0x7effa4102570 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.912+0000 7effaa2c7640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 0x7effa419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.913+0000 7effa92c5640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa4102570 0x7effa4196820 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7eff9400e9f0 tx=0x7eff9400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.913+0000 7eff9affd640 1 -- 172.21.15.100:0/3837208869 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9400ccc0 con 0x7effa4102570 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.913+0000 7eff9affd640 1 -- 172.21.15.100:0/3837208869 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff94005020 con 0x7effa4102570 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.913+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa419b580 con 0x7effa4102570 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.913+0000 7eff9affd640 1 -- 172.21.15.100:0/3837208869 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940049e0 con 0x7effa4102570 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.913+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa41a2e60 con 0x7effa4102570 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.915+0000 7eff9affd640 1 -- 172.21.15.100:0/3837208869 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7eff94005560 con 0x7effa4102570 2024-09-12T02:53:34.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.917+0000 7effae103740 1 Processor -- start 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7eff9affd640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7eff900a2b90 0x7eff900a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effa9ac6640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7eff900a2b90 0x7eff900a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effae103740 1 -- start start 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7eff9affd640 1 -- 172.21.15.100:0/3837208869 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7eff940cf010 con 0x7effa4102570 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effae103740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3d98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effae103740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3d9de0 0x561d7b3da220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effae103740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effae103740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561d7b3372f0 con 0x561d7b3db350 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effae103740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561d7b2decf0 con 0x561d7b3d9de0 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effae103740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561d7b3332b0 con 0x561d7b3e4b80 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effa92c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3d9de0 0x561d7b3da220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effa92c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3d9de0 0x561d7b3da220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49468/0 (socket says 172.21.15.100:49468) 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effa92c5640 1 -- 172.21.15.100:0/4165516130 learned_addr learned my addr 172.21.15.100:0/4165516130 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.918+0000 7effa9ac6640 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3d98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effaa2c7640 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa92c5640 1 -- 172.21.15.100:0/4165516130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 msgr2=0x561d7b3e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa92c5640 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa92c5640 1 -- 172.21.15.100:0/4165516130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 msgr2=0x561d7b3d98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa92c5640 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3d98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa92c5640 1 -- 172.21.15.100:0/4165516130 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7b2c33a0 con 0x561d7b3d9de0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa9ac6640 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3d98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa9ac6640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7eff900a2b90 0x7eff900a5050 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7effa0011630 tx=0x7effa0011a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7effa92c5640 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3d9de0 0x561d7b3da220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff940a3fe0 tx=0x7eff9409b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=752de5ce5bded9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7eff8ffff640 1 -- 172.21.15.100:0/4165516130 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9401c040 con 0x561d7b3d9de0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.919+0000 7eff8ffff640 1 -- 172.21.15.100:0/4165516130 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff9409fc50 con 0x561d7b3d9de0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.920+0000 7eff8ffff640 1 -- 172.21.15.100:0/4165516130 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94086070 con 0x561d7b3d9de0 2024-09-12T02:53:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.920+0000 7effae103740 1 -- 172.21.15.100:0/4165516130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3d9de0 msgr2=0x561d7b3da220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.920+0000 7effae103740 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3d9de0 0x561d7b3da220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff940a3fe0 tx=0x7eff9409b7a0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.920+0000 7effae103740 1 -- 172.21.15.100:0/4165516130 shutdown_connections 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.920+0000 7effae103740 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.920+0000 7effae103740 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3d9de0 0x561d7b3da220 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff940a3fe0 tx=0x7eff9409b7a0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.920+0000 7effae103740 1 --2- 172.21.15.100:0/4165516130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3d98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.921+0000 7effae103740 1 -- 172.21.15.100:0/4165516130 >> 172.21.15.100:0/4165516130 conn(0x561d7b39a310 msgr2=0x561d7b3d6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.921+0000 7effae103740 1 -- 172.21.15.100:0/4165516130 shutdown_connections 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.921+0000 7effae103740 1 -- 172.21.15.100:0/4165516130 wait complete. 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.921+0000 7effae103740 1 -- start start 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 1 Processor -- start 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3db350 0x561d7b3e1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561d7b3e78d0 con 0x561d7b3e4b80 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561d7b2f2060 con 0x561d7b3e24b0 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561d7b3e7a50 con 0x561d7b3db350 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effae103740 10 client.0 _ll_register_callbacks cb 0x561d7b0458c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effa92c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effaa2c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effaa2c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49476/0 (socket says 172.21.15.100:49476) 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effaa2c7640 1 -- 172.21.15.100:0/1014504216 learned_addr learned my addr 172.21.15.100:0/1014504216 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.922+0000 7effa9ac6640 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3db350 0x561d7b3e1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effaa2c7640 1 -- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3db350 msgr2=0x561d7b3e1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effaa2c7640 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3db350 0x561d7b3e1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effaa2c7640 1 -- 172.21.15.100:0/1014504216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 msgr2=0x561d7b3e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effaa2c7640 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3e1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effaa2c7640 1 -- 172.21.15.100:0/1014504216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d7b0a83c0 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effa92c5640 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effaa2c7640 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff9c035000 tx=0x7eff9c02f880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba38fd827e35db6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7eff8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7eff8d7fa640 1 -- 172.21.15.100:0/1014504216 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c034050 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff9409fc50 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7eff8d7fa640 1 -- 172.21.15.100:0/1014504216 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7eff9c02f930 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7eff8d7fa640 1 -- 172.21.15.100:0/1014504216 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff9c02fb30 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effae103740 10 client.27203 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561d7b3f39a0 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.923+0000 7eff8d7fa640 1 -- 172.21.15.100:0/1014504216 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff9409fc50 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7eff8d7fa640 1 -- 172.21.15.100:0/1014504216 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7eff9c04c030 con 0x561d7b3e24b0 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7effae103740 10 client.27203 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7effae103740 10 client.27203 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:53:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7effae103740 20 client.27203 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7effae103740 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b3f51e0 0x561d7b3f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7effae103740 4 client.27203 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d7b344860 con 0x561d7b3f51e0 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.924+0000 7effa9ac6640 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b3f51e0 0x561d7b3f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.926+0000 7effa9ac6640 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b3f51e0 0x561d7b3f7660 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a679d91279663e4 server_cookie=3d2dbf51982105c2 in_seq=0 out_seq=0 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.926+0000 7eff8d7fa640 10 client.27203 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.926+0000 7eff8d7fa640 1 -- 172.21.15.100:0/1014504216 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d7b344860 con 0x561d7b3f51e0 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.926+0000 7eff8d7fa640 10 client.27203 handle_command_reply: tid=0 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 client.27203 shutdown 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 msgr2=0x561d7b3f0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff9c035000 tx=0x7eff9c02f880 comp rx=0 tx=0).stop 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 shutdown_connections 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b3f51e0 0x561d7b3f7660 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7eff8d7fa640 0 client.27203 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 --2- 172.21.15.100:0/1014504216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3db350 0x561d7b3e1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 >> 172.21.15.100:0/1014504216 conn(0x561d7b39a310 msgr2=0x561d7b3dc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 shutdown_connections 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 1 -- 172.21.15.100:0/1014504216 wait complete. 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.927+0000 7effae103740 20 client.27203 trim_cache size 0 max 16384 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 Processor -- start 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 -- start start 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effa41adc90 con 0x561d7b3db350 2024-09-12T02:53:34.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa41ab560 con 0x561d7b3e24b0 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effae103740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effa41a93b0 con 0x561d7b3e4b80 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa92c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa9ac6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa9ac6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3dd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40790/0 (socket says 172.21.15.100:40790) 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa92c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49478/0 (socket says 172.21.15.100:49478) 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa9ac6640 1 -- 172.21.15.100:0/3671471898 learned_addr learned my addr 172.21.15.100:0/3671471898 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effaa2c7640 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa92c5640 1 -- 172.21.15.100:0/3671471898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 msgr2=0x561d7b3f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa92c5640 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa92c5640 1 -- 172.21.15.100:0/3671471898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 msgr2=0x561d7b3dd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa92c5640 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3dd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa92c5640 1 -- 172.21.15.100:0/3671471898 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d7b3f7ce0 con 0x561d7b3e24b0 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effaa2c7640 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.943+0000 7effa9ac6640 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.944+0000 7effa92c5640 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0b70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561d7b3da900 tx=0x7eff9409b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19acda72dfc2a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.944+0000 7eff8f7fe640 1 -- 172.21.15.100:0/3671471898 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940b9070 con 0x561d7b3e24b0 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.945+0000 7eff8f7fe640 1 -- 172.21.15.100:0/3671471898 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff94099ba0 con 0x561d7b3e24b0 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.945+0000 7eff8f7fe640 1 -- 172.21.15.100:0/3671471898 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9401c040 con 0x561d7b3e24b0 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 -- 172.21.15.100:0/3671471898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 msgr2=0x561d7b3f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0b70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561d7b3da900 tx=0x7eff9409b700 comp rx=0 tx=0).stop 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 -- 172.21.15.100:0/3671471898 shutdown_connections 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e4b80 0x561d7b3f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3e24b0 0x561d7b3f0b70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 --2- 172.21.15.100:0/3671471898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3db350 0x561d7b3dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 -- 172.21.15.100:0/3671471898 >> 172.21.15.100:0/3671471898 conn(0x561d7b39a310 msgr2=0x561d7b3dcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 -- 172.21.15.100:0/3671471898 shutdown_connections 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.946+0000 7effae103740 1 -- 172.21.15.100:0/3671471898 wait complete. 2024-09-12T02:53:34.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 -- start start 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 Processor -- start 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3db350 0x561d7b3ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e24b0 0x561d7b3ed520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3dedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effa41a9a20 con 0x561d7b3e4b80 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa41aae90 con 0x561d7b3db350 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effa41aa0f0 con 0x561d7b3e24b0 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.947+0000 7effae103740 10 client.0 _ll_register_callbacks cb 0x7eff94005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3dedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3dedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40800/0 (socket says 172.21.15.100:40800) 2024-09-12T02:53:34.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 -- 172.21.15.100:0/2424644157 learned_addr learned my addr 172.21.15.100:0/2424644157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effa9ac6640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3db350 0x561d7b3ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effa92c5640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e24b0 0x561d7b3ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 -- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e24b0 msgr2=0x561d7b3ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e24b0 0x561d7b3ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 -- 172.21.15.100:0/2424644157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3db350 msgr2=0x561d7b3ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3db350 0x561d7b3ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 -- 172.21.15.100:0/2424644157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d7b3df5f0 con 0x561d7b3e4b80 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effa9ac6640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3db350 0x561d7b3ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7effaa2c7640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3dedf0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7eff9c044580 tx=0x7eff9c044830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4580a7aeed362db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.948+0000 7eff8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.949+0000 7eff8d7fa640 1 -- 172.21.15.100:0/2424644157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c05b020 con 0x561d7b3e4b80 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.949+0000 7eff8d7fa640 1 -- 172.21.15.100:0/2424644157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7eff9c044bc0 con 0x561d7b3e4b80 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.949+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff94099ba0 con 0x561d7b3e4b80 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.949+0000 7eff8d7fa640 1 -- 172.21.15.100:0/2424644157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff9c034040 con 0x561d7b3e4b80 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.949+0000 7effae103740 10 client.18009 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.949+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561d7b3e6240 con 0x561d7b3e4b80 2024-09-12T02:53:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.949+0000 7eff8d7fa640 1 -- 172.21.15.100:0/2424644157 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff94099ba0 con 0x561d7b3e4b80 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7eff8d7fa640 1 -- 172.21.15.100:0/2424644157 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7eff9c04c050 con 0x561d7b3e4b80 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7effae103740 10 client.18009 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7effae103740 10 client.18009 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7effae103740 20 client.18009 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7effae103740 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b460280 0x561d7b462670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7effae103740 4 client.18009 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d7b33ed70 con 0x561d7b460280 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.950+0000 7effa9ac6640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b460280 0x561d7b462670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7eff8d7fa640 10 client.18009 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effa9ac6640 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b460280 0x561d7b462670 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c78320e1c5cf715 server_cookie=aae20ad910e6ea33 in_seq=0 out_seq=0 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7eff8d7fa640 1 -- 172.21.15.100:0/2424644157 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d7b33ed70 con 0x561d7b460280 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7eff8d7fa640 10 client.18009 handle_command_reply: tid=0 2024-09-12T02:53:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 client.18009 shutdown 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 msgr2=0x561d7b3dedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3dedf0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7eff9c044580 tx=0x7eff9c044830 comp rx=0 tx=0).stop 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 shutdown_connections 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x561d7b460280 0x561d7b462670 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d7b3e4b80 0x561d7b3dedf0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d7b3e24b0 0x561d7b3ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 --2- 172.21.15.100:0/2424644157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d7b3db350 0x561d7b3ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7eff8d7fa640 0 client.18009 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 >> 172.21.15.100:0/2424644157 conn(0x561d7b39a310 msgr2=0x561d7b3e3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 shutdown_connections 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.951+0000 7effae103740 1 -- 172.21.15.100:0/2424644157 wait complete. 2024-09-12T02:53:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effae103740 20 client.18009 trim_cache size 0 max 16384 2024-09-12T02:53:34.987 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7eff900a2b90 msgr2=0x7eff900a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7eff900a2b90 0x7eff900a5050 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7effa0011630 tx=0x7effa0011a30 comp rx=0 tx=0).stop 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa4102570 msgr2=0x7effa4196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa4102570 0x7effa4196820 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7eff9400e9f0 tx=0x7eff9400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 shutdown_connections 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7eff900a2b90 0x7eff900a5050 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effa4102ef0 0x7effa419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa4102570 0x7effa4196820 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 --2- 172.21.15.100:0/3837208869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effa4100e20 0x7effa41962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.952+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 >> 172.21.15.100:0/3837208869 conn(0x7effa40fc7d0 msgr2=0x7effa4106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.954+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 shutdown_connections 2024-09-12T02:53:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:34.954+0000 7effabd2a640 1 -- 172.21.15.100:0/3837208869 wait complete. 2024-09-12T02:53:35.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:34 smithi100 ceph-mon[31390]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 582 op/s 2024-09-12T02:53:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:34 smithi189 ceph-mon[35196]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 582 op/s 2024-09-12T02:53:35.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:34 smithi117 ceph-mon[34898]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 582 op/s 2024-09-12T02:53:35.730 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:53:36.144 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 865.0 s, 1922.4 tps, lat 52.136 ms stddev 58.823 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 -- 172.21.15.100:0/979368692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc109e00 msgr2=0x7f48bc10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 --2- 172.21.15.100:0/979368692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc109e00 0x7f48bc10d690 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009860 tx=0x7f48b002a340 comp rx=0 tx=0).stop 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 -- 172.21.15.100:0/979368692 shutdown_connections 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 --2- 172.21.15.100:0/979368692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48bc10ddc0 0x7f48bc115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 --2- 172.21.15.100:0/979368692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc109e00 0x7f48bc10d690 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 --2- 172.21.15.100:0/979368692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 0x7f48bc109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 -- 172.21.15.100:0/979368692 >> 172.21.15.100:0/979368692 conn(0x7f48bc06e140 msgr2=0x7f48bc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 -- 172.21.15.100:0/979368692 shutdown_connections 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.675+0000 7f48c2a55640 1 -- 172.21.15.100:0/979368692 wait complete. 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.676+0000 7f48c2a55640 1 Processor -- start 2024-09-12T02:53:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.676+0000 7f48c2a55640 1 -- start start 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48c2a55640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 0x7f48bc19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48c2a55640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48bc109e00 0x7f48bc19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48c2a55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc10ddc0 0x7f48bc19f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48c2a55640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1185a0 con 0x7f48bc109e00 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48c2a55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc118420 con 0x7f48bc10ddc0 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48c2a55640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc118720 con 0x7f48bc109450 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 0x7f48bc19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 0x7f48bc19e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51368/0 (socket says 172.21.15.100:51368) 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 -- 172.21.15.100:0/3816402728 learned_addr learned my addr 172.21.15.100:0/3816402728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 -- 172.21.15.100:0/3816402728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc10ddc0 msgr2=0x7f48bc19f330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc10ddc0 0x7f48bc19f330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 -- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48bc109e00 msgr2=0x7f48bc19edf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48bc109e00 0x7f48bc19edf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.677+0000 7f48bbfff640 1 -- 172.21.15.100:0/3816402728 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc1af150 con 0x7f48bc109450 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.678+0000 7f48bbfff640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 0x7f48bc19e8b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48b400afc0 tx=0x7f48b400b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.678+0000 7f48b97fa640 1 -- 172.21.15.100:0/3816402728 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40165e0 con 0x7f48bc109450 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.678+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc1a0a50 con 0x7f48bc109450 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.678+0000 7f48b97fa640 1 -- 172.21.15.100:0/3816402728 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48b4016780 con 0x7f48bc109450 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.678+0000 7f48b97fa640 1 -- 172.21.15.100:0/3816402728 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b400d640 con 0x7f48bc109450 2024-09-12T02:53:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.678+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48bc1a0fe0 con 0x7f48bc109450 2024-09-12T02:53:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 Processor -- start 2024-09-12T02:53:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48b97fa640 1 -- 172.21.15.100:0/3816402728 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f48b400e450 con 0x7f48bc109450 2024-09-12T02:53:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 -- start start 2024-09-12T02:53:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558e867222f0 con 0x558e867bc5d0 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558e866c9cf0 con 0x558e867bdb40 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558e8671e2b0 con 0x558e867c7370 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c0ff2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c0ff2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49510/0 (socket says 172.21.15.100:49510) 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48c0ff2640 1 -- 172.21.15.100:0/467911877 learned_addr learned my addr 172.21.15.100:0/467911877 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.682+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48bb7fe640 1 -- 172.21.15.100:0/467911877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 msgr2=0x558e867bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48bb7fe640 1 -- 172.21.15.100:0/467911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 msgr2=0x558e867bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48bb7fe640 1 -- 172.21.15.100:0/467911877 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e866ae3a0 con 0x558e867c7370 2024-09-12T02:53:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48b97fa640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48a40a2c00 0x7f48a40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c9760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48b002a860 tx=0x7f48b0009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ec7c75780febef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48a40a2c00 0x7f48a40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48b97fa640 1 -- 172.21.15.100:0/3816402728 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f48b40e0b70 con 0x7f48bc109450 2024-09-12T02:53:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48a27fc640 1 -- 172.21.15.100:0/467911877 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b003f020 con 0x558e867c7370 2024-09-12T02:53:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48a27fc640 1 -- 172.21.15.100:0/467911877 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48b0030e50 con 0x558e867c7370 2024-09-12T02:53:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.683+0000 7f48a27fc640 1 -- 172.21.15.100:0/467911877 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b003f020 con 0x558e867c7370 2024-09-12T02:53:36.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c4e2e740 1 -- 172.21.15.100:0/467911877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 msgr2=0x558e867c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c9760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48b002a860 tx=0x7f48b0009450 comp rx=0 tx=0).stop 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48a40a2c00 0x7f48a40a50c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009c30 tx=0x7f48ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c4e2e740 1 -- 172.21.15.100:0/467911877 shutdown_connections 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c9760 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/467911877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.684+0000 7f48c4e2e740 1 -- 172.21.15.100:0/467911877 >> 172.21.15.100:0/467911877 conn(0x558e86785310 msgr2=0x558e867b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.685+0000 7f48c4e2e740 1 -- 172.21.15.100:0/467911877 shutdown_connections 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.685+0000 7f48c4e2e740 1 -- 172.21.15.100:0/467911877 wait complete. 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.686+0000 7f48c4e2e740 1 -- start start 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.686+0000 7f48c4e2e740 1 Processor -- start 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.686+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.686+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.686+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558e867ca010 con 0x558e867bc5d0 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558e866dd060 con 0x558e867bdb40 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558e867ca190 con 0x558e867c7370 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48bb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51386/0 (socket says 172.21.15.100:51386) 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48bb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49516/0 (socket says 172.21.15.100:49516) 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 -- 172.21.15.100:0/2818898262 learned_addr learned my addr 172.21.15.100:0/2818898262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c4e2e740 10 client.0 _ll_register_callbacks cb 0x558e864308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 -- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 msgr2=0x558e867c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:36.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48bbfff640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 -- 172.21.15.100:0/2818898262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 msgr2=0x558e867c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 -- 172.21.15.100:0/2818898262 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e864933c0 con 0x558e867c7370 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.687+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c4570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00e780 tx=0x7f48ac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c66b0bc621fb1540 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.688+0000 7f489b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.688+0000 7f48bbfff640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.688+0000 7f489b7fe640 1 -- 172.21.15.100:0/2818898262 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00f940 con 0x558e867c7370 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.688+0000 7f489b7fe640 1 -- 172.21.15.100:0/2818898262 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f48ac00fae0 con 0x558e867c7370 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.688+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48b0030e50 con 0x558e867c7370 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f489b7fe640 1 -- 172.21.15.100:0/2818898262 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f48ac00fce0 con 0x558e867c7370 2024-09-12T02:53:36.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 10 client.27145 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e867d5af0 con 0x558e867c7370 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f489b7fe640 1 -- 172.21.15.100:0/2818898262 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48ac00fe80 con 0x558e867c7370 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f489b7fe640 1 -- 172.21.15.100:0/2818898262 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f48ac01e680 con 0x558e867c7370 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 10 client.27145 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 10 client.27145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 20 client.27145 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e867d93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 4 client.27145 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.689+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f48b0030e50 con 0x558e867d6fb0 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.690+0000 7f48bbfff640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e867d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.690+0000 7f48bbfff640 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e867d93a0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24550b3b0555189f server_cookie=e1d3267d53bed0e8 in_seq=0 out_seq=0 2024-09-12T02:53:36.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.690+0000 7f489b7fe640 10 client.27145 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.691+0000 7f489b7fe640 1 -- 172.21.15.100:0/2818898262 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f48b0030e50 con 0x558e867d6fb0 2024-09-12T02:53:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.691+0000 7f489b7fe640 10 client.27145 handle_command_reply: tid=0 2024-09-12T02:53:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.691+0000 7f48c4e2e740 1 client.27145 shutdown 2024-09-12T02:53:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 msgr2=0x558e867c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c4570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00e780 tx=0x7f48ac004730 comp rx=0 tx=0).stop 2024-09-12T02:53:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 shutdown_connections 2024-09-12T02:53:36.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e867d93a0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f489b7fe640 0 client.27145 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867c7370 0x558e867c4570 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/2818898262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bc5d0 0x558e867c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.692+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 >> 172.21.15.100:0/2818898262 conn(0x558e86785310 msgr2=0x558e867be930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.693+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 shutdown_connections 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.693+0000 7f48c4e2e740 1 -- 172.21.15.100:0/2818898262 wait complete. 2024-09-12T02:53:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.693+0000 7f48c4e2e740 20 client.27145 trim_cache size 0 max 16384 2024-09-12T02:53:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.718+0000 7f48c4e2e740 1 Processor -- start 2024-09-12T02:53:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.719+0000 7f48c4e2e740 1 -- start start 2024-09-12T02:53:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.719+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.719+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.719+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867c7370 0x558e867dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.719+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b64b0 con 0x558e867c7370 2024-09-12T02:53:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b3d80 con 0x558e867bdb40 2024-09-12T02:53:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b1bd0 con 0x558e867bc5d0 2024-09-12T02:53:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867c7370 0x558e867dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867c7370 0x558e867dec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40828/0 (socket says 172.21.15.100:40828) 2024-09-12T02:53:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 -- 172.21.15.100:0/3999332959 learned_addr learned my addr 172.21.15.100:0/3999332959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 -- 172.21.15.100:0/3999332959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 msgr2=0x558e867d32b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/3999332959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867d32b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 -- 172.21.15.100:0/3999332959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 msgr2=0x558e867c5f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/3999332959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.720+0000 7f48c0ff2640 1 -- 172.21.15.100:0/3999332959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e867c2f80 con 0x558e867c7370 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.721+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/3999332959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867c7370 0x558e867dec20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f48ac01ead0 tx=0x7f48ac00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e01f50dad1e197 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.721+0000 7f48a1ffb640 1 -- 172.21.15.100:0/3999332959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00e3b0 con 0x558e867c7370 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.721+0000 7f48a1ffb640 1 -- 172.21.15.100:0/3999332959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48ac00fe80 con 0x558e867c7370 2024-09-12T02:53:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.721+0000 7f48a1ffb640 1 -- 172.21.15.100:0/3999332959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac004590 con 0x558e867c7370 2024-09-12T02:53:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.722+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3999332959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867c7370 msgr2=0x558e867dec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.723+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3999332959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867c7370 0x558e867dec20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f48ac01ead0 tx=0x7f48ac00ef50 comp rx=0 tx=0).stop 2024-09-12T02:53:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.725+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3999332959 shutdown_connections 2024-09-12T02:53:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.725+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3999332959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867c7370 0x558e867dec20 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.725+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3999332959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867bdb40 0x558e867c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.725+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3999332959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.725+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3999332959 >> 172.21.15.100:0/3999332959 conn(0x558e86785310 msgr2=0x558e867c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.728+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3999332959 shutdown_connections 2024-09-12T02:53:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.728+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3999332959 wait complete. 2024-09-12T02:53:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.728+0000 7f48c4e2e740 1 -- start start 2024-09-12T02:53:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.729+0000 7f48c4e2e740 1 Processor -- start 2024-09-12T02:53:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.729+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.729+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bdb40 0x558e867cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.729+0000 7f48c4e2e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867c7370 0x558e867cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b2240 con 0x558e867bdb40 2024-09-12T02:53:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b36b0 con 0x558e867c7370 2024-09-12T02:53:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48c4e2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b2910 con 0x558e867bc5d0 2024-09-12T02:53:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48c4e2e740 10 client.0 _ll_register_callbacks cb 0x7f48ac009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bdb40 0x558e867cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bdb40 0x558e867cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40836/0 (socket says 172.21.15.100:40836) 2024-09-12T02:53:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bb7fe640 1 -- 172.21.15.100:0/3782090989 learned_addr learned my addr 172.21.15.100:0/3782090989 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bbfff640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bbfff640 1 -- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867c7370 msgr2=0x558e867cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867c7370 0x558e867cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bbfff640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867c7370 0x558e867cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bbfff640 1 -- 172.21.15.100:0/3782090989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bdb40 msgr2=0x558e867cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bbfff640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bdb40 0x558e867cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48bbfff640 1 -- 172.21.15.100:0/3782090989 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e867cbe20 con 0x558e867bc5d0 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.730+0000 7f48c0ff2640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867c7370 0x558e867cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.731+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bdb40 0x558e867cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.731+0000 7f48bbfff640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867cfcb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48b40de6b0 tx=0x7f48b4000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95e6b644642f86b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.731+0000 7f489b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:53:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.731+0000 7f489b7fe640 1 -- 172.21.15.100:0/3782090989 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40b1770 con 0x558e867bc5d0 2024-09-12T02:53:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.731+0000 7f489b7fe640 1 -- 172.21.15.100:0/3782090989 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f48b40e6070 con 0x558e867bc5d0 2024-09-12T02:53:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.731+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e8672f860 con 0x558e867bc5d0 2024-09-12T02:53:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.732+0000 7f489b7fe640 1 -- 172.21.15.100:0/3782090989 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f48b40b6030 con 0x558e867bc5d0 2024-09-12T02:53:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.732+0000 7f48c4e2e740 10 client.27148 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.732+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e86841d20 con 0x558e867bc5d0 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.733+0000 7f489b7fe640 1 -- 172.21.15.100:0/3782090989 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558e8672f860 con 0x558e867bc5d0 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.733+0000 7f489b7fe640 1 -- 172.21.15.100:0/3782090989 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f48b400b040 con 0x558e867bc5d0 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.734+0000 7f48c4e2e740 10 client.27148 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.734+0000 7f48c4e2e740 10 client.27148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.734+0000 7f48c4e2e740 20 client.27148 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.734+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e868443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.734+0000 7f48c4e2e740 4 client.27148 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.734+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e86729d70 con 0x558e867d6fb0 2024-09-12T02:53:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.735+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e868443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.736+0000 7f48bb7fe640 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e868443b0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600723306913669e server_cookie=abc73c501b771c84 in_seq=0 out_seq=0 2024-09-12T02:53:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.736+0000 7f489b7fe640 10 client.27148 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.736+0000 7f489b7fe640 1 -- 172.21.15.100:0/3782090989 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e86729d70 con 0x558e867d6fb0 2024-09-12T02:53:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.736+0000 7f489b7fe640 10 client.27148 handle_command_reply: tid=0 2024-09-12T02:53:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.736+0000 7f48c4e2e740 1 client.27148 shutdown 2024-09-12T02:53:36.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.740+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 msgr2=0x558e867cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.740+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867cfcb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48b40de6b0 tx=0x7f48b4000f40 comp rx=0 tx=0).stop 2024-09-12T02:53:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.742+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 shutdown_connections 2024-09-12T02:53:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.742+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558e867d6fb0 0x558e868443b0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f489b7fe640 0 client.27148 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558e867c7370 0x558e867cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558e867bdb40 0x558e867cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f48c4e2e740 1 --2- 172.21.15.100:0/3782090989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558e867bc5d0 0x558e867cfcb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 >> 172.21.15.100:0/3782090989 conn(0x558e86785310 msgr2=0x558e867c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 shutdown_connections 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f48c4e2e740 1 -- 172.21.15.100:0/3782090989 wait complete. 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.743+0000 7f48c4e2e740 20 client.27148 trim_cache size 0 max 16384 2024-09-12T02:53:36.744 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48a40a2c00 msgr2=0x7f48a40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48a40a2c00 0x7f48a40a50c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009c30 tx=0x7f48ac009260 comp rx=0 tx=0).stop 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 msgr2=0x7f48bc19e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 0x7f48bc19e8b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48b400afc0 tx=0x7f48b400b730 comp rx=0 tx=0).stop 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 shutdown_connections 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f48a40a2c00 0x7f48a40a50c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48bc10ddc0 0x7f48bc19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48bc109e00 0x7f48bc19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 --2- 172.21.15.100:0/3816402728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48bc109450 0x7f48bc19e8b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 >> 172.21.15.100:0/3816402728 conn(0x7f48bc06e140 msgr2=0x7f48bc071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 shutdown_connections 2024-09-12T02:53:36.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:36.747+0000 7f48c2a55640 1 -- 172.21.15.100:0/3816402728 wait complete. 2024-09-12T02:53:37.231 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:36 smithi100 ceph-mon[31390]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 645 op/s 2024-09-12T02:53:37.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:36 smithi189 ceph-mon[35196]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 645 op/s 2024-09-12T02:53:37.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:36 smithi117 ceph-mon[34898]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 645 op/s 2024-09-12T02:53:38.585 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:53:38.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:53:38.894 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:38 smithi100 ceph-mon[31390]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 616 op/s 2024-09-12T02:53:38.999 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:38 smithi189 ceph-mon[35196]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 616 op/s 2024-09-12T02:53:39.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:38 smithi117 ceph-mon[34898]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 616 op/s 2024-09-12T02:53:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.635+0000 7f7a837c1640 1 -- 172.21.15.100:0/1242025648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c102d30 msgr2=0x7f7a7c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.635+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1242025648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c102d30 0x7f7a7c103110 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009930 tx=0x7f7a7802a420 comp rx=0 tx=0).stop 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.635+0000 7f7a837c1640 1 -- 172.21.15.100:0/1242025648 shutdown_connections 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.635+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1242025648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c1082a0 0x7f7a7c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.635+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1242025648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a7c1036e0 0x7f7a7c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.635+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1242025648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c102d30 0x7f7a7c103110 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.635+0000 7f7a837c1640 1 -- 172.21.15.100:0/1242025648 >> 172.21.15.100:0/1242025648 conn(0x7f7a7c0fc7d0 msgr2=0x7f7a7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.636+0000 7f7a837c1640 1 -- 172.21.15.100:0/1242025648 shutdown_connections 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.636+0000 7f7a837c1640 1 -- 172.21.15.100:0/1242025648 wait complete. 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.636+0000 7f7a837c1640 1 Processor -- start 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.636+0000 7f7a837c1640 1 -- start start 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.636+0000 7f7a837c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c102d30 0x7f7a7c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.636+0000 7f7a837c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a7c1036e0 0x7f7a7c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a837c1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c1082a0 0x7f7a7c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a837c1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1120f0 con 0x7f7a7c1082a0 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a837c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c111f70 con 0x7f7a7c1036e0 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a837c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c112270 con 0x7f7a7c102d30 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c1082a0 0x7f7a7c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c1082a0 0x7f7a7c19ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40864/0 (socket says 172.21.15.100:40864) 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a81d5e640 1 -- 172.21.15.100:0/1283025053 learned_addr learned my addr 172.21.15.100:0/1283025053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a8155d640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c102d30 0x7f7a7c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a80d5c640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a7c1036e0 0x7f7a7c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a8155d640 1 -- 172.21.15.100:0/1283025053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a7c1036e0 msgr2=0x7f7a7c198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a8155d640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a7c1036e0 0x7f7a7c198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a8155d640 1 -- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c1082a0 msgr2=0x7f7a7c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a8155d640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c1082a0 0x7f7a7c19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a8155d640 1 -- 172.21.15.100:0/1283025053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c19d540 con 0x7f7a7c102d30 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c1082a0 0x7f7a7c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.637+0000 7f7a8155d640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c102d30 0x7f7a7c198590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009850 tx=0x7f7a78003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.638+0000 7f7a727fc640 1 -- 172.21.15.100:0/1283025053 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7803f070 con 0x7f7a7c102d30 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.638+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7c19d7d0 con 0x7f7a7c102d30 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.638+0000 7f7a727fc640 1 -- 172.21.15.100:0/1283025053 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a78031c90 con 0x7f7a7c102d30 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.638+0000 7f7a727fc640 1 -- 172.21.15.100:0/1283025053 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78035030 con 0x7f7a7c102d30 2024-09-12T02:53:39.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.638+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7c1008c0 con 0x7f7a7c102d30 2024-09-12T02:53:39.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 Processor -- start 2024-09-12T02:53:39.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 -- start start 2024-09-12T02:53:39.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a727fc640 1 -- 172.21.15.100:0/1283025053 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7a78042070 con 0x7f7a7c102d30 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9ded0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0b50 0x559f9decbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9dee3fc0 0x559f9dee63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559f9de2d280 con 0x559f9dee3fc0 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559f9ddd4b10 con 0x559f9ded0230 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.641+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559f9de29240 con 0x559f9ded0b50 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.642+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9ded0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.642+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9ded0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49570/0 (socket says 172.21.15.100:49570) 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.642+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3283691071 learned_addr learned my addr 172.21.15.100:0/3283691071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:39.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.642+0000 7f7a8155d640 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0b50 0x559f9decbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a727fc640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7a680a2c40 0x7f7a680a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3283691071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0b50 msgr2=0x559f9decbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0b50 0x559f9decbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3283691071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9dee3fc0 msgr2=0x559f9dee63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9dee3fc0 0x559f9dee63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3283691071 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9dde11f0 con 0x559f9ded0230 2024-09-12T02:53:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a727fc640 1 -- 172.21.15.100:0/1283025053 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7a780ef6f0 con 0x7f7a7c102d30 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7a680a2c40 0x7f7a680a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.643+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9ded0610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a740339e0 tx=0x7f7a74033ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49eecd2a9238685 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a677fe640 1 -- 172.21.15.100:0/3283691071 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74039070 con 0x559f9ded0230 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a677fe640 1 -- 172.21.15.100:0/3283691071 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a74032b50 con 0x559f9ded0230 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a677fe640 1 -- 172.21.15.100:0/3283691071 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400e3b0 con 0x559f9ded0230 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7a680a2c40 0x7f7a680a5100 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a74045000 tx=0x7f7a74046000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3283691071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 msgr2=0x559f9ded0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9ded0610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a740339e0 tx=0x7f7a74033ea0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3283691071 shutdown_connections 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9dee3fc0 0x559f9dee63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0b50 0x559f9decbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3283691071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9ded0610 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.644+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3283691071 >> 172.21.15.100:0/3283691071 conn(0x559f9decc900 msgr2=0x559f9deccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3283691071 shutdown_connections 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3283691071 wait complete. 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 -- start start 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 Processor -- start 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0230 0x559f9ded3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0b50 0x559f9ded39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee3fc0 0x559f9dede4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559f9ded3010 con 0x559f9ded0230 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559f9dde7f10 con 0x559f9ded0b50 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559f9ded3190 con 0x559f9dee3fc0 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.645+0000 7f7a85b9a740 10 client.0 _ll_register_callbacks cb 0x559f9ddb0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee3fc0 0x559f9dede4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee3fc0 0x559f9dede4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51434/0 (socket says 172.21.15.100:51434) 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3049788965 learned_addr learned my addr 172.21.15.100:0/3049788965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a80d5c640 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0b50 0x559f9ded39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a8155d640 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0230 0x559f9ded3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0b50 msgr2=0x559f9ded39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0b50 0x559f9ded39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3049788965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0230 msgr2=0x559f9ded3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0230 0x559f9ded3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 -- 172.21.15.100:0/3049788965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9db9e6a0 con 0x559f9dee3fc0 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee3fc0 0x559f9dede4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400e5e0 tx=0x7f7a7403ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf2d6a8980e5c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a64ff9640 1 -- 172.21.15.100:0/3049788965 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74039040 con 0x559f9dee3fc0 2024-09-12T02:53:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a74032b50 con 0x559f9dee3fc0 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a64ff9640 1 -- 172.21.15.100:0/3049788965 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7a74032950 con 0x559f9dee3fc0 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a64ff9640 1 -- 172.21.15.100:0/3049788965 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7a74032d00 con 0x559f9dee3fc0 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a85b9a740 10 client.27160 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.646+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559f9dee1130 con 0x559f9dee3fc0 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a64ff9640 1 -- 172.21.15.100:0/3049788965 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a74032b50 con 0x559f9dee3fc0 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a64ff9640 1 -- 172.21.15.100:0/3049788965 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7a7405d050 con 0x559f9dee3fc0 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a85b9a740 10 client.27160 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a85b9a740 10 client.27160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a85b9a740 20 client.27160 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee2540 0x559f9dee2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a85b9a740 4 client.27160 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f9de3a7f0 con 0x559f9dee2540 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a8155d640 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee2540 0x559f9dee2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a64ff9640 10 client.27160 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.647+0000 7f7a8155d640 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee2540 0x559f9dee2990 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5280e567cedc33a server_cookie=9a427f3e1e582d58 in_seq=0 out_seq=0 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.648+0000 7f7a64ff9640 1 -- 172.21.15.100:0/3049788965 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f9de3a7f0 con 0x559f9dee2540 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.648+0000 7f7a64ff9640 10 client.27160 handle_command_reply: tid=0 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 client.27160 shutdown 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee3fc0 msgr2=0x559f9dede4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee3fc0 0x559f9dede4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400e5e0 tx=0x7f7a7403ea90 comp rx=0 tx=0).stop 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 shutdown_connections 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee2540 0x559f9dee2990 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee3fc0 0x559f9dede4e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a64ff9640 0 client.27160 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0b50 0x559f9ded39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/3049788965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0230 0x559f9ded3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.649+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 >> 172.21.15.100:0/3049788965 conn(0x559f9decc900 msgr2=0x559f9ded2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.650+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 shutdown_connections 2024-09-12T02:53:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.650+0000 7f7a85b9a740 1 -- 172.21.15.100:0/3049788965 wait complete. 2024-09-12T02:53:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.650+0000 7f7a85b9a740 20 client.27160 trim_cache size 0 max 16384 2024-09-12T02:53:39.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.672+0000 7f7a85b9a740 1 Processor -- start 2024-09-12T02:53:39.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a85b9a740 1 -- start start 2024-09-12T02:53:39.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0230 0x559f9dee3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9deeb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9dee2540 0x559f9deeb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1add10 con 0x559f9ded0b50 2024-09-12T02:53:39.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1ab5e0 con 0x559f9dee2540 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1a9430 con 0x559f9ded0230 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a80d5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9deeb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0230 0x559f9dee3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0230 0x559f9dee3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51436/0 (socket says 172.21.15.100:51436) 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a80d5c640 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9deeb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40894/0 (socket says 172.21.15.100:40894) 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 -- 172.21.15.100:0/2178560472 learned_addr learned my addr 172.21.15.100:0/2178560472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9dee2540 0x559f9deeb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 -- 172.21.15.100:0/2178560472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9dee2540 msgr2=0x559f9deeb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9dee2540 0x559f9deeb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 -- 172.21.15.100:0/2178560472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 msgr2=0x559f9deeb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9deeb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.673+0000 7f7a8155d640 1 -- 172.21.15.100:0/2178560472 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9dee3d90 con 0x559f9ded0230 2024-09-12T02:53:39.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.674+0000 7f7a8155d640 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0230 0x559f9dee3850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b83f0 tx=0x7f7a78040fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f0a8fc2c0a71ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:39.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.674+0000 7f7a66ffd640 1 -- 172.21.15.100:0/2178560472 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78049040 con 0x559f9ded0230 2024-09-12T02:53:39.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.674+0000 7f7a66ffd640 1 -- 172.21.15.100:0/2178560472 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a780bbf90 con 0x559f9ded0230 2024-09-12T02:53:39.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.674+0000 7f7a66ffd640 1 -- 172.21.15.100:0/2178560472 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780b8600 con 0x559f9ded0230 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.674+0000 7f7a85b9a740 1 -- 172.21.15.100:0/2178560472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0230 msgr2=0x559f9dee3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.674+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0230 0x559f9dee3850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b83f0 tx=0x7f7a78040fc0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 -- 172.21.15.100:0/2178560472 shutdown_connections 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9dee2540 0x559f9deeb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9deeb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/2178560472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9ded0230 0x559f9dee3850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 -- 172.21.15.100:0/2178560472 >> 172.21.15.100:0/2178560472 conn(0x559f9decc900 msgr2=0x559f9dee3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 -- 172.21.15.100:0/2178560472 shutdown_connections 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 -- 172.21.15.100:0/2178560472 wait complete. 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 -- start start 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.675+0000 7f7a85b9a740 1 Processor -- start 2024-09-12T02:53:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.676+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9deeb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.676+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9dee8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a85b9a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee2540 0x559f9dee90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1a9aa0 con 0x559f9ded0b50 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1aaf10 con 0x559f9ded0230 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a85b9a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1aa170 con 0x559f9dee2540 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee2540 0x559f9dee90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee2540 0x559f9dee90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51442/0 (socket says 172.21.15.100:51442) 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 -- 172.21.15.100:0/1879303884 learned_addr learned my addr 172.21.15.100:0/1879303884 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a80d5c640 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9dee8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a85b9a740 10 client.0 _ll_register_callbacks cb 0x7f7a7403e830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:39.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 -- 172.21.15.100:0/1879303884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 msgr2=0x559f9deeb810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:53:39.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9deeb810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 -- 172.21.15.100:0/1879303884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 msgr2=0x559f9dee8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:39.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9dee8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.677+0000 7f7a81d5e640 1 -- 172.21.15.100:0/1879303884 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9dee95e0 con 0x559f9dee2540 2024-09-12T02:53:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.684+0000 7f7a81d5e640 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee2540 0x559f9dee90a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a74005ee0 tx=0x7f7a7403e740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc5a7f3c81482f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.688+0000 7f7a64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:53:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.688+0000 7f7a64ff9640 1 -- 172.21.15.100:0/1879303884 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74039040 con 0x559f9dee2540 2024-09-12T02:53:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.688+0000 7f7a64ff9640 1 -- 172.21.15.100:0/1879303884 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7a740049d0 con 0x559f9dee2540 2024-09-12T02:53:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.688+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a780bbf90 con 0x559f9dee2540 2024-09-12T02:53:39.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.695+0000 7f7a64ff9640 1 -- 172.21.15.100:0/1879303884 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7a74032b60 con 0x559f9dee2540 2024-09-12T02:53:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.696+0000 7f7a85b9a740 10 client.27166 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.696+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559f9df4e0b0 con 0x559f9dee2540 2024-09-12T02:53:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.699+0000 7f7a64ff9640 1 -- 172.21.15.100:0/1879303884 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a780bbf90 con 0x559f9dee2540 2024-09-12T02:53:39.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.700+0000 7f7a64ff9640 1 -- 172.21.15.100:0/1879303884 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7a7405d050 con 0x559f9dee2540 2024-09-12T02:53:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.700+0000 7f7a85b9a740 10 client.27166 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.700+0000 7f7a85b9a740 10 client.27166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.700+0000 7f7a85b9a740 20 client.27166 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.700+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee3fc0 0x559f9df50710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.700+0000 7f7a85b9a740 4 client.27166 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:53:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.700+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559f9de34d00 con 0x559f9dee3fc0 2024-09-12T02:53:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.702+0000 7f7a8155d640 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee3fc0 0x559f9df50710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:39.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.704+0000 7f7a64ff9640 10 client.27166 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:39.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.704+0000 7f7a8155d640 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee3fc0 0x559f9df50710 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a347fdba89a87c16 server_cookie=9c9b71c05026cf54 in_seq=0 out_seq=0 2024-09-12T02:53:39.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.705+0000 7f7a64ff9640 1 -- 172.21.15.100:0/1879303884 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559f9de34d00 con 0x559f9dee3fc0 2024-09-12T02:53:39.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.705+0000 7f7a64ff9640 10 client.27166 handle_command_reply: tid=0 2024-09-12T02:53:39.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.706+0000 7f7a85b9a740 1 client.27166 shutdown 2024-09-12T02:53:39.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.706+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee2540 msgr2=0x559f9dee90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.706+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee2540 0x559f9dee90a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a74005ee0 tx=0x7f7a7403e740 comp rx=0 tx=0).stop 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.706+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 shutdown_connections 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.706+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559f9dee3fc0 0x559f9df50710 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.707+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f9dee2540 0x559f9dee90a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.707+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f9ded0b50 0x559f9dee8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.707+0000 7f7a85b9a740 1 --2- 172.21.15.100:0/1879303884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559f9ded0230 0x559f9deeb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.707+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 >> 172.21.15.100:0/1879303884 conn(0x559f9decc900 msgr2=0x559f9dec9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.707+0000 7f7a64ff9640 0 client.27166 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.708+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 shutdown_connections 2024-09-12T02:53:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.708+0000 7f7a85b9a740 1 -- 172.21.15.100:0/1879303884 wait complete. 2024-09-12T02:53:39.711 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:53:39.711 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:53:39.712 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "c04a702d-ebbf-4ab1-b2e0-b567f5a7d7ae", 2024-09-12T02:53:39.712 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:53:39.712 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:53:39.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.711+0000 7f7a85b9a740 20 client.27166 trim_cache size 0 max 16384 2024-09-12T02:53:39.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7a680a2c40 msgr2=0x7f7a680a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7a680a2c40 0x7f7a680a5100 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a74045000 tx=0x7f7a74046000 comp rx=0 tx=0).stop 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c102d30 msgr2=0x7f7a7c198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c102d30 0x7f7a7c198590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009850 tx=0x7f7a78003b90 comp rx=0 tx=0).stop 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 shutdown_connections 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7a680a2c40 0x7f7a680a5100 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c1082a0 0x7f7a7c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a7c1036e0 0x7f7a7c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 --2- 172.21.15.100:0/1283025053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c102d30 0x7f7a7c198590 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.712+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 >> 172.21.15.100:0/1283025053 conn(0x7f7a7c0fc7d0 msgr2=0x7f7a7c105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.713+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 shutdown_connections 2024-09-12T02:53:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:39.713+0000 7f7a837c1640 1 -- 172.21.15.100:0/1283025053 wait complete. 2024-09-12T02:53:40.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:53:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:53:41.202 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:40 smithi100 ceph-mon[31390]: scrub queued for path: / 2024-09-12T02:53:41.203 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.203 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:40 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:53:41.203 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:40 smithi100 ceph-mon[31390]: scrub summary: active paths [/] 2024-09-12T02:53:41.203 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.203 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:40 smithi100 ceph-mon[31390]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.203 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:40 smithi100 ceph-mon[31390]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 701 op/s 2024-09-12T02:53:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:40 smithi189 ceph-mon[35196]: scrub queued for path: / 2024-09-12T02:53:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:40 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:53:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:40 smithi189 ceph-mon[35196]: scrub summary: active paths [/] 2024-09-12T02:53:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:40 smithi189 ceph-mon[35196]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:40 smithi189 ceph-mon[35196]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 701 op/s 2024-09-12T02:53:41.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 870.0 s, 2209.2 tps, lat 45.601 ms stddev 53.928 2024-09-12T02:53:41.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:40 smithi117 ceph-mon[34898]: scrub queued for path: / 2024-09-12T02:53:41.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:40 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:53:41.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:40 smithi117 ceph-mon[34898]: scrub summary: active paths [/] 2024-09-12T02:53:41.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:40 smithi117 ceph-mon[34898]: scrub summary: idle+waiting paths [/] 2024-09-12T02:53:41.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:40 smithi117 ceph-mon[34898]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 701 op/s 2024-09-12T02:53:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.835+0000 7f6141e24640 1 -- 172.21.15.100:0/3499167468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c06ea30 msgr2=0x7f613c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.835+0000 7f6141e24640 1 --2- 172.21.15.100:0/3499167468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c06ea30 0x7f613c06ee70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6128009860 tx=0x7f612802a340 comp rx=0 tx=0).stop 2024-09-12T02:53:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.835+0000 7f6141e24640 1 -- 172.21.15.100:0/3499167468 shutdown_connections 2024-09-12T02:53:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.835+0000 7f6141e24640 1 --2- 172.21.15.100:0/3499167468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 0x7f613c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.835+0000 7f6141e24640 1 --2- 172.21.15.100:0/3499167468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c06ea30 0x7f613c06ee70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.835+0000 7f6141e24640 1 --2- 172.21.15.100:0/3499167468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c110190 0x7f613c06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.835+0000 7f6141e24640 1 -- 172.21.15.100:0/3499167468 >> 172.21.15.100:0/3499167468 conn(0x7f613c073180 msgr2=0x7f613c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.836+0000 7f6141e24640 1 -- 172.21.15.100:0/3499167468 shutdown_connections 2024-09-12T02:53:41.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.837+0000 7f6141e24640 1 -- 172.21.15.100:0/3499167468 wait complete. 2024-09-12T02:53:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.837+0000 7f6141e24640 1 Processor -- start 2024-09-12T02:53:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.837+0000 7f6141e24640 1 -- start start 2024-09-12T02:53:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141e24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c06ea30 0x7f613c1a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141e24640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c110190 0x7f613c1a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141e24640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 0x7f613c1ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141e24640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f613c120b90 con 0x7f613c11b140 2024-09-12T02:53:41.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141e24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f613c120a10 con 0x7f613c06ea30 2024-09-12T02:53:41.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141e24640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f613c120d10 con 0x7f613c110190 2024-09-12T02:53:41.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141623640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 0x7f613c1ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141623640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 0x7f613c1ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40914/0 (socket says 172.21.15.100:40914) 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141623640 1 -- 172.21.15.100:0/3877716934 learned_addr learned my addr 172.21.15.100:0/3877716934 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f613bfff640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c110190 0x7f613c1a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6140e22640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c06ea30 0x7f613c1a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141623640 1 -- 172.21.15.100:0/3877716934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c110190 msgr2=0x7f613c1a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.838+0000 7f6141623640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c110190 0x7f613c1a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.839+0000 7f6141623640 1 -- 172.21.15.100:0/3877716934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c06ea30 msgr2=0x7f613c1a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.839+0000 7f6141623640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c06ea30 0x7f613c1a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.839+0000 7f6141623640 1 -- 172.21.15.100:0/3877716934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c1ac040 con 0x7f613c11b140 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.839+0000 7f6140e22640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c06ea30 0x7f613c1a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:41.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.839+0000 7f6141623640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 0x7f613c1ab960 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f613400eeb0 tx=0x7f613400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.840+0000 7f6139ffb640 1 -- 172.21.15.100:0/3877716934 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134004b20 con 0x7f613c11b140 2024-09-12T02:53:41.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.840+0000 7f6139ffb640 1 -- 172.21.15.100:0/3877716934 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6134003e50 con 0x7f613c11b140 2024-09-12T02:53:41.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.840+0000 7f6139ffb640 1 -- 172.21.15.100:0/3877716934 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613400b570 con 0x7f613c11b140 2024-09-12T02:53:41.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.840+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c1ac330 con 0x7f613c11b140 2024-09-12T02:53:41.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.840+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c1b3c10 con 0x7f613c11b140 2024-09-12T02:53:41.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.844+0000 7f6139ffb640 1 -- 172.21.15.100:0/3877716934 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f613401d020 con 0x7f613c11b140 2024-09-12T02:53:41.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.845+0000 7f614545f740 1 Processor -- start 2024-09-12T02:53:41.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.845+0000 7f614545f740 1 -- start start 2024-09-12T02:53:41.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.847+0000 7f614545f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d922670 0x558f0d922a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.847+0000 7f614545f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922f90 0x558f0d92d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.847+0000 7f614545f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d92fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.847+0000 7f614545f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558f0d8882e0 con 0x558f0d922f90 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.847+0000 7f614545f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558f0d82fce0 con 0x558f0d922670 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.847+0000 7f614545f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558f0d8842a0 con 0x558f0d92d850 2024-09-12T02:53:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.847+0000 7f6139ffb640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f612c0a2d50 0x7f612c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.848+0000 7f6139ffb640 1 -- 172.21.15.100:0/3877716934 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f61340cf040 con 0x7f613c11b140 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.848+0000 7f6140e22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922f90 0x558f0d92d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.848+0000 7f6140e22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922f90 0x558f0d92d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40918/0 (socket says 172.21.15.100:40918) 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.848+0000 7f6140e22640 1 -- 172.21.15.100:0/992316047 learned_addr learned my addr 172.21.15.100:0/992316047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.848+0000 7f613bfff640 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d922670 0x558f0d922a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.848+0000 7f613bfff640 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d92fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.849+0000 7f6140e22640 1 -- 172.21.15.100:0/992316047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 msgr2=0x558f0d92fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.849+0000 7f6140e22640 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d92fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.849+0000 7f6140e22640 1 -- 172.21.15.100:0/992316047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d922670 msgr2=0x558f0d922a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.849+0000 7f6141623640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f612c0a2d50 0x7f612c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.849+0000 7f6140e22640 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d922670 0x558f0d922a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.850+0000 7f6140e22640 1 -- 172.21.15.100:0/992316047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0d814440 con 0x558f0d922f90 2024-09-12T02:53:41.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.850+0000 7f613bfff640 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d922670 0x558f0d922a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.850+0000 7f6140e22640 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922f90 0x558f0d92d310 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f613000bcf0 tx=0x7f613000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16e66cb28864a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.850+0000 7f6141623640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f612c0a2d50 0x7f612c0a5210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f613400cf50 tx=0x7f61340ccf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.850+0000 7f6126ffd640 1 -- 172.21.15.100:0/992316047 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130017620 con 0x558f0d922f90 2024-09-12T02:53:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.851+0000 7f6126ffd640 1 -- 172.21.15.100:0/992316047 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6130017ca0 con 0x558f0d922f90 2024-09-12T02:53:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.851+0000 7f6126ffd640 1 -- 172.21.15.100:0/992316047 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613000fd80 con 0x558f0d922f90 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.852+0000 7f614545f740 1 -- 172.21.15.100:0/992316047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922f90 msgr2=0x558f0d92d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.852+0000 7f614545f740 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922f90 0x558f0d92d310 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f613000bcf0 tx=0x7f613000d710 comp rx=0 tx=0).stop 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 -- 172.21.15.100:0/992316047 shutdown_connections 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d92fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922f90 0x558f0d92d310 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 --2- 172.21.15.100:0/992316047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d922670 0x558f0d922a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 -- 172.21.15.100:0/992316047 >> 172.21.15.100:0/992316047 conn(0x558f0d91ec00 msgr2=0x558f0d91efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 -- 172.21.15.100:0/992316047 shutdown_connections 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 -- 172.21.15.100:0/992316047 wait complete. 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 -- start start 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.853+0000 7f614545f740 1 Processor -- start 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f614545f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d92d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f614545f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922f90 0x558f0d92a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f614545f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d92a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f614545f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558f0d930420 con 0x558f0d922670 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f614545f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558f0d843050 con 0x558f0d92d850 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f614545f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558f0d9305a0 con 0x558f0d922f90 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f614545f740 10 client.0 _ll_register_callbacks cb 0x558f0d883160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.854+0000 7f613bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d92d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.855+0000 7f6140e22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922f90 0x558f0d92a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.855+0000 7f6140e22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922f90 0x558f0d92a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51458/0 (socket says 172.21.15.100:51458) 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.855+0000 7f613bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d92d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40920/0 (socket says 172.21.15.100:40920) 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.855+0000 7f613bfff640 1 -- 172.21.15.100:0/1074819321 learned_addr learned my addr 172.21.15.100:0/1074819321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.855+0000 7f613bfff640 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d92a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.855+0000 7f6140e22640 1 -- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 msgr2=0x558f0d92a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.856+0000 7f6140e22640 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d92a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.856+0000 7f6140e22640 1 -- 172.21.15.100:0/1074819321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 msgr2=0x558f0d92d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.856+0000 7f6140e22640 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d92d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.856+0000 7f6140e22640 1 -- 172.21.15.100:0/1074819321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0d5f93c0 con 0x558f0d922f90 2024-09-12T02:53:41.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.856+0000 7f611bfff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:53:41.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.857+0000 7f6140e22640 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922f90 0x558f0d92a460 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6130019040 tx=0x7f6130004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ff6349e3a3f2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.857+0000 7f611bfff640 1 -- 172.21.15.100:0/1074819321 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130027020 con 0x558f0d922f90 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.857+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6130017ca0 con 0x558f0d922f90 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.857+0000 7f611bfff640 1 -- 172.21.15.100:0/1074819321 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6130004250 con 0x558f0d922f90 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.858+0000 7f611bfff640 1 -- 172.21.15.100:0/1074819321 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6130027020 con 0x558f0d922f90 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.858+0000 7f614545f740 10 client.27178 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.858+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558f0d93bdf0 con 0x558f0d922f90 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.858+0000 7f611bfff640 1 -- 172.21.15.100:0/1074819321 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6130017ca0 con 0x558f0d922f90 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.858+0000 7f611bfff640 1 -- 172.21.15.100:0/1074819321 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f61300035f0 con 0x558f0d922f90 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.859+0000 7f614545f740 10 client.27178 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.859+0000 7f614545f740 10 client.27178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.859+0000 7f614545f740 20 client.27178 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.859+0000 7f614545f740 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d93d1a0 0x558f0d93f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.859+0000 7f614545f740 4 client.27178 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:41.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.859+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f0d895850 con 0x558f0d93d1a0 2024-09-12T02:53:41.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.860+0000 7f613bfff640 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d93d1a0 0x558f0d93f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.860+0000 7f611bfff640 10 client.27178 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:41.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.860+0000 7f613bfff640 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d93d1a0 0x558f0d93f590 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=877cebbc16bff09 server_cookie=79a46e2b4de9e018 in_seq=0 out_seq=0 2024-09-12T02:53:41.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f611bfff640 1 -- 172.21.15.100:0/1074819321 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f0d895850 con 0x558f0d93d1a0 2024-09-12T02:53:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f611bfff640 10 client.27178 handle_command_reply: tid=0 2024-09-12T02:53:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 client.27178 shutdown 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922f90 msgr2=0x558f0d92a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922f90 0x558f0d92a460 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6130019040 tx=0x7f6130004730 comp rx=0 tx=0).stop 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 shutdown_connections 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d93d1a0 0x558f0d93f590 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d92a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922f90 0x558f0d92a460 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 --2- 172.21.15.100:0/1074819321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d92d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 >> 172.21.15.100:0/1074819321 conn(0x558f0d91ec00 msgr2=0x558f0d924930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.861+0000 7f611bfff640 0 client.27178 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.862+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 shutdown_connections 2024-09-12T02:53:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.862+0000 7f614545f740 1 -- 172.21.15.100:0/1074819321 wait complete. 2024-09-12T02:53:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.862+0000 7f614545f740 20 client.27178 trim_cache size 0 max 16384 2024-09-12T02:53:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.886+0000 7f614545f740 1 Processor -- start 2024-09-12T02:53:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.886+0000 7f614545f740 1 -- start start 2024-09-12T02:53:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f614545f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922670 0x558f0d92bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f614545f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d929350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f614545f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d91dd40 0x558f0d9425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f614545f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1bede0 con 0x558f0d91dd40 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f614545f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1bc6b0 con 0x558f0d92d850 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f614545f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1ba4a0 con 0x558f0d922670 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f613bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922670 0x558f0d92bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d929350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f613bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922670 0x558f0d92bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:51472/0 (socket says 172.21.15.100:51472) 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d929350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49626/0 (socket says 172.21.15.100:49626) 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f613bfff640 1 -- 172.21.15.100:0/3843133788 learned_addr learned my addr 172.21.15.100:0/3843133788 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f613bfff640 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d91dd40 0x558f0d9425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 -- 172.21.15.100:0/3843133788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922670 msgr2=0x558f0d92bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922670 0x558f0d92bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 -- 172.21.15.100:0/3843133788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d91dd40 msgr2=0x558f0d9425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d91dd40 0x558f0d9425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 -- 172.21.15.100:0/3843133788 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0d9289f0 con 0x558f0d92d850 2024-09-12T02:53:41.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f6140e22640 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d929350 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x558f0d92b550 tx=0x7f6130005f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57186218a77b815 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.887+0000 7f61267fc640 1 -- 172.21.15.100:0/3843133788 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130039070 con 0x558f0d92d850 2024-09-12T02:53:41.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f61267fc640 1 -- 172.21.15.100:0/3843133788 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6130005ce0 con 0x558f0d92d850 2024-09-12T02:53:41.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f61267fc640 1 -- 172.21.15.100:0/3843133788 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130027020 con 0x558f0d92d850 2024-09-12T02:53:41.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f614545f740 1 -- 172.21.15.100:0/3843133788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 msgr2=0x558f0d929350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f614545f740 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d929350 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x558f0d92b550 tx=0x7f6130005f70 comp rx=0 tx=0).stop 2024-09-12T02:53:41.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f614545f740 1 -- 172.21.15.100:0/3843133788 shutdown_connections 2024-09-12T02:53:41.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f614545f740 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d91dd40 0x558f0d9425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f614545f740 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d92d850 0x558f0d929350 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f614545f740 1 --2- 172.21.15.100:0/3843133788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d922670 0x558f0d92bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.888+0000 7f614545f740 1 -- 172.21.15.100:0/3843133788 >> 172.21.15.100:0/3843133788 conn(0x558f0d91ec00 msgr2=0x558f0d928c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.889+0000 7f614545f740 1 -- 172.21.15.100:0/3843133788 shutdown_connections 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.889+0000 7f614545f740 1 -- 172.21.15.100:0/3843133788 wait complete. 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.889+0000 7f614545f740 1 -- start start 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.890+0000 7f614545f740 1 Processor -- start 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.890+0000 7f614545f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d91dd40 0x558f0d99bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.890+0000 7f614545f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d99c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.890+0000 7f613bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d91dd40 0x558f0d99bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.890+0000 7f613bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d91dd40 0x558f0d99bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49632/0 (socket says 172.21.15.100:49632) 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.890+0000 7f613bfff640 1 -- 172.21.15.100:0/1688520636 learned_addr learned my addr 172.21.15.100:0/1688520636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:53:41.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f6140e22640 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d99c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f614545f740 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d99fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1bab70 con 0x558f0d922670 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1bbfe0 con 0x558f0d91dd40 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1bb240 con 0x558f0d92d850 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f614545f740 10 client.0 _ll_register_callbacks cb 0x7f6128035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f613bfff640 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d99fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f613bfff640 1 -- 172.21.15.100:0/1688520636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 msgr2=0x558f0d99fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f613bfff640 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d99fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f613bfff640 1 -- 172.21.15.100:0/1688520636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 msgr2=0x558f0d99c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f613bfff640 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d99c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f613bfff640 1 -- 172.21.15.100:0/1688520636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0d9a0310 con 0x558f0d91dd40 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f613bfff640 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d91dd40 0x558f0d99bc50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6128009780 tx=0x7f6130010e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f3a480f59b924aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.891+0000 7f611bfff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.892+0000 7f611bfff640 1 -- 172.21.15.100:0/1688520636 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128037040 con 0x558f0d91dd40 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.892+0000 7f611bfff640 1 -- 172.21.15.100:0/1688520636 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f6128004300 con 0x558f0d91dd40 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.892+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6130005ce0 con 0x558f0d91dd40 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.892+0000 7f611bfff640 1 -- 172.21.15.100:0/1688520636 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61280035f0 con 0x558f0d91dd40 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.892+0000 7f614545f740 10 client.27245 fetch_fsmap learned FSMap version 27 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.892+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558f0d9a88d0 con 0x558f0d91dd40 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.892+0000 7f611bfff640 1 -- 172.21.15.100:0/1688520636 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6130005ce0 con 0x558f0d91dd40 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f611bfff640 1 -- 172.21.15.100:0/1688520636 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f612804e020 con 0x558f0d91dd40 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f614545f740 10 client.27245 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f614545f740 10 client.27245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f614545f740 20 client.27245 populate_metadata read hostname 'smithi100' 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f614545f740 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d9a8fd0 0x558f0d9ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f614545f740 4 client.27245 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:53:41.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f0d88fd60 con 0x558f0d9a8fd0 2024-09-12T02:53:41.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.893+0000 7f6140e22640 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d9a8fd0 0x558f0d9ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.894+0000 7f6140e22640 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d9a8fd0 0x558f0d9ab3f0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a40221bc8328af server_cookie=75342cf69418e338 in_seq=0 out_seq=0 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.894+0000 7f611bfff640 10 client.27245 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.894+0000 7f611bfff640 1 -- 172.21.15.100:0/1688520636 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558f0d88fd60 con 0x558f0d9a8fd0 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.894+0000 7f611bfff640 10 client.27245 handle_command_reply: tid=0 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.894+0000 7f614545f740 1 client.27245 shutdown 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d91dd40 msgr2=0x558f0d99bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d91dd40 0x558f0d99bc50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6128009780 tx=0x7f6130010e40 comp rx=0 tx=0).stop 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 shutdown_connections 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x558f0d9a8fd0 0x558f0d9ab3f0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f611bfff640 0 client.27245 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f0d92d850 0x558f0d99fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f0d922670 0x558f0d99c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 --2- 172.21.15.100:0/1688520636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f0d91dd40 0x558f0d99bc50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 >> 172.21.15.100:0/1688520636 conn(0x558f0d91ec00 msgr2=0x558f0d929460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 shutdown_connections 2024-09-12T02:53:41.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 1 -- 172.21.15.100:0/1688520636 wait complete. 2024-09-12T02:53:41.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.895+0000 7f614545f740 20 client.27245 trim_cache size 0 max 16384 2024-09-12T02:53:41.900 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:53:41.901 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:53:41.901 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:53:41.901 INFO:teuthology.orchestra.run.smithi100.stdout: "c04a702d-ebbf-4ab1-b2e0-b567f5a7d7ae": { 2024-09-12T02:53:41.901 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:53:41.901 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "c04a702d-ebbf-4ab1-b2e0-b567f5a7d7ae", 2024-09-12T02:53:41.901 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:53:41.901 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f612c0a2d50 msgr2=0x7f612c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f612c0a2d50 0x7f612c0a5210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f613400cf50 tx=0x7f61340ccf90 comp rx=0 tx=0).stop 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 msgr2=0x7f613c1ab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 0x7f613c1ab960 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f613400eeb0 tx=0x7f613400c740 comp rx=0 tx=0).stop 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 shutdown_connections 2024-09-12T02:53:41.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f612c0a2d50 0x7f612c0a5210 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f613c11b140 0x7f613c1ab960 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f613c110190 0x7f613c1a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 --2- 172.21.15.100:0/3877716934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c06ea30 0x7f613c1a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 >> 172.21.15.100:0/3877716934 conn(0x7f613c073180 msgr2=0x7f613c11a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 shutdown_connections 2024-09-12T02:53:41.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:53:41.896+0000 7f6141e24640 1 -- 172.21.15.100:0/3877716934 wait complete. 2024-09-12T02:53:42.600 INFO:tasks.cephfs.filesystem:scrub status for tag:c04a702d-ebbf-4ab1-b2e0-b567f5a7d7ae - {'path': '/', 'tag': 'c04a702d-ebbf-4ab1-b2e0-b567f5a7d7ae', 'options': 'recursive,force'} 2024-09-12T02:53:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:42 smithi189 ceph-mon[35196]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.3 MiB/s wr, 651 op/s 2024-09-12T02:53:43.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:42 smithi117 ceph-mon[34898]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.3 MiB/s wr, 651 op/s 2024-09-12T02:53:43.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:42 smithi100 ceph-mon[31390]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.3 MiB/s wr, 651 op/s 2024-09-12T02:53:45.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:44 smithi189 ceph-mon[35196]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 MiB/s wr, 638 op/s 2024-09-12T02:53:45.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:44 smithi117 ceph-mon[34898]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 MiB/s wr, 638 op/s 2024-09-12T02:53:45.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:44 smithi100 ceph-mon[31390]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 MiB/s wr, 638 op/s 2024-09-12T02:53:46.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:45 smithi189 ceph-mon[35196]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 756 op/s 2024-09-12T02:53:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 875.0 s, 2970.2 tps, lat 33.305 ms stddev 37.470 2024-09-12T02:53:46.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:45 smithi117 ceph-mon[34898]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 756 op/s 2024-09-12T02:53:46.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:45 smithi100 ceph-mon[31390]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 756 op/s 2024-09-12T02:53:49.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:48 smithi189 ceph-mon[35196]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-09-12T02:53:49.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:48 smithi117 ceph-mon[34898]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-09-12T02:53:49.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:48 smithi100 ceph-mon[31390]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-09-12T02:53:50.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:49 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:53:50.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:49 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:53:50.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:49 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:53:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:50 smithi189 ceph-mon[35196]: scrub summary: idle 2024-09-12T02:53:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:50 smithi189 ceph-mon[35196]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-12T02:53:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 880.0 s, 1974.8 tps, lat 50.991 ms stddev 53.327 2024-09-12T02:53:51.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:50 smithi117 ceph-mon[34898]: scrub summary: idle 2024-09-12T02:53:51.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:50 smithi117 ceph-mon[34898]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-12T02:53:51.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:50 smithi100 ceph-mon[31390]: scrub summary: idle 2024-09-12T02:53:51.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:50 smithi100 ceph-mon[31390]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-12T02:53:53.173 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:52 smithi100 ceph-mon[31390]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 717 op/s 2024-09-12T02:53:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:52 smithi189 ceph-mon[35196]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 717 op/s 2024-09-12T02:53:53.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:52 smithi117 ceph-mon[34898]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 717 op/s 2024-09-12T02:53:55.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:54 smithi100 ceph-mon[31390]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.0 MiB/s wr, 648 op/s 2024-09-12T02:53:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:54 smithi189 ceph-mon[35196]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.0 MiB/s wr, 648 op/s 2024-09-12T02:53:55.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:54 smithi117 ceph-mon[34898]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.0 MiB/s wr, 648 op/s 2024-09-12T02:53:56.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:55 smithi189 ceph-mon[35196]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 MiB/s wr, 711 op/s 2024-09-12T02:53:56.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 885.0 s, 1939.0 tps, lat 51.358 ms stddev 55.670 2024-09-12T02:53:56.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:55 smithi117 ceph-mon[34898]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 MiB/s wr, 711 op/s 2024-09-12T02:53:56.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:55 smithi100 ceph-mon[31390]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 MiB/s wr, 711 op/s 2024-09-12T02:53:59.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:53:58 smithi189 ceph-mon[35196]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 613 op/s 2024-09-12T02:53:59.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:53:58 smithi117 ceph-mon[34898]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 613 op/s 2024-09-12T02:53:59.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:53:58 smithi100 ceph-mon[31390]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 613 op/s 2024-09-12T02:54:01.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:00 smithi189 ceph-mon[35196]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.6 MiB/s wr, 638 op/s 2024-09-12T02:54:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 890.0 s, 2552.8 tps, lat 39.346 ms stddev 46.121 2024-09-12T02:54:01.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:00 smithi117 ceph-mon[34898]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.6 MiB/s wr, 638 op/s 2024-09-12T02:54:01.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:00 smithi100 ceph-mon[31390]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.6 MiB/s wr, 638 op/s 2024-09-12T02:54:03.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:02 smithi189 ceph-mon[35196]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 MiB/s wr, 662 op/s 2024-09-12T02:54:03.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:02 smithi117 ceph-mon[34898]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 MiB/s wr, 662 op/s 2024-09-12T02:54:03.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:02 smithi100 ceph-mon[31390]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 MiB/s wr, 662 op/s 2024-09-12T02:54:04.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:03 smithi189 ceph-mon[35196]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.2 MiB/s wr, 586 op/s 2024-09-12T02:54:04.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:03 smithi117 ceph-mon[34898]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.2 MiB/s wr, 586 op/s 2024-09-12T02:54:04.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:03 smithi100 ceph-mon[31390]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.2 MiB/s wr, 586 op/s 2024-09-12T02:54:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 895.0 s, 2398.4 tps, lat 41.652 ms stddev 45.754 2024-09-12T02:54:07.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:06 smithi189 ceph-mon[35196]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-12T02:54:07.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:06 smithi117 ceph-mon[34898]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-12T02:54:07.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:06 smithi100 ceph-mon[31390]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-12T02:54:09.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:08 smithi189 ceph-mon[35196]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 638 op/s 2024-09-12T02:54:09.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:08 smithi117 ceph-mon[34898]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 638 op/s 2024-09-12T02:54:09.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:08 smithi100 ceph-mon[31390]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 638 op/s 2024-09-12T02:54:10.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:09 smithi189 ceph-mon[35196]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.2 MiB/s wr, 742 op/s 2024-09-12T02:54:10.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:09 smithi117 ceph-mon[34898]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.2 MiB/s wr, 742 op/s 2024-09-12T02:54:10.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:09 smithi100 ceph-mon[31390]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.2 MiB/s wr, 742 op/s 2024-09-12T02:54:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:progress: 900.0 s, 2202.4 tps, lat 44.795 ms stddev 53.106 2024-09-12T02:54:11.538 INFO:teuthology.orchestra.run.smithi100.stdout:transaction type: 2024-09-12T02:54:11.538 INFO:teuthology.orchestra.run.smithi100.stdout:scaling factor: 32 2024-09-12T02:54:11.538 INFO:teuthology.orchestra.run.smithi100.stdout:query mode: simple 2024-09-12T02:54:11.538 INFO:teuthology.orchestra.run.smithi100.stdout:number of clients: 100 2024-09-12T02:54:11.538 INFO:teuthology.orchestra.run.smithi100.stdout:number of threads: 4 2024-09-12T02:54:11.538 INFO:teuthology.orchestra.run.smithi100.stdout:duration: 900 s 2024-09-12T02:54:11.538 INFO:teuthology.orchestra.run.smithi100.stdout:number of transactions actually processed: 1783205 2024-09-12T02:54:11.539 INFO:teuthology.orchestra.run.smithi100.stdout:latency average = 50.468 ms 2024-09-12T02:54:11.539 INFO:teuthology.orchestra.run.smithi100.stdout:latency stddev = 611.506 ms 2024-09-12T02:54:11.539 INFO:teuthology.orchestra.run.smithi100.stdout:tps = 1980.811445 (including connections establishing) 2024-09-12T02:54:11.539 INFO:teuthology.orchestra.run.smithi100.stdout:tps = 1980.816860 (excluding connections establishing) 2024-09-12T02:54:11.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-12T02:54:12.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:54:13.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:12 smithi100 ceph-mon[31390]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 8.3 MiB/s wr, 731 op/s 2024-09-12T02:54:13.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:12 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:54:13.186 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:13.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:12 smithi189 ceph-mon[35196]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 8.3 MiB/s wr, 731 op/s 2024-09-12T02:54:13.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:12 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:54:13.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:12 smithi117 ceph-mon[34898]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 8.3 MiB/s wr, 731 op/s 2024-09-12T02:54:13.345 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:12 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:54:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.926+0000 7f1dffc18640 1 -- 172.21.15.100:0/2209606493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8100860 msgr2=0x7f1df81045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.926+0000 7f1dffc18640 1 --2- 172.21.15.100:0/2209606493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8100860 0x7f1df81045a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009be0 tx=0x7f1df002a710 comp rx=0 tx=0).stop 2024-09-12T02:54:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.927+0000 7f1dffc18640 1 -- 172.21.15.100:0/2209606493 shutdown_connections 2024-09-12T02:54:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.927+0000 7f1dffc18640 1 --2- 172.21.15.100:0/2209606493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8100860 0x7f1df81045a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.927+0000 7f1dffc18640 1 --2- 172.21.15.100:0/2209606493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8107440 0x7f1df8100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.927+0000 7f1dffc18640 1 --2- 172.21.15.100:0/2209606493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1df8106a90 0x7f1df8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.927+0000 7f1dffc18640 1 -- 172.21.15.100:0/2209606493 >> 172.21.15.100:0/2209606493 conn(0x7f1df8077230 msgr2=0x7f1df80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:13.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.930+0000 7f1dffc18640 1 -- 172.21.15.100:0/2209606493 shutdown_connections 2024-09-12T02:54:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.934+0000 7f1dffc18640 1 -- 172.21.15.100:0/2209606493 wait complete. 2024-09-12T02:54:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.934+0000 7f1dffc18640 1 Processor -- start 2024-09-12T02:54:13.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.939+0000 7f1dffc18640 1 -- start start 2024-09-12T02:54:13.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.939+0000 7f1dffc18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1df8100860 0x7f1df810be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dffc18640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8106a90 0x7f1df810c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dffc18640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8072ab0 0x7f1df8072f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dffc18640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81185b0 con 0x7f1df8100860 2024-09-12T02:54:13.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dffc18640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1df8118430 con 0x7f1df8106a90 2024-09-12T02:54:13.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dffc18640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1df8118730 con 0x7f1df8072ab0 2024-09-12T02:54:13.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dfd1b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8106a90 0x7f1df810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dfd1b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8106a90 0x7f1df810c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:35888/0 (socket says 172.21.15.100:35888) 2024-09-12T02:54:13.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.940+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/1050179468 learned_addr learned my addr 172.21.15.100:0/1050179468 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:13.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.942+0000 7f1dfd9b4640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1df8100860 0x7f1df810be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.943+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8072ab0 0x7f1df8072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.943+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/1050179468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8072ab0 msgr2=0x7f1df8072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.943+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8072ab0 0x7f1df8072f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.943+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1df8100860 msgr2=0x7f1df810be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.943+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1df8100860 0x7f1df810be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.943+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/1050179468 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df8073690 con 0x7f1df8106a90 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.944+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8106a90 0x7f1df810c340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1de800b470 tx=0x7f1de800b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.945+0000 7f1deeffd640 1 -- 172.21.15.100:0/1050179468 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8015020 con 0x7f1df8106a90 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.945+0000 7f1deeffd640 1 -- 172.21.15.100:0/1050179468 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de8011d70 con 0x7f1df8106a90 2024-09-12T02:54:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.945+0000 7f1deeffd640 1 -- 172.21.15.100:0/1050179468 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de800f340 con 0x7f1df8106a90 2024-09-12T02:54:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.948+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df8112c60 con 0x7f1df8106a90 2024-09-12T02:54:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.948+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df8113120 con 0x7f1df8106a90 2024-09-12T02:54:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.951+0000 7f1e01ff1740 1 Processor -- start 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.952+0000 7f1e01ff1740 1 -- start start 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.952+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b684a0 0x559537b68880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.952+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 0x559537b73140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.952+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b75a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.952+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559537ace2e0 con 0x559537b684a0 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.952+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559537a75ce0 con 0x559537b73680 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.952+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559537aca2a0 con 0x559537b68dc0 2024-09-12T02:54:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.953+0000 7f1dfd9b4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 0x559537b73140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.954+0000 7f1dfe1b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b684a0 0x559537b68880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.954+0000 7f1dfe1b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b684a0 0x559537b68880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49462/0 (socket says 172.21.15.100:49462) 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.954+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/2774991961 learned_addr learned my addr 172.21.15.100:0/2774991961 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.956+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b75a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.956+0000 7f1deeffd640 1 -- 172.21.15.100:0/1050179468 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1de8018020 con 0x7f1df8106a90 2024-09-12T02:54:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.956+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/2774991961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 msgr2=0x559537b73140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.956+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 0x559537b73140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.956+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/2774991961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b684a0 msgr2=0x559537b68880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.956+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b684a0 0x559537b68880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.956+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/2774991961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537a5a440 con 0x559537b73680 2024-09-12T02:54:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.957+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b75a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1de80cc320 tx=0x7f1de80d4e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5981e0e355a0ceac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:13.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.958+0000 7f1de3fff640 1 -- 172.21.15.100:0/2774991961 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de80de020 con 0x559537b73680 2024-09-12T02:54:13.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.958+0000 7f1de3fff640 1 -- 172.21.15.100:0/2774991961 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de80da400 con 0x559537b73680 2024-09-12T02:54:13.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.959+0000 7f1deeffd640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1de40a2d90 0x7f1de40a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.959+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2774991961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 msgr2=0x559537b75a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.959+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b75a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1de80cc320 tx=0x7f1de80d4e30 comp rx=0 tx=0).stop 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.959+0000 7f1deeffd640 1 -- 172.21.15.100:0/1050179468 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1de80ce8f0 con 0x7f1df8106a90 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.963+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2774991961 shutdown_connections 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.963+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b75a70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.963+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 0x559537b73140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.963+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2774991961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b684a0 0x559537b68880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.963+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2774991961 >> 172.21.15.100:0/2774991961 conn(0x559537b64a30 msgr2=0x559537b64e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.965+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1de40a2d90 0x7f1de40a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.966+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2774991961 shutdown_connections 2024-09-12T02:54:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.966+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2774991961 wait complete. 2024-09-12T02:54:13.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.966+0000 7f1e01ff1740 1 -- start start 2024-09-12T02:54:13.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.966+0000 7f1e01ff1740 1 Processor -- start 2024-09-12T02:54:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.967+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b72e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.967+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b68dc0 0x559537b70110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.967+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b70650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.967+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559537b762f0 con 0x559537b68dc0 2024-09-12T02:54:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.967+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559537a89050 con 0x559537b73680 2024-09-12T02:54:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.967+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559537b76470 con 0x559537b684a0 2024-09-12T02:54:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.967+0000 7f1e01ff1740 10 client.0 _ll_register_callbacks cb 0x559537ac9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:13.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.970+0000 7f1dfe1b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b70650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.970+0000 7f1dfd1b3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b68dc0 0x559537b70110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.970+0000 7f1dfd1b3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b68dc0 0x559537b70110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49472/0 (socket says 172.21.15.100:49472) 2024-09-12T02:54:13.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.970+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/3774440434 learned_addr learned my addr 172.21.15.100:0/3774440434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.970+0000 7f1dfd9b4640 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b72e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:13.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.972+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/3774440434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 msgr2=0x559537b72e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:13.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.972+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b72e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.972+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/3774440434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 msgr2=0x559537b70650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.972+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b70650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.972+0000 7f1dfd1b3640 1 -- 172.21.15.100:0/3774440434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55953783f3c0 con 0x559537b68dc0 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.975+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1de40a2d90 0x7f1de40a5250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009cd0 tx=0x7f1df00304e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.976+0000 7f1dfd1b3640 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b68dc0 0x559537b70110 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1de8097ab0 tx=0x7f1de8010fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d421a39e8b17f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.976+0000 7f1de17fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.977+0000 7f1de17fa640 1 -- 172.21.15.100:0/3774440434 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de80de030 con 0x559537b68dc0 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.977+0000 7f1de17fa640 1 -- 172.21.15.100:0/3774440434 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1de80993e0 con 0x559537b68dc0 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.980+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1de80da400 con 0x559537b68dc0 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.987+0000 7f1de17fa640 1 -- 172.21.15.100:0/3774440434 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1de8097380 con 0x559537b68dc0 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.989+0000 7f1e01ff1740 10 client.18066 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.989+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559537b762f0 con 0x559537b68dc0 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.991+0000 7f1de17fa640 1 -- 172.21.15.100:0/3774440434 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de80da400 con 0x559537b68dc0 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.991+0000 7f1de17fa640 1 -- 172.21.15.100:0/3774440434 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1de8022060 con 0x559537b68dc0 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.993+0000 7f1e01ff1740 10 client.18066 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.993+0000 7f1e01ff1740 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.993+0000 7f1e01ff1740 20 client.18066 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.993+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537b82d70 0x559537b85160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.993+0000 7f1e01ff1740 4 client.18066 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:13.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.993+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559537adb850 con 0x559537b82d70 2024-09-12T02:54:13.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:13.993+0000 7f1dfd9b4640 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537b82d70 0x559537b85160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.002+0000 7f1dfd9b4640 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537b82d70 0x559537b85160 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5f0bef3a950844a server_cookie=85ffbba518f401b0 in_seq=0 out_seq=0 2024-09-12T02:54:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.002+0000 7f1de17fa640 10 client.18066 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.008+0000 7f1de17fa640 1 -- 172.21.15.100:0/3774440434 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559537adb850 con 0x559537b82d70 2024-09-12T02:54:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.008+0000 7f1de17fa640 10 client.18066 handle_command_reply: tid=0 2024-09-12T02:54:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.008+0000 7f1e01ff1740 1 client.18066 shutdown 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.012+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b68dc0 msgr2=0x559537b70110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.012+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b68dc0 0x559537b70110 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1de8097ab0 tx=0x7f1de8010fa0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.013+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 shutdown_connections 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.013+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537b82d70 0x559537b85160 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.013+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b73680 0x559537b70650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.013+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b68dc0 0x559537b70110 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.013+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/3774440434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b72e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.013+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 >> 172.21.15.100:0/3774440434 conn(0x559537b64a30 msgr2=0x559537b6a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.013+0000 7f1de17fa640 0 client.18066 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.017+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 shutdown_connections 2024-09-12T02:54:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.017+0000 7f1e01ff1740 1 -- 172.21.15.100:0/3774440434 wait complete. 2024-09-12T02:54:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.018+0000 7f1e01ff1740 20 client.18066 trim_cache size 0 max 16384 2024-09-12T02:54:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.055+0000 7f1e01ff1740 1 Processor -- start 2024-09-12T02:54:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.055+0000 7f1e01ff1740 1 -- start start 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.056+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b684a0 0x559537b8a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.056+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 0x559537b8ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.056+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b63350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.056+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81c75f0 con 0x559537b73680 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.056+0000 7f1dfe1b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b63350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.056+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81c4ec0 con 0x559537b684a0 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81c2d30 con 0x559537b68dc0 2024-09-12T02:54:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1dfe1b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b63350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49474/0 (socket says 172.21.15.100:49474) 2024-09-12T02:54:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/2086742255 learned_addr learned my addr 172.21.15.100:0/2086742255 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/2086742255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 msgr2=0x559537b8ae10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:54:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/2086742255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 0x559537b8ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/2086742255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b684a0 msgr2=0x559537b8a8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:54:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/2086742255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b684a0 0x559537b8a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.057+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/2086742255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537b64860 con 0x559537b73680 2024-09-12T02:54:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.058+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/2086742255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b63350 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009d00 tx=0x7f1df0044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd50caef1159290 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.059+0000 7f1de37fe640 1 -- 172.21.15.100:0/2086742255 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0036040 con 0x559537b73680 2024-09-12T02:54:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.059+0000 7f1de37fe640 1 -- 172.21.15.100:0/2086742255 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df0050070 con 0x559537b73680 2024-09-12T02:54:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.059+0000 7f1de37fe640 1 -- 172.21.15.100:0/2086742255 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df00042b0 con 0x559537b73680 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.062+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2086742255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 msgr2=0x559537b63350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.062+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2086742255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b63350 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009d00 tx=0x7f1df0044000 comp rx=0 tx=0).stop 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.063+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2086742255 shutdown_connections 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.063+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2086742255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b63350 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.063+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2086742255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b68dc0 0x559537b8ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.063+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/2086742255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b684a0 0x559537b8a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.063+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2086742255 >> 172.21.15.100:0/2086742255 conn(0x559537b64a30 msgr2=0x559537b72190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:14.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.069+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2086742255 shutdown_connections 2024-09-12T02:54:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.071+0000 7f1e01ff1740 1 -- 172.21.15.100:0/2086742255 wait complete. 2024-09-12T02:54:14.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.072+0000 7f1e01ff1740 1 -- start start 2024-09-12T02:54:14.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.072+0000 7f1e01ff1740 1 Processor -- start 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.075+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b7bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.075+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b68dc0 0x559537b6cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.075+0000 7f1e01ff1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b6d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.075+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81c3380 con 0x559537b73680 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.075+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81c47f0 con 0x559537b68dc0 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.075+0000 7f1e01ff1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81c3a50 con 0x559537b684a0 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.075+0000 7f1e01ff1740 10 client.0 _ll_register_callbacks cb 0x7f1df4004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.076+0000 7f1dfd9b4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b7bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:14.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.076+0000 7f1dfd1b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b68dc0 0x559537b6cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.076+0000 7f1dfe1b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b6d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.076+0000 7f1dfe1b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b6d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49482/0 (socket says 172.21.15.100:49482) 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.076+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/1322005204 learned_addr learned my addr 172.21.15.100:0/1322005204 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.077+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/1322005204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 msgr2=0x559537b7bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.077+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b7bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.077+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/1322005204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b68dc0 msgr2=0x559537b6cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.077+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b68dc0 0x559537b6cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.077+0000 7f1dfe1b5640 1 -- 172.21.15.100:0/1322005204 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559537b656c0 con 0x559537b73680 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.077+0000 7f1dfe1b5640 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b6d520 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1df0031fd0 tx=0x7f1df002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0f04324b808050 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.078+0000 7f1de17fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:14.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.078+0000 7f1de17fa640 1 -- 172.21.15.100:0/1322005204 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0036040 con 0x559537b73680 2024-09-12T02:54:14.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.078+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1df0050070 con 0x559537b73680 2024-09-12T02:54:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.078+0000 7f1de17fa640 1 -- 172.21.15.100:0/1322005204 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f1df0004030 con 0x559537b73680 2024-09-12T02:54:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.079+0000 7f1de17fa640 1 -- 172.21.15.100:0/1322005204 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1df0030e90 con 0x559537b73680 2024-09-12T02:54:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.079+0000 7f1e01ff1740 10 client.18072 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:14.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.079+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559537bed8a0 con 0x559537b73680 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.079+0000 7f1de17fa640 1 -- 172.21.15.100:0/1322005204 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df0050070 con 0x559537b73680 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.080+0000 7f1de17fa640 1 -- 172.21.15.100:0/1322005204 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1df003c040 con 0x559537b73680 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.080+0000 7f1e01ff1740 10 client.18072 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.080+0000 7f1e01ff1740 10 client.18072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.080+0000 7f1e01ff1740 20 client.18072 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.080+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537beded0 0x559537bf02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.080+0000 7f1e01ff1740 4 client.18072 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.080+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559537ad5d60 con 0x559537beded0 2024-09-12T02:54:14.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.083+0000 7f1dfd9b4640 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537beded0 0x559537bf02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:14.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.089+0000 7f1de17fa640 10 client.18072 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:14.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.089+0000 7f1dfd9b4640 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537beded0 0x559537bf02f0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08bbfacab7e035b server_cookie=628edd219875bd86 in_seq=0 out_seq=0 2024-09-12T02:54:14.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.095+0000 7f1de17fa640 1 -- 172.21.15.100:0/1322005204 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559537ad5d60 con 0x559537beded0 2024-09-12T02:54:14.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.095+0000 7f1de17fa640 10 client.18072 handle_command_reply: tid=0 2024-09-12T02:54:14.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.095+0000 7f1e01ff1740 1 client.18072 shutdown 2024-09-12T02:54:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 msgr2=0x559537b6d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b6d520 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1df0031fd0 tx=0x7f1df002a710 comp rx=0 tx=0).stop 2024-09-12T02:54:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 shutdown_connections 2024-09-12T02:54:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559537beded0 0x559537bf02f0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559537b73680 0x559537b6d520 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559537b68dc0 0x559537b6cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 --2- 172.21.15.100:0/1322005204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559537b684a0 0x559537b7bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.098+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 >> 172.21.15.100:0/1322005204 conn(0x559537b64a30 msgr2=0x559537b6f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.102+0000 7f1de17fa640 0 client.18072 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.102+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 shutdown_connections 2024-09-12T02:54:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.102+0000 7f1e01ff1740 1 -- 172.21.15.100:0/1322005204 wait complete. 2024-09-12T02:54:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.102+0000 7f1e01ff1740 20 client.18072 trim_cache size 0 max 16384 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1de40a2d90 msgr2=0x7f1de40a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1de40a2d90 0x7f1de40a5250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009cd0 tx=0x7f1df00304e0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8106a90 msgr2=0x7f1df810c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8106a90 0x7f1df810c340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1de800b470 tx=0x7f1de800b930 comp rx=0 tx=0).stop 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 shutdown_connections 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f1de40a2d90 0x7f1de40a5250 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8072ab0 0x7f1df8072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1df8106a90 0x7f1df810c340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 --2- 172.21.15.100:0/1050179468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1df8100860 0x7f1df810be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.104+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 >> 172.21.15.100:0/1050179468 conn(0x7f1df8077230 msgr2=0x7f1df81026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.105+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 shutdown_connections 2024-09-12T02:54:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:14.105+0000 7f1dffc18640 1 -- 172.21.15.100:0/1050179468 wait complete. 2024-09-12T02:54:14.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:13 smithi100 ceph-mon[31390]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 659 op/s 2024-09-12T02:54:14.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:54:14.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:54:14.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:13 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:54:14.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:13 smithi189 ceph-mon[35196]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 659 op/s 2024-09-12T02:54:14.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:54:14.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:54:14.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:13 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:54:14.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:13 smithi117 ceph-mon[34898]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 659 op/s 2024-09-12T02:54:14.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:54:14.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:54:14.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:13 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' 2024-09-12T02:54:15.004 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:54:15.005 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:54:15.527 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.148+0000 7fb924746640 1 -- 172.21.15.100:0/136362194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91c109830 msgr2=0x7fb91c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.148+0000 7fb924746640 1 --2- 172.21.15.100:0/136362194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91c109830 0x7fb91c109c90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009900 tx=0x7fb90c02a440 comp rx=0 tx=0).stop 2024-09-12T02:54:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.152+0000 7fb924746640 1 -- 172.21.15.100:0/136362194 shutdown_connections 2024-09-12T02:54:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.152+0000 7fb924746640 1 --2- 172.21.15.100:0/136362194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c11b140 0x7fb91c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.152+0000 7fb924746640 1 --2- 172.21.15.100:0/136362194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91c109830 0x7fb91c109c90 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.152+0000 7fb924746640 1 --2- 172.21.15.100:0/136362194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109450 0x7fb91c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.152+0000 7fb924746640 1 -- 172.21.15.100:0/136362194 >> 172.21.15.100:0/136362194 conn(0x7fb91c06e140 msgr2=0x7fb91c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.152+0000 7fb924746640 1 -- 172.21.15.100:0/136362194 shutdown_connections 2024-09-12T02:54:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.152+0000 7fb924746640 1 -- 172.21.15.100:0/136362194 wait complete. 2024-09-12T02:54:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 Processor -- start 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 -- start start 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91c109450 0x7fb91c118640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109830 0x7fb91c118b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c11b140 0x7fb91c1118b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c120eb0 con 0x7fb91c109450 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c120d30 con 0x7fb91c11b140 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.153+0000 7fb924746640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c121030 con 0x7fb91c109830 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.154+0000 7fb921ce1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109830 0x7fb91c118b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.154+0000 7fb921ce1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109830 0x7fb91c118b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:58054/0 (socket says 172.21.15.100:58054) 2024-09-12T02:54:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.154+0000 7fb921ce1640 1 -- 172.21.15.100:0/2193398964 learned_addr learned my addr 172.21.15.100:0/2193398964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.156+0000 7fb922ce3640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c11b140 0x7fb91c1118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.156+0000 7fb921ce1640 1 -- 172.21.15.100:0/2193398964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c11b140 msgr2=0x7fb91c1118b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.156+0000 7fb921ce1640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c11b140 0x7fb91c1118b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.156+0000 7fb921ce1640 1 -- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91c109450 msgr2=0x7fb91c118640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.156+0000 7fb921ce1640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91c109450 0x7fb91c118640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.156+0000 7fb921ce1640 1 -- 172.21.15.100:0/2193398964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c112170 con 0x7fb91c109830 2024-09-12T02:54:16.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.160+0000 7fb921ce1640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109830 0x7fb91c118b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006010 tx=0x7fb90c031610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.169+0000 7fb9137fe640 1 -- 172.21.15.100:0/2193398964 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c040070 con 0x7fb91c109830 2024-09-12T02:54:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.169+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91c112400 con 0x7fb91c109830 2024-09-12T02:54:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.169+0000 7fb9137fe640 1 -- 172.21.15.100:0/2193398964 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb90c003ad0 con 0x7fb91c109830 2024-09-12T02:54:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.169+0000 7fb9137fe640 1 -- 172.21.15.100:0/2193398964 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c035030 con 0x7fb91c109830 2024-09-12T02:54:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.169+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91c116340 con 0x7fb91c109830 2024-09-12T02:54:16.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.171+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91c073b00 con 0x7fb91c109830 2024-09-12T02:54:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.176+0000 7fb9137fe640 1 -- 172.21.15.100:0/2193398964 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb90c043070 con 0x7fb91c109830 2024-09-12T02:54:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.177+0000 7fb9137fe640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb9080a2d90 0x7fb9080a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.177+0000 7fb9137fe640 1 -- 172.21.15.100:0/2193398964 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb90c0f0070 con 0x7fb91c109830 2024-09-12T02:54:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.181+0000 7fb9224e2640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb9080a2d90 0x7fb9080a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.181+0000 7fb9137fe640 1 -- 172.21.15.100:0/2193398964 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb90c0bcfe0 con 0x7fb91c109830 2024-09-12T02:54:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.184+0000 7fb9224e2640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb9080a2d90 0x7fb9080a5250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb918009710 tx=0x7fb918006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:16.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.589+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb91c112c00 con 0x7fb91c109830 2024-09-12T02:54:16.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.592+0000 7fb9137fe640 1 -- 172.21.15.100:0/2193398964 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fb91c112c00 con 0x7fb91c109830 2024-09-12T02:54:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:16.594 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:54:16.594 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:54:16.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.599+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb9080a2d90 msgr2=0x7fb9080a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:16.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.599+0000 7fb924746640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb9080a2d90 0x7fb9080a5250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb918009710 tx=0x7fb918006c90 comp rx=0 tx=0).stop 2024-09-12T02:54:16.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.599+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109830 msgr2=0x7fb91c118b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:16.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.599+0000 7fb924746640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109830 0x7fb91c118b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006010 tx=0x7fb90c031610 comp rx=0 tx=0).stop 2024-09-12T02:54:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.603+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 shutdown_connections 2024-09-12T02:54:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.603+0000 7fb924746640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb9080a2d90 0x7fb9080a5250 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.603+0000 7fb924746640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb91c11b140 0x7fb91c1118b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.603+0000 7fb924746640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb91c109830 0x7fb91c118b80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.603+0000 7fb924746640 1 --2- 172.21.15.100:0/2193398964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91c109450 0x7fb91c118640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.603+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 >> 172.21.15.100:0/2193398964 conn(0x7fb91c06e140 msgr2=0x7fb91c11bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:16.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.609+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 shutdown_connections 2024-09-12T02:54:16.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:16.609+0000 7fb924746640 1 -- 172.21.15.100:0/2193398964 wait complete. 2024-09-12T02:54:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:16 smithi189 ceph-mon[35196]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.0 MiB/s wr, 840 op/s 2024-09-12T02:54:17.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:16 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2193398964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:17.313 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:16 smithi100 ceph-mon[31390]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.0 MiB/s wr, 840 op/s 2024-09-12T02:54:17.313 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:16 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2193398964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:17.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:16 smithi117 ceph-mon[34898]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.0 MiB/s wr, 840 op/s 2024-09-12T02:54:17.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:16 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2193398964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:17.365 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:54:17.700 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:18.510 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:54:18.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/1595306175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8101420 msgr2=0x7f7cb810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/1595306175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8101420 0x7f7cb810d950 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009cd0 tx=0x7f7cb002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/1595306175 shutdown_connections 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/1595306175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8101420 0x7f7cb810d950 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/1595306175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb8100a80 0x7f7cb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/1595306175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb8106a80 0x7f7cb8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/1595306175 >> 172.21.15.100:0/1595306175 conn(0x7f7cb80fc7a0 msgr2=0x7f7cb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/1595306175 shutdown_connections 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.351+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/1595306175 wait complete. 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 Processor -- start 2024-09-12T02:54:18.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 -- start start 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8100a80 0x7f7cb8197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb8101420 0x7f7cb8197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb8106a80 0x7f7cb819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8110e80 con 0x7f7cb8100a80 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8110d00 con 0x7f7cb8101420 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.352+0000 7f7cbcdb6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8111000 con 0x7f7cb8106a80 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8100a80 0x7f7cb8197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8100a80 0x7f7cb8197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59376/0 (socket says 172.21.15.100:59376) 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 -- 172.21.15.100:0/3971535689 learned_addr learned my addr 172.21.15.100:0/3971535689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb8106a80 0x7f7cb819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 -- 172.21.15.100:0/3971535689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb8106a80 msgr2=0x7f7cb819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb8106a80 0x7f7cb819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 -- 172.21.15.100:0/3971535689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb8101420 msgr2=0x7f7cb8197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb8101420 0x7f7cb8197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 -- 172.21.15.100:0/3971535689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb819c2d0 con 0x7f7cb8100a80 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cb659c640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8100a80 0x7f7cb8197320 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000d770 tx=0x7f7ca000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7caf7fe640 1 -- 172.21.15.100:0/3971535689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0017070 con 0x7f7cb8100a80 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7caf7fe640 1 -- 172.21.15.100:0/3971535689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca0005500 con 0x7f7cb8100a80 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb819c5c0 con 0x7f7cb8100a80 2024-09-12T02:54:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7caf7fe640 1 -- 172.21.15.100:0/3971535689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0004e00 con 0x7f7cb8100a80 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.353+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb81a3ea0 con 0x7f7cb8100a80 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.356+0000 7f7caf7fe640 1 -- 172.21.15.100:0/3971535689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f7ca0004fa0 con 0x7f7cb8100a80 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.356+0000 7f7cbf18f740 1 Processor -- start 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.356+0000 7f7cbf18f740 1 -- start start 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5a8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a85d0 0x55beda5a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5b7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55beda50e2f0 con 0x55beda5a85d0 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55beda4b5cf0 con 0x55beda5b5580 2024-09-12T02:54:18.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55beda50a2b0 con 0x55beda5a9b40 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a85d0 0x55beda5a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a85d0 0x55beda5a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59378/0 (socket says 172.21.15.100:59378) 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 -- 172.21.15.100:0/1827922138 learned_addr learned my addr 172.21.15.100:0/1827922138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb5d9b640 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 -- 172.21.15.100:0/1827922138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 msgr2=0x55beda5a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 -- 172.21.15.100:0/1827922138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 msgr2=0x55beda5b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7caf7fe640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ca40a2b80 0x7f7ca40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 -- 172.21.15.100:0/1827922138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beda49a3a0 con 0x55beda5a85d0 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ca40a2b80 0x7f7ca40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7cb659c640 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a85d0 0x55beda5a8a10 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00a0df0 tx=0x7f7ca00976d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab96d54ec8c39163 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.357+0000 7f7caf7fe640 1 -- 172.21.15.100:0/3971535689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7ca00ceb20 con 0x7f7cb8100a80 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cacff9640 1 -- 172.21.15.100:0/1827922138 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0020070 con 0x55beda5a85d0 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cacff9640 1 -- 172.21.15.100:0/1827922138 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca00046c0 con 0x55beda5a85d0 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cacff9640 1 -- 172.21.15.100:0/1827922138 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca009aeb0 con 0x55beda5a85d0 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1827922138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a85d0 msgr2=0x55beda5a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ca40a2b80 0x7f7ca40a5040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0006010 tx=0x7f7cb00093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a85d0 0x55beda5a8a10 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00a0df0 tx=0x7f7ca00976d0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1827922138 shutdown_connections 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a85d0 0x55beda5a8a10 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1827922138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.358+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1827922138 >> 172.21.15.100:0/1827922138 conn(0x55beda571310 msgr2=0x55beda5a4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1827922138 shutdown_connections 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1827922138 wait complete. 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 -- start start 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 Processor -- start 2024-09-12T02:54:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5a85d0 0x55beda5b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5b5580 0x55beda5b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55beda5b8280 con 0x55beda5b5580 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55beda4c9060 con 0x55beda5a85d0 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55beda5b8400 con 0x55beda5a9b40 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cbf18f740 10 client.0 _ll_register_callbacks cb 0x55beda21c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cb6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5b5580 0x55beda5b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cb6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5b5580 0x55beda5b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59388/0 (socket says 172.21.15.100:59388) 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cb6d9d640 1 -- 172.21.15.100:0/3692094433 learned_addr learned my addr 172.21.15.100:0/3692094433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cb659c640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5a85d0 0x55beda5b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.359+0000 7f7cb5d9b640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cb6d9d640 1 -- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 msgr2=0x55beda5b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cb6d9d640 1 -- 172.21.15.100:0/3692094433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5a85d0 msgr2=0x55beda5b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5a85d0 0x55beda5b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cb6d9d640 1 -- 172.21.15.100:0/3692094433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beda27f3c0 con 0x55beda5b5580 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cb659c640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5a85d0 0x55beda5b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5b5580 0x55beda5b29f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0031b00 tx=0x7f7cb002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c405760cf5002051 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7c9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7c9dffb640 1 -- 172.21.15.100:0/3692094433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0054060 con 0x55beda5b5580 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7c9dffb640 1 -- 172.21.15.100:0/3692094433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7cb00045c0 con 0x55beda5b5580 2024-09-12T02:54:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55beda51b860 con 0x55beda5b5580 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7c9dffb640 1 -- 172.21.15.100:0/3692094433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7cb0031d40 con 0x55beda5b5580 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cbf18f740 10 client.18087 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55beda5c3d60 con 0x55beda5b5580 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7c9dffb640 1 -- 172.21.15.100:0/3692094433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55beda51b860 con 0x55beda5b5580 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7c9dffb640 1 -- 172.21.15.100:0/3692094433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7cb004e030 con 0x55beda5b5580 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cbf18f740 10 client.18087 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cbf18f740 10 client.18087 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.360+0000 7f7cbf18f740 20 client.18087 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.361+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda5c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.361+0000 7f7cbf18f740 4 client.18087 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.361+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beda515d70 con 0x55beda5c53b0 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.361+0000 7f7cb659c640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda5c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.361+0000 7f7cb659c640 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda5c77a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39cf1a4630506a7a server_cookie=5bcdadc2c9606822 in_seq=0 out_seq=0 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.361+0000 7f7c9dffb640 10 client.18087 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7c9dffb640 1 -- 172.21.15.100:0/3692094433 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55beda515d70 con 0x55beda5c53b0 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7c9dffb640 10 client.18087 handle_command_reply: tid=0 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7cbf18f740 1 client.18087 shutdown 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5b5580 msgr2=0x55beda5b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5b5580 0x55beda5b29f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0031b00 tx=0x7f7cb002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 shutdown_connections 2024-09-12T02:54:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda5c77a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7c9dffb640 0 client.18087 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.362+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5b5580 0x55beda5b29f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.363+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a9b40 0x55beda5b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.363+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/3692094433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5a85d0 0x55beda5b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.363+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 >> 172.21.15.100:0/3692094433 conn(0x55beda571310 msgr2=0x55beda5aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.363+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 shutdown_connections 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.363+0000 7f7cbf18f740 1 -- 172.21.15.100:0/3692094433 wait complete. 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.363+0000 7f7cbf18f740 20 client.18087 trim_cache size 0 max 16384 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 Processor -- start 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 -- start start 2024-09-12T02:54:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb81adce0 con 0x55beda5a9b40 2024-09-12T02:54:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb81ab5b0 con 0x55beda5b5580 2024-09-12T02:54:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.384+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb81a9400 con 0x55beda5a85d0 2024-09-12T02:54:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.386+0000 7f7cb5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.386+0000 7f7cb5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59396/0 (socket says 172.21.15.100:59396) 2024-09-12T02:54:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.386+0000 7f7cb5d9b640 1 -- 172.21.15.100:0/1286411930 learned_addr learned my addr 172.21.15.100:0/1286411930 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.387+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.388+0000 7f7cb5d9b640 1 -- 172.21.15.100:0/1286411930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 msgr2=0x55beda5b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.388+0000 7f7cb5d9b640 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.388+0000 7f7cb5d9b640 1 -- 172.21.15.100:0/1286411930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 msgr2=0x55beda5ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.388+0000 7f7cb5d9b640 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.388+0000 7f7cb5d9b640 1 -- 172.21.15.100:0/1286411930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beda5a8c20 con 0x55beda5a9b40 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.388+0000 7f7cb5d9b640 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5b1070 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80fed60 tx=0x7f7ca800df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92002c644afe07f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.389+0000 7f7c9ffff640 1 -- 172.21.15.100:0/1286411930 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8011da0 con 0x55beda5a9b40 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.389+0000 7f7c9ffff640 1 -- 172.21.15.100:0/1286411930 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca801d960 con 0x55beda5a9b40 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.390+0000 7f7c9ffff640 1 -- 172.21.15.100:0/1286411930 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8012b30 con 0x55beda5a9b40 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.390+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1286411930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 msgr2=0x55beda5b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.390+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5b1070 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80fed60 tx=0x7f7ca800df50 comp rx=0 tx=0).stop 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.393+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1286411930 shutdown_connections 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.393+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.393+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5b1070 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.393+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/1286411930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.393+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1286411930 >> 172.21.15.100:0/1286411930 conn(0x55beda571310 msgr2=0x55beda59fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.394+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1286411930 shutdown_connections 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.397+0000 7f7cbf18f740 1 -- 172.21.15.100:0/1286411930 wait complete. 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.397+0000 7f7cbf18f740 1 -- start start 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.398+0000 7f7cbf18f740 1 Processor -- start 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.400+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.400+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5ac860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.400+0000 7f7cbf18f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.400+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb81a9a70 con 0x55beda5a9b40 2024-09-12T02:54:18.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.400+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb81aaee0 con 0x55beda5b5580 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.400+0000 7f7cbf18f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb81aa140 con 0x55beda5a85d0 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.400+0000 7f7cbf18f740 10 client.0 _ll_register_callbacks cb 0x7f7cb0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.402+0000 7f7cb6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.402+0000 7f7cb659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.404+0000 7f7cb659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5bdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:58094/0 (socket says 172.21.15.100:58094) 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.404+0000 7f7cb659c640 1 -- 172.21.15.100:0/2191110521 learned_addr learned my addr 172.21.15.100:0/2191110521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.405+0000 7f7cb6d9d640 1 -- 172.21.15.100:0/2191110521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 msgr2=0x55beda5bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.405+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5bdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.405+0000 7f7cb6d9d640 1 -- 172.21.15.100:0/2191110521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 msgr2=0x55beda5ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.405+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.405+0000 7f7cb6d9d640 1 -- 172.21.15.100:0/2191110521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beda5ad390 con 0x55beda5b5580 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.409+0000 7f7cb6d9d640 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5acda0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0041040 tx=0x7f7cb0045a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddbe343cedb9c493 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.413+0000 7f7c9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.413+0000 7f7c9dffb640 1 -- 172.21.15.100:0/2191110521 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0054040 con 0x55beda5b5580 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.413+0000 7f7c9dffb640 1 -- 172.21.15.100:0/2191110521 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7cb00044c0 con 0x55beda5b5580 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.413+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca801d960 con 0x55beda5b5580 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.415+0000 7f7c9dffb640 1 -- 172.21.15.100:0/2191110521 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7cb0004700 con 0x55beda5b5580 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.418+0000 7f7cbf18f740 10 client.27266 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.418+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55beda5bb470 con 0x55beda5b5580 2024-09-12T02:54:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.422+0000 7f7c9dffb640 1 -- 172.21.15.100:0/2191110521 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca801d960 con 0x55beda5b5580 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.422+0000 7f7c9dffb640 1 -- 172.21.15.100:0/2191110521 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7cb004e040 con 0x55beda5b5580 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.423+0000 7f7cbf18f740 10 client.27266 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.424+0000 7f7cbf18f740 10 client.27266 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.424+0000 7f7cbf18f740 20 client.27266 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.424+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda630450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.424+0000 7f7cbf18f740 4 client.27266 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.424+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 --> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55beda5a8420 con 0x55beda5c53b0 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.429+0000 7f7cb659c640 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda630450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.437+0000 7f7cb659c640 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda630450 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=282d11faad3d5d5 server_cookie=9f49a652bb68fbed in_seq=0 out_seq=0 2024-09-12T02:54:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.437+0000 7f7c9dffb640 10 client.27266 ms_handle_connect on v2:172.21.15.189:6836/2893582984 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.441+0000 7f7c9dffb640 1 -- 172.21.15.100:0/2191110521 <== mds.2 v2:172.21.15.189:6836/2893582984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55beda5a8420 con 0x55beda5c53b0 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.441+0000 7f7c9dffb640 10 client.27266 handle_command_reply: tid=0 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.441+0000 7f7cbf18f740 1 client.27266 shutdown 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 msgr2=0x55beda5acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5acda0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0041040 tx=0x7f7cb0045a90 comp rx=0 tx=0).stop 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 shutdown_connections 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.189:6836/2893582984,v1:172.21.15.189:6837/2893582984] conn(0x55beda5c53b0 0x55beda630450 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55beda5b5580 0x55beda5acda0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beda5a9b40 0x55beda5ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 --2- 172.21.15.100:0/2191110521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beda5a85d0 0x55beda5bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.442+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 >> 172.21.15.100:0/2191110521 conn(0x55beda571310 msgr2=0x55beda5b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.443+0000 7f7c9dffb640 0 client.27266 ms_handle_reset on v2:172.21.15.189:6836/2893582984 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.446+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 shutdown_connections 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.446+0000 7f7cbf18f740 1 -- 172.21.15.100:0/2191110521 wait complete. 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.449+0000 7f7cbf18f740 20 client.27266 trim_cache size 0 max 16384 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.452+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ca40a2b80 msgr2=0x7f7ca40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.452+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ca40a2b80 0x7f7ca40a5040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0006010 tx=0x7f7cb00093f0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.452+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8100a80 msgr2=0x7f7cb8197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.452+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8100a80 0x7f7cb8197320 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000d770 tx=0x7f7ca000dc30 comp rx=0 tx=0).stop 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.455+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 shutdown_connections 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.455+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f7ca40a2b80 0x7f7ca40a5040 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.455+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb8106a80 0x7f7cb819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.455+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cb8101420 0x7f7cb8197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.455+0000 7f7cbcdb6640 1 --2- 172.21.15.100:0/3971535689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cb8100a80 0x7f7cb8197320 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:18.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.455+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 >> 172.21.15.100:0/3971535689 conn(0x7f7cb80fc7a0 msgr2=0x7f7cb80fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:18.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.456+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 shutdown_connections 2024-09-12T02:54:18.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:18.456+0000 7f7cbcdb6640 1 -- 172.21.15.100:0/3971535689 wait complete. 2024-09-12T02:54:19.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:18 smithi189 ceph-mon[35196]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.7 MiB/s wr, 952 op/s 2024-09-12T02:54:19.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:18 smithi117 ceph-mon[34898]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.7 MiB/s wr, 952 op/s 2024-09-12T02:54:19.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:18 smithi100 ceph-mon[31390]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.7 MiB/s wr, 952 op/s 2024-09-12T02:54:19.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-12T02:54:19.682 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/: 2024-09-12T02:54:19.682 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.682 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:54:19.682 INFO:teuthology.orchestra.run.smithi100.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 .. 2024-09-12T02:54:19.682 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 data 2024-09-12T02:54:19.682 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.682 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data: 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:total 36 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 . 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 .. 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:39 base 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 12 02:39 current_logfiles 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 12 02:39 global 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:39 log 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_commit_ts 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_dynshmem 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 12 02:38 pg_hba.conf 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 12 02:38 pg_ident.conf 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:54 pg_logical 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 pg_multixact 2024-09-12T02:54:19.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_notify 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_replslot 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_serial 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_snapshots 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:54 pg_stat 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:54 pg_stat_tmp 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:54 pg_subtrans 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_tblspc 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 pg_twophase 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 PG_VERSION 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 12 02:54 pg_wal 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:47 pg_xact 2024-09-12T02:54:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 12 02:38 postgresql.auto.conf 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 12 02:38 postgresql.conf 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 12 02:39 postmaster.opts 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base: 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:39 . 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 1 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 13493 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 12 02:43 13494 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 pgsql_tmp 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.685 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:total 7777 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 . 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:39 .. 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 112 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 113 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 1247 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1247_fsm 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1247_vm 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:38 1249 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1249_fsm 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1249_vm 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:38 1255 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1255_fsm 2024-09-12T02:54:19.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1255_vm 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:38 1259 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1259_fsm 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1259_vm 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:38 13344 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13344_fsm 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13344_vm 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13346 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13348 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13349_fsm 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349_vm 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13351 2024-09-12T02:54:19.687 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13353 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13354_fsm 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354_vm 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13356 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13358 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13359_fsm 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359_vm 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13361 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13363 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1417 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1418 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 174 2024-09-12T02:54:19.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 175 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2187 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2224 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2328 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2336 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2337 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2579 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2600 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2600_fsm 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2600_vm 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2601_fsm 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601_vm 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2602 2024-09-12T02:54:19.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2602_fsm 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2602_vm 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2603 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2603_fsm 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2603_vm 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2604 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2605 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2605_fsm 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2605_vm 2024-09-12T02:54:19.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2606_fsm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606_vm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2607 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2607_fsm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2607_vm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:38 2608 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2608_fsm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2608_vm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:38 2609 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2609_fsm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2609_vm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2610 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2610_fsm 2024-09-12T02:54:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2610_vm 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2611 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2612_fsm 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612_vm 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2613 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2615_fsm 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615_vm 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2616 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2616_fsm 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2616_vm 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:38 2617 2024-09-12T02:54:19.692 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2617_fsm 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2617_vm 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:38 2618 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2618_fsm 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2618_vm 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:38 2619 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2619_fsm 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2619_vm 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2620 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2650 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2651 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2652 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2653 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2654 2024-09-12T02:54:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2655 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2656 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2657 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:38 2658 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 2659 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2660 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2661 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2662 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2663 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2664 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2665 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2666 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2667 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2668 2024-09-12T02:54:19.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2669 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2670 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:38 2673 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:38 2674 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:38 2675 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2678 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2679 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2680 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2681 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2682 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2683 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2684 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2685 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2686 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2687 2024-09-12T02:54:19.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2688 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2689 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:38 2690 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:38 2691 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2692 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2693 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2696 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2699 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2701 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2702 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2703 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2704 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2753 2024-09-12T02:54:19.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2753_fsm 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2753_vm 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2754 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2755 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2756 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2757 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2830 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2831 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2832 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2833 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2834 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2835 2024-09-12T02:54:19.697 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2836 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2837 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:38 2838 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2838_fsm 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2838_vm 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2839 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840_fsm 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2840_vm 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2841 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2995 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2996 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079 2024-09-12T02:54:19.698 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3079_fsm 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079_vm 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3080 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3081 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3085 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3118 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3119 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:38 3164 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3256 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3257 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3258 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3350 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3351 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3379 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3380 2024-09-12T02:54:19.699 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3381 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3394 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3394_fsm 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3394_vm 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3395 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3429 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3430 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3431 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3433 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3439 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3440 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3455 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:38 3456 2024-09-12T02:54:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3456_fsm 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3456_vm 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3466 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3467 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3468 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3501 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3502 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3503 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3534 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3541_fsm 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541_vm 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3542 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3574 2024-09-12T02:54:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3575 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3576 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3596 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3597 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3598 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3599 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3600_fsm 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600_vm 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3601_fsm 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601_vm 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3602_fsm 2024-09-12T02:54:19.702 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602_vm 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603_fsm 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3603_vm 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3604 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3605 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3606 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3607 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3608 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 3609 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3712 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3764_fsm 2024-09-12T02:54:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764_vm 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3766 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3767 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3997 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4143 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4144 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4145 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4146 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4147 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4148 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4149 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4150 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4151 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4152 2024-09-12T02:54:19.704 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4153 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4154 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4155 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4156 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4157 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4158 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4159 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4160 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4161 2024-09-12T02:54:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4162 2024-09-12T02:54:19.706 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4163 2024-09-12T02:54:19.706 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4164 2024-09-12T02:54:19.706 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4165 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4166 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4167 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4168 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4169 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4170 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4171 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4172 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4173 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4174 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 5002 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 548 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 549 2024-09-12T02:54:19.707 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6102 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6104 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6106 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6110 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6111 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6112 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6113 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6117 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 826 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 827 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 828 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:38 pg_filenode.map 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 PG_VERSION 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:total 7777 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:38 . 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:39 .. 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 112 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 113 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 1247 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1247_fsm 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1247_vm 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:38 1249 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1249_fsm 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1249_vm 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:38 1255 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1255_fsm 2024-09-12T02:54:19.709 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1255_vm 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:38 1259 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1259_fsm 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1259_vm 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:38 13344 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13344_fsm 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13344_vm 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13346 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13348 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13349_fsm 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349_vm 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13351 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13353 2024-09-12T02:54:19.710 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13354_fsm 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13354_vm 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13356 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13358 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13359_fsm 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359_vm 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13361 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13363 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1417 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1418 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 174 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 175 2024-09-12T02:54:19.711 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2187 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2224 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2328 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2336 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2337 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2579 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2600 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2600_fsm 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2600_vm 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2601_fsm 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601_vm 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2602 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2602_fsm 2024-09-12T02:54:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2602_vm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2603 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2603_fsm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2603_vm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2604 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2605 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2605_fsm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2605_vm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2606_fsm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2606_vm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2607 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2607_fsm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2607_vm 2024-09-12T02:54:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:38 2608 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2608_fsm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2608_vm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:38 2609 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2609_fsm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2609_vm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2610 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2610_fsm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2610_vm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2611 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2612_fsm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612_vm 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2613 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2615_fsm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615_vm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2616 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2616_fsm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2616_vm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:38 2617 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2617_fsm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2617_vm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:38 2618 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2618_fsm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2618_vm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:38 2619 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2619_fsm 2024-09-12T02:54:19.715 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2619_vm 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2620 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2650 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2651 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2652 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2653 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2654 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2655 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2656 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2657 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:38 2658 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:38 2659 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2660 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2661 2024-09-12T02:54:19.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2662 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2663 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2664 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2665 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2666 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2667 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2668 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2669 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2670 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:38 2673 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:38 2674 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:38 2675 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2678 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2679 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2680 2024-09-12T02:54:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2681 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2682 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2683 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2684 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2685 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2686 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2687 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2688 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2689 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:38 2690 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:38 2691 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2692 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2693 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2696 2024-09-12T02:54:19.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2699 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2701 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2702 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2703 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2704 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2753 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2753_fsm 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2753_vm 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2754 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2755 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2756 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2757 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2830 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2831 2024-09-12T02:54:19.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2832 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2833 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2834 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2835 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2836 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2837 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:38 2838 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2838_fsm 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2838_vm 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2839 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2840_fsm 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2840_vm 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2841 2024-09-12T02:54:19.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2995 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2996 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3079_fsm 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3079_vm 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3080 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3081 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3085 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3118 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3119 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:38 3164 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3256 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3257 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3258 2024-09-12T02:54:19.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3350 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3351 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3379 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3380 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3381 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3394 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3394_fsm 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3394_vm 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3395 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3429 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3430 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3431 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3433 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3439 2024-09-12T02:54:19.722 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3440 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 3455 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:38 3456 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3456_fsm 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3456_vm 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3466 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3467 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3468 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3501 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3502 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3503 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3534 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3541_fsm 2024-09-12T02:54:19.723 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541_vm 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3542 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3574 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3575 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3576 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3596 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3597 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3598 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3599 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3600_fsm 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600_vm 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3601_fsm 2024-09-12T02:54:19.724 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601_vm 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3602_fsm 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602_vm 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3603_fsm 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3603_vm 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3604 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3605 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3606 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3607 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3608 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 3609 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3712 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3764_fsm 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3764_vm 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3766 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3767 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3997 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4143 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4144 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4145 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4146 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4147 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4148 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4149 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4150 2024-09-12T02:54:19.726 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4151 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4152 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4153 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4154 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4155 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4156 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4157 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4158 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4159 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4160 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4161 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4162 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4163 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4164 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4165 2024-09-12T02:54:19.727 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4166 2024-09-12T02:54:19.728 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4167 2024-09-12T02:54:19.728 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4168 2024-09-12T02:54:19.728 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4169 2024-09-12T02:54:19.728 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4170 2024-09-12T02:54:19.728 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4171 2024-09-12T02:54:19.728 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4172 2024-09-12T02:54:19.730 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4173 2024-09-12T02:54:19.730 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4174 2024-09-12T02:54:19.730 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 5002 2024-09-12T02:54:19.730 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 548 2024-09-12T02:54:19.730 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 549 2024-09-12T02:54:19.730 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6102 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6104 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6106 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6110 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6111 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6112 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6113 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6117 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 826 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 827 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 828 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:38 pg_filenode.map 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:38 PG_VERSION 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.731 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:total 606406 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 12 02:43 . 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:39 .. 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 112 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 113 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:39 1247 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1247_fsm 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 1247_vm 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:39 1249 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 1249_fsm 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 1249_vm 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:38 1255 2024-09-12T02:54:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 1255_fsm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1255_vm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:54 1259 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 1259_fsm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 1259_vm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:38 13344 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13344_fsm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13344_vm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13346 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13348 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13349 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13349_fsm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13349_vm 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 13351 2024-09-12T02:54:19.733 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13353 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13354 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 13354_fsm 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 13354_vm 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 13356 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13358 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 13359_fsm 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13359_vm 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 13361 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 13363 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 1417 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 1418 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 444211200 Sep 12 02:54 16396 2024-09-12T02:54:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 12 02:54 16396_fsm 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:43 16396_vm 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1392640 Sep 12 02:54 16397 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:54 16397_fsm 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:54 16397_vm 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1646592 Sep 12 02:54 16399 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:54 16399_fsm 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:54 16399_vm 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:54 16400 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:54 16402 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 12 02:54 16404 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 93315072 Sep 12 02:54 16406 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:54 16406_fsm 2024-09-12T02:54:19.735 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:53 16406_vm 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 174 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 175 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2187 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2224 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2328 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2336 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2337 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2579 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2600 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2600_fsm 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2600_vm 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2601_fsm 2024-09-12T02:54:19.736 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2601_vm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2602 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2602_fsm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2602_vm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2603 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2603_fsm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2603_vm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2604 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2605 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2605_fsm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2605_vm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2606 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2606_fsm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2606_vm 2024-09-12T02:54:19.737 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2607 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2607_fsm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2607_vm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:39 2608 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2608_fsm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2608_vm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:38 2609 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2609_fsm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2609_vm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2610 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2610_fsm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2610_vm 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2611 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612 2024-09-12T02:54:19.738 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2612_fsm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2612_vm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2613 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2615_fsm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2615_vm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2616 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2616_fsm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2616_vm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:38 2617 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2617_fsm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2617_vm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:38 2618 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2618_fsm 2024-09-12T02:54:19.739 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2618_vm 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 12 02:54 2619 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:42 2619_fsm 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2619_vm 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2620 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2650 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2651 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2652 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 2653 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 2654 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2655 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2656 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2657 2024-09-12T02:54:19.740 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:39 2658 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:39 2659 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2660 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2661 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2662 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:39 2663 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2664 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2665 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2666 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2667 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2668 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2669 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2670 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:39 2673 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:39 2674 2024-09-12T02:54:19.741 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:38 2675 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2678 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2679 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2680 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2681 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2682 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2683 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2684 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2685 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2686 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2687 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:38 2688 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:38 2689 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:39 2690 2024-09-12T02:54:19.742 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:39 2691 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2692 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2693 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:44 2696 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2699 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2701 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2702 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:39 2703 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 2704 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2753 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2753_fsm 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2753_vm 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2754 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2755 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2756 2024-09-12T02:54:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 2757 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2830 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2831 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2832 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2833 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2834 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2835 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 2836 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2837 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:39 2838 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2838_fsm 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2838_vm 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2839 2024-09-12T02:54:19.744 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2840 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 2840_fsm 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2840_vm 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2841 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2995 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2996 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3079 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3079_fsm 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3079_vm 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3080 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3081 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 3085 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3118 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3119 2024-09-12T02:54:19.745 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:39 3164 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3256 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3257 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3258 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3350 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3351 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3379 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3380 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3381 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3394 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3394_fsm 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3394_vm 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3395 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3429 2024-09-12T02:54:19.746 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3430 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3431 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3433 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3439 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3440 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:39 3455 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:38 3456 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3456_fsm 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3456_vm 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3466 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3467 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3468 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3501 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3502 2024-09-12T02:54:19.747 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3503 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3534 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3541 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3541_fsm 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3541_vm 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3542 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3574 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3575 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 3576 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3596 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3597 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3598 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3599 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600 2024-09-12T02:54:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3600_fsm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3600_vm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3601 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3601_fsm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3601_vm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3602 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3602_fsm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3602_vm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3603 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:39 3603_fsm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3603_vm 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3604 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3605 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3606 2024-09-12T02:54:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3607 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3608 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:38 3609 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 3712 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3764 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 3764_fsm 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3764_vm 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3766 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 3767 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 3997 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4143 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4144 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4145 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4146 2024-09-12T02:54:19.750 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4147 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4148 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4149 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4150 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4151 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4152 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4153 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4154 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4155 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4156 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4157 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4158 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4159 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4160 2024-09-12T02:54:19.751 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4161 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4162 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4163 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4164 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4165 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4166 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 4167 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4168 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4169 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4170 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4171 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4172 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4173 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 4174 2024-09-12T02:54:19.752 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 5002 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 548 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 549 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6102 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6104 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 6106 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 6110 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 6111 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 6112 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6113 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6117 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 826 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 827 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 828 2024-09-12T02:54:19.753 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:39 pg_filenode.map 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 12 02:39 pg_internal.init 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:39 PG_VERSION 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:39 . 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:39 .. 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/global: 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:total 560 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 12 02:39 . 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1213 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1213_fsm 2024-09-12T02:54:19.754 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1213_vm 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1214 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1214_fsm 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1214_vm 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 1232 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 1233 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1260 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1260_fsm 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1260_vm 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1261 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1261_fsm 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1261_vm 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 1262 2024-09-12T02:54:19.755 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 1262_fsm 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 1262_vm 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:39 2396 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:38 2396_fsm 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2396_vm 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:39 2397 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2671 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2672 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2676 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2677 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2694 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2695 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2697 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:38 2698 2024-09-12T02:54:19.756 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2846 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2847 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2964 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2965 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 2966 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 2967 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 3592 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 3593 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4060 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4061 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4175 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4176 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4177 2024-09-12T02:54:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4178 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4181 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4182 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4183 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4184 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 4185 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 4186 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6000 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6001 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6002 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 6100 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6114 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 6115 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:54 pg_control 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:38 pg_filenode.map 2024-09-12T02:54:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 12 02:39 pg_internal.init 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/log: 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:total 2 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:39 . 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1512 Sep 12 02:54 postgresql-Thu.log 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-12T02:54:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:total 1 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:54 . 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 mappings 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 12 02:54 replorigin_checkpoint 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 snapshots 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:54 .. 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:54 .. 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 . 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 members 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 offsets 2024-09-12T02:54:19.761 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:total 8 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 .. 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:38 0000 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:total 8 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:38 . 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:38 .. 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:43 0000 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.762 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.763 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:total 15 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:54 . 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 12 02:54 db_0.stat 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 12 02:54 db_13494.stat 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 12 02:54 global.stat 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-12T02:54:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:54 . 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:total 56 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:54 . 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:54 001B 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.765 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:total 1048576 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 12 02:54 . 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:54 00000001000000000000009F 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:49 0000000100000000000000A0 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000A1 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000A2 2024-09-12T02:54:19.766 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000A3 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000A4 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:48 0000000100000000000000A5 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000A6 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000A7 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000A8 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000A9 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000AA 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:48 0000000100000000000000AB 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000AC 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000AD 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000AE 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000AF 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B0 2024-09-12T02:54:19.767 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B1 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B2 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B3 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B4 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B5 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B6 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B7 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000B8 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:50 0000000100000000000000B9 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:48 0000000100000000000000BA 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:50 0000000100000000000000BB 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:50 0000000100000000000000BC 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:49 0000000100000000000000BD 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:47 0000000100000000000000BE 2024-09-12T02:54:19.768 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000BF 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000C0 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000C1 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000C2 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000C3 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000C4 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000C5 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:52 0000000100000000000000C6 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000C7 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000C8 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000C9 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000CA 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:54 0000000100000000000000CB 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000CC 2024-09-12T02:54:19.769 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000CD 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:52 0000000100000000000000CE 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000CF 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000D0 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000D1 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000D2 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000D3 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000D4 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000D5 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000D6 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000D7 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000D8 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000D9 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000DA 2024-09-12T02:54:19.770 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:51 0000000100000000000000DB 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:52 0000000100000000000000DC 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:53 0000000100000000000000DD 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:52 0000000100000000000000DE 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 archive_status 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:total 0 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:38 . 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 12 02:54 .. 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:total 440 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:47 . 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:54 .. 2024-09-12T02:54:19.771 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 12 02:47 0000 2024-09-12T02:54:19.772 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 188416 Sep 12 02:54 0001 2024-09-12T02:54:19.772 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T02:54:19.783 INFO:tasks.quiescer:joining Quiescers 2024-09-12T02:54:19.783 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T02:54:19.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:54:19.963 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:54:20.035 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:20.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:19 smithi189 ceph-mon[35196]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 1.66k op/s 2024-09-12T02:54:20.313 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:19 smithi100 ceph-mon[31390]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 1.66k op/s 2024-09-12T02:54:20.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:19 smithi117 ceph-mon[34898]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 1.66k op/s 2024-09-12T02:54:20.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 -- 172.21.15.100:0/3540090818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4106f10 msgr2=0x7fc8d410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 --2- 172.21.15.100:0/3540090818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4106f10 0x7fc8d410ea90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009ca0 tx=0x7fc8cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 -- 172.21.15.100:0/3540090818 shutdown_connections 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 --2- 172.21.15.100:0/3540090818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4106f10 0x7fc8d410ea90 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 --2- 172.21.15.100:0/3540090818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d4102790 0x7fc8d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 --2- 172.21.15.100:0/3540090818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8d4101de0 0x7fc8d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 -- 172.21.15.100:0/3540090818 >> 172.21.15.100:0/3540090818 conn(0x7fc8d40fd8c0 msgr2=0x7fc8d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 -- 172.21.15.100:0/3540090818 shutdown_connections 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 -- 172.21.15.100:0/3540090818 wait complete. 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 Processor -- start 2024-09-12T02:54:20.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.523+0000 7fc8da999640 1 -- start start 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8da999640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4101de0 0x7fc8d4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8da999640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d4102790 0x7fc8d4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8da999640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8d4106f10 0x7fc8d419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8da999640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4111f90 con 0x7fc8d4101de0 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8da999640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4111e10 con 0x7fc8d4106f10 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8da999640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4112110 con 0x7fc8d4102790 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4101de0 0x7fc8d4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:20.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4101de0 0x7fc8d4198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59428/0 (socket says 172.21.15.100:59428) 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 -- 172.21.15.100:0/192685452 learned_addr learned my addr 172.21.15.100:0/192685452 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d8f36640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8d4106f10 0x7fc8d419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d37fe640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d4102790 0x7fc8d4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 -- 172.21.15.100:0/192685452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d4102790 msgr2=0x7fc8d4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d4102790 0x7fc8d4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 -- 172.21.15.100:0/192685452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8d4106f10 msgr2=0x7fc8d419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8d4106f10 0x7fc8d419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 -- 172.21.15.100:0/192685452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d419d3e0 con 0x7fc8d4101de0 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d8f36640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8d4106f10 0x7fc8d419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d3fff640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4101de0 0x7fc8d4198430 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400d950 tx=0x7fc8c400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.524+0000 7fc8d17fa640 1 -- 172.21.15.100:0/192685452 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4017070 con 0x7fc8d4101de0 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.525+0000 7fc8d17fa640 1 -- 172.21.15.100:0/192685452 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c400de80 con 0x7fc8d4101de0 2024-09-12T02:54:20.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.525+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d419d6d0 con 0x7fc8d4101de0 2024-09-12T02:54:20.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.525+0000 7fc8d17fa640 1 -- 172.21.15.100:0/192685452 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400f620 con 0x7fc8d4101de0 2024-09-12T02:54:20.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.525+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41a4fb0 con 0x7fc8d4101de0 2024-09-12T02:54:20.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.526+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d41021c0 con 0x7fc8d4101de0 2024-09-12T02:54:20.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.527+0000 7fc8d17fa640 1 -- 172.21.15.100:0/192685452 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fc8c4009c30 con 0x7fc8d4101de0 2024-09-12T02:54:20.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.527+0000 7fc8d17fa640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8bc0a2c00 0x7fc8bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:20.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.528+0000 7fc8d37fe640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8bc0a2c00 0x7fc8bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:20.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.528+0000 7fc8d17fa640 1 -- 172.21.15.100:0/192685452 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc8c40ceba0 con 0x7fc8d4101de0 2024-09-12T02:54:20.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.528+0000 7fc8d37fe640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8bc0a2c00 0x7fc8bc0a50c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40fdce0 tx=0x7fc8c8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:20.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.531+0000 7fc8d17fa640 1 -- 172.21.15.100:0/192685452 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8c409bb70 con 0x7fc8d4101de0 2024-09-12T02:54:20.594 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:20.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.758+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8d4199790 con 0x7fc8d4101de0 2024-09-12T02:54:20.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.759+0000 7fc8d17fa640 1 -- 172.21.15.100:0/192685452 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fc8d4199790 con 0x7fc8d4101de0 2024-09-12T02:54:20.760 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:20.760 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-12T02:41:04:683741+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:41:04.513456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:54:20.761 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-12T02:54:20.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8bc0a2c00 msgr2=0x7fc8bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:20.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8bc0a2c00 0x7fc8bc0a50c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40fdce0 tx=0x7fc8c8009110 comp rx=0 tx=0).stop 2024-09-12T02:54:20.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4101de0 msgr2=0x7fc8d4198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:20.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4101de0 0x7fc8d4198430 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400d950 tx=0x7fc8c400dd50 comp rx=0 tx=0).stop 2024-09-12T02:54:20.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 shutdown_connections 2024-09-12T02:54:20.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fc8bc0a2c00 0x7fc8bc0a50c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8d4106f10 0x7fc8d419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8d4102790 0x7fc8d4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 --2- 172.21.15.100:0/192685452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d4101de0 0x7fc8d4198430 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:20.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 >> 172.21.15.100:0/192685452 conn(0x7fc8d40fd8c0 msgr2=0x7fc8d40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:20.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 shutdown_connections 2024-09-12T02:54:20.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:20.761+0000 7fc8da999640 1 -- 172.21.15.100:0/192685452 wait complete. 2024-09-12T02:54:20.973 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:20 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/192685452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:21.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:20 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/192685452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:21.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:20 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/192685452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:22.114 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --cancel --all' 2024-09-12T02:54:22.114 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --cancel --all 2024-09-12T02:54:22.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:21 smithi189 ceph-mon[35196]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 2.02k op/s 2024-09-12T02:54:22.281 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:21 smithi100 ceph-mon[31390]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 2.02k op/s 2024-09-12T02:54:22.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:21 smithi117 ceph-mon[34898]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 2.02k op/s 2024-09-12T02:54:22.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 -- 172.21.15.100:0/1342970946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc102570 msgr2=0x7f03bc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 --2- 172.21.15.100:0/1342970946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc102570 0x7f03bc1029b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009900 tx=0x7f03a802a480 comp rx=0 tx=0).stop 2024-09-12T02:54:22.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 -- 172.21.15.100:0/1342970946 shutdown_connections 2024-09-12T02:54:22.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 --2- 172.21.15.100:0/1342970946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03bc102ef0 0x7f03bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 --2- 172.21.15.100:0/1342970946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc102570 0x7f03bc1029b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 --2- 172.21.15.100:0/1342970946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03bc100e20 0x7f03bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 -- 172.21.15.100:0/1342970946 >> 172.21.15.100:0/1342970946 conn(0x7f03bc0fc7d0 msgr2=0x7f03bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 -- 172.21.15.100:0/1342970946 shutdown_connections 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 -- 172.21.15.100:0/1342970946 wait complete. 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 Processor -- start 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.363+0000 7f03c309c640 1 -- start start 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c309c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc100e20 0x7f03bc199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c309c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03bc102570 0x7f03bc1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c309c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03bc102ef0 0x7f03bc1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c309c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc110f80 con 0x7f03bc100e20 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c309c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc110e00 con 0x7f03bc102570 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c309c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc111100 con 0x7f03bc102ef0 2024-09-12T02:54:22.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc100e20 0x7f03bc199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc100e20 0x7f03bc199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59456/0 (socket says 172.21.15.100:59456) 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 -- 172.21.15.100:0/1706917388 learned_addr learned my addr 172.21.15.100:0/1706917388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c1639640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03bc102ef0 0x7f03bc1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 -- 172.21.15.100:0/1706917388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03bc102ef0 msgr2=0x7f03bc1a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03bbfff640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03bc102570 0x7f03bc1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03bc102ef0 0x7f03bc1a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 -- 172.21.15.100:0/1706917388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03bc102570 msgr2=0x7f03bc1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03bc102570 0x7f03bc1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 -- 172.21.15.100:0/1706917388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc1a4950 con 0x7f03bc100e20 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03bbfff640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03bc102570 0x7f03bc1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c0e38640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc100e20 0x7f03bc199390 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f03b000d770 tx=0x7f03b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03b9ffb640 1 -- 172.21.15.100:0/1706917388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0017070 con 0x7f03bc100e20 2024-09-12T02:54:22.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03b9ffb640 1 -- 172.21.15.100:0/1706917388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b0005500 con 0x7f03bc100e20 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03bc1a4b20 con 0x7f03bc100e20 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.364+0000 7f03b9ffb640 1 -- 172.21.15.100:0/1706917388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0004e00 con 0x7f03bc100e20 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.365+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03bc1a4fe0 con 0x7f03bc100e20 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.366+0000 7f03b9ffb640 1 -- 172.21.15.100:0/1706917388 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f03b0004fa0 con 0x7f03bc100e20 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 Processor -- start 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03b9ffb640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f03ac0a2b80 0x7f03ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 -- start start 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c1639640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f03ac0a2b80 0x7f03ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03b9ffb640 1 -- 172.21.15.100:0/1706917388 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f03b00ceb80 con 0x7f03bc100e20 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f05d0 0x555f351f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f351fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f351562f0 con 0x555f351f1b40 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555f350fdcf0 con 0x555f351fb370 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c5475740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555f351522b0 con 0x555f351f05d0 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c0e38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c0e38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59468/0 (socket says 172.21.15.100:59468) 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.367+0000 7f03c0e38640 1 -- 172.21.15.100:0/2406063202 learned_addr learned my addr 172.21.15.100:0/2406063202 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03bbfff640 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f05d0 0x555f351f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c1639640 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f351fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c0e38640 1 -- 172.21.15.100:0/2406063202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f05d0 msgr2=0x555f351f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c0e38640 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f05d0 0x555f351f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c0e38640 1 -- 172.21.15.100:0/2406063202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 msgr2=0x555f351fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c0e38640 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f351fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c0e38640 1 -- 172.21.15.100:0/2406063202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f350e23a0 con 0x555f351f1b40 2024-09-12T02:54:22.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c1639640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f03ac0a2b80 0x7f03ac0a5040 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f03b40092f0 tx=0x7f03b4010740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03c0e38640 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f0090 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f03b009b360 tx=0x7f03b00048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0265ff10e32d08a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03a6ffd640 1 -- 172.21.15.100:0/2406063202 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0020070 con 0x555f351f1b40 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03a6ffd640 1 -- 172.21.15.100:0/2406063202 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b009f780 con 0x555f351f1b40 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.368+0000 7f03a6ffd640 1 -- 172.21.15.100:0/2406063202 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0097a40 con 0x555f351f1b40 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 -- 172.21.15.100:0/2406063202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 msgr2=0x555f351f0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f0090 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f03b009b360 tx=0x7f03b00048a0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 -- 172.21.15.100:0/2406063202 shutdown_connections 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f351fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f05d0 0x555f351f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 --2- 172.21.15.100:0/2406063202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f0090 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 -- 172.21.15.100:0/2406063202 >> 172.21.15.100:0/2406063202 conn(0x555f351b9310 msgr2=0x555f351ecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 -- 172.21.15.100:0/2406063202 shutdown_connections 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 -- 172.21.15.100:0/2406063202 wait complete. 2024-09-12T02:54:22.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 -- start start 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.369+0000 7f03c5475740 1 Processor -- start 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c5475740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f351fad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c5475740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c5475740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c5475740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f35202480 con 0x555f351f1b40 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c5475740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555f35111060 con 0x555f351f05d0 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c5475740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555f35202600 con 0x555f351fb370 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c5475740 10 client.0 _ll_register_callbacks cb 0x555f34e648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59484/0 (socket says 172.21.15.100:59484) 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 -- 172.21.15.100:0/982715734 learned_addr learned my addr 172.21.15.100:0/982715734 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c0e38640 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f351fad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03c1639640 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 -- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 msgr2=0x555f351f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 -- 172.21.15.100:0/982715734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 msgr2=0x555f351fad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f351fad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 -- 172.21.15.100:0/982715734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f34ec73c0 con 0x555f351f1b40 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f03bbfff640 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f8000 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009230 tx=0x7f03a8004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde13f48a6827ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.370+0000 7f039bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f039bfff640 1 -- 172.21.15.100:0/982715734 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8035040 con 0x555f351f1b40 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f039bfff640 1 -- 172.21.15.100:0/982715734 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f03a8005510 con 0x555f351f1b40 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b009f780 con 0x555f351f1b40 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f039bfff640 1 -- 172.21.15.100:0/982715734 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03a80046c0 con 0x555f351f1b40 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 10 client.18108 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f3520df00 con 0x555f351f1b40 2024-09-12T02:54:22.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f039bfff640 1 -- 172.21.15.100:0/982715734 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b009f780 con 0x555f351f1b40 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f039bfff640 1 -- 172.21.15.100:0/982715734 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f03a8003af0 con 0x555f351f1b40 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 10 client.18108 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 10 client.18108 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 20 client.18108 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3520f3c0 0x555f352117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 4 client.18108 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.371+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f35163860 con 0x555f3520f3c0 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.372+0000 7f03c0e38640 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3520f3c0 0x555f352117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.372+0000 7f03c0e38640 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3520f3c0 0x555f352117b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe016d3f2754e98a server_cookie=5e016f65e86ccc82 in_seq=0 out_seq=0 2024-09-12T02:54:22.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.372+0000 7f039bfff640 10 client.18108 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:54:22.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f039bfff640 1 -- 172.21.15.100:0/982715734 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f35163860 con 0x555f3520f3c0 2024-09-12T02:54:22.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f039bfff640 10 client.18108 handle_command_reply: tid=0 2024-09-12T02:54:22.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 client.18108 shutdown 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 msgr2=0x555f351f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f8000 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009230 tx=0x7f03a8004510 comp rx=0 tx=0).stop 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 shutdown_connections 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3520f3c0 0x555f352117b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f039bfff640 0 client.18108 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f1b40 0x555f351f8000 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 --2- 172.21.15.100:0/982715734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f351fad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 >> 172.21.15.100:0/982715734 conn(0x555f351b9310 msgr2=0x555f351f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 shutdown_connections 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 1 -- 172.21.15.100:0/982715734 wait complete. 2024-09-12T02:54:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.373+0000 7f03c5475740 20 client.18108 trim_cache size 0 max 16384 2024-09-12T02:54:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 Processor -- start 2024-09-12T02:54:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 -- start start 2024-09-12T02:54:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f3520b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f3980 0x555f35217080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1addc0 con 0x555f351f3980 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1ab690 con 0x555f351f05d0 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c5475740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1a94e0 con 0x555f351fb370 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c1639640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f3980 0x555f35217080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c1639640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f3980 0x555f35217080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59496/0 (socket says 172.21.15.100:59496) 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.387+0000 7f03c1639640 1 -- 172.21.15.100:0/3276976982 learned_addr learned my addr 172.21.15.100:0/3276976982 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03bbfff640 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c0e38640 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f3520b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c1639640 1 -- 172.21.15.100:0/3276976982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 msgr2=0x555f351f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c1639640 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c1639640 1 -- 172.21.15.100:0/3276976982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 msgr2=0x555f3520b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c1639640 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f3520b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c1639640 1 -- 172.21.15.100:0/3276976982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f35211b20 con 0x555f351f3980 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c0e38640 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f3520b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03c1639640 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f3980 0x555f35217080 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f03b4012750 tx=0x7f03b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab3de2342aabdce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03a67fc640 1 -- 172.21.15.100:0/3276976982 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4011820 con 0x555f351f3980 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03a67fc640 1 -- 172.21.15.100:0/3276976982 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b401f440 con 0x555f351f3980 2024-09-12T02:54:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.388+0000 7f03a67fc640 1 -- 172.21.15.100:0/3276976982 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b401e6a0 con 0x555f351f3980 2024-09-12T02:54:22.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 -- 172.21.15.100:0/3276976982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f3980 msgr2=0x555f35217080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f3980 0x555f35217080 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f03b4012750 tx=0x7f03b4015000 comp rx=0 tx=0).stop 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 -- 172.21.15.100:0/3276976982 shutdown_connections 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f3980 0x555f35217080 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351fb370 0x555f351f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 --2- 172.21.15.100:0/3276976982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351f05d0 0x555f3520b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 -- 172.21.15.100:0/3276976982 >> 172.21.15.100:0/3276976982 conn(0x555f351b9310 msgr2=0x555f351f68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 -- 172.21.15.100:0/3276976982 shutdown_connections 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 -- 172.21.15.100:0/3276976982 wait complete. 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.389+0000 7f03c5475740 1 -- start start 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 1 Processor -- start 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f05d0 0x555f35203530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f3980 0x555f35203a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f35203fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1a9b50 con 0x555f351f05d0 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1aafc0 con 0x555f351fb370 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1aa220 con 0x555f351f3980 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c5475740 10 client.0 _ll_register_callbacks cb 0x7f03a80095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c0e38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f05d0 0x555f35203530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c0e38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f05d0 0x555f35203530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59498/0 (socket says 172.21.15.100:59498) 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c0e38640 1 -- 172.21.15.100:0/2095380909 learned_addr learned my addr 172.21.15.100:0/2095380909 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03bbfff640 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f3980 0x555f35203a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.390+0000 7f03c1639640 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f35203fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03bbfff640 1 -- 172.21.15.100:0/2095380909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 msgr2=0x555f35203fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03bbfff640 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f35203fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03bbfff640 1 -- 172.21.15.100:0/2095380909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f05d0 msgr2=0x555f35203530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03bbfff640 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f05d0 0x555f35203530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03bbfff640 1 -- 172.21.15.100:0/2095380909 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f35279050 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03bbfff640 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f3980 0x555f35203a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x555f351f90f0 tx=0x7f03a8005540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11dc6cd8f56e2b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f039bfff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f039bfff640 1 -- 172.21.15.100:0/2095380909 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8035040 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b401f440 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f039bfff640 1 -- 172.21.15.100:0/2095380909 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f03a8004860 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f039bfff640 1 -- 172.21.15.100:0/2095380909 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03a802ab00 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03c5475740 10 client.27232 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.391+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f3527a290 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f039bfff640 1 -- 172.21.15.100:0/2095380909 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b401f440 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f039bfff640 1 -- 172.21.15.100:0/2095380909 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f03a80037d0 con 0x555f351f3980 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c5475740 10 client.27232 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c5475740 10 client.27232 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c5475740 20 client.27232 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c5475740 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3527aa10 0x555f3527ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c5475740 4 client.27232 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 --> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f3515dd70 con 0x555f3527aa10 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c0e38640 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3527aa10 0x555f3527ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f03c0e38640 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3527aa10 0x555f3527ce30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb6a4f3bf34a5ef5 server_cookie=cd67d07affb497bd in_seq=0 out_seq=0 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.392+0000 7f039bfff640 10 client.27232 ms_handle_connect on v2:172.21.15.189:6838/249791432 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f039bfff640 1 -- 172.21.15.100:0/2095380909 <== mds.1 v2:172.21.15.189:6838/249791432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f3515dd70 con 0x555f3527aa10 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f039bfff640 10 client.27232 handle_command_reply: tid=0 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 client.27232 shutdown 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f3980 msgr2=0x555f35203a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f3980 0x555f35203a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x555f351f90f0 tx=0x7f03a8005540 comp rx=0 tx=0).stop 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 shutdown_connections 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:6838/249791432,v1:172.21.15.189:6839/249791432] conn(0x555f3527aa10 0x555f3527ce30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f351fb370 0x555f35203fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f351f3980 0x555f35203a70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 --2- 172.21.15.100:0/2095380909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f351f05d0 0x555f35203530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f039bfff640 0 client.27232 ms_handle_reset on v2:172.21.15.189:6838/249791432 2024-09-12T02:54:22.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 >> 172.21.15.100:0/2095380909 conn(0x555f351b9310 msgr2=0x555f351f70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:22.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 shutdown_connections 2024-09-12T02:54:22.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 1 -- 172.21.15.100:0/2095380909 wait complete. 2024-09-12T02:54:22.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.393+0000 7f03c5475740 20 client.27232 trim_cache size 0 max 16384 2024-09-12T02:54:22.400 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f03ac0a2b80 msgr2=0x7f03ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f03ac0a2b80 0x7f03ac0a5040 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f03b40092f0 tx=0x7f03b4010740 comp rx=0 tx=0).stop 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc100e20 msgr2=0x7f03bc199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc100e20 0x7f03bc199390 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f03b000d770 tx=0x7f03b000dc30 comp rx=0 tx=0).stop 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 shutdown_connections 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f03ac0a2b80 0x7f03ac0a5040 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03bc102ef0 0x7f03bc1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03bc102570 0x7f03bc1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 --2- 172.21.15.100:0/1706917388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03bc100e20 0x7f03bc199390 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 >> 172.21.15.100:0/1706917388 conn(0x7f03bc0fc7d0 msgr2=0x7f03bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:22.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 shutdown_connections 2024-09-12T02:54:22.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:22.394+0000 7f03c309c640 1 -- 172.21.15.100:0/1706917388 wait complete. 2024-09-12T02:54:23.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:54:23.182 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 -- 172.21.15.100:0/4027521891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 msgr2=0x7f16d8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 --2- 172.21.15.100:0/4027521891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8107b90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009930 tx=0x7f16cc02a420 comp rx=0 tx=0).stop 2024-09-12T02:54:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 -- 172.21.15.100:0/4027521891 shutdown_connections 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 --2- 172.21.15.100:0/4027521891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16d81082a0 0x7f16d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 --2- 172.21.15.100:0/4027521891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8107b90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 --2- 172.21.15.100:0/4027521891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d8102d30 0x7f16d8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 -- 172.21.15.100:0/4027521891 >> 172.21.15.100:0/4027521891 conn(0x7f16d80fc7d0 msgr2=0x7f16d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 -- 172.21.15.100:0/4027521891 shutdown_connections 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 -- 172.21.15.100:0/4027521891 wait complete. 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 Processor -- start 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.623+0000 7f16defa1640 1 -- start start 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16defa1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16d8102d30 0x7f16d8198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16defa1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16defa1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d81082a0 0x7f16d819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16defa1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f16d8112060 con 0x7f16d81036e0 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16defa1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16d8111ee0 con 0x7f16d81082a0 2024-09-12T02:54:23.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16defa1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81121e0 con 0x7f16d8102d30 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59516/0 (socket says 172.21.15.100:59516) 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 -- 172.21.15.100:0/111157883 learned_addr learned my addr 172.21.15.100:0/111157883 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16dd53e640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d81082a0 0x7f16d819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16d8102d30 0x7f16d8198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 -- 172.21.15.100:0/111157883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16d8102d30 msgr2=0x7f16d8198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16d8102d30 0x7f16d8198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 -- 172.21.15.100:0/111157883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d81082a0 msgr2=0x7f16d819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d81082a0 0x7f16d819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 -- 172.21.15.100:0/111157883 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d819d5b0 con 0x7f16d81036e0 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16d8102d30 0x7f16d8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:54:23.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d7fff640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8198b40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f16cc005940 tx=0x7f16cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.624+0000 7f16d5ffb640 1 -- 172.21.15.100:0/111157883 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc03f030 con 0x7f16d81036e0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.625+0000 7f16d5ffb640 1 -- 172.21.15.100:0/111157883 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16cc003ce0 con 0x7f16d81036e0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.625+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d819d840 con 0x7f16d81036e0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.625+0000 7f16d5ffb640 1 -- 172.21.15.100:0/111157883 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc035070 con 0x7f16d81036e0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.625+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d81a5180 con 0x7f16d81036e0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.627+0000 7f16d5ffb640 1 -- 172.21.15.100:0/111157883 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f16cc042030 con 0x7f16d81036e0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.627+0000 7f16e137a740 1 Processor -- start 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.627+0000 7f16e137a740 1 -- start start 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16e137a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef79fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16e137a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef7aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16e137a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16e137a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555cef704200 con 0x555cef7aabe0 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16e137a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555cef6aadc0 con 0x555cef79fa00 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16e137a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555cef7001c0 con 0x555cef7a0320 2024-09-12T02:54:23.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59524/0 (socket says 172.21.15.100:59524) 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 -- 172.21.15.100:0/1361086664 learned_addr learned my addr 172.21.15.100:0/1361086664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef7aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d5ffb640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f16c00a2b80 0x7f16c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16dd53e640 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef79fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 -- 172.21.15.100:0/1361086664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 msgr2=0x555cef7aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef7aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 -- 172.21.15.100:0/1361086664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 msgr2=0x555cef79fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef79fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 -- 172.21.15.100:0/1361086664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cef475620 con 0x555cef7aabe0 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16dd53e640 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef79fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16dd53e640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f16c00a2b80 0x7f16c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d5ffb640 1 -- 172.21.15.100:0/111157883 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f16cc0ef670 con 0x7f16d81036e0 2024-09-12T02:54:23.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.628+0000 7f16d7fff640 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7acfd0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0bbb60 tx=0x7f16cc04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9af154e24a0bae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16beffd640 1 -- 172.21.15.100:0/1361086664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc036260 con 0x555cef7aabe0 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16beffd640 1 -- 172.21.15.100:0/1361086664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16cc072d40 con 0x555cef7aabe0 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16beffd640 1 -- 172.21.15.100:0/1361086664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc04a260 con 0x555cef7aabe0 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 -- 172.21.15.100:0/1361086664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 msgr2=0x555cef7acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16dd53e640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f16c00a2b80 0x7f16c00a5040 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f16d000a2c0 tx=0x7f16d0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7acfd0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0bbb60 tx=0x7f16cc04b000 comp rx=0 tx=0).stop 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 -- 172.21.15.100:0/1361086664 shutdown_connections 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7acfd0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef7aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 --2- 172.21.15.100:0/1361086664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef79fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 -- 172.21.15.100:0/1361086664 >> 172.21.15.100:0/1361086664 conn(0x555cef79bf90 msgr2=0x555cef79c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 -- 172.21.15.100:0/1361086664 shutdown_connections 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.629+0000 7f16e137a740 1 -- 172.21.15.100:0/1361086664 wait complete. 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 -- start start 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 Processor -- start 2024-09-12T02:54:23.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef79fa00 0x555cef7aa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7a0320 0x555cef7a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7aabe0 0x555cef7a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555cef7ad570 con 0x555cef7a0320 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555cef69ec50 con 0x555cef7aabe0 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 27, 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24473, 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 56, 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": {} 2024-09-12T02:54:23.672 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555cef7ad6f0 con 0x555cef79fa00 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16e137a740 10 client.0 _ll_register_callbacks cb 0x555cef6b0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7a0320 0x555cef7a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7a0320 0x555cef7a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59536/0 (socket says 172.21.15.100:59536) 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16d7fff640 1 -- 172.21.15.100:0/3765507355 learned_addr learned my addr 172.21.15.100:0/3765507355 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.630+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef79fa00 0x555cef7aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16dd53e640 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7aabe0 0x555cef7a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16d7fff640 1 -- 172.21.15.100:0/3765507355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef79fa00 msgr2=0x555cef7aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16d7fff640 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef79fa00 0x555cef7aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16d7fff640 1 -- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7aabe0 msgr2=0x555cef7a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16d7fff640 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7aabe0 0x555cef7a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16d7fff640 1 -- 172.21.15.100:0/3765507355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cef7a8480 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16d7fff640 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7a0320 0x555cef7a7740 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0c45a0 tx=0x7f16cc0c0210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3056bbcedb2debb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16b7fff640 1 -- 172.21.15.100:0/3765507355 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc04a260 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16b7fff640 1 -- 172.21.15.100:0/3765507355 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f16cc03b460 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555cef711770 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16b7fff640 1 -- 172.21.15.100:0/3765507355 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f16cc036260 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16e137a740 10 client.18126 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cef7ad570 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16b7fff640 1 -- 172.21.15.100:0/3765507355 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555cef711770 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16b7fff640 1 -- 172.21.15.100:0/3765507355 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f16cc0b84d0 con 0x555cef7a0320 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16e137a740 10 client.18126 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16e137a740 10 client.18126 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:54:23.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16e137a740 20 client.18126 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.631+0000 7f16e137a740 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef7ba210 0x555cef7bc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.632+0000 7f16e137a740 4 client.18126 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.632+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cef70bc80 con 0x555cef7ba210 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.632+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef7ba210 0x555cef7bc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.632+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef7ba210 0x555cef7bc630 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=131afe2fd5e05f20 server_cookie=66e236b37f635c2a in_seq=0 out_seq=0 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.632+0000 7f16b7fff640 10 client.18126 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16b7fff640 1 -- 172.21.15.100:0/3765507355 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cef70bc80 con 0x555cef7ba210 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16b7fff640 10 client.18126 handle_command_reply: tid=0 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 client.18126 shutdown 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7a0320 msgr2=0x555cef7a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7a0320 0x555cef7a7740 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0c45a0 tx=0x7f16cc0c0210 comp rx=0 tx=0).stop 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 shutdown_connections 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef7ba210 0x555cef7bc630 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7aabe0 0x555cef7a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7a0320 0x555cef7a7740 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16b7fff640 0 client.18126 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 --2- 172.21.15.100:0/3765507355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef79fa00 0x555cef7aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 >> 172.21.15.100:0/3765507355 conn(0x555cef79bf90 msgr2=0x555cef79b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 shutdown_connections 2024-09-12T02:54:23.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 1 -- 172.21.15.100:0/3765507355 wait complete. 2024-09-12T02:54:23.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.633+0000 7f16e137a740 20 client.18126 trim_cache size 0 max 16384 2024-09-12T02:54:23.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 Processor -- start 2024-09-12T02:54:23.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 -- start start 2024-09-12T02:54:23.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef7b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef79b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81aff00 con 0x555cef7aabe0 2024-09-12T02:54:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81ad7d0 con 0x555cef79fa00 2024-09-12T02:54:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16e137a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81ab620 con 0x555cef7a0320 2024-09-12T02:54:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16dd53e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16dd53e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59542/0 (socket says 172.21.15.100:59542) 2024-09-12T02:54:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16dd53e640 1 -- 172.21.15.100:0/2486141365 learned_addr learned my addr 172.21.15.100:0/2486141365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16d7fff640 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef79b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef7b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16dd53e640 1 -- 172.21.15.100:0/2486141365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 msgr2=0x555cef79b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.650+0000 7f16dd53e640 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef79b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16dd53e640 1 -- 172.21.15.100:0/2486141365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 msgr2=0x555cef7b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16dd53e640 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef7b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16dd53e640 1 -- 172.21.15.100:0/2486141365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cef79bdc0 con 0x555cef7aabe0 2024-09-12T02:54:23.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef7b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:54:23.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16dd53e640 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7c1ec0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f16d000b010 tx=0x7f16d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e666fba7cc8f3363 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:23.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16be7fc640 1 -- 172.21.15.100:0/2486141365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0010760 con 0x555cef7aabe0 2024-09-12T02:54:23.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16be7fc640 1 -- 172.21.15.100:0/2486141365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16d0010de0 con 0x555cef7aabe0 2024-09-12T02:54:23.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.651+0000 7f16be7fc640 1 -- 172.21.15.100:0/2486141365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d00193d0 con 0x555cef7aabe0 2024-09-12T02:54:23.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- 172.21.15.100:0/2486141365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 msgr2=0x555cef7c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7c1ec0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f16d000b010 tx=0x7f16d0015000 comp rx=0 tx=0).stop 2024-09-12T02:54:23.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- 172.21.15.100:0/2486141365 shutdown_connections 2024-09-12T02:54:23.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef7aabe0 0x555cef7c1ec0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7a0320 0x555cef79b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 --2- 172.21.15.100:0/2486141365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef79fa00 0x555cef7b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- 172.21.15.100:0/2486141365 >> 172.21.15.100:0/2486141365 conn(0x555cef79bf90 msgr2=0x555cef79a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- 172.21.15.100:0/2486141365 shutdown_connections 2024-09-12T02:54:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- 172.21.15.100:0/2486141365 wait complete. 2024-09-12T02:54:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- start start 2024-09-12T02:54:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 Processor -- start 2024-09-12T02:54:23.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef79fa00 0x555cef7b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7a0320 0x555cef7ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7aabe0 0x555cef7aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81abc90 con 0x555cef79fa00 2024-09-12T02:54:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81ad100 con 0x555cef7a0320 2024-09-12T02:54:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81ac360 con 0x555cef7aabe0 2024-09-12T02:54:23.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16e137a740 10 client.0 _ll_register_callbacks cb 0x7f16cc003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.652+0000 7f16dcd3d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef79fa00 0x555cef7b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef79fa00 0x555cef7b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59556/0 (socket says 172.21.15.100:59556) 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 -- 172.21.15.100:0/2118986202 learned_addr learned my addr 172.21.15.100:0/2118986202 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dd53e640 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7aabe0 0x555cef7aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 -- 172.21.15.100:0/2118986202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7aabe0 msgr2=0x555cef7aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7aabe0 0x555cef7aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 -- 172.21.15.100:0/2118986202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7a0320 msgr2=0x555cef7ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7a0320 0x555cef7ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 -- 172.21.15.100:0/2118986202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cef797730 con 0x555cef79fa00 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16dcd3d640 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef79fa00 0x555cef7b3190 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f16c800b8f0 tx=0x7f16c800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ddd06721c4aeca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:23.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16b7fff640 1 -- 172.21.15.100:0/2118986202 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c801c940 con 0x555cef79fa00 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16b7fff640 1 -- 172.21.15.100:0/2118986202 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f16c801cae0 con 0x555cef79fa00 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16d0010de0 con 0x555cef79fa00 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16b7fff640 1 -- 172.21.15.100:0/2118986202 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f16c802c050 con 0x555cef79fa00 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16e137a740 10 client.18132 fetch_fsmap learned FSMap version 27 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cef824e50 con 0x555cef79fa00 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.653+0000 7f16b7fff640 1 -- 172.21.15.100:0/2118986202 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16d0010de0 con 0x555cef79fa00 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16b7fff640 1 -- 172.21.15.100:0/2118986202 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f16c801b590 con 0x555cef79fa00 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16e137a740 10 client.18132 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16e137a740 10 client.18132 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16e137a740 20 client.18132 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16e137a740 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef825570 0x555cef827990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16e137a740 4 client.18132 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x555cef6881e0 con 0x555cef825570 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16d7fff640 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef825570 0x555cef827990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16d7fff640 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef825570 0x555cef827990 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51276a4320c65a35 server_cookie=1c59f3a6b9af4202 in_seq=0 out_seq=0 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.654+0000 7f16b7fff640 10 client.18132 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16b7fff640 1 -- 172.21.15.100:0/2118986202 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x555cef6881e0 con 0x555cef825570 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16b7fff640 10 client.18132 handle_command_reply: tid=0 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 client.18132 shutdown 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef79fa00 msgr2=0x555cef7b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef79fa00 0x555cef7b3190 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f16c800b8f0 tx=0x7f16c800fae0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 shutdown_connections 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x555cef825570 0x555cef827990 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555cef7aabe0 0x555cef7aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cef7a0320 0x555cef7ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 --2- 172.21.15.100:0/2118986202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555cef79fa00 0x555cef7b3190 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 >> 172.21.15.100:0/2118986202 conn(0x555cef79bf90 msgr2=0x555cef79b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16b7fff640 0 client.18132 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 shutdown_connections 2024-09-12T02:54:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 1 -- 172.21.15.100:0/2118986202 wait complete. 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.655+0000 7f16e137a740 20 client.18132 trim_cache size 0 max 16384 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f16c00a2b80 msgr2=0x7f16c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f16c00a2b80 0x7f16c00a5040 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f16d000a2c0 tx=0x7f16d0004a40 comp rx=0 tx=0).stop 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 msgr2=0x7f16d8198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8198b40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f16cc005940 tx=0x7f16cc0042f0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 shutdown_connections 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f16c00a2b80 0x7f16c00a5040 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d81082a0 0x7f16d819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16d81036e0 0x7f16d8198b40 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 --2- 172.21.15.100:0/111157883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16d8102d30 0x7f16d8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 >> 172.21.15.100:0/111157883 conn(0x7f16d80fc7d0 msgr2=0x7f16d8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 shutdown_connections 2024-09-12T02:54:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:23.656+0000 7f16defa1640 1 -- 172.21.15.100:0/111157883 wait complete. 2024-09-12T02:54:24.767 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T02:54:24.767 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T02:54:24.777 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T02:54:24.778 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:25.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:24 smithi100 ceph-mon[31390]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 31 MiB/s wr, 2.07k op/s 2024-09-12T02:54:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 -- 172.21.15.100:0/2056626982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c102d30 msgr2=0x7f915c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 --2- 172.21.15.100:0/2056626982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c102d30 0x7f915c103110 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f914c009cd0 tx=0x7f914c02a910 comp rx=0 tx=0).stop 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 -- 172.21.15.100:0/2056626982 shutdown_connections 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 --2- 172.21.15.100:0/2056626982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f915c1082a0 0x7f915c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 --2- 172.21.15.100:0/2056626982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f915c1036e0 0x7f915c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 --2- 172.21.15.100:0/2056626982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c102d30 0x7f915c103110 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 -- 172.21.15.100:0/2056626982 >> 172.21.15.100:0/2056626982 conn(0x7f915c0fc7d0 msgr2=0x7f915c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 -- 172.21.15.100:0/2056626982 shutdown_connections 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 -- 172.21.15.100:0/2056626982 wait complete. 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.246+0000 7f9163d2f640 1 Processor -- start 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9163d2f640 1 -- start start 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9163d2f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f915c102d30 0x7f915c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9163d2f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c1036e0 0x7f915c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9163d2f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f915c1082a0 0x7f915c19cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9163d2f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f915c112160 con 0x7f915c1036e0 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9163d2f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f915c111fe0 con 0x7f915c102d30 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9163d2f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1122e0 con 0x7f915c1082a0 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c1036e0 0x7f915c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c1036e0 0x7f915c198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45258/0 (socket says 172.21.15.100:45258) 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 -- 172.21.15.100:0/123373501 learned_addr learned my addr 172.21.15.100:0/123373501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f9161acb640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f915c102d30 0x7f915c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91622cc640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f915c1082a0 0x7f915c19cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 -- 172.21.15.100:0/123373501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f915c1082a0 msgr2=0x7f915c19cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f915c1082a0 0x7f915c19cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 -- 172.21.15.100:0/123373501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f915c102d30 msgr2=0x7f915c198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f915c102d30 0x7f915c198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 -- 172.21.15.100:0/123373501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c19d6d0 con 0x7f915c1036e0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f91612ca640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c1036e0 0x7f915c198c60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f9150006fd0 tx=0x7f915000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.247+0000 7f915affd640 1 -- 172.21.15.100:0/123373501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9150011830 con 0x7f915c1036e0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.248+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915c19d9c0 con 0x7f915c1036e0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.248+0000 7f915affd640 1 -- 172.21.15.100:0/123373501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9150016070 con 0x7f915c1036e0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.248+0000 7f915affd640 1 -- 172.21.15.100:0/123373501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915000f2e0 con 0x7f915c1036e0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.248+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915c1a52a0 con 0x7f915c1036e0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f915affd640 1 -- 172.21.15.100:0/123373501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f915001b460 con 0x7f915c1036e0 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 Processor -- start 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 -- start start 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593513090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593513a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x559593524b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5595934792f0 con 0x559593514b40 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559593420cf0 con 0x5595935135d0 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f9166108740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595934752b0 con 0x559593522780 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.250+0000 7f915affd640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91440a2b80 0x7f91440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593513090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593513090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45260/0 (socket says 172.21.15.100:45260) 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 -- 172.21.15.100:0/940555720 learned_addr learned my addr 172.21.15.100:0/940555720 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91440a2b80 0x7f91440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91612ca640 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x559593524b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f9161acb640 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593513a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f915affd640 1 -- 172.21.15.100:0/123373501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f91500ce6f0 con 0x7f915c1036e0 2024-09-12T02:54:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 -- 172.21.15.100:0/940555720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 msgr2=0x559593524b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x559593524b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 -- 172.21.15.100:0/940555720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 msgr2=0x559593513a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593513a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 -- 172.21.15.100:0/940555720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595934053a0 con 0x559593514b40 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593513090 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f9154016740 tx=0x7f9154016c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d3bafe35e66785 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f91622cc640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91440a2b80 0x7f91440a5040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9154006aa0 tx=0x7f915401a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f9143fff640 1 -- 172.21.15.100:0/940555720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154024070 con 0x559593514b40 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f9143fff640 1 -- 172.21.15.100:0/940555720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915400a770 con 0x559593514b40 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.251+0000 7f9143fff640 1 -- 172.21.15.100:0/940555720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915401f650 con 0x559593514b40 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 -- 172.21.15.100:0/940555720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 msgr2=0x559593513090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593513090 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f9154016740 tx=0x7f9154016c00 comp rx=0 tx=0).stop 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 -- 172.21.15.100:0/940555720 shutdown_connections 2024-09-12T02:54:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x559593524b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593513a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 --2- 172.21.15.100:0/940555720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593513090 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 -- 172.21.15.100:0/940555720 >> 172.21.15.100:0/940555720 conn(0x5595934dc310 msgr2=0x55959350fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 -- 172.21.15.100:0/940555720 shutdown_connections 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.252+0000 7f9166108740 1 -- 172.21.15.100:0/940555720 wait complete. 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 -- start start 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 Processor -- start 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595935135d0 0x5595935221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x55959351f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959351fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559593525420 con 0x559593514b40 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559593434060 con 0x559593522780 2024-09-12T02:54:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595935255a0 con 0x5595935135d0 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9166108740 10 client.0 _ll_register_callbacks cb 0x5595931878c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f91612ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x55959351f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f91612ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x55959351f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45274/0 (socket says 172.21.15.100:45274) 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f91612ca640 1 -- 172.21.15.100:0/3358115112 learned_addr learned my addr 172.21.15.100:0/3358115112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f91622cc640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959351fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.253+0000 7f9161acb640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595935135d0 0x5595935221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91612ca640 1 -- 172.21.15.100:0/3358115112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595935135d0 msgr2=0x5595935221a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91612ca640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595935135d0 0x5595935221a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91612ca640 1 -- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 msgr2=0x55959351fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91612ca640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959351fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91612ca640 1 -- 172.21.15.100:0/3358115112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595931ea3c0 con 0x559593514b40 2024-09-12T02:54:25.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91622cc640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959351fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91612ca640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x55959351f450 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9150097910 tx=0x7f9150014e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f73c99d17d6e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91417fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91417fa640 1 -- 172.21.15.100:0/3358115112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915009ad10 con 0x559593514b40 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91417fa640 1 -- 172.21.15.100:0/3358115112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f91500975b0 con 0x559593514b40 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559593486860 con 0x559593514b40 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91417fa640 1 -- 172.21.15.100:0/3358115112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f915001e100 con 0x559593514b40 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 10 client.18144 fetch_fsmap learned FSMap version 28 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559593530f50 con 0x559593514b40 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91417fa640 1 -- 172.21.15.100:0/3358115112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559593486860 con 0x559593514b40 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f91417fa640 1 -- 172.21.15.100:0/3358115112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f915009e070 con 0x559593514b40 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 10 client.18144 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 10 client.18144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:25.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 20 client.18144 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559593532410 0x559593534820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 4 client.18144 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.254+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559593480d70 con 0x559593532410 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.255+0000 7f9161acb640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559593532410 0x559593534820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.255+0000 7f9161acb640 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559593532410 0x559593534820 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf8f78384a007b84 server_cookie=a304c40f8fb74f63 in_seq=0 out_seq=0 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.255+0000 7f91417fa640 10 client.18144 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f91417fa640 1 -- 172.21.15.100:0/3358115112 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559593480d70 con 0x559593532410 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f91417fa640 10 client.18144 handle_command_reply: tid=0 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 client.18144 shutdown 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 msgr2=0x55959351f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x55959351f450 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9150097910 tx=0x7f9150014e30 comp rx=0 tx=0).stop 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 shutdown_connections 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x559593532410 0x559593534820 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959351fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x55959351f450 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 --2- 172.21.15.100:0/3358115112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595935135d0 0x5595935221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f91417fa640 0 client.18144 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 >> 172.21.15.100:0/3358115112 conn(0x5595934dc310 msgr2=0x559593515960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 shutdown_connections 2024-09-12T02:54:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 1 -- 172.21.15.100:0/3358115112 wait complete. 2024-09-12T02:54:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.256+0000 7f9166108740 20 client.18144 trim_cache size 0 max 16384 2024-09-12T02:54:25.269 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:24 smithi189 ceph-mon[35196]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 31 MiB/s wr, 2.07k op/s 2024-09-12T02:54:25.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 Processor -- start 2024-09-12T02:54:25.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 -- start start 2024-09-12T02:54:25.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595935135d0 0x55959350fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593514b40 0x55959352e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959353a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1add90 con 0x5595935135d0 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1ab660 con 0x559593522780 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9166108740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1a94b0 con 0x559593514b40 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9161acb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595935135d0 0x55959350fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9161acb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595935135d0 0x55959350fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45286/0 (socket says 172.21.15.100:45286) 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.269+0000 7f9161acb640 1 -- 172.21.15.100:0/3467578079 learned_addr learned my addr 172.21.15.100:0/3467578079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f91612ca640 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593514b40 0x55959352e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f91622cc640 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959353a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f9161acb640 1 -- 172.21.15.100:0/3467578079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593514b40 msgr2=0x55959352e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f9161acb640 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593514b40 0x55959352e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f9161acb640 1 -- 172.21.15.100:0/3467578079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 msgr2=0x55959353a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f9161acb640 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959353a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f9161acb640 1 -- 172.21.15.100:0/3467578079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595935203f0 con 0x5595935135d0 2024-09-12T02:54:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f9161acb640 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595935135d0 0x55959350fe10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f914c009430 tx=0x7f914c0093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f556f4366a1e490c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f91437fe640 1 -- 172.21.15.100:0/3467578079 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c003b70 con 0x5595935135d0 2024-09-12T02:54:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f91437fe640 1 -- 172.21.15.100:0/3467578079 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f914c036040 con 0x5595935135d0 2024-09-12T02:54:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.270+0000 7f91437fe640 1 -- 172.21.15.100:0/3467578079 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c004670 con 0x5595935135d0 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 -- 172.21.15.100:0/3467578079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595935135d0 msgr2=0x55959350fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595935135d0 0x55959350fe10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f914c009430 tx=0x7f914c0093c0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 -- 172.21.15.100:0/3467578079 shutdown_connections 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559593522780 0x55959353a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593514b40 0x55959352e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 --2- 172.21.15.100:0/3467578079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595935135d0 0x55959350fe10 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 -- 172.21.15.100:0/3467578079 >> 172.21.15.100:0/3467578079 conn(0x5595934dc310 msgr2=0x55959350f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 -- 172.21.15.100:0/3467578079 shutdown_connections 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 -- 172.21.15.100:0/3467578079 wait complete. 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 -- start start 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.271+0000 7f9166108740 1 Processor -- start 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593526720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593526c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x5595935271a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1a9b20 con 0x559593514b40 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1aaf90 con 0x5595935135d0 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f915c1aa1f0 con 0x559593522780 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 10 client.0 _ll_register_callbacks cb 0x7f91500bb0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593526c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593526c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45300/0 (socket says 172.21.15.100:45300) 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 -- 172.21.15.100:0/2856136353 learned_addr learned my addr 172.21.15.100:0/2856136353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9161acb640 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593526720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91622cc640 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x5595935271a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 -- 172.21.15.100:0/2856136353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 msgr2=0x5595935271a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x5595935271a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 -- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 msgr2=0x559593526720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593526720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 -- 172.21.15.100:0/2856136353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959359c220 con 0x559593514b40 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91612ca640 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593526c60 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9150009fd0 tx=0x7f9150095920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0461f6fd65f2ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91417fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91417fa640 1 -- 172.21.15.100:0/2856136353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915009a8a0 con 0x559593514b40 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f91417fa640 1 -- 172.21.15.100:0/2856136353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f915009a610 con 0x559593514b40 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.272+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f914c036040 con 0x559593514b40 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f91417fa640 1 -- 172.21.15.100:0/2856136353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f915009aa80 con 0x559593514b40 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 10 client.18150 fetch_fsmap learned FSMap version 28 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55959359d4e0 con 0x559593514b40 2024-09-12T02:54:25.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f91417fa640 1 -- 172.21.15.100:0/2856136353 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f914c036040 con 0x559593514b40 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f91417fa640 1 -- 172.21.15.100:0/2856136353 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f915009e070 con 0x559593514b40 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 10 client.18150 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 10 client.18150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 20 client.18150 populate_metadata read hostname 'smithi100' 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55959359dc40 0x5595935a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 4 client.18150 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 --> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595933fd170 con 0x55959359dc40 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9161acb640 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55959359dc40 0x5595935a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f91417fa640 10 client.18150 ms_handle_connect on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.273+0000 7f9161acb640 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55959359dc40 0x5595935a0060 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66b99cc1ace0060c server_cookie=17e54e893f796a69 in_seq=0 out_seq=0 2024-09-12T02:54:25.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f91417fa640 1 -- 172.21.15.100:0/2856136353 <== mds.0 v2:172.21.15.117:6838/801964439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595933fd170 con 0x55959359dc40 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f91417fa640 10 client.18150 handle_command_reply: tid=0 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 client.18150 shutdown 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 msgr2=0x559593526c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593526c60 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9150009fd0 tx=0x7f9150095920 comp rx=0 tx=0).stop 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 shutdown_connections 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:6838/801964439,v1:172.21.15.117:6839/801964439] conn(0x55959359dc40 0x5595935a0060 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559593522780 0x5595935271a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559593514b40 0x559593526c60 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f91417fa640 0 client.18150 ms_handle_reset on v2:172.21.15.117:6838/801964439 2024-09-12T02:54:25.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 --2- 172.21.15.100:0/2856136353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5595935135d0 0x559593526720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 >> 172.21.15.100:0/2856136353 conn(0x5595934dc310 msgr2=0x559593520cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:25.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 shutdown_connections 2024-09-12T02:54:25.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 1 -- 172.21.15.100:0/2856136353 wait complete. 2024-09-12T02:54:25.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.274+0000 7f9166108740 20 client.18150 trim_cache size 0 max 16384 2024-09-12T02:54:25.282 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91440a2b80 msgr2=0x7f91440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91440a2b80 0x7f91440a5040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9154006aa0 tx=0x7f915401a000 comp rx=0 tx=0).stop 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c1036e0 msgr2=0x7f915c198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c1036e0 0x7f915c198c60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f9150006fd0 tx=0x7f915000b8e0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 shutdown_connections 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f91440a2b80 0x7f91440a5040 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f915c1082a0 0x7f915c19cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f915c1036e0 0x7f915c198c60 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 --2- 172.21.15.100:0/123373501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f915c102d30 0x7f915c198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 >> 172.21.15.100:0/123373501 conn(0x7f915c0fc7d0 msgr2=0x7f915c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:25.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 shutdown_connections 2024-09-12T02:54:25.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:25.275+0000 7f9163d2f640 1 -- 172.21.15.100:0/123373501 wait complete. 2024-09-12T02:54:25.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:24 smithi117 ceph-mon[34898]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 31 MiB/s wr, 2.07k op/s 2024-09-12T02:54:25.944 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T02:54:25.945 INFO:tasks.fwd_scrub:done joining 2024-09-12T02:54:25.945 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T02:54:25.956 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:54:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.085+0000 7fe8f898f640 1 -- 172.21.15.100:0/1486865858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 msgr2=0x7fe8f4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.085+0000 7fe8f898f640 1 --2- 172.21.15.100:0/1486865858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4100e30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009900 tx=0x7fe8e402a410 comp rx=0 tx=0).stop 2024-09-12T02:54:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 -- 172.21.15.100:0/1486865858 shutdown_connections 2024-09-12T02:54:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 --2- 172.21.15.100:0/1486865858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41025e0 0x7fe8f4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 --2- 172.21.15.100:0/1486865858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4101c20 0x7fe8f41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 --2- 172.21.15.100:0/1486865858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4100e30 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 -- 172.21.15.100:0/1486865858 >> 172.21.15.100:0/1486865858 conn(0x7fe8f40fc1b0 msgr2=0x7fe8f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:26.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 -- 172.21.15.100:0/1486865858 shutdown_connections 2024-09-12T02:54:26.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 -- 172.21.15.100:0/1486865858 wait complete. 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 Processor -- start 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.086+0000 7fe8f898f640 1 -- start start 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4101c20 0x7fe8f41972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41025e0 0x7fe8f419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f410c710 con 0x7fe8f4100a30 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f410c590 con 0x7fe8f4101c20 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f410c890 con 0x7fe8f41025e0 2024-09-12T02:54:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45326/0 (socket says 172.21.15.100:45326) 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 -- 172.21.15.100:0/394436656 learned_addr learned my addr 172.21.15.100:0/394436656 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f1d9b640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4101c20 0x7fe8f41972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 -- 172.21.15.100:0/394436656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41025e0 msgr2=0x7fe8f419e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41025e0 0x7fe8f419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 -- 172.21.15.100:0/394436656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4101c20 msgr2=0x7fe8f41972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4101c20 0x7fe8f41972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 -- 172.21.15.100:0/394436656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f419e980 con 0x7fe8f4100a30 2024-09-12T02:54:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f259c640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4196d60 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4031610 tx=0x7fe8e40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8e37fe640 1 -- 172.21.15.100:0/394436656 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e403f030 con 0x7fe8f4100a30 2024-09-12T02:54:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f419ec10 con 0x7fe8f4100a30 2024-09-12T02:54:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8e37fe640 1 -- 172.21.15.100:0/394436656 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e4003ce0 con 0x7fe8f4100a30 2024-09-12T02:54:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8e37fe640 1 -- 172.21.15.100:0/394436656 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4035070 con 0x7fe8f4100a30 2024-09-12T02:54:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.087+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f419f100 con 0x7fe8f4100a30 2024-09-12T02:54:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.088+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f4107d70 con 0x7fe8f4100a30 2024-09-12T02:54:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.089+0000 7fe8e37fe640 1 -- 172.21.15.100:0/394436656 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fe8e4042030 con 0x7fe8f4100a30 2024-09-12T02:54:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.090+0000 7fe8e37fe640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8dc0a2b90 0x7fe8dc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.090+0000 7fe8f1d9b640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8dc0a2b90 0x7fe8dc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.090+0000 7fe8e37fe640 1 -- 172.21.15.100:0/394436656 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe8e40ef720 con 0x7fe8f4100a30 2024-09-12T02:54:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.090+0000 7fe8f1d9b640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8dc0a2b90 0x7fe8dc0a5050 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4198270 tx=0x7fe8e800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.094+0000 7fe8e37fe640 1 -- 172.21.15.100:0/394436656 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8e40bc670 con 0x7fe8f4100a30 2024-09-12T02:54:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.258+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8f4062ef0 con 0x7fe8f4100a30 2024-09-12T02:54:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.259+0000 7fe8e37fe640 1 -- 172.21.15.100:0/394436656 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22871 (secure 0 0 0) 0x7fe8e40bbf70 con 0x7fe8f4100a30 2024-09-12T02:54:26.261 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:26.262 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:37:56.665591+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:54:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8dc0a2b90 msgr2=0x7fe8dc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8dc0a2b90 0x7fe8dc0a5050 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4198270 tx=0x7fe8e800a2d0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 msgr2=0x7fe8f4196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4196d60 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4031610 tx=0x7fe8e40043b0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 shutdown_connections 2024-09-12T02:54:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fe8dc0a2b90 0x7fe8dc0a5050 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41025e0 0x7fe8f419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4101c20 0x7fe8f41972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 --2- 172.21.15.100:0/394436656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8f4100a30 0x7fe8f4196d60 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.261+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 >> 172.21.15.100:0/394436656 conn(0x7fe8f40fc1b0 msgr2=0x7fe8f4104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.262+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 shutdown_connections 2024-09-12T02:54:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.262+0000 7fe8f898f640 1 -- 172.21.15.100:0/394436656 wait complete. 2024-09-12T02:54:26.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:25 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:54:26.273 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:25 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:54:26.274 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:32:09.751769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:36:45.679784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:36:47.737140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:54:26.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:54:26.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:25 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:54:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.375+0000 7f968fce4640 1 -- 172.21.15.100:0/466248566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96881077e0 msgr2=0x7f9688109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.375+0000 7f968fce4640 1 --2- 172.21.15.100:0/466248566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96881077e0 0x7f9688109c50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f9680009ca0 tx=0x7f968002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- 172.21.15.100:0/466248566 shutdown_connections 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 --2- 172.21.15.100:0/466248566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96881077e0 0x7f9688109c50 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 --2- 172.21.15.100:0/466248566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9688104eb0 0x7f96881072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 --2- 172.21.15.100:0/466248566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9688102580 0x7f9688104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- 172.21.15.100:0/466248566 >> 172.21.15.100:0/466248566 conn(0x7f96880fc140 msgr2=0x7f96880fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- 172.21.15.100:0/466248566 shutdown_connections 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- 172.21.15.100:0/466248566 wait complete. 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 Processor -- start 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- start start 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9688102580 0x7f9688197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9688104eb0 0x7f96881983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96881077e0 0x7f968819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f968810d7c0 con 0x7f9688102580 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f968810d640 con 0x7f96881077e0 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968fce4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f968810d940 con 0x7f9688104eb0 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968da80640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9688102580 0x7f9688197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.376+0000 7f968da80640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9688102580 0x7f9688197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45346/0 (socket says 172.21.15.100:45346) 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968da80640 1 -- 172.21.15.100:0/2962129407 learned_addr learned my addr 172.21.15.100:0/2962129407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968d27f640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9688104eb0 0x7f96881983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968da80640 1 -- 172.21.15.100:0/2962129407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9688104eb0 msgr2=0x7f96881983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968da80640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9688104eb0 0x7f96881983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968e281640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96881077e0 0x7f968819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968da80640 1 -- 172.21.15.100:0/2962129407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96881077e0 msgr2=0x7f968819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968da80640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96881077e0 0x7f968819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968da80640 1 -- 172.21.15.100:0/2962129407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968819fac0 con 0x7f9688102580 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968e281640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96881077e0 0x7f968819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:54:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968da80640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9688102580 0x7f9688197ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f967800c890 tx=0x7f967800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f9686ffd640 1 -- 172.21.15.100:0/2962129407 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678004220 con 0x7f9688102580 2024-09-12T02:54:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f9686ffd640 1 -- 172.21.15.100:0/2962129407 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96780043c0 con 0x7f9688102580 2024-09-12T02:54:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f9686ffd640 1 -- 172.21.15.100:0/2962129407 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780049e0 con 0x7f9688102580 2024-09-12T02:54:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968819fdb0 con 0x7f9688102580 2024-09-12T02:54:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.377+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96881a0220 con 0x7f9688102580 2024-09-12T02:54:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.378+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96880fdc30 con 0x7f9688102580 2024-09-12T02:54:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.380+0000 7f9686ffd640 1 -- 172.21.15.100:0/2962129407 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f96780079b0 con 0x7f9688102580 2024-09-12T02:54:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.380+0000 7f9686ffd640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96700a2b90 0x7f96700a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.380+0000 7f968d27f640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96700a2b90 0x7f96700a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.380+0000 7f9686ffd640 1 -- 172.21.15.100:0/2962129407 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f96780cf160 con 0x7f9688102580 2024-09-12T02:54:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.381+0000 7f968d27f640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96700a2b90 0x7f96700a5050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f967c005fd0 tx=0x7f967c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.384+0000 7f9686ffd640 1 -- 172.21.15.100:0/2962129407 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9678014030 con 0x7f9688102580 2024-09-12T02:54:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.550+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f968802da50 con 0x7f9688102580 2024-09-12T02:54:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.551+0000 7f9686ffd640 1 -- 172.21.15.100:0/2962129407 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f967809c0b0 con 0x7f9688102580 2024-09-12T02:54:26.552 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-12T02:54:26.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96700a2b90 msgr2=0x7f96700a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96700a2b90 0x7f96700a5050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f967c005fd0 tx=0x7f967c005850 comp rx=0 tx=0).stop 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9688102580 msgr2=0x7f9688197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9688102580 0x7f9688197ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f967800c890 tx=0x7f967800cd50 comp rx=0 tx=0).stop 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 shutdown_connections 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f96700a2b90 0x7f96700a5050 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96881077e0 0x7f968819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9688104eb0 0x7f96881983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 --2- 172.21.15.100:0/2962129407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9688102580 0x7f9688197ea0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 >> 172.21.15.100:0/2962129407 conn(0x7f96880fc140 msgr2=0x7f9688102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:26.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 shutdown_connections 2024-09-12T02:54:26.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.553+0000 7f968fce4640 1 -- 172.21.15.100:0/2962129407 wait complete. 2024-09-12T02:54:26.565 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 -- 172.21.15.100:0/304391630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 msgr2=0x7f4a44108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/304391630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44108e40 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009ca0 tx=0x7f4a3c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 -- 172.21.15.100:0/304391630 shutdown_connections 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/304391630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44108e40 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/304391630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44101bf0 0x7f4a44102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/304391630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a44100a00 0x7f4a44100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 -- 172.21.15.100:0/304391630 >> 172.21.15.100:0/304391630 conn(0x7f4a440fc140 msgr2=0x7f4a440fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:26.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 -- 172.21.15.100:0/304391630 shutdown_connections 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 -- 172.21.15.100:0/304391630 wait complete. 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.666+0000 7f4a49d3b640 1 Processor -- start 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a49d3b640 1 -- start start 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a49d3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a44100a00 0x7f4a4410b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a49d3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44101bf0 0x7f4a441099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a49d3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a49d3b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410d7d0 con 0x7f4a441025b0 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a49d3b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410d650 con 0x7f4a44100a00 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a49d3b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410d950 con 0x7f4a44101bf0 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44109f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45356/0 (socket says 172.21.15.100:45356) 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 -- 172.21.15.100:0/1893210274 learned_addr learned my addr 172.21.15.100:0/1893210274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:26.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a3bfff640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44101bf0 0x7f4a441099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a437fe640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a44100a00 0x7f4a4410b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 -- 172.21.15.100:0/1893210274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44101bf0 msgr2=0x7f4a441099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44101bf0 0x7f4a441099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 -- 172.21.15.100:0/1893210274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a44100a00 msgr2=0x7f4a4410b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a44100a00 0x7f4a4410b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 -- 172.21.15.100:0/1893210274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4410a790 con 0x7f4a441025b0 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a3bfff640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44101bf0 0x7f4a441099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a437fe640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a44100a00 0x7f4a4410b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a43fff640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44109f00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c031ae0 tx=0x7f4a3c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.667+0000 7f4a417fa640 1 -- 172.21.15.100:0/1893210274 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c003c30 con 0x7f4a441025b0 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.668+0000 7f4a417fa640 1 -- 172.21.15.100:0/1893210274 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a3c003dd0 con 0x7f4a441025b0 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.668+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a441a1f30 con 0x7f4a441025b0 2024-09-12T02:54:26.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.668+0000 7f4a417fa640 1 -- 172.21.15.100:0/1893210274 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c02fcb0 con 0x7f4a441025b0 2024-09-12T02:54:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.668+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a441a2390 con 0x7f4a441025b0 2024-09-12T02:54:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.669+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a44107e10 con 0x7f4a441025b0 2024-09-12T02:54:26.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.670+0000 7f4a417fa640 1 -- 172.21.15.100:0/1893210274 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f4a3c004050 con 0x7f4a441025b0 2024-09-12T02:54:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.671+0000 7f4a417fa640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a300a2b90 0x7f4a300a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.671+0000 7f4a437fe640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a300a2b90 0x7f4a300a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.671+0000 7f4a417fa640 1 -- 172.21.15.100:0/1893210274 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f4a3c0f0350 con 0x7f4a441025b0 2024-09-12T02:54:26.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.671+0000 7f4a437fe640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a300a2b90 0x7f4a300a5050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4a44101a50 tx=0x7f4a34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.675+0000 7f4a417fa640 1 -- 172.21.15.100:0/1893210274 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a3c0bd2a0 con 0x7f4a441025b0 2024-09-12T02:54:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.841+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4a44062e90 con 0x7f4a441025b0 2024-09-12T02:54:26.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.841+0000 7f4a417fa640 1 -- 172.21.15.100:0/1893210274 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f4a3c0bcba0 con 0x7f4a441025b0 2024-09-12T02:54:26.843 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-12T02:54:26.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a300a2b90 msgr2=0x7f4a300a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a300a2b90 0x7f4a300a5050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4a44101a50 tx=0x7f4a34005f90 comp rx=0 tx=0).stop 2024-09-12T02:54:26.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 msgr2=0x7f4a44109f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44109f00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c031ae0 tx=0x7f4a3c031ee0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 shutdown_connections 2024-09-12T02:54:26.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f4a300a2b90 0x7f4a300a5050 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a441025b0 0x7f4a44109f00 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44101bf0 0x7f4a441099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 --2- 172.21.15.100:0/1893210274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a44100a00 0x7f4a4410b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 >> 172.21.15.100:0/1893210274 conn(0x7f4a440fc140 msgr2=0x7f4a44104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:26.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 shutdown_connections 2024-09-12T02:54:26.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.843+0000 7f4a49d3b640 1 -- 172.21.15.100:0/1893210274 wait complete. 2024-09-12T02:54:26.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:54:26.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 -- 172.21.15.100:0/2367812252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 msgr2=0x7fa580101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 --2- 172.21.15.100:0/2367812252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580101f30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa570009900 tx=0x7fa57002a410 comp rx=0 tx=0).stop 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 -- 172.21.15.100:0/2367812252 shutdown_connections 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 --2- 172.21.15.100:0/2367812252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5801036e0 0x7fa580109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 --2- 172.21.15.100:0/2367812252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa580102d20 0x7fa5801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 --2- 172.21.15.100:0/2367812252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580101f30 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 -- 172.21.15.100:0/2367812252 >> 172.21.15.100:0/2367812252 conn(0x7fa5800fd2b0 msgr2=0x7fa5800ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 -- 172.21.15.100:0/2367812252 shutdown_connections 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 -- 172.21.15.100:0/2367812252 wait complete. 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 Processor -- start 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.960+0000 7fa5868b7640 1 -- start start 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa580102d20 0x7fa5801983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5801036e0 0x7fa58019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010d7b0 con 0x7fa580101b30 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010d630 con 0x7fa5801036e0 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010d930 con 0x7fa580102d20 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45380/0 (socket says 172.21.15.100:45380) 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 -- 172.21.15.100:0/650668739 learned_addr learned my addr 172.21.15.100:0/650668739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa584e54640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5801036e0 0x7fa58019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa577fff640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa580102d20 0x7fa5801983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 -- 172.21.15.100:0/650668739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa580102d20 msgr2=0x7fa5801983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa580102d20 0x7fa5801983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 -- 172.21.15.100:0/650668739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5801036e0 msgr2=0x7fa58019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5801036e0 0x7fa58019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 -- 172.21.15.100:0/650668739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58019fa90 con 0x7fa580101b30 2024-09-12T02:54:26.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa577fff640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa580102d20 0x7fa5801983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa584e54640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5801036e0 0x7fa58019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57ffff640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580197e70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa570031610 tx=0x7fa5700043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57dffb640 1 -- 172.21.15.100:0/650668739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57003f030 con 0x7fa580101b30 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57dffb640 1 -- 172.21.15.100:0/650668739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa570003ce0 con 0x7fa580101b30 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58019fd20 con 0x7fa580101b30 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa57dffb640 1 -- 172.21.15.100:0/650668739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570035070 con 0x7fa580101b30 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.961+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5801a01c0 con 0x7fa580101b30 2024-09-12T02:54:26.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.962+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5801a0390 con 0x7fa580101b30 2024-09-12T02:54:26.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.963+0000 7fa57dffb640 1 -- 172.21.15.100:0/650668739 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fa570042030 con 0x7fa580101b30 2024-09-12T02:54:26.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.964+0000 7fa57dffb640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa56c0a2b90 0x7fa56c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:26.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.964+0000 7fa577fff640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa56c0a2b90 0x7fa56c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:26.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.964+0000 7fa57dffb640 1 -- 172.21.15.100:0/650668739 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa5700ef6d0 con 0x7fa580101b30 2024-09-12T02:54:26.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.964+0000 7fa577fff640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa56c0a2b90 0x7fa56c0a5050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa580199380 tx=0x7fa568005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:26.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:26.968+0000 7fa57dffb640 1 -- 172.21.15.100:0/650668739 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5700bc620 con 0x7fa580101b30 2024-09-12T02:54:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:26 smithi100 ceph-mon[31390]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 30 MiB/s wr, 1.97k op/s 2024-09-12T02:54:27.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/394436656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:54:27.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2962129407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:54:27.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:26 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1893210274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:54:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.137+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa580108960 con 0x7fa580101b30 2024-09-12T02:54:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.137+0000 7fa57dffb640 1 -- 172.21.15.100:0/650668739 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7fa5700bbf20 con 0x7fa580101b30 2024-09-12T02:54:27.139 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa56c0a2b90 msgr2=0x7fa56c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa56c0a2b90 0x7fa56c0a5050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa580199380 tx=0x7fa568005e50 comp rx=0 tx=0).stop 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 msgr2=0x7fa580197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580197e70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa570031610 tx=0x7fa5700043b0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 shutdown_connections 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fa56c0a2b90 0x7fa56c0a5050 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5801036e0 0x7fa58019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa580102d20 0x7fa5801983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 --2- 172.21.15.100:0/650668739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa580101b30 0x7fa580197e70 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 >> 172.21.15.100:0/650668739 conn(0x7fa5800fd2b0 msgr2=0x7fa5800ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 shutdown_connections 2024-09-12T02:54:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.139+0000 7fa5868b7640 1 -- 172.21.15.100:0/650668739 wait complete. 2024-09-12T02:54:27.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T02:54:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 -- 172.21.15.100:0/1544904956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c101c00 msgr2=0x7f5a1c102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 --2- 172.21.15.100:0/1544904956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c101c00 0x7f5a1c102080 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009900 tx=0x7f5a1002a410 comp rx=0 tx=0).stop 2024-09-12T02:54:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 -- 172.21.15.100:0/1544904956 shutdown_connections 2024-09-12T02:54:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 --2- 172.21.15.100:0/1544904956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c1025c0 0x7f5a1c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 --2- 172.21.15.100:0/1544904956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c101c00 0x7f5a1c102080 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 --2- 172.21.15.100:0/1544904956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c100a10 0x7f5a1c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 -- 172.21.15.100:0/1544904956 >> 172.21.15.100:0/1544904956 conn(0x7f5a1c0fc170 msgr2=0x7f5a1c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 -- 172.21.15.100:0/1544904956 shutdown_connections 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.249+0000 7f5a21a27640 1 -- 172.21.15.100:0/1544904956 wait complete. 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 Processor -- start 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 -- start start 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c100a10 0x7f5a1c196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c101c00 0x7f5a1c197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1025c0 0x7f5a1c19e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c10c690 con 0x7f5a1c1025c0 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c10c510 con 0x7f5a1c100a10 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.250+0000 7f5a21a27640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c10c810 con 0x7f5a1c101c00 2024-09-12T02:54:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1025c0 0x7f5a1c19e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1025c0 0x7f5a1c19e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45402/0 (socket says 172.21.15.100:45402) 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 -- 172.21.15.100:0/3237663374 learned_addr learned my addr 172.21.15.100:0/3237663374 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1a7fc640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c101c00 0x7f5a1c197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1affd640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c100a10 0x7f5a1c196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 -- 172.21.15.100:0/3237663374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c101c00 msgr2=0x7f5a1c197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c101c00 0x7f5a1c197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 -- 172.21.15.100:0/3237663374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c100a10 msgr2=0x7f5a1c196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c100a10 0x7f5a1c196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 -- 172.21.15.100:0/3237663374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c19e960 con 0x7f5a1c1025c0 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a1b7fe640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1025c0 0x7f5a1c19e2f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400eb10 tx=0x7f5a1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a20a25640 1 -- 172.21.15.100:0/3237663374 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14004b20 con 0x7f5a1c1025c0 2024-09-12T02:54:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1c19ec50 con 0x7f5a1c1025c0 2024-09-12T02:54:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a20a25640 1 -- 172.21.15.100:0/3237663374 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a14004cc0 con 0x7f5a1c1025c0 2024-09-12T02:54:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a20a25640 1 -- 172.21.15.100:0/3237663374 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14010760 con 0x7f5a1c1025c0 2024-09-12T02:54:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.251+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1c19f170 con 0x7f5a1c1025c0 2024-09-12T02:54:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.252+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1c107e50 con 0x7f5a1c1025c0 2024-09-12T02:54:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.253+0000 7f5a20a25640 1 -- 172.21.15.100:0/3237663374 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f5a14005000 con 0x7f5a1c1025c0 2024-09-12T02:54:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.254+0000 7f5a20a25640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5a040a2b90 0x7f5a040a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.254+0000 7f5a1affd640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5a040a2b90 0x7f5a040a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.254+0000 7f5a20a25640 1 -- 172.21.15.100:0/3237663374 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5a140cfab0 con 0x7f5a1c1025c0 2024-09-12T02:54:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.255+0000 7f5a1affd640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5a040a2b90 0x7f5a040a5050 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c101a60 tx=0x7f5a0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.258+0000 7f5a20a25640 1 -- 172.21.15.100:0/3237663374 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a1409c9a0 con 0x7f5a1c1025c0 2024-09-12T02:54:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:26 smithi189 ceph-mon[35196]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 30 MiB/s wr, 1.97k op/s 2024-09-12T02:54:27.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:26 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/394436656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:54:27.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:26 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2962129407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:54:27.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:26 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1893210274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:54:27.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:26 smithi117 ceph-mon[34898]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 30 MiB/s wr, 1.97k op/s 2024-09-12T02:54:27.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:26 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/394436656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:54:27.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:26 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2962129407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:54:27.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:26 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1893210274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:54:27.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.471+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f5a1c02d9e0 con 0x7f5a1c1025c0 2024-09-12T02:54:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.478+0000 7f5a20a25640 1 -- 172.21.15.100:0/3237663374 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+740378 (secure 0 0 0) 0x7f5a1409c2a0 con 0x7f5a1c1025c0 2024-09-12T02:54:27.491 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:27.491 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:54:27.491 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 20, 2024-09-12T02:54:27.491 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.491 INFO:teuthology.orchestra.run.smithi100.stdout: "active_gid": 14150, 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: "active_name": "x", 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addrs": { 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6800", 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2819887168 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6801", 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2819887168 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addr": "172.21.15.100:6801/2819887168", 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: "active_change": "2024-09-12T02:29:55.443289+0000", 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: "available": true, 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: "standbys": [ 2024-09-12T02:54:27.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 24115, 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "z", 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.494 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.495 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.496 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.497 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.499 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.500 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.502 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:54:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.505 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.506 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.507 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.508 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.509 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.510 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.511 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.512 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.513 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.514 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.515 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.516 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-09-12T02:54:27.517 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-09-12T02:54:27.519 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.520 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.521 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:54:27.522 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.523 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.524 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.525 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.526 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.527 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.528 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.530 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-09-12T02:54:27.531 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-09-12T02:54:27.532 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.533 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:54:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:27.535 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.536 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.538 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-09-12T02:54:27.539 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.541 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.542 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-09-12T02:54:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.544 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.545 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.546 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.547 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.548 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.549 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-09-12T02:54:27.550 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.552 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:54:27.553 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.554 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-09-12T02:54:27.555 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.556 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.557 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-09-12T02:54:27.558 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:54:27.559 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.560 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.561 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.562 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.563 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.564 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.565 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.566 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-09-12T02:54:27.568 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.570 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:54:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:54:27.572 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.573 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-09-12T02:54:27.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.575 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.576 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.577 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.578 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.579 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.580 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.581 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:54:27.583 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.584 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.585 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-09-12T02:54:27.586 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.587 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.588 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.590 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.591 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.592 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.593 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.594 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.596 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.597 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.598 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.599 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.600 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.603 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-09-12T02:54:27.604 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.605 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.606 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.607 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.608 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.609 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.610 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.611 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:54:27.612 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.613 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.614 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-09-12T02:54:27.615 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.616 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.617 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.618 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.620 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.621 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.622 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.623 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.624 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.625 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.627 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.628 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.629 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:54:27.630 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.631 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.632 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.633 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.634 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.635 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:54:27.636 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.637 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.638 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.639 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.640 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:54:27.641 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.642 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.643 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.644 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.645 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:54:27.646 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.647 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.648 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.649 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:54:27.650 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.651 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.652 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.653 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:27.654 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.655 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.656 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.657 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.658 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.659 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.660 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:54:27.661 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.664 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.665 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.666 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:54:27.667 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.668 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.669 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.670 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.671 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.672 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:54:27.673 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.676 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.678 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:54:27.679 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.681 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.682 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.683 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.684 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-09-12T02:54:27.685 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.686 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.687 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.688 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-09-12T02:54:27.689 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.692 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.694 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.695 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.696 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.697 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:54:27.698 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.700 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.701 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.702 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.703 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.703 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.703 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.703 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.703 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.703 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.703 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.704 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.705 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.705 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.705 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:54:27.705 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:54:27.705 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.705 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.706 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.707 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.708 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:54:27.709 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.711 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.712 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.713 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.714 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.715 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.716 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.717 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.718 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-09-12T02:54:27.719 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.720 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.721 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.722 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-09-12T02:54:27.724 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.725 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.726 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.727 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.728 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.729 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.731 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.732 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-09-12T02:54:27.733 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.735 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-09-12T02:54:27.736 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:54:27.738 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.739 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.740 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.742 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.743 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.745 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.746 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-09-12T02:54:27.747 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.748 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.749 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.750 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:27.751 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.752 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-09-12T02:54:27.753 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.754 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.755 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.756 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.757 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.758 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.761 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.762 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.763 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.764 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.765 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.766 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:54:27.770 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.771 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.773 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.774 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.776 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-09-12T02:54:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.778 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.779 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.780 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.781 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.782 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.783 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-09-12T02:54:27.784 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:54:27.786 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.788 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.789 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.791 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.792 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.793 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.794 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.795 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.796 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.797 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.798 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.799 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.800 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.801 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.802 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.803 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.804 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.805 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.806 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.807 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.808 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.809 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.810 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:54:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.812 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.814 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.815 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.816 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.817 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:54:27.818 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.819 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.820 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.821 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.822 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.823 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.825 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.826 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.827 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.828 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.829 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.830 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.831 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.832 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.833 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.835 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.836 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.837 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.838 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.839 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.840 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.842 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.843 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.844 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.846 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.847 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.848 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.850 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.851 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.852 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.853 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.854 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.855 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.857 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.858 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.859 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.860 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.861 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.862 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.863 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.864 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:27.865 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:27.866 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:54:27.868 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.869 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.870 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.872 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.873 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.874 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-09-12T02:54:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.883 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.884 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.885 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.886 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.888 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.889 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.890 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.891 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.892 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:27.893 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.895 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.897 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.899 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.900 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.901 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.904 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.905 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.906 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.907 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.908 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.911 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.912 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.913 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.914 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.915 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.916 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-09-12T02:54:27.917 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.919 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.920 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.921 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-09-12T02:54:27.922 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.924 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.925 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.926 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-09-12T02:54:27.927 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.928 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.943 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.944 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.945 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.946 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.947 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.948 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.949 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.950 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.951 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:54:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-09-12T02:54:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.971 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.972 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.973 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.974 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.975 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.978 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.980 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.981 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.983 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.984 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.985 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.986 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.987 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-09-12T02:54:27.988 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.990 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.991 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.992 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.993 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.994 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.995 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.996 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.997 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:27.999 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.000 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.001 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.002 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.004 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.005 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.006 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.007 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.008 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.009 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.010 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.011 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.012 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.013 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.014 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.017 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.018 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.019 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.020 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.021 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.022 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-09-12T02:54:28.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.024 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 24119, 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "y", 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-09-12T02:54:28.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.027 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.028 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.029 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.033 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.034 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-09-12T02:54:28.035 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-09-12T02:54:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.037 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-09-12T02:54:28.039 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.040 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-09-12T02:54:28.041 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.043 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.044 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:54:28.045 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.046 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.047 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-09-12T02:54:28.048 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:54:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-09-12T02:54:28.051 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.052 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-09-12T02:54:28.053 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.054 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.055 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.056 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.057 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.058 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.059 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.061 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-09-12T02:54:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-09-12T02:54:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:54:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-09-12T02:54:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-09-12T02:54:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-09-12T02:54:28.072 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.073 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:54:28.074 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.075 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.076 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.079 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.080 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.081 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-09-12T02:54:28.082 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.083 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.085 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.086 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.087 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:54:28.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.090 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.091 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.092 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.093 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.094 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.095 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.096 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:54:28.097 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.098 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.099 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.100 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.101 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.102 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:54:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.104 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.105 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-09-12T02:54:28.106 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.107 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:54:28.109 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.110 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.111 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-09-12T02:54:28.112 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.113 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.114 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.116 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.117 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.118 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.119 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.120 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.121 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:54:28.123 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.124 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.125 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.126 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.129 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.130 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.132 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.133 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.134 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.135 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:54:28.136 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.137 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.138 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-09-12T02:54:28.139 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:54:28.141 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.142 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.143 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.144 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:54:28.145 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.147 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.148 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.149 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.151 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.152 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.153 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.154 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.155 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.156 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.158 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.159 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.160 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.161 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.162 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.163 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.164 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:54:28.166 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.168 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.169 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.170 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:54:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.172 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.173 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.174 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.175 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:54:28.176 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.178 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.179 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.180 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.181 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:54:28.182 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.184 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.185 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.186 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:54:28.187 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.189 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.190 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.191 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:54:28.192 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.193 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.194 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.195 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:54:28.196 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.197 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.198 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.199 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-09-12T02:54:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.201 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:54:28.202 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.203 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.204 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.205 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.206 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.207 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:54:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.209 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.211 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.212 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.213 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-09-12T02:54:28.214 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.215 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.216 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.217 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.218 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.219 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.220 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.223 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.224 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.225 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.226 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.227 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-09-12T02:54:28.228 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.230 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.231 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-09-12T02:54:28.232 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.233 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.234 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.235 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.236 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.237 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.238 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.239 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.240 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-09-12T02:54:28.241 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.242 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-09-12T02:54:28.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.258 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.259 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-09-12T02:54:28.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.261 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.262 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.263 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-09-12T02:54:28.264 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.265 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.266 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.267 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.268 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.269 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.270 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-09-12T02:54:28.271 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.272 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.273 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.274 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-09-12T02:54:28.276 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.277 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.278 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.279 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.280 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.281 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.282 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.283 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.284 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.287 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.288 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.289 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.290 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.292 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.293 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.294 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.295 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.296 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.297 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.298 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.299 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.300 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.301 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.302 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.303 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.304 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.305 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.306 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.307 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.308 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.309 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-09-12T02:54:28.310 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.311 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.313 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.314 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.316 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.317 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.318 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.319 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.320 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.321 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.322 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.323 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.324 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.325 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.326 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.328 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.329 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.333 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.334 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.335 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.336 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.338 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.339 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.340 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.342 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.343 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.344 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.346 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.348 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.349 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.350 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.351 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.353 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.354 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.355 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.356 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.357 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-09-12T02:54:28.358 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.359 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.361 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.362 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.363 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.364 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-09-12T02:54:28.366 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.367 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.368 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.370 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.371 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.373 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.374 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.375 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.376 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.377 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.378 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.380 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-09-12T02:54:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.383 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.384 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.385 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.386 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.387 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.388 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.389 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.390 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.392 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.393 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-09-12T02:54:28.394 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.395 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:54:28.396 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.397 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:54:28.398 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.399 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.400 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.401 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.403 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.406 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.407 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.408 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-09-12T02:54:28.409 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.411 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.413 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.415 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.416 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.418 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.420 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.421 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.422 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.423 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.424 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.425 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.427 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.428 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.429 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.430 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.431 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.432 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.437 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.438 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.439 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.440 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.443 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.444 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.445 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.446 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.447 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-09-12T02:54:28.448 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.449 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.450 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.451 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.452 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.453 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-09-12T02:54:28.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.456 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-09-12T02:54:28.457 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.458 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.459 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.460 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.461 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.462 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.463 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.466 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.467 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.468 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.469 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.470 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.471 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.472 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.473 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.474 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.475 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.476 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.478 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.479 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.480 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.481 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.482 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.483 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.484 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.485 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.486 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-09-12T02:54:28.487 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.488 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.489 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.490 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-09-12T02:54:28.491 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.492 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.493 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.494 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.495 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.496 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:54:28.497 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-09-12T02:54:28.499 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.500 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-09-12T02:54:28.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.503 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.504 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.506 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.522 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.523 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.524 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.525 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.526 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.527 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.528 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.529 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:54:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.531 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.532 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.533 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.534 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.535 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.536 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.537 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.538 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.539 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.540 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-09-12T02:54:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "modules": [ 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "dashboard", 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "iostat", 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "nfs", 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "restful" 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.554 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.555 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-09-12T02:54:28.556 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.558 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-09-12T02:54:28.559 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.560 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.561 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.562 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.565 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-09-12T02:54:28.566 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.567 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:54:28.568 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.569 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-09-12T02:54:28.570 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.571 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-09-12T02:54:28.572 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.574 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.575 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.576 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.578 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-09-12T02:54:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-09-12T02:54:28.581 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.582 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.583 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.585 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:54:28.586 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:54:28.586 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.586 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.586 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-09-12T02:54:28.586 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:54:28.587 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:28.587 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.588 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.589 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-09-12T02:54:28.590 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.591 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:54:28.592 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.593 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.594 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.595 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.596 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.597 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-09-12T02:54:28.598 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.599 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.600 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.601 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.602 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-09-12T02:54:28.603 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-09-12T02:54:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.606 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.607 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.608 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-09-12T02:54:28.609 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-09-12T02:54:28.611 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:54:28.612 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.613 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.614 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.616 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.617 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.618 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-09-12T02:54:28.619 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.620 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.621 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.622 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.623 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.624 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.626 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.627 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.629 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:54:28.630 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.631 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:54:28.632 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.634 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.635 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.636 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.637 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.638 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.640 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.641 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.642 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:54:28.645 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.646 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-09-12T02:54:28.648 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.649 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.650 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-09-12T02:54:28.651 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.652 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.653 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.654 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.655 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-09-12T02:54:28.656 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.657 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.658 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.659 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-09-12T02:54:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.661 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.662 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.663 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:54:28.665 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.666 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.667 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.668 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:54:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.670 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.671 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.672 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.674 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.675 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.676 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-09-12T02:54:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:54:28.679 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.680 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.681 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.682 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.683 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:54:28.684 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.685 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.686 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.687 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:54:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.690 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.691 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.692 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.693 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:54:28.696 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.698 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.699 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.701 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.703 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.704 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.705 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.706 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.707 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:54:28.708 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.709 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.710 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:54:28.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.712 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.714 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.715 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.717 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.718 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:54:28.719 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.720 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.721 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:54:28.723 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.725 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-09-12T02:54:28.726 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.727 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.729 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:54:28.730 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.731 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.733 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.734 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.735 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.738 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.739 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.740 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-09-12T02:54:28.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.742 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.744 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.745 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.746 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.747 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.749 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.750 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.751 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.752 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.753 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.754 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.755 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.756 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-09-12T02:54:28.758 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:54:28.759 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.761 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.762 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.763 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.764 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.765 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.766 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.767 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.768 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.770 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.771 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-09-12T02:54:28.772 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.773 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:54:28.774 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.776 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.777 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.779 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.780 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.781 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.783 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.784 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.785 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-09-12T02:54:28.787 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.789 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.791 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.792 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.793 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.794 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-09-12T02:54:28.795 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.796 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.797 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.798 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.799 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.800 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.801 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.802 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.803 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.804 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.805 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-09-12T02:54:28.806 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:54:28.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.808 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.809 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.810 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-09-12T02:54:28.811 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.812 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.813 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.814 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.816 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.817 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.818 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.821 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.822 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.823 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.824 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.825 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.827 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.829 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.830 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.831 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.833 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.834 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.835 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.836 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.837 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.838 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.839 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.840 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.841 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.843 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.844 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.845 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.846 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.847 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.849 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.850 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.851 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:54:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.855 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.857 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.858 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.860 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.861 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.862 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.864 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.865 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.866 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.867 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.868 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.869 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.871 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.872 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.874 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.876 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.878 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.879 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.880 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.881 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.882 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.883 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.884 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.885 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.886 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.888 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.889 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.891 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.892 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-09-12T02:54:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.906 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:54:28.907 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.908 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.909 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.910 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.911 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.912 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.913 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.914 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.915 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.916 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.917 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.918 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-09-12T02:54:28.919 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.920 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.922 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.923 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.924 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.925 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.926 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.928 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.929 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:54:28.930 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.931 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.932 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.933 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.934 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-09-12T02:54:28.935 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-09-12T02:54:28.937 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.938 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.939 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.940 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.941 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.943 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.945 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.946 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.947 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.948 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.949 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.950 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.951 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.952 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.953 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.954 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.955 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.956 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.957 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.959 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.960 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.961 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.962 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.963 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.964 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.965 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.966 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.967 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.968 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.969 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.970 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.971 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.972 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.973 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.974 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.975 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.976 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:28.977 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.978 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.979 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.980 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:28.981 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.982 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.983 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.984 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-09-12T02:54:28.985 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.987 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.988 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:54:28.989 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.992 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.993 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-09-12T02:54:28.994 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.995 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:28.996 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:28.997 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:28.997 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:28.997 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:28.997 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:28.997 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:28.997 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.000 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.001 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.002 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.003 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.004 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.005 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.006 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.007 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.008 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.011 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.012 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.013 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.014 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.015 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.016 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.017 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.018 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.019 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.020 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.024 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.025 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.026 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-09-12T02:54:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-09-12T02:54:29.042 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.045 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.046 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:54:29.047 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.048 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.049 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-09-12T02:54:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-09-12T02:54:29.051 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.053 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.054 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.055 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.056 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.057 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.058 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.059 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.060 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-09-12T02:54:29.061 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.062 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.064 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.065 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.066 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.067 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.068 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.069 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.070 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.072 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.073 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.076 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.077 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.078 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.079 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.080 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:54:29.081 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.082 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-09-12T02:54:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.085 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.088 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.089 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.090 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.091 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.092 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.093 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.094 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:54:29.095 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.096 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "services": { 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "dashboard": "https://172.21.15.100:8443/" 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "always_on_modules": { 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus": [ 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:54:29.097 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific": [ 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:54:29.098 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy": [ 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:54:29.099 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "reef": [ 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:54:29.100 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "squid": [ 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:54:29.101 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "last_failure_osd_epoch": 3, 2024-09-12T02:54:29.102 INFO:teuthology.orchestra.run.smithi100.stdout: "active_clients": [ 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2308856494 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.103 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "libcephsqlite", 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1198113806 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:54:29.104 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1400788821 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:54:29.105 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:54:29.106 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:54:29.106 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 855163196 2024-09-12T02:54:29.106 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.106 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:29.106 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.106 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:54:29.106 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:54:29.107 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:27 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/650668739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:54:29.108 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:27 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3237663374' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:54:29.108 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:27 smithi117 ceph-mon[34898]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 28 MiB/s wr, 1.75k op/s 2024-09-12T02:54:29.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:27 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/650668739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:54:29.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:27 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3237663374' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:54:29.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:27 smithi189 ceph-mon[35196]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 28 MiB/s wr, 1.75k op/s 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5a040a2b90 msgr2=0x7f5a040a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5a040a2b90 0x7f5a040a5050 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c101a60 tx=0x7f5a0c005f90 comp rx=0 tx=0).stop 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1025c0 msgr2=0x7f5a1c19e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1025c0 0x7f5a1c19e2f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400eb10 tx=0x7f5a1400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 shutdown_connections 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f5a040a2b90 0x7f5a040a5050 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1025c0 0x7f5a1c19e2f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c101c00 0x7f5a1c197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 --2- 172.21.15.100:0/3237663374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c100a10 0x7f5a1c196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 >> 172.21.15.100:0/3237663374 conn(0x7f5a1c0fc170 msgr2=0x7f5a1c105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 shutdown_connections 2024-09-12T02:54:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:27.484+0000 7f5a21a27640 1 -- 172.21.15.100:0/3237663374 wait complete. 2024-09-12T02:54:29.169 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T02:54:29.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T02:54:29.170 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:27 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/650668739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:54:29.170 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:27 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3237663374' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:54:29.170 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:27 smithi100 ceph-mon[31390]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 28 MiB/s wr, 1.75k op/s 2024-09-12T02:54:29.426 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:29.914 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 4, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3072, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 448, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.004286294, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000049200, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.003372334, 2024-09-12T02:54:29.915 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.006000268, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002000089 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:54:29.916 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 219, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 196080, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.016353009, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.012460844, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001607070, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:29.917 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 217, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.009849682, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000045390 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 196080 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.918 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 292, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 287, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 774400, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 176864, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.044428216, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.019641297, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.032209581, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 286, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.022342673, 2024-09-12T02:54:29.919 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000078121 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 774400, 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 176864 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:54:29.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:29.921 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:29.922 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:29.923 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 147954, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 29, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:29.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:29.925 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 294, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 733161, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 294, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 294, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 733161, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:29.927 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.927 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:29.927 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:54:30.560 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-12T02:54:30.560 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-12T02:54:30.561 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-12T02:54:30.561 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-12T02:54:30.561 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T02:54:30.561 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T02:54:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:30.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:30 smithi100 ceph-mon[31390]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:54:30.872 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:30 smithi100 ceph-mon[31390]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 26 MiB/s wr, 1.52k op/s 2024-09-12T02:54:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:30 smithi189 ceph-mon[35196]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:54:31.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:30 smithi189 ceph-mon[35196]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 26 MiB/s wr, 1.52k op/s 2024-09-12T02:54:31.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:30 smithi117 ceph-mon[34898]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:54:31.094 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:30 smithi117 ceph-mon[34898]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 26 MiB/s wr, 1.52k op/s 2024-09-12T02:54:31.303 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:54:31.303 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:31.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 0, 2024-09-12T02:54:31.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2, 2024-09-12T02:54:31.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:54:31.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 0, 2024-09-12T02:54:31.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:31.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:54:31.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.001288875, 2024-09-12T02:54:31.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:54:31.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000361032, 2024-09-12T02:54:31.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:31.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:31.306 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:31.306 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:31.306 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:31.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:31.307 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:31.307 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:31.307 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:31.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.307 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:54:31.308 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:54:31.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.308 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:31.308 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 6, 2024-09-12T02:54:31.308 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 225, 2024-09-12T02:54:31.309 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3392, 2024-09-12T02:54:31.309 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 197232, 2024-09-12T02:54:31.309 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:31.309 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:31.309 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.018718219, 2024-09-12T02:54:31.310 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.012893085, 2024-09-12T02:54:31.310 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.003687314, 2024-09-12T02:54:31.310 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:31.310 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:31.310 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 224, 2024-09-12T02:54:31.311 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.024952110, 2024-09-12T02:54:31.311 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000111393 2024-09-12T02:54:31.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.311 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:31.311 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:31.312 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:31.312 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:31.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.312 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T02:54:31.312 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 197232 2024-09-12T02:54:31.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.313 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:31.313 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 298, 2024-09-12T02:54:31.313 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 293, 2024-09-12T02:54:31.313 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 776656, 2024-09-12T02:54:31.314 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 180400, 2024-09-12T02:54:31.314 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:54:31.314 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:31.314 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.045719656, 2024-09-12T02:54:31.314 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.021152549, 2024-09-12T02:54:31.314 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.029827164, 2024-09-12T02:54:31.315 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:31.315 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:31.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 292, 2024-09-12T02:54:31.315 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.018214646, 2024-09-12T02:54:31.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000062378 2024-09-12T02:54:31.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.316 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:31.316 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:31.316 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:31.316 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:31.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.317 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 776656, 2024-09-12T02:54:31.317 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 180400 2024-09-12T02:54:31.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.317 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:54:31.317 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:54:31.318 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:54:31.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.318 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:54:31.318 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:31.318 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:31.319 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:31.319 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:31.319 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:31.319 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:31.319 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:31.320 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:31.320 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:31.320 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:31.320 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:31.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:31.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:31.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:31.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:31.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:31.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:31.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:31.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:31.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:31.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:31.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:31.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:31.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:31.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:31.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:31.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:31.324 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:31.324 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:31.324 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:31.324 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:31.324 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:54:31.325 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:31.325 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:31.325 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:31.325 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:31.325 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148704, 2024-09-12T02:54:31.325 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 29, 2024-09-12T02:54:31.326 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:31.326 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:31.326 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:54:31.326 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:54:31.326 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:31.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:31.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:31.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:31.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:54:31.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:54:31.328 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:31.328 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:31.328 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:31.328 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:54:31.328 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:54:31.328 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:54:31.329 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:31.329 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:54:31.329 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:31.329 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:54:31.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:31.330 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:31.330 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:54:31.330 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:54:31.330 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:54:31.330 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 300, 2024-09-12T02:54:31.331 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 734578, 2024-09-12T02:54:31.331 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:31.331 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 300, 2024-09-12T02:54:31.331 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:54:31.331 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:54:31.331 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 300, 2024-09-12T02:54:31.332 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 734578, 2024-09-12T02:54:31.332 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:54:31.332 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:31.332 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:31.332 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:31.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:31.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:31.333 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:54:32.012 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T02:54:32.012 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T02:54:32.012 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-12T02:54:32.012 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-12T02:54:32.012 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T02:54:32.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T02:54:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:32.779 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 4, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3072, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 448, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.003235959, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000032305, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002264631, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:32.780 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003967386, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001322462 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.781 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 220, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 196256, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.016883453, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.013285456, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001527387, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 218, 2024-09-12T02:54:32.782 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.011681856, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000053586 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 196256 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 293, 2024-09-12T02:54:32.783 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 288, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 774672, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 177504, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.042057024, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.019316639, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.028177164, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:32.784 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 287, 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014228829, 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000049577 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:32.785 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 774672, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 177504 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:32.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 147960, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 28, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 295, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 733291, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 295, 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 295, 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 733291, 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:32.793 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:54:33.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:32 smithi100 ceph-mon[31390]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-09-12T02:54:33.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:32 smithi189 ceph-mon[35196]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-09-12T02:54:33.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:32 smithi117 ceph-mon[34898]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-09-12T02:54:33.445 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T02:54:33.445 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T02:54:33.446 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-12T02:54:33.446 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-12T02:54:33.446 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T02:54:33.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T02:54:33.688 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:34.181 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:54:34.181 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:34.181 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 4, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3072, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 448, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.002884696, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000039971, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002069866, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:34.182 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003872819, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001290939 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.183 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 225, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 197136, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.016858202, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.013386202, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001366961, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:34.184 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 223, 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014833205, 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000066516 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:54:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 197136 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 300, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 295, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 777200, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 181680, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.043323353, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.019415284, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.029916459, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:34.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 294, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.016900941, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000057486 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 777200, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 181680 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.187 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:34.188 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:34.189 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:34.190 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148682, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 29, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:34.191 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:54:34.192 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:54:34.192 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:34.192 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:34.192 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:34.192 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:34.192 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:54:34.193 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 302, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 734838, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 302, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 302, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 734838, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:54:34.194 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:54:34.195 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:54:34.195 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:34.195 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:54:34.195 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:54:34.900 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T02:54:34.901 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T02:54:34.901 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-12T02:54:34.901 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-12T02:54:34.901 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T02:54:34.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T02:54:35.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:34 smithi100 ceph-mon[31390]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 162 op/s 2024-09-12T02:54:35.159 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:54:35.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:34 smithi189 ceph-mon[35196]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 162 op/s 2024-09-12T02:54:35.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:34 smithi117 ceph-mon[34898]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 162 op/s 2024-09-12T02:54:35.909 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:54:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 12211, 2024-09-12T02:54:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 13347, 2024-09-12T02:54:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 3114169, 2024-09-12T02:54:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 16289818, 2024-09-12T02:54:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 220, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 5, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.759477472, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.251948717, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.292155838, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.180284528, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 13348, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.171884806, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000087794 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5122, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000866390, 2024-09-12T02:54:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000169 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 39712, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 1856 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 22178, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 26232, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 7222448, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 16836991, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 29, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 7, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 1.178496156, 2024-09-12T02:54:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.418010871, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.733478388, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.223983487, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 26229, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.700034946, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000064815 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 24892, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.003610406, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000145 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 899696, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 239728 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 8842, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 10283, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 2277769, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 8257082, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 10, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 6, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.541010771, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.200005937, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.191455622, 2024-09-12T02:54:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.132074733, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 10281, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.885382064, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000086118 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4781, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000860416, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000179 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 476016 2024-09-12T02:54:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 21332, 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 7.349560829, 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000344532 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 826, 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.034704461, 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000042015 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 5154, 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 5152, 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5152, 2024-09-12T02:54:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 74.395397505, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.014440100 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 2, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 39, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 3, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 1542, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 0, 2024-09-12T02:54:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 0, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 1542, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 1542, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 8, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 1060, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 1060, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 6, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 9061, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 7506, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 0, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 0, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-12T02:54:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 446, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 2, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 7, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 0, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 0, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 21169, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 1026, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 1711701571, 2024-09-12T02:54:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 21169, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 727, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 21, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 706, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 20442, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 38, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 2709, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 4421, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:54:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 5325, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 1938, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 230, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 1516 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 80, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 0, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 0, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 0, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 124, 2024-09-12T02:54:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 12, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 484, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 250, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 222, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:54:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 14, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 14789, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 21, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 2, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 3, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-12T02:54:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-12T02:54:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 7075, 2024-09-12T02:54:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 0, 2024-09-12T02:54:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 0, 2024-09-12T02:54:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 7075, 2024-09-12T02:54:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-12T02:54:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 0, 2024-09-12T02:54:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 10, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 0, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 0, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 10, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 2, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 0, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 4194304, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 21946005, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 0, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3916, 2024-09-12T02:54:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 13.295926874, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.003395282 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 0 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 1082, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 1357, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 275, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 68, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 73, 2024-09-12T02:54:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 5, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 1542, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 2081, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 539, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 1060, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 2903, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 1843, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 74392, 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 231712 2024-09-12T02:54:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 6288, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 1, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 5154, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 471, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 2, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1300, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 60.018572976, 2024-09-12T02:54:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.046168133 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 34, 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.055638651, 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001636430 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 222, 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.410858569, 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001850714 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1846, 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 10.625121581, 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.005755753 2024-09-12T02:54:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000171475, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000171475 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 37, 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.311993679, 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.008432261 2024-09-12T02:54:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-12T02:54:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 901, 2024-09-12T02:54:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.509670104, 2024-09-12T02:54:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000565671 2024-09-12T02:54:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 82, 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.126206813, 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001539107 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 450, 2024-09-12T02:54:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.920587650, 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.004267972 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.010893525, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.005446762 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-12T02:54:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000855937, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000855937 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 8, 2024-09-12T02:54:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.019020862, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.002377607 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 268, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.385805683, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001439573 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 3, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 2, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 1, 2024-09-12T02:54:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 869, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 869, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 962, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 333718, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 1158, 2024-09-12T02:54:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 7600, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 157, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:54:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 4185141, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 61448, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 26624, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 18413108, 2024-09-12T02:54:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 37, 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 26624, 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 26624, 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 41.694183266, 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001566037 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 26624, 2024-09-12T02:54:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 27033 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 26624, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 21310, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 5314, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 0, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 11, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 120, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 4015, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 149, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-12T02:54:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 3, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 780, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 21190, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 22, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:54:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-12T02:54:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 84, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-12T02:54:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 12, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 12, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 607, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 0, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 136 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 1, 2024-09-12T02:54:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "osd-slow-ops": { 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 14805 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 17, 2024-09-12T02:54:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 10, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 264, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 250, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 43227, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 8691233, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 43227, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 43227, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 8691233, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 26624, 2024-09-12T02:54:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 18438358, 2024-09-12T02:54:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 26624, 2024-09-12T02:54:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 18438358, 2024-09-12T02:54:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 26624, 2024-09-12T02:54:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 26624, 2024-09-12T02:54:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 26624, 2024-09-12T02:54:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 26624, 2024-09-12T02:54:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 250, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 25250, 2024-09-12T02:54:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 250, 2024-09-12T02:54:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 99, 2024-09-12T02:54:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 25250, 2024-09-12T02:54:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x555bb2154960": { 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 7075, 2024-09-12T02:54:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 17751701, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 7075, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3916, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 17751701, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.966 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:35.966 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:54:36.852 INFO:tasks.check_counter:Daemon mds.b mds.exported=2 2024-09-12T02:54:36.852 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-12T02:54:36.852 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=80 2024-09-12T02:54:36.852 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-12T02:54:36.852 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T02:54:36.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T02:54:37.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:36 smithi117 ceph-mon[34898]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-12T02:54:37.107 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:54:37.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:36 smithi189 ceph-mon[35196]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-12T02:54:37.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:36 smithi100 ceph-mon[31390]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-12T02:54:37.649 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:54:37.649 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:37.649 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 313, 2024-09-12T02:54:37.649 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 302, 2024-09-12T02:54:37.649 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 817970, 2024-09-12T02:54:37.649 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 182548, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 6, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.042329077, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.018415535, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.031209886, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000015061, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 301, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.019676666, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000065370 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:37.650 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 817136, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 182224 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 961, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 1183, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 236342, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 774997, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 5, 2024-09-12T02:54:37.651 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 4, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.085799842, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.030337268, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.017640922, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.028672129, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1181, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.054963534, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000046539 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.652 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 469712 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 2118, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 2118, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 646447, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 672758, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 3, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.182700843, 2024-09-12T02:54:37.653 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.062804339, 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.048437972, 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.055970842, 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2117, 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.098134094, 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000046355 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:37.654 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:54:37.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5111, 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.123974374, 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000024256 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:54:37.656 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 0, 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 0, 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.657 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 9, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 9, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 0, 2024-09-12T02:54:37.658 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 9, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 3, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-12T02:54:37.659 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-12T02:54:37.660 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 0, 2024-09-12T02:54:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 0 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:54:37.662 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-12T02:54:37.663 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 9, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 0, 2024-09-12T02:54:37.664 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 0, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 0, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 0, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 2, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 2, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 0, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 4194304, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 4206024, 2024-09-12T02:54:37.665 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 4205883, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 9 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 12, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 12, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 0, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 10, 2024-09-12T02:54:37.666 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 10, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 0, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 9, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 9, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 0, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 0, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 0, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 0, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 48516, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 215328 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 0, 2024-09-12T02:54:37.667 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 0, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 0, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 0, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 0, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.668 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.669 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.670 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-12T02:54:37.671 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-12T02:54:37.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.673 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.673 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.673 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-12T02:54:37.673 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.673 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.674 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.676 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.677 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-12T02:54:37.678 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.679 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.680 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 2, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 1, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 2, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 0, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 0, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 3442, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:37.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:37.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:37.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 190352, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 57, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:54:37.684 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 7600, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 157, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:54:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 47154, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 241, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 3075, 2024-09-12T02:54:37.686 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 21, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 3, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 3075, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3075, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 6.866866296, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.002233127 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3075, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 3076 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 3075, 2024-09-12T02:54:37.687 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 3075, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 2010, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 1063, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-12T02:54:37.688 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 1, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-12T02:54:37.689 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-12T02:54:37.690 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 84, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 5, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 6, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 1, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 0, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 2, 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 0 2024-09-12T02:54:37.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 0, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "osd-slow-ops": { 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 0 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:54:37.692 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 0, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 0, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 0, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 3388, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 1376745, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 3388, 2024-09-12T02:54:37.693 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3388, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 1376745, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:54:37.694 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 3075, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 11725, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3075, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 11725, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 3075, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 3075, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3075, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 3075, 2024-09-12T02:54:37.696 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:37.697 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x56317fd24b40": { 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:37.698 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:37.699 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:54:38.429 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T02:54:38.429 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T02:54:38.430 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-12T02:54:38.430 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-12T02:54:38.430 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T02:54:38.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T02:54:38.673 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:54:39.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:38 smithi117 ceph-mon[34898]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T02:54:39.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:38 smithi189 ceph-mon[35196]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T02:54:39.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:38 smithi100 ceph-mon[31390]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T02:54:39.670 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 1654, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 1656, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 5674262, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 525982, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 6, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.146236895, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.052940738, 2024-09-12T02:54:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.035647435, 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.043885843, 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1654, 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.075768087, 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000045809 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 1442, 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 1661, 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 8767078, 2024-09-12T02:54:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 927016, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 5, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 4, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.110473576, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.032111308, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.035759079, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.033599647, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1660, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.068192976, 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000041080 2024-09-12T02:54:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 469984 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 731, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 720, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 5117599, 2024-09-12T02:54:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 314665, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 3, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.075016669, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.027237826, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.042011670, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.010581516, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 719, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.033128417, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000046075 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 816752, 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 181104 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-12T02:54:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5899, 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.126476843, 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000021440 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:54:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 0, 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 0, 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 1791, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 0, 2024-09-12T02:54:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 1791, 2024-09-12T02:54:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 0, 2024-09-12T02:54:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 1791, 2024-09-12T02:54:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 0, 2024-09-12T02:54:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 0, 2024-09-12T02:54:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 0, 2024-09-12T02:54:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 4, 2024-09-12T02:54:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 0, 2024-09-12T02:54:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 1026, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 1711701571, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:54:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 0, 2024-09-12T02:54:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 0 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 0, 2024-09-12T02:54:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 0, 2024-09-12T02:54:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 0, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 0, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 0, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 7075, 2024-09-12T02:54:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 0, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 0, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 0, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 0, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 10, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 2, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 0, 2024-09-12T02:54:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 4194304, 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 21946005, 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 21941368, 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 7075 2024-09-12T02:54:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 1081, 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 1335, 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 254, 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 67, 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 72, 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 5, 2024-09-12T02:54:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 1791, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 1802, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 11, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 0, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 0, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 0, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 56232, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 215328 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 0, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 0, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 0, 2024-09-12T02:54:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 0, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 0, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-12T02:54:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-12T02:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-12T02:54:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-12T02:54:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-12T02:54:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-12T02:54:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-12T02:54:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-12T02:54:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-12T02:54:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:54:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:54:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-12T02:54:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-12T02:54:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-12T02:54:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 3, 2024-09-12T02:54:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 2, 2024-09-12T02:54:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 2, 2024-09-12T02:54:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 0, 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 0, 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 3446, 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 237430, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 1115, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 7600, 2024-09-12T02:54:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 157, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 3838045, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 45549, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-12T02:54:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 3511, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 26, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 4, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 3511, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3511, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 5.048901636, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001438023 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3511, 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 3512 2024-09-12T02:54:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 3511, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 3511, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 0, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 2103, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 0, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 1405, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 0, 2024-09-12T02:54:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 2, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-12T02:54:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-12T02:54:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 84, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 6, 2024-09-12T02:54:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 6, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 0, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 2, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 0 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 0, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-12T02:54:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "osd-slow-ops": { 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 0 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 0, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 0, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 0, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 3823, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 19195833, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 3823, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3823, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 19195833, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 3511, 2024-09-12T02:54:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 17761415, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3511, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 17761415, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-12T02:54:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 3511, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 3511, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3511, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 3511, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x55c8c832eb40": { 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:54:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-12T02:54:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:39.729 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:54:40.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:39 smithi189 ceph-mon[35196]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-12T02:54:40.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:39 smithi117 ceph-mon[34898]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-12T02:54:40.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:39 smithi100 ceph-mon[31390]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-12T02:54:40.480 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T02:54:40.480 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T02:54:40.480 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-12T02:54:40.480 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-12T02:54:40.480 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T02:54:40.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T02:54:40.724 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:54:41.232 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:54:41.232 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:41.232 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 0, 2024-09-12T02:54:41.232 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 2, 2024-09-12T02:54:41.232 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 0, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 0, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.000930792, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.000114908, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 306, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 299, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 780816, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 183408, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 2, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.043965650, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.018714294, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.032546641, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 299, 2024-09-12T02:54:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.026997693, 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000090293 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 780816, 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 183408 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 2, 2024-09-12T02:54:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 227, 2024-09-12T02:54:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:54:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 197488, 2024-09-12T02:54:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.012744615, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.009149319, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.001336663, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 225, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.015974695, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000070998 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 197488 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 0, 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 148682, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 29, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 928, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 2, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 304, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 735098, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 304, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:54:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 304, 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 735098, 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:54:41.246 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:54:41.942 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-12T02:54:41.942 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-12T02:54:41.943 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-12T02:54:41.943 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-12T02:54:41.943 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T02:54:41.943 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T02:54:42.208 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:54:42.777 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:54:42.777 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:42.777 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 456, 2024-09-12T02:54:42.777 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 441, 2024-09-12T02:54:42.777 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 850425, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 691821, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 48, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.065079950, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.021631162, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.047390030, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000412180, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 441, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.034838909, 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000078999 2024-09-12T02:54:42.778 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 59, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000007415, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000125 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 840256, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 209280 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 267, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 523, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 73872, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 559425, 2024-09-12T02:54:42.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 9, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.038311522, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.017613697, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.019643012, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000936205, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 521, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.033551470, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000064398 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 451, 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000077136, 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000171 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 472320 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.781 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3223, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2006, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 982434, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 667366, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 17, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 7, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.177727731, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.065864662, 2024-09-12T02:54:42.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.136826764, 2024-09-12T02:54:42.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.007073652, 2024-09-12T02:54:42.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:42.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2004, 2024-09-12T02:54:42.783 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.078580929, 2024-09-12T02:54:42.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000039212 2024-09-12T02:54:42.784 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.784 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:42.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 5028, 2024-09-12T02:54:42.784 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000936028, 2024-09-12T02:54:42.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000186 2024-09-12T02:54:42.784 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T02:54:42.785 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:54:42.786 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:54:42.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 91, 2024-09-12T02:54:42.786 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.003938590, 2024-09-12T02:54:42.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000043281 2024-09-12T02:54:42.786 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.786 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000016026, 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000008013 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.787 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 159, 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 18, 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 18, 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.007481498, 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000415638 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.788 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 141, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 11, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 35, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 9, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 26, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 22, 2024-09-12T02:54:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 4, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 7, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 7, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 4, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 256, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 96, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 140, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 20, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:54:42.790 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 1, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 1, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 20, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 1027, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 1703542446, 2024-09-12T02:54:42.791 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 20, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 20, 2024-09-12T02:54:42.792 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 51, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 50, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 62, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 6, 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 5 2024-09-12T02:54:42.793 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 2, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 99, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 59, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 60, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 2, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T02:54:42.794 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 14, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 331, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:54:42.795 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 9, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 9, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T02:54:42.796 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 2, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4206024, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 8, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.012874288, 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001609286 2024-09-12T02:54:42.797 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 39, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 41, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 2, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 57, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 62, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 5, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 35, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 39, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 4, 2024-09-12T02:54:42.798 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 7, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 22, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 15, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 51196, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 223520 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 162, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 159, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 17, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 1, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.799 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001682450, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001682450 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.800 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 10, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.003036659, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000303665 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000105989, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000105989 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.802 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.803 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 4, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001490870, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000372717 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001165530, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000582765 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.805 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.806 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.807 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.808 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.809 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T02:54:42.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.811 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 5, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 5, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 946, 2024-09-12T02:54:42.812 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:42.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:42.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:42.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 263878, 2024-09-12T02:54:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 107, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7600, 2024-09-12T02:54:42.817 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 157, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 194104, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 1039, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:42.818 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 85, 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 25614, 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 33, 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 85, 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T02:54:42.819 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 85, 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.752985177, 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.008858649 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 85, 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 126 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.820 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 85, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 20, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 65, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 0, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 10, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 0, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 8, 2024-09-12T02:54:42.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 9, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 6, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 20, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 20, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T02:54:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T02:54:42.823 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 84, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T02:54:42.824 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 8, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 12, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 4, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 44, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 0, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 9 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:54:42.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 344 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T02:54:42.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 3942, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1529144, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 3942, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3942, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1529144, 2024-09-12T02:54:42.827 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 85, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 25614, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 85, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 25614, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.829 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 85, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 85, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 85, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 85, 2024-09-12T02:54:42.830 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:42.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x555717a72960": { 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:54:42.832 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 9, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 11720, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 9, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 8, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 11720, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:42.833 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.834 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:42.834 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:54:43.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:42 smithi117 ceph-mon[34898]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-12T02:54:43.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:42 smithi189 ceph-mon[35196]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-12T02:54:43.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:42 smithi100 ceph-mon[31390]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-12T02:54:43.705 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T02:54:43.705 INFO:tasks.check_counter:Daemon mds.c mds.imported=1 2024-09-12T02:54:43.705 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=2 2024-09-12T02:54:43.705 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=99 2024-09-12T02:54:43.706 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T02:54:43.706 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T02:54:43.952 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:54:44.656 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1377, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 1366, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1174912, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 521216, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.152689654, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.052489483, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.059965601, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.036995867, 2024-09-12T02:54:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1365, 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.080415465, 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000058912 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 817408, 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 182864 2024-09-12T02:54:44.658 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 4, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 227, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 876, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 560602, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.013090120, 2024-09-12T02:54:44.659 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.009168118, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001832458, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000070668, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 225, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015077673, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000067011 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.660 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 559904 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2055, 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2055, 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 538186, 2024-09-12T02:54:44.661 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 652673, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.126181665, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.039866949, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.032789091, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.045258852, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2054, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.088096819, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000042890 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:44.662 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:54:44.663 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 5205, 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.127912697, 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000024574 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:54:44.664 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-12T02:54:44.665 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T02:54:44.666 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 13, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 13, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 13, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 3, 2024-09-12T02:54:44.667 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-12T02:54:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T02:54:44.670 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-12T02:54:44.671 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T02:54:44.672 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T02:54:44.673 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 8, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T02:54:44.674 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4207203, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4204790, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 8 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.675 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 13, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 13, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 0, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 9, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 9, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 13, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 13, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-12T02:54:44.676 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 47788, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.677 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.678 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.679 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.680 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.681 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.682 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T02:54:44.683 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.684 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.686 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.687 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.688 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 2198, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.689 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:44.690 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:44.691 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:44.692 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 182326, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 55, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7600, 2024-09-12T02:54:44.693 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 157, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 51027, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 278, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T02:54:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 3117, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 3117, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3117, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 2.208956266, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000708680 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3117, 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 3118 2024-09-12T02:54:44.695 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 3117, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 3117, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 2041, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 1074, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T02:54:44.696 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T02:54:44.697 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T02:54:44.698 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 84, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T02:54:44.699 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 4, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 5, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 1, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T02:54:44.700 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T02:54:44.701 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:54:44.702 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 3432, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1385905, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 3432, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3432, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1385905, 2024-09-12T02:54:44.703 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:44.704 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3117, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 12904, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3117, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 12904, 2024-09-12T02:54:44.705 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:44.706 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3117, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 3117, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3117, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 3117, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.707 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:44.708 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:44.709 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x55a48aa44b40": { 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:44.710 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:44.711 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:44.711 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:44.711 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.711 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:44.711 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:54:45.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:44 smithi189 ceph-mon[35196]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:45.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:44 smithi117 ceph-mon[34898]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:45.372 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:44 smithi100 ceph-mon[31390]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:45.457 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T02:54:45.457 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T02:54:45.457 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-12T02:54:45.457 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-12T02:54:45.457 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T02:54:45.458 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T02:54:45.704 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:54:46.217 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:54:46.217 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:46.217 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3222, 2024-09-12T02:54:46.217 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 1998, 2024-09-12T02:54:46.217 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 973003, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 1050699, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 51, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 6, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.190248531, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.066001711, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.147893422, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.006350301, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1996, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.093628789, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000046908 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.218 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 4997, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001166294, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000233 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 623, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 663, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 909376, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 293477, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 12, 2024-09-12T02:54:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.071925698, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.029084220, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.050691929, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000170368, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 662, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.034442441, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000052027 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 527, 2024-09-12T02:54:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000091240, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000173 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 831888, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 187664 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 42, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 259, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 25234, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 635700, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 14, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.020251657, 2024-09-12T02:54:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.009794609, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.007714591, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000767867, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 258, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.036944979, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000143197 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 16, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000002446, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000152 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T02:54:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 560000 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 54, 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001987604, 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000036807 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000015581, 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000007790 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 163, 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 10, 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T02:54:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 10, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.003184629, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000318462 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 153, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 11, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 40, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 10, 2024-09-12T02:54:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 30, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 26, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 4, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 5, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 5, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 4, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 265, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 90, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 152, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 22, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:54:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 1, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 6, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 1027, 2024-09-12T02:54:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 1703542446, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 68, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 70, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:54:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 79, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 7, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 4 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 105, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 63, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 66, 2024-09-12T02:54:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 14, 2024-09-12T02:54:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 317, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 8, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T02:54:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 8, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 2, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4207203, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-12T02:54:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 7, 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.014895580, 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002127940 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 41, 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 43, 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 2, 2024-09-12T02:54:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 57, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 62, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 5, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 40, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 44, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 4, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 5, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 14, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 9, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 51780, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 223520 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 164, 2024-09-12T02:54:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 163, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 17, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000217922, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000217922 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 9, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.002966707, 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000329634 2024-09-12T02:54:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T02:54:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T02:54:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T02:54:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 1, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 1, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 974, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 248160, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 108, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7600, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 157, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 201578, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 1102, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:54:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 59, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 25562, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 28, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 59, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 59, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.358992872, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.006084624 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 59, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 97 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 59, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 0, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 59, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 0, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 10, 2024-09-12T02:54:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 7, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 7, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 6, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 0, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 20, 2024-09-12T02:54:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T02:54:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 84, 2024-09-12T02:54:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 9, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 15, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 6, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 39, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 0, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 8 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T02:54:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 330 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T02:54:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 3883, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1537411, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 3883, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3883, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1537411, 2024-09-12T02:54:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 59, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 25562, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 59, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 25562, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T02:54:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 59, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 59, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 59, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 59, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:54:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x561a43034960": { 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 8, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 12899, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 8, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 7, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 12899, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:46.266 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:54:47.011 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-12T02:54:47.011 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-12T02:54:47.011 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-12T02:54:47.011 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=105 2024-09-12T02:54:47.011 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T02:54:47.012 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T02:54:47.258 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:54:47.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:46 smithi189 ceph-mon[35196]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:47.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:46 smithi117 ceph-mon[34898]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:47.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:46 smithi100 ceph-mon[31390]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:47.788 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:54:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:54:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 305, 2024-09-12T02:54:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 300, 2024-09-12T02:54:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 778560, 2024-09-12T02:54:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 184880, 2024-09-12T02:54:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.042881168, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.018818616, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.029731022, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 299, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015608406, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000052202 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 778560, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 184880 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 229, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 197840, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-12T02:54:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.013240125, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.009854505, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001075836, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 227, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.012551107, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000055291 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 197840 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 4, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 4, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 3072, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 448, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-12T02:54:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.002192681, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000036828, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.002124484, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.003883233, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001294411 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:54:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:54:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:54:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148704, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 29, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:54:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-12T02:54:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 307, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 735488, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:54:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 307, 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 307, 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 735488, 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:54:47.800 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:54:48.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:47 smithi189 ceph-mon[35196]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-09-12T02:54:48.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:47 smithi117 ceph-mon[34898]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-09-12T02:54:48.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:47 smithi100 ceph-mon[31390]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-09-12T02:54:48.734 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-12T02:54:48.734 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-12T02:54:48.734 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-12T02:54:48.734 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-12T02:54:48.734 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:54:48.745 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:54:48.746 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:54:48.746 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:54:48.767 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:54:48.767 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:54:48.831 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:54:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 -- 172.21.15.100:0/1872393972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 msgr2=0x7f04341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 --2- 172.21.15.100:0/1872393972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341067e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0428009900 tx=0x7f042802a410 comp rx=0 tx=0).stop 2024-09-12T02:54:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 -- 172.21.15.100:0/1872393972 shutdown_connections 2024-09-12T02:54:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 --2- 172.21.15.100:0/1872393972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0434106f10 0x7f043410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 --2- 172.21.15.100:0/1872393972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341067e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 --2- 172.21.15.100:0/1872393972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0434101de0 0x7f04341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 -- 172.21.15.100:0/1872393972 >> 172.21.15.100:0/1872393972 conn(0x7f04340fd8c0 msgr2=0x7f04340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 -- 172.21.15.100:0/1872393972 shutdown_connections 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.581+0000 7f0439a41640 1 -- 172.21.15.100:0/1872393972 wait complete. 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 Processor -- start 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 -- start start 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0434101de0 0x7f04341a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0434106f10 0x7f043419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0434112010 con 0x7f0434102790 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0434111e90 con 0x7f0434101de0 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f0439a41640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0434112190 con 0x7f0434106f10 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f04327fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f04327fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33048/0 (socket says 172.21.15.100:33048) 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.582+0000 7f04327fc640 1 -- 172.21.15.100:0/2576681393 learned_addr learned my addr 172.21.15.100:0/2576681393 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04337fe640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0434106f10 0x7f043419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f0432ffd640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0434101de0 0x7f04341a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04327fc640 1 -- 172.21.15.100:0/2576681393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0434106f10 msgr2=0x7f043419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04327fc640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0434106f10 0x7f043419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04327fc640 1 -- 172.21.15.100:0/2576681393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0434101de0 msgr2=0x7f04341a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:49.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04327fc640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0434101de0 0x7f04341a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04327fc640 1 -- 172.21.15.100:0/2576681393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043419ad50 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f0432ffd640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0434101de0 0x7f04341a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04337fe640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0434106f10 0x7f043419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f04327fc640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341a09a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0428005ab0 tx=0x7f04280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f0438a3f640 1 -- 172.21.15.100:0/2576681393 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042803f030 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f0438a3f640 1 -- 172.21.15.100:0/2576681393 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0428003ce0 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043419afe0 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f0438a3f640 1 -- 172.21.15.100:0/2576681393 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428035070 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.583+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04341a7330 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.584+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0434102240 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.586+0000 7f0438a3f640 1 -- 172.21.15.100:0/2576681393 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f0428042030 con 0x7f0434102790 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.587+0000 7f0438a3f640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f041c0a2b80 0x7f041c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:49.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.587+0000 7f0432ffd640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f041c0a2b80 0x7f041c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:49.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.587+0000 7f0438a3f640 1 -- 172.21.15.100:0/2576681393 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f04280efc90 con 0x7f0434102790 2024-09-12T02:54:49.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.587+0000 7f0432ffd640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f041c0a2b80 0x7f041c0a5040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f0424008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:49.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.589+0000 7f0438a3f640 1 -- 172.21.15.100:0/2576681393 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04280bcbe0 con 0x7f0434102790 2024-09-12T02:54:49.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.774+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f04341a7500 con 0x7f0434102790 2024-09-12T02:54:49.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.774+0000 7f0438a3f640 1 -- 172.21.15.100:0/2576681393 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+600 (secure 0 0 0) 0x7f04280bc4e0 con 0x7f0434102790 2024-09-12T02:54:49.775 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2890609660 2024-09-13T02:29:55.443151+0000 2024-09-12T02:54:49.775 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2742281949 2024-09-13T02:29:55.443151+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3730537393 2024-09-13T02:29:55.443151+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3548885308 2024-09-13T02:29:55.443151+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/274092264 2024-09-13T02:29:31.443245+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3636516515 2024-09-13T02:29:31.443245+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3636516515 2024-09-13T02:29:31.443245+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1503257974 2024-09-13T02:29:31.443245+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3548885308 2024-09-13T02:29:55.443151+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/875119703 2024-09-13T02:29:31.443245+0000 2024-09-12T02:54:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:listed 10 entries 2024-09-12T02:54:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f041c0a2b80 msgr2=0x7f041c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f041c0a2b80 0x7f041c0a5040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f0424008040 comp rx=0 tx=0).stop 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 msgr2=0x7f04341a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341a09a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0428005ab0 tx=0x7f04280042f0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 shutdown_connections 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f041c0a2b80 0x7f041c0a5040 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0434106f10 0x7f043419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0434102790 0x7f04341a09a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 --2- 172.21.15.100:0/2576681393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0434101de0 0x7f04341a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 >> 172.21.15.100:0/2576681393 conn(0x7f04340fd8c0 msgr2=0x7f04340fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 shutdown_connections 2024-09-12T02:54:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:49.777+0000 7f0439a41640 1 -- 172.21.15.100:0/2576681393 wait complete. 2024-09-12T02:54:50.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:49 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2576681393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:54:50.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:49 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2576681393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:54:50.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:49 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2576681393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:54:50.690 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:54:50.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:54:50.690 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /tmp/cephfs 2024-09-12T02:54:50.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:54:50.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:54:50.942 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-12T02:54:50.942 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:50 smithi100 ceph-mon[31390]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-12T02:54:50.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:54:50.968 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-12T02:54:51.024 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-12T02:54:51.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:54:51.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-12T02:54:51.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:54:51.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-12T02:54:51.093 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:50 smithi117 ceph-mon[34898]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-12T02:54:51.196 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T02:54:51.215 INFO:tasks.cephadm:Teardown begin 2024-09-12T02:54:51.215 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:54:51.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:54:51.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:50 smithi189 ceph-mon[35196]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-12T02:54:51.462 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:51.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 -- 172.21.15.100:0/342122191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 msgr2=0x7f40c010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:51.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 --2- 172.21.15.100:0/342122191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c010d950 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009cd0 tx=0x7f40b802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:54:51.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 -- 172.21.15.100:0/342122191 shutdown_connections 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 --2- 172.21.15.100:0/342122191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c010d950 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 --2- 172.21.15.100:0/342122191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c0100a80 0x7f40c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 --2- 172.21.15.100:0/342122191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c0106a80 0x7f40c0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 -- 172.21.15.100:0/342122191 >> 172.21.15.100:0/342122191 conn(0x7f40c00fc7a0 msgr2=0x7f40c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 -- 172.21.15.100:0/342122191 shutdown_connections 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.948+0000 7f40c6c73640 1 -- 172.21.15.100:0/342122191 wait complete. 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 Processor -- start 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 -- start start 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c0100a80 0x7f40c0197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c0197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c0106a80 0x7f40c019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0110e80 con 0x7f40c0101420 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0110d00 con 0x7f40c0106a80 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c6c73640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0111000 con 0x7f40c0100a80 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c0197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c4a0f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c0100a80 0x7f40c0197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c0197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33070/0 (socket says 172.21.15.100:33070) 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40c4a0f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c0100a80 0x7f40c0197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:34994/0 (socket says 172.21.15.100:34994) 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.949+0000 7f40bffff640 1 -- 172.21.15.100:0/2357351171 learned_addr learned my addr 172.21.15.100:0/2357351171 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40c5210640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c0106a80 0x7f40c019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bffff640 1 -- 172.21.15.100:0/2357351171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c0100a80 msgr2=0x7f40c0197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bffff640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c0100a80 0x7f40c0197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bffff640 1 -- 172.21.15.100:0/2357351171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c0106a80 msgr2=0x7f40c019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bffff640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c0106a80 0x7f40c019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bffff640 1 -- 172.21.15.100:0/2357351171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c019c2d0 con 0x7f40c0101420 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bffff640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c0197860 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c890 tx=0x7f40ac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bdffb640 1 -- 172.21.15.100:0/2357351171 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac004220 con 0x7f40c0101420 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c019c5c0 con 0x7f40c0101420 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bdffb640 1 -- 172.21.15.100:0/2357351171 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40ac0043c0 con 0x7f40c0101420 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40bdffb640 1 -- 172.21.15.100:0/2357351171 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac004a00 con 0x7f40c0101420 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.950+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c01a3ea0 con 0x7f40c0101420 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.951+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c0100ee0 con 0x7f40c0101420 2024-09-12T02:54:51.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.952+0000 7f40bdffb640 1 -- 172.21.15.100:0/2357351171 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f40ac0079b0 con 0x7f40c0101420 2024-09-12T02:54:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.953+0000 7f40bdffb640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40b00a2b80 0x7f40b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.953+0000 7f40c4a0f640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40b00a2b80 0x7f40b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.953+0000 7f40bdffb640 1 -- 172.21.15.100:0/2357351171 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f40ac0ced50 con 0x7f40c0101420 2024-09-12T02:54:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.953+0000 7f40c4a0f640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40b00a2b80 0x7f40b00a5040 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f40b4005fd0 tx=0x7f40b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:51.957+0000 7f40bdffb640 1 -- 172.21.15.100:0/2357351171 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40ac0d2030 con 0x7f40c0101420 2024-09-12T02:54:52.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.159+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40c0109050 con 0x7f40c0101420 2024-09-12T02:54:52.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.160+0000 7f40bdffb640 1 -- 172.21.15.100:0/2357351171 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11924 (secure 0 0 0) 0x7f40ac014030 con 0x7f40c0101420 2024-09-12T02:54:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"btime":"2024-09-12T02:54:29:590890+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:54:29.540732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:54:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 29 2024-09-12T02:54:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40b00a2b80 msgr2=0x7f40b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40b00a2b80 0x7f40b00a5040 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f40b4005fd0 tx=0x7f40b400b390 comp rx=0 tx=0).stop 2024-09-12T02:54:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 msgr2=0x7f40c0197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c0197860 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c890 tx=0x7f40ac00cd50 comp rx=0 tx=0).stop 2024-09-12T02:54:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 shutdown_connections 2024-09-12T02:54:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f40b00a2b80 0x7f40b00a5040 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40c0106a80 0x7f40c019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0101420 0x7f40c0197860 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 --2- 172.21.15.100:0/2357351171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40c0100a80 0x7f40c0197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 >> 172.21.15.100:0/2357351171 conn(0x7f40c00fc7a0 msgr2=0x7f40c00fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 shutdown_connections 2024-09-12T02:54:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:52.162+0000 7f40c6c73640 1 -- 172.21.15.100:0/2357351171 wait complete. 2024-09-12T02:54:52.964 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:54:53.224 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:53.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:52 smithi189 ceph-mon[35196]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 37 KiB/s wr, 10 op/s 2024-09-12T02:54:53.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:52 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2357351171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:53.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:52 smithi100 ceph-mon[31390]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 37 KiB/s wr, 10 op/s 2024-09-12T02:54:53.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:52 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2357351171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:53.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:52 smithi117 ceph-mon[34898]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 37 KiB/s wr, 10 op/s 2024-09-12T02:54:53.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:52 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2357351171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 -- 172.21.15.100:0/2791851407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100e30 msgr2=0x7f25b8104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/2791851407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100e30 0x7f25b8104e80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009900 tx=0x7f25b402a410 comp rx=0 tx=0).stop 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 -- 172.21.15.100:0/2791851407 shutdown_connections 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/2791851407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81055b0 0x7f25b810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/2791851407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100e30 0x7f25b8104e80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/2791851407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25b8100480 0x7f25b8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 -- 172.21.15.100:0/2791851407 >> 172.21.15.100:0/2791851407 conn(0x7f25b8077210 msgr2=0x7f25b80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 -- 172.21.15.100:0/2791851407 shutdown_connections 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 -- 172.21.15.100:0/2791851407 wait complete. 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.674+0000 7f25bfe9f640 1 Processor -- start 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bfe9f640 1 -- start start 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bfe9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100480 0x7f25b8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bfe9f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25b8100e30 0x7f25b8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bfe9f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81055b0 0x7f25b819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bfe9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8110700 con 0x7f25b8100480 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bfe9f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8110580 con 0x7f25b81055b0 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bfe9f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8110880 con 0x7f25b8100e30 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100480 0x7f25b8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100480 0x7f25b8198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33088/0 (socket says 172.21.15.100:33088) 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 -- 172.21.15.100:0/3998720352 learned_addr learned my addr 172.21.15.100:0/3998720352 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25be43c640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81055b0 0x7f25b819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 -- 172.21.15.100:0/3998720352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25b8100e30 msgr2=0x7f25b8198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25b8100e30 0x7f25b8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 -- 172.21.15.100:0/3998720352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81055b0 msgr2=0x7f25b819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81055b0 0x7f25b819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 -- 172.21.15.100:0/3998720352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b819d5d0 con 0x7f25b8100480 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25be43c640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81055b0 0x7f25b819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.675+0000 7f25bdc3b640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100480 0x7f25b8198620 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f25a800b4a0 tx=0x7f25a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.676+0000 7f25aeffd640 1 -- 172.21.15.100:0/3998720352 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8014070 con 0x7f25b8100480 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.676+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b819d8c0 con 0x7f25b8100480 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.676+0000 7f25aeffd640 1 -- 172.21.15.100:0/3998720352 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25a8010af0 con 0x7f25b8100480 2024-09-12T02:54:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.676+0000 7f25aeffd640 1 -- 172.21.15.100:0/3998720352 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8017d10 con 0x7f25b8100480 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.676+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b81a51a0 con 0x7f25b8100480 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.677+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b81008e0 con 0x7f25b8100480 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.678+0000 7f25aeffd640 1 -- 172.21.15.100:0/3998720352 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f25a8017070 con 0x7f25b8100480 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.678+0000 7f25aeffd640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25a40a2b80 0x7f25a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.679+0000 7f25bd43a640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25a40a2b80 0x7f25a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.679+0000 7f25aeffd640 1 -- 172.21.15.100:0/3998720352 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f25a80ce8e0 con 0x7f25b8100480 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.679+0000 7f25bd43a640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25a40a2b80 0x7f25a40a5040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25b40096c0 tx=0x7f25b4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:53.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.682+0000 7f25aeffd640 1 -- 172.21.15.100:0/3998720352 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25a809b830 con 0x7f25b8100480 2024-09-12T02:54:53.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.882+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25b8199980 con 0x7f25b8100480 2024-09-12T02:54:53.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.883+0000 7f25aeffd640 1 -- 172.21.15.100:0/3998720352 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11924 (secure 0 0 0) 0x7f25a809b130 con 0x7f25b8100480 2024-09-12T02:54:53.884 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:53.884 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"btime":"2024-09-12T02:54:29:590890+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/742594492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":742594492},{"type":"v1","addr":"172.21.15.100:6835","nonce":742594492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3109981916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3109981916},{"type":"v1","addr":"172.21.15.100:6837","nonce":3109981916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3873069130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3873069130},{"type":"v1","addr":"172.21.15.100:6839","nonce":3873069130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/612034998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":612034998},{"type":"v1","addr":"172.21.15.100:6841","nonce":612034998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/369784956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":369784956},{"type":"v1","addr":"172.21.15.117:6833","nonce":369784956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/244666903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":244666903},{"type":"v1","addr":"172.21.15.189:6833","nonce":244666903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:36:49.490181+0000","modified":"2024-09-12T02:54:29.540732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24466,"mds_2":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3724625594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3724625594},{"type":"v1","addr":"172.21.15.117:6835","nonce":3724625594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/4244197989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4244197989},{"type":"v1","addr":"172.21.15.189:6835","nonce":4244197989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6837/2625823245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2625823245},{"type":"v1","addr":"172.21.15.117:6837","nonce":2625823245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6837/2893582984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2893582984},{"type":"v1","addr":"172.21.15.189:6837","nonce":2893582984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/249791432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":249791432},{"type":"v1","addr":"172.21.15.189:6839","nonce":249791432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/801964439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":801964439},{"type":"v1","addr":"172.21.15.117:6839","nonce":801964439}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24466,24448]},"id":1}]} 2024-09-12T02:54:53.884 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 29 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25a40a2b80 msgr2=0x7f25a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25a40a2b80 0x7f25a40a5040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25b40096c0 tx=0x7f25b4000bc0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100480 msgr2=0x7f25b8198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100480 0x7f25b8198620 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f25a800b4a0 tx=0x7f25a800b960 comp rx=0 tx=0).stop 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 shutdown_connections 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f25a40a2b80 0x7f25a40a5040 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81055b0 0x7f25b819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25b8100e30 0x7f25b8198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 --2- 172.21.15.100:0/3998720352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8100480 0x7f25b8198620 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 >> 172.21.15.100:0/3998720352 conn(0x7f25b8077210 msgr2=0x7f25b80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 shutdown_connections 2024-09-12T02:54:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:53.885+0000 7f25bfe9f640 1 -- 172.21.15.100:0/3998720352 wait complete. 2024-09-12T02:54:54.257 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:53 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3998720352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:54.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:53 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3998720352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:54.295 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:53 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3998720352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:54:54.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:54:54.973 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:55.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:54 smithi100 ceph-mon[31390]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 55 KiB/s wr, 10 op/s 2024-09-12T02:54:55.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:54 smithi189 ceph-mon[35196]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 55 KiB/s wr, 10 op/s 2024-09-12T02:54:55.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:54 smithi117 ceph-mon[34898]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 55 KiB/s wr, 10 op/s 2024-09-12T02:54:55.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 -- 172.21.15.100:0/1245600094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 msgr2=0x7fb64c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 --2- 172.21.15.100:0/1245600094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c101200 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fb648009900 tx=0x7fb64802a480 comp rx=0 tx=0).stop 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 -- 172.21.15.100:0/1245600094 shutdown_connections 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 --2- 172.21.15.100:0/1245600094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64c102ef0 0x7fb64c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 --2- 172.21.15.100:0/1245600094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb64c102570 0x7fb64c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 --2- 172.21.15.100:0/1245600094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c101200 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 -- 172.21.15.100:0/1245600094 >> 172.21.15.100:0/1245600094 conn(0x7fb64c0fc7d0 msgr2=0x7fb64c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 -- 172.21.15.100:0/1245600094 shutdown_connections 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 -- 172.21.15.100:0/1245600094 wait complete. 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.617+0000 7fb653a81640 1 Processor -- start 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb653a81640 1 -- start start 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb653a81640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb653a81640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb64c102570 0x7fb64c199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb653a81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64c102ef0 0x7fb64c1a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb653a81640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c111020 con 0x7fb64c100e20 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb653a81640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c110ea0 con 0x7fb64c102ef0 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb653a81640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c1111a0 con 0x7fb64c102570 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c1994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59798/0 (socket says 172.21.15.100:59798) 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 -- 172.21.15.100:0/2332634776 learned_addr learned my addr 172.21.15.100:0/2332634776 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65101c640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb64c102570 0x7fb64c199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65201e640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64c102ef0 0x7fb64c1a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 -- 172.21.15.100:0/2332634776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb64c102570 msgr2=0x7fb64c199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb64c102570 0x7fb64c199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 -- 172.21.15.100:0/2332634776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64c102ef0 msgr2=0x7fb64c1a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64c102ef0 0x7fb64c1a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 -- 172.21.15.100:0/2332634776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c1a4ab0 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65101c640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb64c102570 0x7fb64c199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65201e640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64c102ef0 0x7fb64c1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.618+0000 7fb65181d640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c1994f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fb648006010 tx=0x7fb648003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.619+0000 7fb642ffd640 1 -- 172.21.15.100:0/2332634776 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64803f070 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.619+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c1a4c80 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.619+0000 7fb642ffd640 1 -- 172.21.15.100:0/2332634776 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb648031e30 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.619+0000 7fb642ffd640 1 -- 172.21.15.100:0/2332634776 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648035030 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.619+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c1a50d0 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.620+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c101280 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.621+0000 7fb642ffd640 1 -- 172.21.15.100:0/2332634776 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fb648042070 con 0x7fb64c100e20 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.622+0000 7fb642ffd640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6380a2b80 0x7fb6380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.622+0000 7fb65101c640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6380a2b80 0x7fb6380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.622+0000 7fb642ffd640 1 -- 172.21.15.100:0/2332634776 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb6480efa50 con 0x7fb64c100e20 2024-09-12T02:54:55.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.622+0000 7fb65101c640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6380a2b80 0x7fb6380a5040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb64c06aac0 tx=0x7fb63c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:55.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.626+0000 7fb642ffd640 1 -- 172.21.15.100:0/2332634776 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6480bc9a0 con 0x7fb64c100e20 2024-09-12T02:54:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.794+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb64c06a560 con 0x7fb64c100e20 2024-09-12T02:54:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.796+0000 7fb642ffd640 1 -- 172.21.15.100:0/2332634776 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22871 (secure 0 0 0) 0x7fb64c06a560 con 0x7fb64c100e20 2024-09-12T02:54:55.797 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:54:55.797 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"a7cd2c8a-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:29:09.444773+0000","modified":"2024-09-12T02:37:56.665591+0000","last_up_change":"2024-09-12T02:35:57.703147+0000","last_in_change":"2024-09-12T02:35:33.547949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:32:09.751769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:36:45.679784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:36:47.737140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"061ede74-c965-4987-8ac2-94b01404f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6803","nonce":1448972907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6805","nonce":1448972907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6809","nonce":1448972907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1448972907},{"type":"v1","addr":"172.21.15.100:6807","nonce":1448972907}]},"public_addr":"172.21.15.100:6803/1448972907","cluster_addr":"172.21.15.100:6805/1448972907","heartbeat_back_addr":"172.21.15.100:6809/1448972907","heartbeat_front_addr":"172.21.15.100:6807/1448972907","state":["exists","up"]},{"osd":1,"uuid":"efb6f9f2-be2b-4368-baa2-38e7cc3e27f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6801","nonce":3983495954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6803","nonce":3983495954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6807","nonce":3983495954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3983495954},{"type":"v1","addr":"172.21.15.117:6805","nonce":3983495954}]},"public_addr":"172.21.15.117:6801/3983495954","cluster_addr":"172.21.15.117:6803/3983495954","heartbeat_back_addr":"172.21.15.117:6807/3983495954","heartbeat_front_addr":"172.21.15.117:6805/3983495954","state":["exists","up"]},{"osd":2,"uuid":"489afc2d-f3a0-4497-b48d-f055beda717b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6801","nonce":2928382700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6803","nonce":2928382700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6807","nonce":2928382700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2928382700},{"type":"v1","addr":"172.21.15.189:6805","nonce":2928382700}]},"public_addr":"172.21.15.189:6801/2928382700","cluster_addr":"172.21.15.189:6803/2928382700","heartbeat_back_addr":"172.21.15.189:6807/2928382700","heartbeat_front_addr":"172.21.15.189:6805/2928382700","state":["exists","up"]},{"osd":3,"uuid":"23f116e6-4bfa-46b5-a1a6-96f999ad3e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6811","nonce":379828632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6813","nonce":379828632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6817","nonce":379828632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":379828632},{"type":"v1","addr":"172.21.15.100:6815","nonce":379828632}]},"public_addr":"172.21.15.100:6811/379828632","cluster_addr":"172.21.15.100:6813/379828632","heartbeat_back_addr":"172.21.15.100:6817/379828632","heartbeat_front_addr":"172.21.15.100:6815/379828632","state":["exists","up"]},{"osd":4,"uuid":"d3e44e9c-ef09-4279-b36c-21c6221798e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6809","nonce":3265990366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6811","nonce":3265990366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6815","nonce":3265990366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3265990366},{"type":"v1","addr":"172.21.15.117:6813","nonce":3265990366}]},"public_addr":"172.21.15.117:6809/3265990366","cluster_addr":"172.21.15.117:6811/3265990366","heartbeat_back_addr":"172.21.15.117:6815/3265990366","heartbeat_front_addr":"172.21.15.117:6813/3265990366","state":["exists","up"]},{"osd":5,"uuid":"7c5fd350-58ff-4c17-a016-49d7b9dca138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6809","nonce":2955557122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6811","nonce":2955557122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6815","nonce":2955557122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2955557122},{"type":"v1","addr":"172.21.15.189:6813","nonce":2955557122}]},"public_addr":"172.21.15.189:6809/2955557122","cluster_addr":"172.21.15.189:6811/2955557122","heartbeat_back_addr":"172.21.15.189:6815/2955557122","heartbeat_front_addr":"172.21.15.189:6813/2955557122","state":["exists","up"]},{"osd":6,"uuid":"1d1f711c-acc7-40e2-93fa-961388eb3fda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6819","nonce":4163564084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6821","nonce":4163564084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6825","nonce":4163564084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4163564084},{"type":"v1","addr":"172.21.15.100:6823","nonce":4163564084}]},"public_addr":"172.21.15.100:6819/4163564084","cluster_addr":"172.21.15.100:6821/4163564084","heartbeat_back_addr":"172.21.15.100:6825/4163564084","heartbeat_front_addr":"172.21.15.100:6823/4163564084","state":["exists","up"]},{"osd":7,"uuid":"1f867c1d-c6aa-4b5a-92b9-013474aa1c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6817","nonce":3414657732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6819","nonce":3414657732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6823","nonce":3414657732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3414657732},{"type":"v1","addr":"172.21.15.117:6821","nonce":3414657732}]},"public_addr":"172.21.15.117:6817/3414657732","cluster_addr":"172.21.15.117:6819/3414657732","heartbeat_back_addr":"172.21.15.117:6823/3414657732","heartbeat_front_addr":"172.21.15.117:6821/3414657732","state":["exists","up"]},{"osd":8,"uuid":"fa0583fc-c147-414e-8811-c43c590bd307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6817","nonce":4129547978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6819","nonce":4129547978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6823","nonce":4129547978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4129547978},{"type":"v1","addr":"172.21.15.189:6821","nonce":4129547978}]},"public_addr":"172.21.15.189:6817/4129547978","cluster_addr":"172.21.15.189:6819/4129547978","heartbeat_back_addr":"172.21.15.189:6823/4129547978","heartbeat_front_addr":"172.21.15.189:6821/4129547978","state":["exists","up"]},{"osd":9,"uuid":"770580c2-fe84-4438-87c8-f42c8ffc4f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6827","nonce":4123309490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6829","nonce":4123309490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6833","nonce":4123309490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4123309490},{"type":"v1","addr":"172.21.15.100:6831","nonce":4123309490}]},"public_addr":"172.21.15.100:6827/4123309490","cluster_addr":"172.21.15.100:6829/4123309490","heartbeat_back_addr":"172.21.15.100:6833/4123309490","heartbeat_front_addr":"172.21.15.100:6831/4123309490","state":["exists","up"]},{"osd":10,"uuid":"0c29d5aa-1979-4f2a-9e47-6a3d566dce43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6825","nonce":1425929388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6827","nonce":1425929388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6831","nonce":1425929388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1425929388},{"type":"v1","addr":"172.21.15.117:6829","nonce":1425929388}]},"public_addr":"172.21.15.117:6825/1425929388","cluster_addr":"172.21.15.117:6827/1425929388","heartbeat_back_addr":"172.21.15.117:6831/1425929388","heartbeat_front_addr":"172.21.15.117:6829/1425929388","state":["exists","up"]},{"osd":11,"uuid":"a7d1327c-e505-4aa9-b444-7d53cc8f6a03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6825","nonce":2500641850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6827","nonce":2500641850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6831","nonce":2500641850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2500641850},{"type":"v1","addr":"172.21.15.189:6829","nonce":2500641850}]},"public_addr":"172.21.15.189:6825/2500641850","cluster_addr":"172.21.15.189:6827/2500641850","heartbeat_back_addr":"172.21.15.189:6831/2500641850","heartbeat_front_addr":"172.21.15.189:6829/2500641850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:16.096836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:40.774733+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:05.861158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:31.973819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:56.686321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:21.925199+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:47.766622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:13.559704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:38.458872+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:04.316396+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:29.475823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:35:55.850503+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2890609660":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/2742281949":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/3730537393":"2024-09-13T02:29:55.443151+0000","172.21.15.100:6801/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/274092264":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6801/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3636516515":"2024-09-13T02:29:31.443245+0000","172.21.15.100:0/1503257974":"2024-09-13T02:29:31.443245+0000","172.21.15.100:6800/3548885308":"2024-09-13T02:29:55.443151+0000","172.21.15.100:0/875119703":"2024-09-13T02:29:31.443245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:54:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.798+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6380a2b80 msgr2=0x7fb6380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6380a2b80 0x7fb6380a5040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb64c06aac0 tx=0x7fb63c008040 comp rx=0 tx=0).stop 2024-09-12T02:54:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 msgr2=0x7fb64c1994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c1994f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fb648006010 tx=0x7fb648003c80 comp rx=0 tx=0).stop 2024-09-12T02:54:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 shutdown_connections 2024-09-12T02:54:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fb6380a2b80 0x7fb6380a5040 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64c102ef0 0x7fb64c1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb64c102570 0x7fb64c199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 --2- 172.21.15.100:0/2332634776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c100e20 0x7fb64c1994f0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 >> 172.21.15.100:0/2332634776 conn(0x7fb64c0fc7d0 msgr2=0x7fb64c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 shutdown_connections 2024-09-12T02:54:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:55.799+0000 7fb653a81640 1 -- 172.21.15.100:0/2332634776 wait complete. 2024-09-12T02:54:56.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:55 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/2332634776' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:54:56.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:55 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/2332634776' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:54:56.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:55 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/2332634776' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:54:56.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T02:54:56.837 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:57.214 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:56 smithi100 ceph-mon[31390]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-12T02:54:57.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:56 smithi189 ceph-mon[35196]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-12T02:54:57.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3182898245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8101de0 msgr2=0x7fbef81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:57.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3182898245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8101de0 0x7fbef81021c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009900 tx=0x7fbee802a410 comp rx=0 tx=0).stop 2024-09-12T02:54:57.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3182898245 shutdown_connections 2024-09-12T02:54:57.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3182898245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8106f10 0x7fbef810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3182898245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbef8102790 0x7fbef81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3182898245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8101de0 0x7fbef81021c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3182898245 >> 172.21.15.100:0/3182898245 conn(0x7fbef80fd8c0 msgr2=0x7fbef80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3182898245 shutdown_connections 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.294+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3182898245 wait complete. 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 Processor -- start 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 -- start start 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbef8101de0 0x7fbef81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8102790 0x7fbef8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8106f10 0x7fbef819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8112010 con 0x7fbef8106f10 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8111e90 con 0x7fbef8102790 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbefcfa3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8112190 con 0x7fbef8101de0 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8106f10 0x7fbef819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:57.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8106f10 0x7fbef819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59814/0 (socket says 172.21.15.100:59814) 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 -- 172.21.15.100:0/3565713720 learned_addr learned my addr 172.21.15.100:0/3565713720 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef659c640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbef8101de0 0x7fbef81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef5d9b640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8102790 0x7fbef8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 -- 172.21.15.100:0/3565713720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbef8101de0 msgr2=0x7fbef81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbef8101de0 0x7fbef81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 -- 172.21.15.100:0/3565713720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8102790 msgr2=0x7fbef8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8102790 0x7fbef8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.295+0000 7fbef6d9d640 1 -- 172.21.15.100:0/3565713720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef819d560 con 0x7fbef8106f10 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbef659c640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbef8101de0 0x7fbef81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbef5d9b640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8102790 0x7fbef8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbef6d9d640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8106f10 0x7fbef819ce80 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbef000b970 tx=0x7fbef000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbee77fe640 1 -- 172.21.15.100:0/3565713720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0019070 con 0x7fbef8106f10 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbee77fe640 1 -- 172.21.15.100:0/3565713720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef000cb40 con 0x7fbef8106f10 2024-09-12T02:54:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef819d850 con 0x7fbef8106f10 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbee77fe640 1 -- 172.21.15.100:0/3565713720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0007650 con 0x7fbef8106f10 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.296+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81a5130 con 0x7fbef8106f10 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.297+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef8102240 con 0x7fbef8106f10 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.298+0000 7fbee77fe640 1 -- 172.21.15.100:0/3565713720 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7fbef001c070 con 0x7fbef8106f10 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.298+0000 7fbee77fe640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbee00a2b80 0x7fbee00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.299+0000 7fbef659c640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbee00a2b80 0x7fbee00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.299+0000 7fbee77fe640 1 -- 172.21.15.100:0/3565713720 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbef00ce6f0 con 0x7fbef8106f10 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.299+0000 7fbef659c640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbee00a2b80 0x7fbee00a5040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbee8005ab0 tx=0x7fbee8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.303+0000 7fbee77fe640 1 -- 172.21.15.100:0/3565713720 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbef009b640 con 0x7fbef8106f10 2024-09-12T02:54:57.343 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:56 smithi117 ceph-mon[34898]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-12T02:54:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.505+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbef8109b60 con 0x7fbef8106f10 2024-09-12T02:54:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.507+0000 7fbee77fe640 1 -- 172.21.15.100:0/3565713720 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7fbef009af40 con 0x7fbef8106f10 2024-09-12T02:54:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbee00a2b80 msgr2=0x7fbee00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbee00a2b80 0x7fbee00a5040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbee8005ab0 tx=0x7fbee8005a20 comp rx=0 tx=0).stop 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8106f10 msgr2=0x7fbef819ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8106f10 0x7fbef819ce80 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbef000b970 tx=0x7fbef000be30 comp rx=0 tx=0).stop 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 shutdown_connections 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7fbee00a2b80 0x7fbee00a5040 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef8106f10 0x7fbef819ce80 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef8102790 0x7fbef8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 --2- 172.21.15.100:0/3565713720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbef8101de0 0x7fbef81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.509+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 >> 172.21.15.100:0/3565713720 conn(0x7fbef80fd8c0 msgr2=0x7fbef80fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.510+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 shutdown_connections 2024-09-12T02:54:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:57.510+0000 7fbefcfa3640 1 -- 172.21.15.100:0/3565713720 wait complete. 2024-09-12T02:54:57.550 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e[64687]: ignoring --setuser ceph since I am not root 2024-09-12T02:54:57.551 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h[64987]: ignoring --setuser ceph since I am not root 2024-09-12T02:54:57.551 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: ignoring --setuser ceph since I am not root 2024-09-12T02:54:57.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: ignoring --setgroup ceph since I am not root 2024-09-12T02:54:57.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mds[65302]: -- 172.21.15.117:0/2227866876 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e87905860 con 0x557e878e2800 2024-09-12T02:54:57.844 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: starting mds.b at 2024-09-12T02:54:57.844 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e[64687]: ignoring --setgroup ceph since I am not root 2024-09-12T02:54:57.845 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mds[64691]: -- 172.21.15.117:0/1807253970 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5576ba49d860 con 0x5576ba47b000 2024-09-12T02:54:57.845 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e[64687]: starting mds.e at 2024-09-12T02:54:57.845 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h[64987]: ignoring --setgroup ceph since I am not root 2024-09-12T02:54:57.845 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mds[64991]: -- 172.21.15.117:0/2556859667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562ed245d860 con 0x562ed243b000 2024-09-12T02:54:57.845 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h[64987]: starting mds.h at 2024-09-12T02:54:57.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a[31386]: 2024-09-12T02:54:57.505+0000 7f392c93d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:54:57.931 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i[65981]: ignoring --setuser ceph since I am not root 2024-09-12T02:54:57.931 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i[65981]: ignoring --setgroup ceph since I am not root 2024-09-12T02:54:57.931 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mds[65985]: -- 172.21.15.189:0/2066192409 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558444bab860 con 0x558444b88800 2024-09-12T02:54:57.931 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i[65981]: starting mds.i at 2024-09-12T02:54:57.931 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f[65382]: ignoring --setuser ceph since I am not root 2024-09-12T02:54:57.932 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f[65382]: ignoring --setgroup ceph since I am not root 2024-09-12T02:54:57.932 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mds[65386]: -- 172.21.15.189:0/1662133545 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bae63b1860 con 0x55bae638f400 2024-09-12T02:54:57.932 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f[65382]: starting mds.f at 2024-09-12T02:54:57.932 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c[65680]: ignoring --setuser ceph since I am not root 2024-09-12T02:54:57.932 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c[65680]: ignoring --setgroup ceph since I am not root 2024-09-12T02:54:57.932 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mds[65684]: -- 172.21.15.189:0/3727088362 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637a64f3c20 con 0x5637a64d1000 2024-09-12T02:54:57.932 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c[65680]: starting mds.c at 2024-09-12T02:54:58.187 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3565713720' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:54:58.187 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-mon[31390]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:54:58.187 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-mon[31390]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:54:58.187 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/3565713720' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:54:58.187 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-mon[31390]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:54:58.187 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-mon[31390]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:54:58.188 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:57 smithi100 ceph-mon[31390]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:58.217 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:54:58.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3565713720' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:54:58.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mon[35196]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:54:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mon[35196]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:54:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/3565713720' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:54:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mon[35196]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:54:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mon[35196]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:54:58.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:57 smithi189 ceph-mon[35196]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3565713720' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:54:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mon[34898]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:54:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mon[34898]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:54:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/3565713720' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:54:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mon[34898]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:54:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mon[34898]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:54:58.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:57 smithi117 ceph-mon[34898]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-09-12T02:54:58.463 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:54:58.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 -- 172.21.15.100:0/2613474366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074eb0 msgr2=0x7f2ddc112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:58.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 --2- 172.21.15.100:0/2613474366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074eb0 0x7f2ddc112650 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009900 tx=0x7f2dd802a480 comp rx=0 tx=0).stop 2024-09-12T02:54:58.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 -- 172.21.15.100:0/2613474366 shutdown_connections 2024-09-12T02:54:58.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 --2- 172.21.15.100:0/2613474366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ddc112b90 0x7f2ddc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:58.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 --2- 172.21.15.100:0/2613474366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074eb0 0x7f2ddc112650 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:58.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 --2- 172.21.15.100:0/2613474366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc074590 0x7f2ddc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 -- 172.21.15.100:0/2613474366 >> 172.21.15.100:0/2613474366 conn(0x7f2ddc0fd8c0 msgr2=0x7f2ddc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 -- 172.21.15.100:0/2613474366 shutdown_connections 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.914+0000 7f2de371a640 1 -- 172.21.15.100:0/2613474366 wait complete. 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 Processor -- start 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 -- start start 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074590 0x7f2ddc1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ddc074eb0 0x7f2ddc1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc112b90 0x7f2ddc19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc118540 con 0x7f2ddc074590 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1183c0 con 0x7f2ddc112b90 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de371a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1186c0 con 0x7f2ddc074eb0 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074590 0x7f2ddc1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:58.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074590 0x7f2ddc1a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59826/0 (socket says 172.21.15.100:59826) 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 -- 172.21.15.100:0/746183788 learned_addr learned my addr 172.21.15.100:0/746183788 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de1cb7640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc112b90 0x7f2ddc19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de0cb5640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ddc074eb0 0x7f2ddc1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 -- 172.21.15.100:0/746183788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ddc074eb0 msgr2=0x7f2ddc1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ddc074eb0 0x7f2ddc1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 -- 172.21.15.100:0/746183788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc112b90 msgr2=0x7f2ddc19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc112b90 0x7f2ddc19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 -- 172.21.15.100:0/746183788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc19efc0 con 0x7f2ddc074590 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de1cb7640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc112b90 0x7f2ddc19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.915+0000 7f2de14b6640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074590 0x7f2ddc1a46d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c920 tx=0x7f2dcc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.916+0000 7f2dd27fc640 1 -- 172.21.15.100:0/746183788 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc007c70 con 0x7f2ddc074590 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.916+0000 7f2dd27fc640 1 -- 172.21.15.100:0/746183788 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dcc007e10 con 0x7f2ddc074590 2024-09-12T02:54:58.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.916+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc19f2b0 con 0x7f2ddc074590 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.916+0000 7f2dd27fc640 1 -- 172.21.15.100:0/746183788 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc018890 con 0x7f2ddc074590 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.916+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc1ab5a0 con 0x7f2ddc074590 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.917+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc074970 con 0x7f2ddc074590 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.918+0000 7f2dd27fc640 1 -- 172.21.15.100:0/746183788 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f2dcc018a50 con 0x7f2ddc074590 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.918+0000 7f2dd27fc640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2dc80a2c00 0x7f2dc80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.919+0000 7f2de0cb5640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2dc80a2c00 0x7f2dc80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.919+0000 7f2dd27fc640 1 -- 172.21.15.100:0/746183788 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8506+0+0 (secure 0 0 0) 0x7f2dcc0cf540 con 0x7f2ddc074590 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.919+0000 7f2de0cb5640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2dc80a2c00 0x7f2dc80a50c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc1a0080 tx=0x7f2dd8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:58.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:58.922+0000 7f2dd27fc640 1 -- 172.21.15.100:0/746183788 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dcc014030 con 0x7f2ddc074590 2024-09-12T02:54:59.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.124+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2ddc02d7c0 con 0x7f2ddc074590 2024-09-12T02:54:59.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.514+0000 7f2dd27fc640 1 -- 172.21.15.100:0/746183788 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f2dcc09c4a0 con 0x7f2ddc074590 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2dc80a2c00 msgr2=0x7f2dc80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2dc80a2c00 0x7f2dc80a50c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc1a0080 tx=0x7f2dd8005a20 comp rx=0 tx=0).stop 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074590 msgr2=0x7f2ddc1a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074590 0x7f2ddc1a46d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c920 tx=0x7f2dcc00cde0 comp rx=0 tx=0).stop 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 shutdown_connections 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f2dc80a2c00 0x7f2dc80a50c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ddc112b90 0x7f2ddc19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ddc074eb0 0x7f2ddc1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 --2- 172.21.15.100:0/746183788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ddc074590 0x7f2ddc1a46d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 >> 172.21.15.100:0/746183788 conn(0x7f2ddc0fd8c0 msgr2=0x7f2ddc0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 shutdown_connections 2024-09-12T02:54:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:54:59.517+0000 7f2de371a640 1 -- 172.21.15.100:0/746183788 wait complete. 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6834/2402881684,v1:172.21.15.189:6837/2402881684] up:boot 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6835/181970691,v1:172.21.15.189:6838/181970691] up:boot 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.189:6836/1050633215,v1:172.21.15.189:6839/1050633215] up:boot 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6835/1227078561,v1:172.21.15.117:6838/1227078561] up:boot 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6834/769625690,v1:172.21.15.117:6837/769625690] up:boot 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: mds.? [v2:172.21.15.117:6836/1006308859,v1:172.21.15.117:6839/1006308859] up:boot 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:54:59.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:54:59.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:54:59.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:54:59.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:54:59.845 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:54:59 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/746183788' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6834/2402881684,v1:172.21.15.189:6837/2402881684] up:boot 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6835/181970691,v1:172.21.15.189:6838/181970691] up:boot 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.189:6836/1050633215,v1:172.21.15.189:6839/1050633215] up:boot 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6835/1227078561,v1:172.21.15.117:6838/1227078561] up:boot 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6834/769625690,v1:172.21.15.117:6837/769625690] up:boot 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: mds.? [v2:172.21.15.117:6836/1006308859,v1:172.21.15.117:6839/1006308859] up:boot 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:54:59.873 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:54:59.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:54:59.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:54:59.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:54:59 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/746183788' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:55:00.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6834/2402881684,v1:172.21.15.189:6837/2402881684] up:boot 2024-09-12T02:55:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6835/181970691,v1:172.21.15.189:6838/181970691] up:boot 2024-09-12T02:55:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.189:6836/1050633215,v1:172.21.15.189:6839/1050633215] up:boot 2024-09-12T02:55:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6835/1227078561,v1:172.21.15.117:6838/1227078561] up:boot 2024-09-12T02:55:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6834/769625690,v1:172.21.15.117:6837/769625690] up:boot 2024-09-12T02:55:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: mds.? [v2:172.21.15.117:6836/1006308859,v1:172.21.15.117:6839/1006308859] up:boot 2024-09-12T02:55:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:55:00.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:55:00.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:55:00.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:55:00.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:55:00.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:55:00.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: from='mgr.14150 172.21.15.100:0/501411212' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:55:00.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:54:59 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/746183788' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:55:00.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:55:00.593 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:55:00.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:00 smithi100 ceph-mon[31390]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:55:00.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:00 smithi100 ceph-mon[31390]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:55:00.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:00 smithi100 ceph-mon[31390]: Cluster is now healthy 2024-09-12T02:55:00.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:00 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/746183788' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:55:00.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:00 smithi100 ceph-mon[31390]: fsmap 12 up:standby 2024-09-12T02:55:00.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:00 smithi100 ceph-mon[31390]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-12T02:55:00.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:00 smithi117 ceph-mon[34898]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:55:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:00 smithi117 ceph-mon[34898]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:55:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:00 smithi117 ceph-mon[34898]: Cluster is now healthy 2024-09-12T02:55:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:00 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/746183788' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:55:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:00 smithi117 ceph-mon[34898]: fsmap 12 up:standby 2024-09-12T02:55:00.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:00 smithi117 ceph-mon[34898]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-12T02:55:01.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:00 smithi189 ceph-mon[35196]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:55:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:00 smithi189 ceph-mon[35196]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:55:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:00 smithi189 ceph-mon[35196]: Cluster is now healthy 2024-09-12T02:55:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:00 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/746183788' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:55:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:00 smithi189 ceph-mon[35196]: fsmap 12 up:standby 2024-09-12T02:55:01.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:00 smithi189 ceph-mon[35196]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-12T02:55:01.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 -- 172.21.15.100:0/3641050481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 msgr2=0x7f139c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:01.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 --2- 172.21.15.100:0/3641050481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c104e80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1384009900 tx=0x7f138402a410 comp rx=0 tx=0).stop 2024-09-12T02:55:01.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 -- 172.21.15.100:0/3641050481 shutdown_connections 2024-09-12T02:55:01.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 --2- 172.21.15.100:0/3641050481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139c1055b0 0x7f139c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 --2- 172.21.15.100:0/3641050481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c104e80 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 --2- 172.21.15.100:0/3641050481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f139c100480 0x7f139c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 -- 172.21.15.100:0/3641050481 >> 172.21.15.100:0/3641050481 conn(0x7f139c077210 msgr2=0x7f139c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.149+0000 7f13a18d0640 1 -- 172.21.15.100:0/3641050481 shutdown_connections 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 -- 172.21.15.100:0/3641050481 wait complete. 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 Processor -- start 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 -- start start 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139c100480 0x7f139c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f139c1055b0 0x7f139c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f139c110630 con 0x7f139c100e30 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1104b0 con 0x7f139c100480 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f13a18d0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1107b0 con 0x7f139c1055b0 2024-09-12T02:55:01.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f1393fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f1393fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59852/0 (socket says 172.21.15.100:59852) 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.150+0000 7f1393fff640 1 -- 172.21.15.100:0/1101073213 learned_addr learned my addr 172.21.15.100:0/1101073213 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f1393fff640 1 -- 172.21.15.100:0/1101073213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f139c1055b0 msgr2=0x7f139c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f139affd640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139c100480 0x7f139c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f1393fff640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f139c1055b0 0x7f139c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f1393fff640 1 -- 172.21.15.100:0/1101073213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139c100480 msgr2=0x7f139c198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f1393fff640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139c100480 0x7f139c198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f1393fff640 1 -- 172.21.15.100:0/1101073213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c19d540 con 0x7f139c100e30 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f1393fff640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c198ad0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1384005ab0 tx=0x7f13840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f13a08ce640 1 -- 172.21.15.100:0/1101073213 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138403f030 con 0x7f139c100e30 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c19d7d0 con 0x7f139c100e30 2024-09-12T02:55:01.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f13a08ce640 1 -- 172.21.15.100:0/1101073213 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1384003ce0 con 0x7f139c100e30 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f13a08ce640 1 -- 172.21.15.100:0/1101073213 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384035070 con 0x7f139c100e30 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.151+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c1a5110 con 0x7f139c100e30 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.152+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f139c100860 con 0x7f139c100e30 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.153+0000 7f13a08ce640 1 -- 172.21.15.100:0/1101073213 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f1384042030 con 0x7f139c100e30 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.154+0000 7f13a08ce640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13880a2b80 0x7f13880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.154+0000 7f139affd640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13880a2b80 0x7f13880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.154+0000 7f13a08ce640 1 -- 172.21.15.100:0/1101073213 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8506+0+0 (secure 0 0 0) 0x7f13840efaf0 con 0x7f139c100e30 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.154+0000 7f139affd640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13880a2b80 0x7f13880a5040 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f138c00a810 tx=0x7f138c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.158+0000 7f13a08ce640 1 -- 172.21.15.100:0/1101073213 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13840bc940 con 0x7f139c100e30 2024-09-12T02:55:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.326+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f139c10a7a0 con 0x7f139c100e30 2024-09-12T02:55:01.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.533+0000 7f13a08ce640 1 -- 172.21.15.100:0/1101073213 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7f13840bc240 con 0x7f139c100e30 2024-09-12T02:55:01.535 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13880a2b80 msgr2=0x7f13880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13880a2b80 0x7f13880a5040 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f138c00a810 tx=0x7f138c008040 comp rx=0 tx=0).stop 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 msgr2=0x7f139c198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c198ad0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1384005ab0 tx=0x7f13840042f0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 shutdown_connections 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f13880a2b80 0x7f13880a5040 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f139c1055b0 0x7f139c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c100e30 0x7f139c198ad0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 --2- 172.21.15.100:0/1101073213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139c100480 0x7f139c198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.535+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 >> 172.21.15.100:0/1101073213 conn(0x7f139c077210 msgr2=0x7f139c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:01.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.536+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 shutdown_connections 2024-09-12T02:55:01.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:01.536+0000 7f13a18d0640 1 -- 172.21.15.100:0/1101073213 wait complete. 2024-09-12T02:55:01.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:01 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1101073213' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:55:01.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:01 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1101073213' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:55:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:01 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1101073213' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:55:02.228 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:55:02.473 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:55:02.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:02 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1101073213' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:55:02.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:02 smithi117 ceph-mon[34898]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:55:02.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:02 smithi117 ceph-mon[34898]: pgmap v829: 65 pgs: 65 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:55:02.852 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:02 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1101073213' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:55:02.853 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:02 smithi100 ceph-mon[31390]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:55:02.853 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:02 smithi100 ceph-mon[31390]: pgmap v829: 65 pgs: 65 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:55:02.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 -- 172.21.15.100:0/4053572179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2200100ca0 msgr2=0x7f2200106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:02.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 --2- 172.21.15.100:0/4053572179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2200100ca0 0x7f2200106840 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009930 tx=0x7f21fc02a420 comp rx=0 tx=0).stop 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 -- 172.21.15.100:0/4053572179 shutdown_connections 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 --2- 172.21.15.100:0/4053572179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2200106f50 0x7f220010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 --2- 172.21.15.100:0/4053572179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2200100ca0 0x7f2200106840 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 --2- 172.21.15.100:0/4053572179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22001002f0 0x7f22001006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 -- 172.21.15.100:0/4053572179 >> 172.21.15.100:0/4053572179 conn(0x7f2200077210 msgr2=0x7f22000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 -- 172.21.15.100:0/4053572179 shutdown_connections 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.935+0000 7f2208092640 1 -- 172.21.15.100:0/4053572179 wait complete. 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 Processor -- start 2024-09-12T02:55:02.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 -- start start 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22001002f0 0x7f2200101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2200100ca0 0x7f22001017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2200106f50 0x7f2200101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2200112060 con 0x7f22001002f0 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2200111ee0 con 0x7f2200106f50 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2208092640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f22001121e0 con 0x7f2200100ca0 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22001002f0 0x7f2200101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:02.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22001002f0 0x7f2200101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59876/0 (socket says 172.21.15.100:59876) 2024-09-12T02:55:02.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 -- 172.21.15.100:0/1561835761 learned_addr learned my addr 172.21.15.100:0/1561835761 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:55:02.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f220562d640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2200100ca0 0x7f22001017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:02.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f220662f640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2200106f50 0x7f2200101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:02.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 -- 172.21.15.100:0/1561835761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2200100ca0 msgr2=0x7f22001017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:02.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2200100ca0 0x7f22001017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:02.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 -- 172.21.15.100:0/1561835761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2200106f50 msgr2=0x7f2200101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:02.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2200106f50 0x7f2200101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 -- 172.21.15.100:0/1561835761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22001a6ae0 con 0x7f22001002f0 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f220562d640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2200100ca0 0x7f22001017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.936+0000 7f2205e2e640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22001002f0 0x7f2200101270 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b4a0 tx=0x7f21f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.937+0000 7f21f2ffd640 1 -- 172.21.15.100:0/1561835761 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4014070 con 0x7f22001002f0 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.937+0000 7f21f2ffd640 1 -- 172.21.15.100:0/1561835761 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f4010af0 con 0x7f22001002f0 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.937+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22001a6dd0 con 0x7f22001002f0 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.937+0000 7f21f2ffd640 1 -- 172.21.15.100:0/1561835761 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4017d10 con 0x7f22001002f0 2024-09-12T02:55:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.937+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22001a7280 con 0x7f22001002f0 2024-09-12T02:55:02.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.938+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2200100750 con 0x7f22001002f0 2024-09-12T02:55:02.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.939+0000 7f21f2ffd640 1 -- 172.21.15.100:0/1561835761 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) ==== 137834+0+0 (secure 0 0 0) 0x7f21f4017070 con 0x7f22001002f0 2024-09-12T02:55:02.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.940+0000 7f21f2ffd640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f21ec0a2c00 0x7f21ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:02.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.940+0000 7f220562d640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f21ec0a2c00 0x7f21ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:02.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.940+0000 7f21f2ffd640 1 -- 172.21.15.100:0/1561835761 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7952+0+0 (secure 0 0 0) 0x7f21f40ce250 con 0x7f22001002f0 2024-09-12T02:55:02.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.940+0000 7f220562d640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f21ec0a2c00 0x7f21ec0a50c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f21fc006010 tx=0x7f21fc0314b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:02.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:02.944+0000 7f21f2ffd640 1 -- 172.21.15.100:0/1561835761 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21f409b320 con 0x7f22001002f0 2024-09-12T02:55:03.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:02 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1101073213' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:55:03.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:02 smithi189 ceph-mon[35196]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:55:03.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:02 smithi189 ceph-mon[35196]: pgmap v829: 65 pgs: 65 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:55:03.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.110+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2200109bb0 con 0x7f22001002f0 2024-09-12T02:55:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.547+0000 7f21f2ffd640 1 -- 172.21.15.100:0/1561835761 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7f21f40850d0 con 0x7f22001002f0 2024-09-12T02:55:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-09-12T02:55:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.550+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f21ec0a2c00 msgr2=0x7f21ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.550+0000 7f2208092640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f21ec0a2c00 0x7f21ec0a50c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f21fc006010 tx=0x7f21fc0314b0 comp rx=0 tx=0).stop 2024-09-12T02:55:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.550+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22001002f0 msgr2=0x7f2200101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.550+0000 7f2208092640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22001002f0 0x7f2200101270 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b4a0 tx=0x7f21f400b960 comp rx=0 tx=0).stop 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.553+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 shutdown_connections 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.553+0000 7f2208092640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:6800/2819887168,v1:172.21.15.100:6801/2819887168] conn(0x7f21ec0a2c00 0x7f21ec0a50c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.553+0000 7f2208092640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2200106f50 0x7f2200101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.553+0000 7f2208092640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2200100ca0 0x7f22001017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.553+0000 7f2208092640 1 --2- 172.21.15.100:0/1561835761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22001002f0 0x7f2200101270 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.553+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 >> 172.21.15.100:0/1561835761 conn(0x7f2200077210 msgr2=0x7f2200105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.554+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 shutdown_connections 2024-09-12T02:55:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:55:03.554+0000 7f2208092640 1 -- 172.21.15.100:0/1561835761 wait complete. 2024-09-12T02:55:03.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:03 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1561835761' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:55:03.871 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:03 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1561835761' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:55:04.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:03 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1561835761' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:55:04.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:55:04.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:55:04.295 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:55:04.323 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T02:55:04.323 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:55:04.339 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:55:04.355 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:55:04.379 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T02:55:04.379 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T02:55:04.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:55:04.556 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:04 smithi100 systemd[1]: Stopping Ceph mon.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:04.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:04 smithi189 ceph-mon[35196]: from='client.? 172.21.15.100:0/1561835761' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:55:04.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:04 smithi189 ceph-mon[35196]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:55:04.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:04 smithi189 ceph-mon[35196]: pgmap v831: 1 pgs: 1 active+clean; 577 KiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:55:04.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:04 smithi100 ceph-mon[31390]: from='client.? 172.21.15.100:0/1561835761' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:55:04.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:04 smithi100 ceph-mon[31390]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:55:04.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:04 smithi100 ceph-mon[31390]: pgmap v831: 1 pgs: 1 active+clean; 577 KiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:55:04.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a[31386]: 2024-09-12T02:55:04.745+0000 7f3932148640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:04.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a[31386]: 2024-09-12T02:55:04.745+0000 7f3932148640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T02:55:04.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:04 smithi100 podman[116498]: 2024-09-12 02:55:04.788403826 +0000 UTC m=+0.181245721 container died 91e9c64e6d8312893d876e758495a6cd94fe0ff382fb42454697ddb137b5b8a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T02:55:04.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:04 smithi117 ceph-mon[34898]: from='client.? 172.21.15.100:0/1561835761' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:55:04.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:04 smithi117 ceph-mon[34898]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:55:04.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:04 smithi117 ceph-mon[34898]: pgmap v831: 1 pgs: 1 active+clean; 577 KiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:55:05.464 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:05 smithi100 podman[116498]: 2024-09-12 02:55:05.162759047 +0000 UTC m=+0.555600928 container cleanup 91e9c64e6d8312893d876e758495a6cd94fe0ff382fb42454697ddb137b5b8a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T02:55:05.465 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:55:05 smithi100 bash[116498]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:55:05.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T02:55:05.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:05.645 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T02:55:05.645 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T02:55:05.645 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.b 2024-09-12T02:55:05.955 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:05 smithi117 systemd[1]: Stopping Ceph mon.b for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:06.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-b[34894]: 2024-09-12T02:55:05.954+0000 7f1b246ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:06.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-b[34894]: 2024-09-12T02:55:05.954+0000 7f1b246ff640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:55:06.344 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:06 smithi117 podman[70511]: 2024-09-12 02:55:06.046960773 +0000 UTC m=+0.216992860 container died ffbbb2359a9e7d87d69c088a8abb632eee4b4ce8d4cddd8ab61fca795d1da3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:55:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:06 smithi117 podman[70511]: 2024-09-12 02:55:06.488259816 +0000 UTC m=+0.658291902 container cleanup ffbbb2359a9e7d87d69c088a8abb632eee4b4ce8d4cddd8ab61fca795d1da3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:55:06.844 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:06 smithi117 bash[70511]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-b 2024-09-12T02:55:07.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T02:55:07.193 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:06 smithi117 podman[70523]: 2024-09-12 02:55:06.940348444 +0000 UTC m=+0.892725264 container remove ffbbb2359a9e7d87d69c088a8abb632eee4b4ce8d4cddd8ab61fca795d1da3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:55:07.193 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:07 smithi117 systemd[1]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-12T02:55:07.193 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:07 smithi117 systemd[1]: Stopped Ceph mon.b for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:55:07.193 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:55:07 smithi117 systemd[1]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.b.service: Consumed 13.195s CPU time. 2024-09-12T02:55:07.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:07.220 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T02:55:07.220 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T02:55:07.220 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.c 2024-09-12T02:55:07.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:07 smithi189 systemd[1]: Stopping Ceph mon.c for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:08.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c[35192]: 2024-09-12T02:55:07.610+0000 7fc5bd8a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:08.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c[35192]: 2024-09-12T02:55:07.610+0000 7fc5bd8a3640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:55:08.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:07 smithi189 podman[70867]: 2024-09-12 02:55:07.805293026 +0000 UTC m=+0.381625410 container died 59e872dd50d83bb0ebfb604f9a47b54052bf3025ea1fef7d41d4ad08d2bb641d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:55:08.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:08 smithi189 podman[70867]: 2024-09-12 02:55:08.203899984 +0000 UTC m=+0.780232366 container cleanup 59e872dd50d83bb0ebfb604f9a47b54052bf3025ea1fef7d41d4ad08d2bb641d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:55:08.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:55:08 smithi189 bash[70867]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mon-c 2024-09-12T02:55:08.627 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T02:55:08.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:08.669 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T02:55:08.669 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T02:55:08.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:55:08.985 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:55:08 smithi100 systemd[1]: Stopping Ceph mgr.x for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:09.311 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:55:08 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:55:08.983+0000 7fe63455d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:09.312 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:55:08 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x[31618]: 2024-09-12T02:55:08.983+0000 7fe63455d640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-12T02:55:09.312 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:55:09 smithi100 podman[116618]: 2024-09-12 02:55:09.015131544 +0000 UTC m=+0.150631756 container died 4b275610bea7b23887e03520d7ef12fe9656bc174a720f280cba16481366b3de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:55:09.621 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:55:09 smithi100 podman[116618]: 2024-09-12 02:55:09.418646778 +0000 UTC m=+0.554146985 container cleanup 4b275610bea7b23887e03520d7ef12fe9656bc174a720f280cba16481366b3de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T02:55:09.621 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:55:09 smithi100 bash[116618]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-x 2024-09-12T02:55:09.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T02:55:09.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:09.819 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T02:55:09.819 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T02:55:09.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.y 2024-09-12T02:55:10.344 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:55:09 smithi117 systemd[1]: Stopping Ceph mgr.y for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:10.844 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:55:10 smithi117 podman[70633]: 2024-09-12 02:55:10.500120787 +0000 UTC m=+0.479042779 container died b77a863990c8bcc7db5486ef4bf81260f1aad9395a471d92db1e487b7f504ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:55:11.263 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:55:11 smithi117 podman[70633]: 2024-09-12 02:55:11.002582541 +0000 UTC m=+0.981504521 container cleanup b77a863990c8bcc7db5486ef4bf81260f1aad9395a471d92db1e487b7f504ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:55:11.263 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:55:11 smithi117 bash[70633]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-y 2024-09-12T02:55:11.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T02:55:11.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:11.473 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T02:55:11.473 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T02:55:11.473 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.z 2024-09-12T02:55:11.763 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:55:11 smithi189 systemd[1]: Stopping Ceph mgr.z for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:12.513 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:55:12 smithi189 podman[70988]: 2024-09-12 02:55:12.06336245 +0000 UTC m=+0.385017310 container died 4b00d1651fc960f5781c9f8f46164aaa8b8a65adb2daec5e14070bc17ed1f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T02:55:13.120 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:55:12 smithi189 podman[70988]: 2024-09-12 02:55:12.818768375 +0000 UTC m=+1.140423241 container cleanup 4b00d1651fc960f5781c9f8f46164aaa8b8a65adb2daec5e14070bc17ed1f7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:55:13.120 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:55:12 smithi189 bash[70988]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mgr-z 2024-09-12T02:55:13.249 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T02:55:13.283 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:13.284 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T02:55:13.284 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T02:55:13.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.0 2024-09-12T02:55:13.621 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:13 smithi100 systemd[1]: Stopping Ceph osd.0 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:14.121 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0[45347]: 2024-09-12T02:55:13.739+0000 7ff7f11a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:14.122 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0[45347]: 2024-09-12T02:55:13.739+0000 7ff7f11a5640 -1 osd.0 87 *** Got signal Terminated *** 2024-09-12T02:55:14.122 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0[45347]: 2024-09-12T02:55:13.739+0000 7ff7f11a5640 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:55:19.609 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:19 smithi100 podman[116741]: 2024-09-12 02:55:19.285046794 +0000 UTC m=+5.811177384 container died 98953d050a290a95bee2cc75b7ff78ed0a00f44a2c9db9ba2dc262706462943a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:55:19.871 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:19 smithi100 podman[116741]: 2024-09-12 02:55:19.707770268 +0000 UTC m=+6.233900856 container cleanup 98953d050a290a95bee2cc75b7ff78ed0a00f44a2c9db9ba2dc262706462943a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T02:55:19.872 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:19 smithi100 bash[116741]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0 2024-09-12T02:55:20.370 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:19 smithi100 podman[116758]: 2024-09-12 02:55:19.959550843 +0000 UTC m=+0.668975958 container remove 98953d050a290a95bee2cc75b7ff78ed0a00f44a2c9db9ba2dc262706462943a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T02:55:20.621 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:20 smithi100 podman[116847]: 2024-09-12 02:55:20.273086565 +0000 UTC m=+0.015811911 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:55:20.622 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:20 smithi100 podman[116847]: 2024-09-12 02:55:20.385300343 +0000 UTC m=+0.128025687 container create 364d17c6dae41fd51aca500ae29a8d1928af3961fbf8295c2a05ebf26f2e970c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T02:55:20.622 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:20 smithi100 podman[116847]: 2024-09-12 02:55:20.605000808 +0000 UTC m=+0.347726151 container init 364d17c6dae41fd51aca500ae29a8d1928af3961fbf8295c2a05ebf26f2e970c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:55:20.622 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:20 smithi100 podman[116847]: 2024-09-12 02:55:20.608968223 +0000 UTC m=+0.351693574 container start 364d17c6dae41fd51aca500ae29a8d1928af3961fbf8295c2a05ebf26f2e970c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T02:55:21.121 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:20 smithi100 podman[116847]: 2024-09-12 02:55:20.713458403 +0000 UTC m=+0.456183753 container attach 364d17c6dae41fd51aca500ae29a8d1928af3961fbf8295c2a05ebf26f2e970c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:55:21.122 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:55:20 smithi100 podman[116847]: 2024-09-12 02:55:20.807891629 +0000 UTC m=+0.550616981 container died 364d17c6dae41fd51aca500ae29a8d1928af3961fbf8295c2a05ebf26f2e970c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T02:55:21.516 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T02:55:21.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:21.557 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T02:55:21.557 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T02:55:21.557 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.1 2024-09-12T02:55:21.844 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:21 smithi117 systemd[1]: Stopping Ceph osd.1 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:22.343 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1[39231]: 2024-09-12T02:55:21.880+0000 7f1184a82640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:22.344 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1[39231]: 2024-09-12T02:55:21.880+0000 7f1184a82640 -1 osd.1 87 *** Got signal Terminated *** 2024-09-12T02:55:22.344 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1[39231]: 2024-09-12T02:55:21.880+0000 7f1184a82640 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:55:27.641 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:27 smithi117 podman[70773]: 2024-09-12 02:55:27.344491316 +0000 UTC m=+5.600506017 container died f8ca2aa2f555d6220ddde50db2e442fbbc588619cf49fe37aa0cb80867416d9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:55:27.999 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:27 smithi117 podman[70773]: 2024-09-12 02:55:27.739356431 +0000 UTC m=+5.995371132 container cleanup f8ca2aa2f555d6220ddde50db2e442fbbc588619cf49fe37aa0cb80867416d9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T02:55:27.999 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:27 smithi117 bash[70773]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1 2024-09-12T02:55:28.343 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:27 smithi117 podman[70790]: 2024-09-12 02:55:27.99913636 +0000 UTC m=+0.654816877 container remove f8ca2aa2f555d6220ddde50db2e442fbbc588619cf49fe37aa0cb80867416d9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T02:55:28.670 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:28 smithi117 podman[70875]: 2024-09-12 02:55:28.260360348 +0000 UTC m=+0.016250662 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:55:28.670 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:28 smithi117 podman[70875]: 2024-09-12 02:55:28.391631746 +0000 UTC m=+0.147522083 container create d6f391e652d3899abb4fb117b724fef7c7d085565f8eb5b19637f5f0a1fb216d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:55:28.670 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:28 smithi117 podman[70875]: 2024-09-12 02:55:28.6699154 +0000 UTC m=+0.425805707 container init d6f391e652d3899abb4fb117b724fef7c7d085565f8eb5b19637f5f0a1fb216d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:55:29.094 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:28 smithi117 podman[70875]: 2024-09-12 02:55:28.673742964 +0000 UTC m=+0.429633269 container start d6f391e652d3899abb4fb117b724fef7c7d085565f8eb5b19637f5f0a1fb216d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T02:55:29.094 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:28 smithi117 podman[70875]: 2024-09-12 02:55:28.769801857 +0000 UTC m=+0.525692170 container attach d6f391e652d3899abb4fb117b724fef7c7d085565f8eb5b19637f5f0a1fb216d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T02:55:29.094 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:55:28 smithi117 podman[70875]: 2024-09-12 02:55:28.871596978 +0000 UTC m=+0.627487274 container died d6f391e652d3899abb4fb117b724fef7c7d085565f8eb5b19637f5f0a1fb216d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:55:29.523 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T02:55:29.563 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:29.564 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T02:55:29.564 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T02:55:29.564 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.2 2024-09-12T02:55:29.891 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:29 smithi189 systemd[1]: Stopping Ceph osd.2 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:30.263 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2[40043]: 2024-09-12T02:55:29.890+0000 7fb79f3bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:30.263 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2[40043]: 2024-09-12T02:55:29.890+0000 7fb79f3bf640 -1 osd.2 87 *** Got signal Terminated *** 2024-09-12T02:55:30.263 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2[40043]: 2024-09-12T02:55:29.890+0000 7fb79f3bf640 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:55:35.764 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:35 smithi189 podman[71128]: 2024-09-12 02:55:35.46255465 +0000 UTC m=+5.702576356 container died 685c2125f634c1319641075f3054ffa4ccbc2177031154d623ad36f37c40ef69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T02:55:36.084 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:35 smithi189 podman[71128]: 2024-09-12 02:55:35.882801216 +0000 UTC m=+6.122822922 container cleanup 685c2125f634c1319641075f3054ffa4ccbc2177031154d623ad36f37c40ef69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:55:36.084 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:35 smithi189 bash[71128]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2 2024-09-12T02:55:36.501 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:36 smithi189 podman[71144]: 2024-09-12 02:55:36.084181115 +0000 UTC m=+0.618362189 container remove 685c2125f634c1319641075f3054ffa4ccbc2177031154d623ad36f37c40ef69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:55:36.763 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:36 smithi189 podman[71232]: 2024-09-12 02:55:36.403757721 +0000 UTC m=+0.015711690 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:55:36.763 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:36 smithi189 podman[71232]: 2024-09-12 02:55:36.518433076 +0000 UTC m=+0.130387028 container create e1c53a2070c116a21b49aee8bc4e89435a7e95418eb1a9acc94134cd31106c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T02:55:37.264 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:36 smithi189 podman[71232]: 2024-09-12 02:55:36.779585167 +0000 UTC m=+0.391539120 container init e1c53a2070c116a21b49aee8bc4e89435a7e95418eb1a9acc94134cd31106c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:55:37.264 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:36 smithi189 podman[71232]: 2024-09-12 02:55:36.783105466 +0000 UTC m=+0.395059414 container start e1c53a2070c116a21b49aee8bc4e89435a7e95418eb1a9acc94134cd31106c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T02:55:37.264 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:36 smithi189 podman[71232]: 2024-09-12 02:55:36.879677358 +0000 UTC m=+0.491631307 container attach e1c53a2070c116a21b49aee8bc4e89435a7e95418eb1a9acc94134cd31106c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:55:37.264 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:55:36 smithi189 podman[71232]: 2024-09-12 02:55:36.980991035 +0000 UTC m=+0.592944995 container died e1c53a2070c116a21b49aee8bc4e89435a7e95418eb1a9acc94134cd31106c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:55:37.673 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T02:55:37.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:37.715 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T02:55:37.715 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T02:55:37.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.3 2024-09-12T02:55:38.078 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:37 smithi100 systemd[1]: Stopping Ceph osd.3 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:38.371 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:38 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:55:38.077+0000 7fb3d5c4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:38.372 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:38 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:55:38.077+0000 7fb3d5c4d640 -1 osd.3 87 *** Got signal Terminated *** 2024-09-12T02:55:38.372 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:38 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:55:38.077+0000 7fb3d5c4d640 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:55:40.621 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:40 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:55:40.324+0000 7fb3d2263640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.733333+0000 front 2024-09-12T02:55:18.733519+0000 (oldest deadline 2024-09-12T02:55:39.833312+0000) 2024-09-12T02:55:41.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:40 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:40.816+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:41.780 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:41 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:55:41.371+0000 7fb3d2263640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.733333+0000 front 2024-09-12T02:55:18.733519+0000 (oldest deadline 2024-09-12T02:55:39.833312+0000) 2024-09-12T02:55:42.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:41 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:41.779+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:42.621 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:42 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3[51774]: 2024-09-12T02:55:42.322+0000 7fb3d2263640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.733333+0000 front 2024-09-12T02:55:18.733519+0000 (oldest deadline 2024-09-12T02:55:39.833312+0000) 2024-09-12T02:55:43.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:42 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:42.811+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:43.343 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:43 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:43.035+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:43.871 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:43 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:43.783+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:43.872 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:43 smithi100 podman[116962]: 2024-09-12 02:55:43.602131055 +0000 UTC m=+5.692970786 container died 224b2e96ac24b6a2ebb487316930622846191165b6a46e680737694570d19dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:55:44.032 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:43.772+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:44.314 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:44 smithi100 podman[116962]: 2024-09-12 02:55:44.129122065 +0000 UTC m=+6.219961777 container cleanup 224b2e96ac24b6a2ebb487316930622846191165b6a46e680737694570d19dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T02:55:44.315 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:44 smithi100 bash[116962]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3 2024-09-12T02:55:44.343 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:44 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:44.063+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:44.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:44 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:44.031+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:44.638 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:44 smithi100 podman[116976]: 2024-09-12 02:55:44.314159184 +0000 UTC m=+0.711904859 container remove 224b2e96ac24b6a2ebb487316930622846191165b6a46e680737694570d19dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T02:55:44.991 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:44 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:44.735+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:45.009 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:44 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:44.798+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:45.010 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:44 smithi100 podman[117065]: 2024-09-12 02:55:44.608754066 +0000 UTC m=+0.015568880 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:55:45.010 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:44 smithi100 podman[117065]: 2024-09-12 02:55:44.731847497 +0000 UTC m=+0.138662303 container create 6068ee0be1625467596714d35f90acaceaab68668f78a54b947df36e81b29a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T02:55:45.010 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:44 smithi100 podman[117065]: 2024-09-12 02:55:44.942869477 +0000 UTC m=+0.349684291 container init 6068ee0be1625467596714d35f90acaceaab68668f78a54b947df36e81b29a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:55:45.010 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:44 smithi100 podman[117065]: 2024-09-12 02:55:44.946088127 +0000 UTC m=+0.352902941 container start 6068ee0be1625467596714d35f90acaceaab68668f78a54b947df36e81b29a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:55:45.010 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:45 smithi100 podman[117065]: 2024-09-12 02:55:45.009472157 +0000 UTC m=+0.416286976 container attach 6068ee0be1625467596714d35f90acaceaab68668f78a54b947df36e81b29a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:55:45.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:44 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:44.990+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:45.343 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:45 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:45.034+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:45.371 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:55:45 smithi100 podman[117065]: 2024-09-12 02:55:45.139586762 +0000 UTC m=+0.546401568 container died 6068ee0be1625467596714d35f90acaceaab68668f78a54b947df36e81b29a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T02:55:45.830 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:45 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:45.638+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:45.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T02:55:45.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:45.924 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T02:55:45.925 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T02:55:45.925 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.4 2024-09-12T02:55:46.124 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:45 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:45.829+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:46.250 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:45 smithi117 systemd[1]: Stopping Ceph osd.4 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:46.251 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:46 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:46.037+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:46.263 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:45.771+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:46.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:45.995+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:46.593 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:46 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:55:46.250+0000 7fa0e4ee8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:46.593 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:46 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:55:46.250+0000 7fa0e4ee8640 -1 osd.4 87 *** Got signal Terminated *** 2024-09-12T02:55:46.594 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:46 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:55:46.250+0000 7fa0e4ee8640 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:55:46.871 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:46 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:46.619+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:46.871 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:46 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:46.822+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:47.263 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:46.798+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:46.947+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:47.343 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:47 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:47.007+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:48.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:47 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:47.667+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:48.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:47 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:47.780+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:48.263 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:47.818+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:48.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:47.921+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:48.343 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:48 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:48.047+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:49.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:48 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:48.681+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:49.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:48 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:48.772+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:49.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:48 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:48.772+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:49.263 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:48 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:48.861+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:49.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:48 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:48.881+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:49.343 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:49 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:49.085+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:50.013 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:49 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:49.816+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:50.017 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:49 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:49.661+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:50.017 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:49 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:49.876+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:50.017 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:49 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:49.876+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:50.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:49 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:49.651+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:50.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:49 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:49.771+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:50.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:49 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:49.771+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:50.343 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:49 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:55:49.981+0000 7fa0e14fe640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:22.330778+0000 front 2024-09-12T02:55:22.330806+0000 (oldest deadline 2024-09-12T02:55:49.931494+0000) 2024-09-12T02:55:50.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:50 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:50.130+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:51.013 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:50 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:50.770+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:51.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:50 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:50.662+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:51.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:50 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:50.840+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:51.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:50 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:50.840+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:51.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:50.694+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:51.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:50.791+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:51.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:50.791+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:51.343 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:51 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4[46136]: 2024-09-12T02:55:51.028+0000 7fa0e14fe640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:22.330778+0000 front 2024-09-12T02:55:22.330806+0000 (oldest deadline 2024-09-12T02:55:49.931494+0000) 2024-09-12T02:55:51.344 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:51 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:51.240+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:51.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:51 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:51.086+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:51.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:51 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:51.086+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:52.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:51 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:51.709+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:52.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:51 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:51.820+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:52.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:51 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:51.820+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:52.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:51 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:51.774+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:52.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:51 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:51.774+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:52.080 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:51 smithi117 podman[70978]: 2024-09-12 02:55:51.823837579 +0000 UTC m=+5.703649776 container died ca487f2a4577ef3d75290c3948d3b111570a8125457378329dea3141535cdfef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T02:55:52.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:51.779+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:52.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:51.779+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:52.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:51.695+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:52.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:51 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:51.695+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:52.344 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:52 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:52.195+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:52.344 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:52 smithi117 podman[70978]: 2024-09-12 02:55:52.233585857 +0000 UTC m=+6.113398053 container cleanup ca487f2a4577ef3d75290c3948d3b111570a8125457378329dea3141535cdfef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:55:52.344 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:52 smithi117 bash[70978]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4 2024-09-12T02:55:52.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:52 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:52.079+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:52.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:52 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:52.079+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:52.843 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:52 smithi117 podman[71005]: 2024-09-12 02:55:52.459797102 +0000 UTC m=+0.636578476 container remove ca487f2a4577ef3d75290c3948d3b111570a8125457378329dea3141535cdfef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-12T02:55:53.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:52.670+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:53.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:52.787+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:53.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:52.787+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:53.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:52.823+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:53.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:52 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:52.823+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:53.023 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:52 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:52.681+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:53.023 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:52 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:52.681+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:53.023 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:52 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:52.780+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:53.023 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:52 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:52.780+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:53.108 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:52 smithi117 podman[71095]: 2024-09-12 02:55:52.758394612 +0000 UTC m=+0.016321713 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:55:53.108 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:52 smithi117 podman[71095]: 2024-09-12 02:55:52.86054522 +0000 UTC m=+0.118472310 container create 1786d153b0093ff464d5c13a364b73f21562003fad73f99683e90c723a75db92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:55:53.108 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:53 smithi117 podman[71095]: 2024-09-12 02:55:53.104880273 +0000 UTC m=+0.362807372 container init 1786d153b0093ff464d5c13a364b73f21562003fad73f99683e90c723a75db92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:55:53.108 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:53 smithi117 podman[71095]: 2024-09-12 02:55:53.10821439 +0000 UTC m=+0.366141478 container start 1786d153b0093ff464d5c13a364b73f21562003fad73f99683e90c723a75db92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:55:53.594 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:53 smithi117 podman[71095]: 2024-09-12 02:55:53.213454517 +0000 UTC m=+0.471381604 container attach 1786d153b0093ff464d5c13a364b73f21562003fad73f99683e90c723a75db92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:55:53.594 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:55:53 smithi117 podman[71095]: 2024-09-12 02:55:53.296851053 +0000 UTC m=+0.554778145 container died 1786d153b0093ff464d5c13a364b73f21562003fad73f99683e90c723a75db92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:55:53.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:53 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:53.155+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:53.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:53 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:53.125+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:53.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:53 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:53.125+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:54.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:53.753+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:54.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:53.753+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:54.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:53.632+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:54.015 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:53.830+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:54.015 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:53 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:53.830+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:54.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T02:55:54.057 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:55:54.057 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T02:55:54.057 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T02:55:54.058 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.5 2024-09-12T02:55:54.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:53.766+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:54.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:53.766+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:54.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:53.669+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:54.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:53.669+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:54.343 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:54.131+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:54.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:54.153+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:54.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:54 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:54.153+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:54.354 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:54 smithi189 systemd[1]: Stopping Ceph osd.5 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:55:54.613 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:54.353+0000 7efd51501640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:55:54.613 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:54.353+0000 7efd51501640 -1 osd.5 87 *** Got signal Terminated *** 2024-09-12T02:55:54.613 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:54.353+0000 7efd51501640 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:55:55.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:54.612+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:55.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:54.718+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:55.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:54.718+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:55.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:54.814+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:55.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:54 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:54.814+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:55.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:54.644+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:55.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:54.644+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:55.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:54.753+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:55.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:54 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:54.753+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:55.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:55.173+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:55.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:55.173+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:55.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:55 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:55.165+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:56.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:55.611+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:56.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:55.705+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:56.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:55.705+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:56.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:55.792+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:56.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:55 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:55.792+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:56.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:55 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:55.758+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:56.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:55 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:55.758+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:56.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:55 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:55.687+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:56.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:55 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:55.687+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:56.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:56 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:56.125+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:56.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:56 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:56.125+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:56.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:56 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:56.179+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:57.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:56.651+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:57.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:56.743+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:57.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:56.743+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:57.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:56.684+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:57.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:56.684+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:57.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:56 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:56.684+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:31.184135+0000 front 2024-09-12T02:55:31.184182+0000 (oldest deadline 2024-09-12T02:55:56.484193+0000) 2024-09-12T02:55:57.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:56.661+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:57.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:56.661+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:57.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:56.768+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:57.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:56.768+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:57.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:56 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:56.768+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:55:57.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:57.173+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:57.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:57.109+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:57.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:57 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:57.109+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:58.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:57.702+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:58.016 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:57.744+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:58.016 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:57.744+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:58.016 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:57.722+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:58.017 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:57.722+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:58.017 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:57 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:57.722+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:31.184135+0000 front 2024-09-12T02:55:31.184182+0000 (oldest deadline 2024-09-12T02:55:56.484193+0000) 2024-09-12T02:55:58.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:57 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:57.699+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:58.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:57 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:57.699+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:58.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:57 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:57.784+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:58.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:57 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:57.784+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:58.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:57 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:57.784+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:55:58.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:58.128+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:58.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:58.128+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:58.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:58.197+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:58.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:58 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:58.197+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:55:59.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:58.698+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:55:59.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:58.698+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:55:59.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:58.695+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:17.281606+0000 front 2024-09-12T02:55:17.281453+0000 (oldest deadline 2024-09-12T02:55:43.181527+0000) 2024-09-12T02:55:59.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:58.695+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:26.583086+0000 front 2024-09-12T02:55:26.583178+0000 (oldest deadline 2024-09-12T02:55:51.183785+0000) 2024-09-12T02:55:59.014 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5[46937]: 2024-09-12T02:55:58.695+0000 7efd4db17640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:31.184135+0000 front 2024-09-12T02:55:31.184182+0000 (oldest deadline 2024-09-12T02:55:56.484193+0000) 2024-09-12T02:55:59.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:58.773+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:55:59.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:58.773+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:55:59.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:58 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:58.773+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:55:59.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:58.808+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:55:59.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:58.808+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:55:59.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:58.808+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:55:59.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:58.744+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:55:59.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:58.744+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:55:59.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:58.744+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:55:59.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:59.161+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:55:59.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:59.161+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:55:59.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:55:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:55:59.161+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:55:59.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:59.202+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:55:59.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:55:59 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:55:59.202+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:00.013 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:55:59 smithi189 podman[71347]: 2024-09-12 02:55:59.783875468 +0000 UTC m=+5.531264926 container died 597338e4ee810e2cc45da17463d0b837dddc9534f28aa43e362c8628c25d0e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:56:00.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:59 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:59.664+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:00.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:55:59 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:55:59.664+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:00.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:59 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:59.790+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:00.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:59 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:59.790+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:00.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:55:59 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:55:59.790+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:00.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:59 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:59.833+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:00.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:59 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:59.833+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:00.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:55:59 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:55:59.833+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:00.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:59 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:59.725+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:00.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:59 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:59.725+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:00.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:55:59 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:55:59.725+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:00.343 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:00 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:00.160+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:00.344 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:00 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:00.160+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:00.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:00 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:00.193+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:00.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:00 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:00.193+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:00.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:00 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:00.193+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:00.405 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:00 smithi189 podman[71347]: 2024-09-12 02:56:00.212689686 +0000 UTC m=+5.960079134 container cleanup 597338e4ee810e2cc45da17463d0b837dddc9534f28aa43e362c8628c25d0e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:56:00.406 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:00 smithi189 bash[71347]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5 2024-09-12T02:56:00.763 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:00 smithi189 podman[71364]: 2024-09-12 02:56:00.40570789 +0000 UTC m=+0.612625480 container remove 597338e4ee810e2cc45da17463d0b837dddc9534f28aa43e362c8628c25d0e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T02:56:00.764 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:00 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:00.636+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:00.764 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:00 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:00.636+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:01.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:00 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:00.843+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:01.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:00 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:00.843+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:01.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:00 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:00.843+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:01.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:00 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:00.703+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:01.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:00 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:00.703+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:01.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:00 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:00.703+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:01.126 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:00 smithi189 podman[71449]: 2024-09-12 02:56:00.73319634 +0000 UTC m=+0.016014600 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:56:01.126 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:00 smithi189 podman[71449]: 2024-09-12 02:56:00.873385631 +0000 UTC m=+0.156203888 container create 9eca02c0d3baa8abe5e201b6da7f4ccd1c61675ecb5fe9cca2b7d2c76d35b78b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:56:01.126 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:00 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:00.795+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:01.126 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:00 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:00.795+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:01.126 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:00 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:00.795+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:01.514 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:01 smithi189 podman[71449]: 2024-09-12 02:56:01.125901953 +0000 UTC m=+0.408720215 container init 9eca02c0d3baa8abe5e201b6da7f4ccd1c61675ecb5fe9cca2b7d2c76d35b78b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:56:01.514 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:01 smithi189 podman[71449]: 2024-09-12 02:56:01.129362494 +0000 UTC m=+0.412180754 container start 9eca02c0d3baa8abe5e201b6da7f4ccd1c61675ecb5fe9cca2b7d2c76d35b78b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:56:01.514 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:01 smithi189 podman[71449]: 2024-09-12 02:56:01.217657657 +0000 UTC m=+0.500475926 container attach 9eca02c0d3baa8abe5e201b6da7f4ccd1c61675ecb5fe9cca2b7d2c76d35b78b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:56:01.514 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:56:01 smithi189 podman[71449]: 2024-09-12 02:56:01.316505983 +0000 UTC m=+0.599324246 container died 9eca02c0d3baa8abe5e201b6da7f4ccd1c61675ecb5fe9cca2b7d2c76d35b78b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:56:01.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:01 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:01.186+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:01.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:01 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:01.186+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:01.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:01 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:01.190+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:01.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:01 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:01.190+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:01.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:01 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:01.190+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:01.971 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:01 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:01.682+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:01.972 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:01 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:01.682+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:01.972 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:01 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:01.817+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:01.972 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:01 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:01.817+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:01.972 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:01 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:01.817+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:02.001 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T02:56:02.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:02.042 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T02:56:02.042 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T02:56:02.042 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.6 2024-09-12T02:56:02.070 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:01 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:01.868+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:02.070 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:01 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:01.868+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:02.070 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:01 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:01.868+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:02.070 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:01 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:01.705+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:02.071 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:01 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:01.705+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:02.071 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:01 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:01.705+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:02.371 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:02 smithi100 systemd[1]: Stopping Ceph osd.6 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:02.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:02 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:02.207+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:02.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:02 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:02.207+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:02.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:02 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:02.147+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:02.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:02 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:02.147+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:02.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:02 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:02.147+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:02.842 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:02.747+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:02.842 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:02.747+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:02.842 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:02.747+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:02.843 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:02.499+0000 7f1b069a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:02.843 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:02.499+0000 7f1b069a8640 -1 osd.6 87 *** Got signal Terminated *** 2024-09-12T02:56:02.843 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:02.499+0000 7f1b069a8640 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:56:02.843 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:02.842+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:02.843 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:02.842+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:02.843 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:02 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:02.842+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:03.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:02 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:02.642+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:03.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:02 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:02.642+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:03.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:02 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:02.847+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:03.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:02 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:02.847+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:03.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:02 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:02.847+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:03.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:03 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:03.222+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:03.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:03 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:03.222+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:03.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:03 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:03.121+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:03.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:03 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:03.121+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:03.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:03 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:03.121+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:04.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:03 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:03.690+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:04.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:03 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:03.690+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:04.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:03 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:03.874+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:04.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:03 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:03.874+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:04.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:03 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:03.874+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:04.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:03.882+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:04.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:03.882+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:04.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:03.882+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:04.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:03.777+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:04.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:03.777+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:04.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:03.777+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:04.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:03.777+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:04.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:04 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:04.222+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:04.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:04 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:04.222+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:04.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:04 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:04.222+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:04.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:04 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:04.135+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:04.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:04 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:04.135+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:04.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:04 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:04.135+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:05.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:04 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:04.650+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:05.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:04 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:04.650+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:05.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:04 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:04.892+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:05.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:04 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:04.892+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:05.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:04 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:04.892+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:05.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:04.864+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:05.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:04.864+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:05.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:04.864+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:05.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:04.749+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:05.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:04.749+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:05.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:04.749+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:05.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:04 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:04.749+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:05.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:05.237+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:05.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:05.237+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:05.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:05.237+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:05.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:05.115+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:05.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:05.115+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:05.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:05 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:05.115+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:05.934 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:05 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:05.636+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:05.934 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:05 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:05.636+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:05.934 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:05 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:05.636+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:06.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:05.914+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:06.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:05.914+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:06.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:05.914+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:06.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:05.914+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:41.809676+0000 front 2024-09-12T02:55:41.809617+0000 (oldest deadline 2024-09-12T02:56:05.909568+0000) 2024-09-12T02:56:06.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:05.711+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:06.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:05.711+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:06.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:05.711+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:06.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:05 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:05.711+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:06.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:05 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:05.933+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:06.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:05 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:05.933+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:06.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:05 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:05.933+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:06.343 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:06.282+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:06.344 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:06.282+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:06.344 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:06.282+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:06.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:06.082+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:06.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:06.082+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:06.344 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:06.082+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:06.945 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:06.651+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:06.945 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:06.651+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:06.945 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:06.651+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:07.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:06.960+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:13.904672+0000 front 2024-09-12T02:55:13.904751+0000 (oldest deadline 2024-09-12T02:55:39.804684+0000) 2024-09-12T02:56:07.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:06.960+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.705908+0000 front 2024-09-12T02:55:25.706053+0000 (oldest deadline 2024-09-12T02:55:48.605990+0000) 2024-09-12T02:56:07.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:06.960+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.308142+0000 front 2024-09-12T02:55:34.308071+0000 (oldest deadline 2024-09-12T02:55:56.508688+0000) 2024-09-12T02:56:07.122 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6[58520]: 2024-09-12T02:56:06.960+0000 7f1b02fbe640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:41.809676+0000 front 2024-09-12T02:55:41.809617+0000 (oldest deadline 2024-09-12T02:56:05.909568+0000) 2024-09-12T02:56:07.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:06.736+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:07.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:06.736+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:07.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:06.736+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:07.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:06 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:06.736+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:07.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:06.945+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:07.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:06.945+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:07.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:06 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:06.945+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:07.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:07 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:07.235+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:07.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:07 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:07.235+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:07.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:07 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:07.235+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:07.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:07 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:07.103+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:07.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:07 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:07.103+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:07.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:07 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:07.103+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:07.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:07 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:07.103+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:07.917 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:07.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:07.917 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:07.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:07.918 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:07.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:08.121 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:07 smithi100 podman[117167]: 2024-09-12 02:56:07.919785225 +0000 UTC m=+5.682277843 container died 88429e38fd121516a22c64b24c5ec64fbdaef64077dc27f30d9a8804f2a59ec9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T02:56:08.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:07 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:07.721+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:08.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:07 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:07.721+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:08.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:07 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:07.721+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:08.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:07 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:07.721+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:08.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:07.916+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:08.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:07.916+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:08.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:07 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:07.916+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:08.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:08 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:08.186+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:08.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:08 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:08.186+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:08.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:08 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:08.186+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:08.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:08 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:08.099+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:08.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:08 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:08.099+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:08.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:08 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:08.099+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:08.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:08 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:08.099+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:08.621 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:08 smithi100 podman[117167]: 2024-09-12 02:56:08.42469139 +0000 UTC m=+6.187184005 container cleanup 88429e38fd121516a22c64b24c5ec64fbdaef64077dc27f30d9a8804f2a59ec9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:56:08.621 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:08 smithi100 bash[117167]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6 2024-09-12T02:56:08.962 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:08 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:08.650+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:08.962 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:08 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:08.650+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:08.962 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:08 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:08.650+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:09.091 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:08 smithi100 podman[117181]: 2024-09-12 02:56:08.659329489 +0000 UTC m=+0.742837711 container remove 88429e38fd121516a22c64b24c5ec64fbdaef64077dc27f30d9a8804f2a59ec9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:56:09.092 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:08 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:08.738+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:09.092 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:08 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:08.738+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:09.092 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:08 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:08.738+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:09.092 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:08 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:08.738+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:09.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:08 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:08.961+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:09.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:08 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:08.961+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:09.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:08 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:08.961+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:09.371 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:09 smithi100 podman[117266]: 2024-09-12 02:56:08.994148289 +0000 UTC m=+0.015631393 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:56:09.371 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:09 smithi100 podman[117266]: 2024-09-12 02:56:09.110331833 +0000 UTC m=+0.131814992 container create 27a2c2be329e75222320b023fe325dcf6121a450dcc91a9b49d46c4b64cfb3fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T02:56:09.372 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:09 smithi100 podman[117266]: 2024-09-12 02:56:09.337907566 +0000 UTC m=+0.359390659 container init 27a2c2be329e75222320b023fe325dcf6121a450dcc91a9b49d46c4b64cfb3fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T02:56:09.372 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:09 smithi100 podman[117266]: 2024-09-12 02:56:09.341172216 +0000 UTC m=+0.362655314 container start 27a2c2be329e75222320b023fe325dcf6121a450dcc91a9b49d46c4b64cfb3fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:56:09.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:09 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:09.144+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:09.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:09 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:09.144+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:09.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:09 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:09.144+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:09.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:09 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:09.147+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:09.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:09 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:09.147+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:09.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:09 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:09.147+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:09.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:09 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:09.147+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:09.763 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:09 smithi100 podman[117266]: 2024-09-12 02:56:09.438229189 +0000 UTC m=+0.459712282 container attach 27a2c2be329e75222320b023fe325dcf6121a450dcc91a9b49d46c4b64cfb3fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:56:09.763 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:56:09 smithi100 podman[117266]: 2024-09-12 02:56:09.539566621 +0000 UTC m=+0.561049714 container died 27a2c2be329e75222320b023fe325dcf6121a450dcc91a9b49d46c4b64cfb3fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:56:09.962 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:09 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:09.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:09.962 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:09 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:09.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:09.963 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:09 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:09.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:10.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:09 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:09.762+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:10.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:09 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:09.762+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:10.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:09 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:09.762+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:10.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:09 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:09.762+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:10.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:09 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:09.962+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:10.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:09 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:09.962+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:10.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:09 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:09.962+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:10.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T02:56:10.410 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:10.410 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T02:56:10.411 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T02:56:10.411 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.7 2024-09-12T02:56:10.438 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:10.180+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:10.438 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:10.180+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:10.438 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:10.180+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:10.438 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:10.194+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:10.438 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:10.194+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:10.438 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:10.194+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:10.438 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:10.194+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:10.719 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:10 smithi117 systemd[1]: Stopping Ceph osd.7 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:11.008 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:10 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:10.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:11.008 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:10 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:10.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:11.008 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:10 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:10.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:11.097 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:10.717+0000 7fcd8a1a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:11.097 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:10.717+0000 7fcd8a1a7640 -1 osd.7 87 *** Got signal Terminated *** 2024-09-12T02:56:11.097 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:10.717+0000 7fcd8a1a7640 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:56:11.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:10 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:10.755+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:11.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:10 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:10.755+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:11.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:10 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:10.755+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:11.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:10 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:10.755+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:11.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:11 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:11.008+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:11.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:11 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:11.008+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:11.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:11 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:11.008+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:11.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:11 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:11.208+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:11.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:11 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:11.208+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:11.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:11 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:11.208+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:11.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:11 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:11.228+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:11.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:11 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:11.228+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:11.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:11 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:11.228+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:11.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:11 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:11.228+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:12.011 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:11 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:11.663+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:12.012 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:11 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:11.663+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:12.012 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:11 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:11.663+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:12.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:11 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:11.741+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:12.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:11 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:11.741+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:12.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:11 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:11.741+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:12.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:11 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:11.741+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:12.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:12.011+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:12.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:12.011+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:12.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:12.011+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:12.593 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:12.215+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:12.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:12.215+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:12.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:12.215+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:12.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:12.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:12.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:12.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:12.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:12.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:12.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:12 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:12.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:12.963 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:12.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:12.963 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:12.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:12.963 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:12.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:12.964 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:12.637+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:13.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:12 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:12.789+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:13.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:12 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:12.789+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:13.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:12 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:12.789+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:13.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:12 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:12.789+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:13.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:12.963+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:13.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:12.963+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:13.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:12 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:12.963+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:13.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:13.231+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:13.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:13.231+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:13.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:13.231+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:13.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:13.231+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:46.750277+0000 front 2024-09-12T02:55:46.750309+0000 (oldest deadline 2024-09-12T02:56:12.650390+0000) 2024-09-12T02:56:13.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:13.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:13.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:13.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:13.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:13.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:13.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:13 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:13.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:14.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:13.683+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:14.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:13.683+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:14.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:13.683+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:14.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:13.683+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:14.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:13.933+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:14.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:13.933+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:14.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:13.933+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:14.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:13 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:13.933+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:14.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:13.798+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:14.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:13.798+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:14.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:13.798+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:14.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:13.798+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:14.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:13 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:13.798+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:14.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:14.238+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:14.238+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:14.238+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:14.238+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:14.238+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:14.277+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:14.277+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:14.277+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:14.594 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:14.277+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:46.750277+0000 front 2024-09-12T02:55:46.750309+0000 (oldest deadline 2024-09-12T02:56:12.650390+0000) 2024-09-12T02:56:15.013 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:14.961+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:15.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:14.961+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:15.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:14.961+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:15.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:14.961+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:15.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:14.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:15.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:14.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:15.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:14.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:15.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:14 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:14.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:15.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:14 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:14.821+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:15.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:14 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:14.821+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:15.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:14 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:14.821+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:15.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:14 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:14.821+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:15.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:14 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:14.821+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:15.596 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:15.313+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:24.646832+0000 front 2024-09-12T02:55:24.647095+0000 (oldest deadline 2024-09-12T02:55:50.546995+0000) 2024-09-12T02:56:15.596 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:15.313+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.948428+0000 front 2024-09-12T02:55:33.948449+0000 (oldest deadline 2024-09-12T02:55:58.048567+0000) 2024-09-12T02:56:15.596 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:15.313+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:40.349532+0000 front 2024-09-12T02:55:40.349569+0000 (oldest deadline 2024-09-12T02:56:03.849420+0000) 2024-09-12T02:56:15.596 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7[53081]: 2024-09-12T02:56:15.313+0000 7fcd867bd640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:46.750277+0000 front 2024-09-12T02:55:46.750309+0000 (oldest deadline 2024-09-12T02:56:12.650390+0000) 2024-09-12T02:56:15.597 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:15.241+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:15.597 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:15.241+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:15.597 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:15.241+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:15.597 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:15.241+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:15.597 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:15 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:15.241+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:16.013 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:15.969+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:16.013 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:15.969+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:16.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:15.969+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:16.014 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:15.969+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:16.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:15.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:16.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:15.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:16.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:15.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:16.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:15 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:15.729+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:16.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:15 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:15.806+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:16.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:15 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:15.806+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:16.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:15 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:15.806+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:16.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:15 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:15.806+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:16.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:15 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:15.806+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:16.485 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:16 smithi117 podman[71196]: 2024-09-12 02:56:16.20237141 +0000 UTC m=+5.589780101 container died 89fa73d4695f969e4822a878b60ae4dfaa9cc1e16eddec49b12376a80c40f5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:56:16.486 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:16 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:16.210+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:16.486 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:16 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:16.210+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:16.486 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:16 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:16.210+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:16.486 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:16 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:16.210+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:16.486 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:16 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:16.210+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:16.827 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:16 smithi117 podman[71196]: 2024-09-12 02:56:16.592819948 +0000 UTC m=+5.980228641 container cleanup 89fa73d4695f969e4822a878b60ae4dfaa9cc1e16eddec49b12376a80c40f5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:56:16.827 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:16 smithi117 bash[71196]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7 2024-09-12T02:56:17.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:16 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:16.679+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:17.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:16 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:16.679+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:17.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:16 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:16.679+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:17.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:16 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:16.679+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:17.093 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:16 smithi117 podman[71211]: 2024-09-12 02:56:16.827552882 +0000 UTC m=+0.623469472 container remove 89fa73d4695f969e4822a878b60ae4dfaa9cc1e16eddec49b12376a80c40f5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:56:17.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:16.830+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:17.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:16.830+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:17.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:16.830+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:17.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:16.830+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:17.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:16 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:16.830+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:17.422 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:17 smithi117 podman[71297]: 2024-09-12 02:56:17.05625725 +0000 UTC m=+0.016294212 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:56:17.422 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:17 smithi117 podman[71297]: 2024-09-12 02:56:17.186607672 +0000 UTC m=+0.146644641 container create 4655a8b7fc0c077dc2629fcd874ef86cfdd5b4bd20411512ba80a2df57800e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T02:56:17.422 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:17 smithi117 podman[71297]: 2024-09-12 02:56:17.422421982 +0000 UTC m=+0.382458944 container init 4655a8b7fc0c077dc2629fcd874ef86cfdd5b4bd20411512ba80a2df57800e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:56:17.423 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:17 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:17.220+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:17.423 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:17 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:17.220+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:17.423 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:17 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:17.220+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:17.423 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:17 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:17.220+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:17.423 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:17 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:17.220+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:17.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:17.017+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:17.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:17.017+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:17.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:17.017+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:17.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:17.017+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:17.844 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:17 smithi117 podman[71297]: 2024-09-12 02:56:17.425776794 +0000 UTC m=+0.385813759 container start 4655a8b7fc0c077dc2629fcd874ef86cfdd5b4bd20411512ba80a2df57800e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T02:56:17.844 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:17 smithi117 podman[71297]: 2024-09-12 02:56:17.522454082 +0000 UTC m=+0.482491045 container attach 4655a8b7fc0c077dc2629fcd874ef86cfdd5b4bd20411512ba80a2df57800e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:56:17.844 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:56:17 smithi117 podman[71297]: 2024-09-12 02:56:17.619024325 +0000 UTC m=+0.579061287 container died 4655a8b7fc0c077dc2629fcd874ef86cfdd5b4bd20411512ba80a2df57800e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T02:56:18.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:17.633+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:18.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:17.633+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:18.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:17.633+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:18.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:17 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:17.633+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:18.254 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T02:56:18.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:18.333 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T02:56:18.333 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T02:56:18.333 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.8 2024-09-12T02:56:18.362 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:18.052+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:18.362 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:18.052+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:18.362 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:18.052+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:18.362 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:18.052+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:18.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:17.873+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:18.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:17.873+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:18.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:17.873+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:18.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:17.873+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:18.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:17 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:17.873+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:18.506 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:18 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:18.235+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:18.506 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:18 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:18.235+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:18.506 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:18 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:18.235+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:18.506 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:18 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:18.235+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:18.506 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:18 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:18.235+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:18.619 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 systemd[1]: Stopping Ceph osd.8 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:19.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:18.619+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:19.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:18.619+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:19.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:18.619+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:19.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:18.619+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:19.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:18.649+0000 7f9d1c092640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:19.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:18.649+0000 7f9d1c092640 -1 osd.8 87 *** Got signal Terminated *** 2024-09-12T02:56:19.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:18 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:18.649+0000 7f9d1c092640 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:56:19.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:18 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:18.892+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:19.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:18 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:18.892+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:19.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:18 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:18.892+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:19.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:18 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:18.892+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:19.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:18 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:18.892+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:19.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:19.066+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:19.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:19.066+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:19.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:19.066+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:19.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:19.066+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:19.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:19 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:19.245+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:19.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:19 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:19.245+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:19.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:19 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:19.245+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:19.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:19 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:19.245+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:19.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:19 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:19.245+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:20.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:19.607+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:20.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:19.607+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:20.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:19.607+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:20.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:19 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:19.607+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:20.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:19.864+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:20.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:19.864+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:20.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:19.864+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:20.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:19.864+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:20.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:19 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:19.864+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:20.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:20.068+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:20.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:20.068+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:20.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:20.068+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:20.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:20.068+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:20.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:20 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:20.276+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:20.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:20 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:20.276+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:20.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:20 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:20.276+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:20.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:20 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:20.276+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:20.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:20 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:20.276+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:20.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:20 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:20.276+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:21.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:20.574+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:21.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:20.574+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:21.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:20.574+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:21.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:20.574+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:21.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:20 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:20.574+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.664525+0000 front 2024-09-12T02:55:56.664553+0000 (oldest deadline 2024-09-12T02:56:20.164680+0000) 2024-09-12T02:56:21.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:20.904+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:21.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:20.904+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:21.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:20.904+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:21.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:20.904+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:21.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:20.904+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:21.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:20 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:20.904+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:21.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:21.089+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:21.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:21.089+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:21.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:21.089+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:21.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:21.089+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:21.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:21.270+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:21.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:21.270+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:21.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:21.270+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:21.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:21.270+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:21.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:21.270+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:21.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:21 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:21.270+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:22.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:21.596+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:22.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:21.596+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:22.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:21.596+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:22.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:21.596+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:22.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:21 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:21.596+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.664525+0000 front 2024-09-12T02:55:56.664553+0000 (oldest deadline 2024-09-12T02:56:20.164680+0000) 2024-09-12T02:56:22.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:21 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:21.954+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:22.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:21 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:21.954+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:22.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:21 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:21.954+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:22.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:21 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:21.954+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:22.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:21 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:21.954+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:22.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:21 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:21.954+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:22.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:22.101+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:22.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:22.101+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:22.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:22.101+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:22.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:22.101+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:22.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:22 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:22.263+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:22.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:22 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:22.263+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:22.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:22 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:22.263+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:22.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:22 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:22.263+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:22.595 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:22 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:22.263+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:22.596 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:22 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:22.263+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:23.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:22.563+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:23.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:22.563+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:23.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:22.563+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:23.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:22.563+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:23.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:22 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:22.563+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.664525+0000 front 2024-09-12T02:55:56.664553+0000 (oldest deadline 2024-09-12T02:56:20.164680+0000) 2024-09-12T02:56:23.273 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:22 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:22.985+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:23.273 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:22 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:22.985+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:23.273 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:22 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:22.985+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:23.273 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:22 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:22.985+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:23.273 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:22 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:22.985+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:23.273 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:22 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:22.985+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:23.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:23.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:23.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:23.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:23.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:23.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:23.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:23.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:23.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:23.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:23.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:23 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:23.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:23.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:23 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:23.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:23.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:23 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:23.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:23.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:23 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:23.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:23.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:23 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:23.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:23.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:23 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:23.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:24.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:23.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.959336+0000 front 2024-09-12T02:55:25.959321+0000 (oldest deadline 2024-09-12T02:55:49.459371+0000) 2024-09-12T02:56:24.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:23.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.361226+0000 front 2024-09-12T02:55:33.361185+0000 (oldest deadline 2024-09-12T02:55:58.661293+0000) 2024-09-12T02:56:24.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:23.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.162415+0000 front 2024-09-12T02:55:42.162330+0000 (oldest deadline 2024-09-12T02:56:05.062093+0000) 2024-09-12T02:56:24.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:23.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.063775+0000 front 2024-09-12T02:55:49.063904+0000 (oldest deadline 2024-09-12T02:56:12.563678+0000) 2024-09-12T02:56:24.014 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8[53854]: 2024-09-12T02:56:23.602+0000 7f9d146a0640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.664525+0000 front 2024-09-12T02:55:56.664553+0000 (oldest deadline 2024-09-12T02:56:20.164680+0000) 2024-09-12T02:56:24.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.013+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:24.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.013+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:24.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.013+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:24.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.013+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:24.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.013+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:24.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.013+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:24.514 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:24 smithi189 podman[71564]: 2024-09-12 02:56:24.230398479 +0000 UTC m=+5.701924982 container died fe274858f6d6a68cd470cc2a277a3115f0ee2ffb93496807c60b9cd1167fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T02:56:24.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:24 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:24.140+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:24.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:24 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:24.140+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:24.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:24 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:24.140+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:24.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:24 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:24.140+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:24.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:24 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:24.140+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:24.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:24 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:24.273+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:24.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:24 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:24.273+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:24.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:24 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:24.273+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:24.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:24 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:24.273+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:24.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:24 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:24.273+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:24.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:24 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:24.273+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:24.917 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:24 smithi189 podman[71564]: 2024-09-12 02:56:24.624489953 +0000 UTC m=+6.096016449 container cleanup fe274858f6d6a68cd470cc2a277a3115f0ee2ffb93496807c60b9cd1167fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:56:24.917 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:24 smithi189 bash[71564]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8 2024-09-12T02:56:25.172 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:24 smithi189 podman[71582]: 2024-09-12 02:56:24.917452265 +0000 UTC m=+0.686273559 container remove fe274858f6d6a68cd470cc2a277a3115f0ee2ffb93496807c60b9cd1167fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:56:25.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.973+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:25.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.973+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:25.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.973+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:25.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.973+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:25.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.973+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:25.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:24 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:24.973+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:25.438 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:25 smithi189 podman[71671]: 2024-09-12 02:56:25.149331309 +0000 UTC m=+0.015725293 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:56:25.438 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:25 smithi189 podman[71671]: 2024-09-12 02:56:25.285956738 +0000 UTC m=+0.152350722 container create a95efe3374bf2ca322e7a616a78385cb9bae6b6f48e0017a1629446a09733c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-12T02:56:25.438 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:25 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:25.171+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:25.438 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:25 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:25.171+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:25.439 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:25 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:25.171+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:25.439 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:25 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:25.171+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:25.439 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:25 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:25.171+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:25.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:25 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:25.268+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:25.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:25 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:25.268+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:25.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:25 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:25.268+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:25.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:25 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:25.268+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:25.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:25 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:25.268+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:25.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:25 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:25.268+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:25.739 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:25 smithi189 podman[71671]: 2024-09-12 02:56:25.546570046 +0000 UTC m=+0.412964031 container init a95efe3374bf2ca322e7a616a78385cb9bae6b6f48e0017a1629446a09733c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T02:56:25.739 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:25 smithi189 podman[71671]: 2024-09-12 02:56:25.549831236 +0000 UTC m=+0.416225221 container start a95efe3374bf2ca322e7a616a78385cb9bae6b6f48e0017a1629446a09733c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T02:56:25.739 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:25 smithi189 podman[71671]: 2024-09-12 02:56:25.646573599 +0000 UTC m=+0.512967586 container attach a95efe3374bf2ca322e7a616a78385cb9bae6b6f48e0017a1629446a09733c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:56:26.013 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:56:25 smithi189 podman[71671]: 2024-09-12 02:56:25.739502793 +0000 UTC m=+0.605896785 container died a95efe3374bf2ca322e7a616a78385cb9bae6b6f48e0017a1629446a09733c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:56:26.350 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:26 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:26.177+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:26.350 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:26 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:26.177+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:26.350 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:26 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:26.177+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:26.351 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:26 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:26.177+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:26.351 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:26 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:26.177+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:26.371 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T02:56:26.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:25 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:25.998+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:26.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:25 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:25.998+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:26.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:25 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:25.998+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:26.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:25 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:25.998+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:26.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:25 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:25.998+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:26.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:25 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:25.998+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:26.452 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:26.452 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T02:56:26.452 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T02:56:26.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.9 2024-09-12T02:56:26.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:26 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:26.232+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:26.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:26 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:26.232+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:26.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:26 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:26.232+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:26.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:26 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:26.232+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:26.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:26 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:26.232+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:26.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:26 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:26.232+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:26.753 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 systemd[1]: Stopping Ceph osd.9 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:26.753 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.751+0000 7f1f103c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:27.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.751+0000 7f1f103c9640 -1 osd.9 87 *** Got signal Terminated *** 2024-09-12T02:56:27.121 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.751+0000 7f1f103c9640 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:56:27.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.978+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:27.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.978+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:27.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.978+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:27.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.978+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:27.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.978+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:27.122 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:26 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:26.978+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:27.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:27 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:27.147+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:27.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:27 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:27.147+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:27.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:27 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:27.147+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:27.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:27 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:27.147+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:27.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:27 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:27.147+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:27.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:27 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:27.281+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:27.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:27 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:27.281+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:27.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:27 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:27.281+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:27.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:27 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:27.281+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:27.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:27 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:27.281+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:27.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:27 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:27.281+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:28.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:28.023+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:28.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:28.023+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:28.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:28.023+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:28.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:28.023+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:28.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:28.023+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:28.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:28 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:28.023+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:28.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:28 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:28.132+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:28.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:28 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:28.132+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:28.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:28 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:28.132+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:28.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:28 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:28.132+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:28.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:28 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:28.132+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:28.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:28.293+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:28.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:28.293+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:28.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:28.293+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:28.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:28.293+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:28.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:28.293+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:28.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:28 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:28.293+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:29.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:29.050+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:29.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:29.050+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:29.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:29.050+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:29.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:29.050+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:29.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:29.050+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:29.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:29 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:29.050+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:29.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:29.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:29.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:29.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:29.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:29.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:29.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:29.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:29.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:29 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:29.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:29.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:29 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:29.277+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:29.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:29 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:29.277+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:29.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:29 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:29.277+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:29.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:29 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:29.277+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:29.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:29 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:29.277+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:29.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:29 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:29.277+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:30.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.024+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:30.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.024+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:30.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.024+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:30.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.024+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:30.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.024+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:30.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.024+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:30.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.024+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:05.949790+0000 front 2024-09-12T02:56:05.949820+0000 (oldest deadline 2024-09-12T02:56:29.350296+0000) 2024-09-12T02:56:30.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:30.114+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:30.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:30.114+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:30.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:30.114+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:30.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:30.114+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:30.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:30.114+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:30.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:30.249+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:30.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:30.249+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:30.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:30.249+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:30.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:30.249+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:30.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:30.249+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:30.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:30 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:30.249+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:31.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.994+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.042831+0000 front 2024-09-12T02:55:18.042937+0000 (oldest deadline 2024-09-12T02:55:45.043671+0000) 2024-09-12T02:56:31.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.994+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.544929+0000 front 2024-09-12T02:55:25.545127+0000 (oldest deadline 2024-09-12T02:55:50.844864+0000) 2024-09-12T02:56:31.371 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.994+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:30.845379+0000 front 2024-09-12T02:55:30.845460+0000 (oldest deadline 2024-09-12T02:55:58.445972+0000) 2024-09-12T02:56:31.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.994+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.546932+0000 front 2024-09-12T02:55:42.546845+0000 (oldest deadline 2024-09-12T02:56:03.646941+0000) 2024-09-12T02:56:31.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.994+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:48.347880+0000 front 2024-09-12T02:55:48.348003+0000 (oldest deadline 2024-09-12T02:56:13.647839+0000) 2024-09-12T02:56:31.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.994+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:56.549101+0000 front 2024-09-12T02:55:56.549078+0000 (oldest deadline 2024-09-12T02:56:20.648960+0000) 2024-09-12T02:56:31.372 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:30 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9[65352]: 2024-09-12T02:56:30.994+0000 7f1f089d7640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:05.949790+0000 front 2024-09-12T02:56:05.949820+0000 (oldest deadline 2024-09-12T02:56:29.350296+0000) 2024-09-12T02:56:31.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:31 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:31.110+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:31.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:31 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:31.110+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:31.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:31 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:31.110+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:31.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:31 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:31.110+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:31.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:31 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:31.110+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:31.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:31 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:31.287+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:31.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:31 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:31.287+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:31.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:31 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:31.287+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:31.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:31 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:31.287+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:31.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:31 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:31.287+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:31.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:31 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:31.287+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:32.510 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:32 smithi100 podman[117380]: 2024-09-12 02:56:32.218249951 +0000 UTC m=+5.562301819 container died dd8ee6bb0f8790350c482ee85b5a6b843c4979757ea6e536ea4ecd5fd6997cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:56:32.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:32 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:32.075+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:32.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:32 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:32.075+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:32.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:32 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:32.075+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:32.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:32 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:32.075+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:32.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:32 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:32.075+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:32.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:32 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:32.075+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:32.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:32 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:32.319+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:32.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:32 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:32.319+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:32.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:32 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:32.319+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:32.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:32 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:32.319+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:32.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:32 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:32.319+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:32.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:32 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:32.319+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:32.871 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:32 smithi100 podman[117380]: 2024-09-12 02:56:32.702058587 +0000 UTC m=+6.046110501 container cleanup dd8ee6bb0f8790350c482ee85b5a6b843c4979757ea6e536ea4ecd5fd6997cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T02:56:32.871 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:32 smithi100 bash[117380]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9 2024-09-12T02:56:33.320 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:32 smithi100 podman[117395]: 2024-09-12 02:56:32.978424489 +0000 UTC m=+0.753742956 container remove dd8ee6bb0f8790350c482ee85b5a6b843c4979757ea6e536ea4ecd5fd6997cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:56:33.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:33 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:33.064+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:33.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:33 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:33.064+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:33.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:33 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:33.064+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:33.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:33 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:33.064+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:33.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:33 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:33.064+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:33.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:33 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:33.064+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:33.581 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:33 smithi100 podman[117483]: 2024-09-12 02:56:33.223120875 +0000 UTC m=+0.015555893 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:56:33.581 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:33 smithi100 podman[117483]: 2024-09-12 02:56:33.320843876 +0000 UTC m=+0.113278891 container create eedcf6d62877877e37967c9b57713232ab8579167760da691282398920eb89c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:56:33.581 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:33 smithi100 podman[117483]: 2024-09-12 02:56:33.581701121 +0000 UTC m=+0.374136142 container init eedcf6d62877877e37967c9b57713232ab8579167760da691282398920eb89c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:56:33.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:33 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:33.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:33.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:33 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:33.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:33.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:33 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:33.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:33.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:33 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:33.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:33.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:33 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:33.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:33.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:33 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:33.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:33.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:33 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:33.278+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:07.386855+0000 front 2024-09-12T02:56:07.386977+0000 (oldest deadline 2024-09-12T02:56:32.686743+0000) 2024-09-12T02:56:33.872 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:33 smithi100 podman[117483]: 2024-09-12 02:56:33.585169049 +0000 UTC m=+0.377604079 container start eedcf6d62877877e37967c9b57713232ab8579167760da691282398920eb89c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T02:56:33.872 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:33 smithi100 podman[117483]: 2024-09-12 02:56:33.664987752 +0000 UTC m=+0.457422776 container attach eedcf6d62877877e37967c9b57713232ab8579167760da691282398920eb89c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:56:33.872 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:56:33 smithi100 podman[117483]: 2024-09-12 02:56:33.778582425 +0000 UTC m=+0.571017451 container died eedcf6d62877877e37967c9b57713232ab8579167760da691282398920eb89c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:56:34.429 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T02:56:34.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:34.467 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T02:56:34.467 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T02:56:34.467 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.10 2024-09-12T02:56:34.495 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.231+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:34.495 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.231+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:34.495 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.231+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:34.495 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.231+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:34.496 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.231+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:34.496 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.231+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:34.496 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.231+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:07.386855+0000 front 2024-09-12T02:56:07.386977+0000 (oldest deadline 2024-09-12T02:56:32.686743+0000) 2024-09-12T02:56:34.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:34.081+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:34.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:34.081+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:34.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:34.081+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:34.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:34.081+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:34.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:34.081+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:34.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:34.081+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:34.778 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 systemd[1]: Stopping Ceph osd.10 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:35.093 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.777+0000 7fd552627640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:35.094 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.777+0000 7fd552627640 -1 osd.10 87 *** Got signal Terminated *** 2024-09-12T02:56:35.094 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:34 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:34.777+0000 7fd552627640 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:56:35.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:35 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:35.098+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:35.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:35 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:35.098+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:35.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:35 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:35.098+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:35.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:35 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:35.098+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:35.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:35 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:35.098+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:35.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:35 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:35.098+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:35.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:35 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:35.253+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:35.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:35 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:35.253+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:35.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:35 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:35.253+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:35.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:35 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:35.253+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:35.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:35 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:35.253+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:35.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:35 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:35.253+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:35.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:35 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:35.253+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:07.386855+0000 front 2024-09-12T02:56:07.386977+0000 (oldest deadline 2024-09-12T02:56:32.686743+0000) 2024-09-12T02:56:36.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:36 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:36.143+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:36.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:36 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:36.143+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:36.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:36 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:36.143+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:36.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:36 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:36.143+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:36.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:36 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:36.143+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:36.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:36 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:36.143+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:36.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:36 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:36.282+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:36.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:36 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:36.282+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:36.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:36 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:36.282+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:36.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:36 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:36.282+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:36.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:36 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:36.282+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:36.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:36 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:36.282+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:36.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:36 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:36.282+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:07.386855+0000 front 2024-09-12T02:56:07.386977+0000 (oldest deadline 2024-09-12T02:56:32.686743+0000) 2024-09-12T02:56:37.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:37.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:37.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:37.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:37.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:37.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:37.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:37.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:37.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:37.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:37.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:37.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:37.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:37 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:37.134+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:37.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:37 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:37.254+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:37.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:37 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:37.254+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:37.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:37 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:37.254+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:37.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:37 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:37.254+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:37.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:37 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:37.254+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:37.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:37 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:37.254+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:37.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:37 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:37.254+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:07.386855+0000 front 2024-09-12T02:56:07.386977+0000 (oldest deadline 2024-09-12T02:56:32.686743+0000) 2024-09-12T02:56:38.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:38 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:38.093+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:38.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:38 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:38.093+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:38.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:38 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:38.093+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:38.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:38 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:38.093+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:38.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:38 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:38.093+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:38.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:38 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:38.093+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:38.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:38 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:38.093+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:38.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:38 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:38.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:38.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:38 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:38.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:38.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:38 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:38.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:38.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:38 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:38.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:38.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:38 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:38.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:38.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:38 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:38.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:38.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:38 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:38.248+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:07.386855+0000 front 2024-09-12T02:56:07.386977+0000 (oldest deadline 2024-09-12T02:56:32.686743+0000) 2024-09-12T02:56:39.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:39.078+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:39.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:39.078+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:39.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:39.078+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:39.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:39.078+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:39.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:39.078+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:39.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:39.078+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:39.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:39 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:39.078+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:39.593 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:39.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:18.178406+0000 front 2024-09-12T02:55:18.178522+0000 (oldest deadline 2024-09-12T02:55:42.878249+0000) 2024-09-12T02:56:39.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:39.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:25.579963+0000 front 2024-09-12T02:55:25.580265+0000 (oldest deadline 2024-09-12T02:55:50.280106+0000) 2024-09-12T02:56:39.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:39.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:34.881821+0000 front 2024-09-12T02:55:34.881802+0000 (oldest deadline 2024-09-12T02:55:58.981879+0000) 2024-09-12T02:56:39.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:39.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:55:42.983503+0000 front 2024-09-12T02:55:42.983613+0000 (oldest deadline 2024-09-12T02:56:06.483466+0000) 2024-09-12T02:56:39.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:39.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:49.384236+0000 front 2024-09-12T02:55:49.384190+0000 (oldest deadline 2024-09-12T02:56:13.484300+0000) 2024-09-12T02:56:39.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:39.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:57.585381+0000 front 2024-09-12T02:55:57.585368+0000 (oldest deadline 2024-09-12T02:56:19.885171+0000) 2024-09-12T02:56:39.594 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:39 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10[60102]: 2024-09-12T02:56:39.233+0000 7fd54ec3d640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:07.386855+0000 front 2024-09-12T02:56:07.386977+0000 (oldest deadline 2024-09-12T02:56:32.686743+0000) 2024-09-12T02:56:40.478 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:40 smithi117 podman[71411]: 2024-09-12 02:56:40.20122502 +0000 UTC m=+5.528560351 container died c8c4e773cc99ba528d361259f096fb3945b77ffa11376c0d1285fa3d1fec00e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:56:40.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:40 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:40.040+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:40.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:40 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:40.040+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:40.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:40 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:40.040+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:40.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:40 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:40.040+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:40.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:40 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:40.040+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:40.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:40 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:40.040+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:40.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:40 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:40.040+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:40.843 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:40 smithi117 podman[71411]: 2024-09-12 02:56:40.576816756 +0000 UTC m=+5.904152084 container cleanup c8c4e773cc99ba528d361259f096fb3945b77ffa11376c0d1285fa3d1fec00e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T02:56:40.844 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:40 smithi117 bash[71411]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10 2024-09-12T02:56:41.193 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:40 smithi117 podman[71427]: 2024-09-12 02:56:40.844908405 +0000 UTC m=+0.637070791 container remove c8c4e773cc99ba528d361259f096fb3945b77ffa11376c0d1285fa3d1fec00e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:56:41.456 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:41 smithi117 podman[71518]: 2024-09-12 02:56:41.095778772 +0000 UTC m=+0.015770372 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:56:41.456 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:41 smithi117 podman[71518]: 2024-09-12 02:56:41.195539639 +0000 UTC m=+0.115531224 container create b640d85f75a639f71fa63dd6ddad164a03ec1e89815cb1659d1d29b740603f6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:56:41.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:41 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:41.013+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:41.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:41 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:41.013+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:41.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:41 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:41.013+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:41.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:41 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:41.013+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:41.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:41 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:41.013+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:41.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:41 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:41.013+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:41.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:41 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:41.013+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:41.844 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:41 smithi117 podman[71518]: 2024-09-12 02:56:41.456318707 +0000 UTC m=+0.376310292 container init b640d85f75a639f71fa63dd6ddad164a03ec1e89815cb1659d1d29b740603f6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T02:56:41.844 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:41 smithi117 podman[71518]: 2024-09-12 02:56:41.460668634 +0000 UTC m=+0.380660222 container start b640d85f75a639f71fa63dd6ddad164a03ec1e89815cb1659d1d29b740603f6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:56:41.844 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:41 smithi117 podman[71518]: 2024-09-12 02:56:41.514494784 +0000 UTC m=+0.434486377 container attach b640d85f75a639f71fa63dd6ddad164a03ec1e89815cb1659d1d29b740603f6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T02:56:41.844 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:56:41 smithi117 podman[71518]: 2024-09-12 02:56:41.644742365 +0000 UTC m=+0.564733963 container died b640d85f75a639f71fa63dd6ddad164a03ec1e89815cb1659d1d29b740603f6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T02:56:42.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T02:56:42.293 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:42.294 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T02:56:42.294 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T02:56:42.294 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.11 2024-09-12T02:56:42.323 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.036+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:42.323 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.036+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:42.323 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.036+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:42.323 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.036+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:42.323 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.036+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:42.323 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.036+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:42.323 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.036+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:42.603 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 systemd[1]: Stopping Ceph osd.11 for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:42.603 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.602+0000 7f0a1bd7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:42.603 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.602+0000 7f0a1bd7b640 -1 osd.11 87 *** Got signal Terminated *** 2024-09-12T02:56:43.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:42 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:42.602+0000 7f0a1bd7b640 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:56:43.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.025+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:43.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.025+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:43.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.025+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:43.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.025+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:43.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.025+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:43.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.025+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:43.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.025+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:44.263 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.996+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:44.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.996+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:44.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.996+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:44.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.996+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:44.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.996+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:44.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.996+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:44.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:43 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:43.996+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:45.493 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:45.046+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:45.494 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:45.046+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:45.494 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:45.046+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:45.494 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:45.046+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:45.494 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:45.046+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:45.494 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:45.046+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:45.494 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:45 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:45.046+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:46.513 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:46.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:46.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:46.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:46.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:46.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:46.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:46.514 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:46 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:46.029+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-12T02:56:21.214767+0000 front 2024-09-12T02:56:21.214798+0000 (oldest deadline 2024-09-12T02:56:45.914767+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:55:14.505988+0000 front 2024-09-12T02:55:14.505925+0000 (oldest deadline 2024-09-12T02:55:43.906209+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:55:23.906655+0000 front 2024-09-12T02:55:23.906775+0000 (oldest deadline 2024-09-12T02:55:49.206896+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:55:33.908204+0000 front 2024-09-12T02:55:33.907978+0000 (oldest deadline 2024-09-12T02:55:58.608053+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:55:47.409695+0000 front 2024-09-12T02:55:47.409510+0000 (oldest deadline 2024-09-12T02:56:13.309413+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:55:59.110882+0000 front 2024-09-12T02:55:59.110952+0000 (oldest deadline 2024-09-12T02:56:22.611033+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:56:06.012627+0000 front 2024-09-12T02:56:06.012738+0000 (oldest deadline 2024-09-12T02:56:31.312633+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:56:11.313079+0000 front 2024-09-12T02:56:11.313097+0000 (oldest deadline 2024-09-12T02:56:36.613104+0000) 2024-09-12T02:56:47.264 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:47 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11[60413]: 2024-09-12T02:56:47.000+0000 7f0a18391640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-12T02:56:21.214767+0000 front 2024-09-12T02:56:21.214798+0000 (oldest deadline 2024-09-12T02:56:45.914767+0000) 2024-09-12T02:56:48.470 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:48 smithi189 podman[71785]: 2024-09-12 02:56:48.196086106 +0000 UTC m=+5.704531924 container died a478ef9c7239f30534e8132f5d3977c59f19aaa1620eb18ff00e238eacc737bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:56:48.763 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:48 smithi189 podman[71785]: 2024-09-12 02:56:48.569263646 +0000 UTC m=+6.077709473 container cleanup a478ef9c7239f30534e8132f5d3977c59f19aaa1620eb18ff00e238eacc737bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:56:48.763 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:48 smithi189 bash[71785]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11 2024-09-12T02:56:49.130 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:48 smithi189 podman[71815]: 2024-09-12 02:56:48.812797229 +0000 UTC m=+0.615409094 container remove a478ef9c7239f30534e8132f5d3977c59f19aaa1620eb18ff00e238eacc737bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:56:49.440 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:49 smithi189 podman[71903]: 2024-09-12 02:56:49.032982884 +0000 UTC m=+0.015548258 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:56:49.440 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:49 smithi189 podman[71903]: 2024-09-12 02:56:49.146765821 +0000 UTC m=+0.129331194 container create 5a58742e554378ceb4ccaca4d41fee7aee5375368ad86bc62b98fb281b9e68a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T02:56:49.440 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:49 smithi189 podman[71903]: 2024-09-12 02:56:49.357577543 +0000 UTC m=+0.340142916 container init 5a58742e554378ceb4ccaca4d41fee7aee5375368ad86bc62b98fb281b9e68a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:56:49.440 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:49 smithi189 podman[71903]: 2024-09-12 02:56:49.360961331 +0000 UTC m=+0.343526710 container start 5a58742e554378ceb4ccaca4d41fee7aee5375368ad86bc62b98fb281b9e68a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:56:49.441 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:49 smithi189 podman[71903]: 2024-09-12 02:56:49.440601701 +0000 UTC m=+0.423167085 container attach 5a58742e554378ceb4ccaca4d41fee7aee5375368ad86bc62b98fb281b9e68a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:56:49.763 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:56:49 smithi189 podman[71925]: 2024-09-12 02:56:49.578480965 +0000 UTC m=+0.017305963 container died 5a58742e554378ceb4ccaca4d41fee7aee5375368ad86bc62b98fb281b9e68a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:56:50.134 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T02:56:50.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:50.216 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T02:56:50.216 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T02:56:50.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.a 2024-09-12T02:56:50.506 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:50 smithi100 systemd[1]: Stopping Ceph mds.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:50.871 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a[72157]: 2024-09-12T02:56:50.505+0000 7fa1eb5a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:50.872 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:50 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a[72157]: 2024-09-12T02:56:50.505+0000 7fa1eb5a3640 -1 mds.a *** got signal Terminated *** 2024-09-12T02:56:53.072 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:52 smithi100 podman[117583]: 2024-09-12 02:56:52.779171668 +0000 UTC m=+2.370915226 container stop 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:56:53.073 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:52 smithi100 podman[117583]: 2024-09-12 02:56:52.808811189 +0000 UTC m=+2.400554791 container died 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:56:53.347 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:53 smithi100 podman[117583]: 2024-09-12 02:56:53.171593966 +0000 UTC m=+2.763337523 container cleanup 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T02:56:53.348 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:53 smithi100 bash[117583]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a 2024-09-12T02:56:53.597 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T02:56:53.619 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:53 smithi100 podman[117596]: 2024-09-12 02:56:53.347680734 +0000 UTC m=+0.561717175 container remove 9ed79b300c76a41aa6f0a73837239744f276450c89da588dce78a6fba0b77cda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:56:53.619 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:53 smithi100 systemd[1]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-12T02:56:53.619 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:53 smithi100 systemd[1]: Stopped Ceph mds.a for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:56:53.619 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:56:53 smithi100 systemd[1]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.a.service: Consumed 1.070s CPU time. 2024-09-12T02:56:53.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:53.632 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T02:56:53.632 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T02:56:53.633 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.d 2024-09-12T02:56:53.871 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:56:53 smithi100 systemd[1]: Stopping Ceph mds.d for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:54.371 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:56:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d[70973]: 2024-09-12T02:56:53.975+0000 7fb8205b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:54.371 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:56:53 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d[70973]: 2024-09-12T02:56:53.975+0000 7fb8205b3640 -1 mds.d *** got signal Terminated *** 2024-09-12T02:56:57.621 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:56:57 smithi100 podman[117705]: 2024-09-12 02:56:57.362943102 +0000 UTC m=+3.518204346 container died ebb4589b0184b4bc2c6a5f147e5ca9c0976e0cdd7239a2e2b08eb1d7ce9647b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:56:57.993 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:56:57 smithi100 podman[117705]: 2024-09-12 02:56:57.717113914 +0000 UTC m=+3.872375158 container cleanup ebb4589b0184b4bc2c6a5f147e5ca9c0976e0cdd7239a2e2b08eb1d7ce9647b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T02:56:57.993 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:56:57 smithi100 bash[117705]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-d 2024-09-12T02:56:58.153 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T02:56:58.187 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:56:58.187 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T02:56:58.187 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T02:56:58.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.g 2024-09-12T02:56:58.521 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:56:58 smithi100 systemd[1]: Stopping Ceph mds.g for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:56:58.871 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:56:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-g[71849]: 2024-09-12T02:56:58.521+0000 7fa6ea288640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:56:58.871 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:56:58 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-g[71849]: 2024-09-12T02:56:58.521+0000 7fa6ea288640 -1 mds.g *** got signal Terminated *** 2024-09-12T02:57:02.371 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:57:02 smithi100 podman[117840]: 2024-09-12 02:57:02.094009386 +0000 UTC m=+3.690267349 container died 6802c1e6904731772a91e49598d1340bee03d4562f69500b00b503fd0a2873b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:57:03.044 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:57:02 smithi100 podman[117840]: 2024-09-12 02:57:02.670761228 +0000 UTC m=+4.267019234 container cleanup 6802c1e6904731772a91e49598d1340bee03d4562f69500b00b503fd0a2873b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:57:03.045 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:57:02 smithi100 bash[117840]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-g 2024-09-12T02:57:03.045 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:57:02 smithi100 podman[117852]: 2024-09-12 02:57:02.913799064 +0000 UTC m=+0.822485221 container remove 6802c1e6904731772a91e49598d1340bee03d4562f69500b00b503fd0a2873b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:57:03.073 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T02:57:03.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:03.107 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T02:57:03.107 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T02:57:03.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.j 2024-09-12T02:57:03.371 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:57:03 smithi100 systemd[1]: Stopping Ceph mds.j for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:03.871 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:57:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j[70577]: 2024-09-12T02:57:03.398+0000 7f0de2a91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:03.871 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:57:03 smithi100 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j[70577]: 2024-09-12T02:57:03.398+0000 7f0de2a91640 -1 mds.j *** got signal Terminated *** 2024-09-12T02:57:05.871 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:57:05 smithi100 podman[117959]: 2024-09-12 02:57:05.59077833 +0000 UTC m=+2.268623456 container died fdcbbc8ff2174b1cd5871c5fe2d76e7deff82f910cecdc3b25ceb45067686e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:57:06.335 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:57:06 smithi100 podman[117959]: 2024-09-12 02:57:06.050549903 +0000 UTC m=+2.728395027 container cleanup fdcbbc8ff2174b1cd5871c5fe2d76e7deff82f910cecdc3b25ceb45067686e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:57:06.335 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:57:06 smithi100 bash[117959]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-j 2024-09-12T02:57:06.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T02:57:06.487 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:06.487 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T02:57:06.488 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T02:57:06.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.b 2024-09-12T02:57:06.800 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:57:06 smithi117 systemd[1]: Stopping Ceph mds.b for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:07.054 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:57:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: 2024-09-12T02:57:06.798+0000 7f0fcd28b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:07.054 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:57:06 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b[65298]: 2024-09-12T02:57:06.798+0000 7f0fcd28b640 -1 mds.b *** got signal Terminated *** 2024-09-12T02:57:09.843 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:57:09 smithi117 podman[71621]: 2024-09-12 02:57:09.570472984 +0000 UTC m=+2.885897926 container died 2e043629fb7ed15de15488ae9ae4a586c2a3d1826230c91297b3d13197a91f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T02:57:10.217 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:57:09 smithi117 podman[71621]: 2024-09-12 02:57:09.941452409 +0000 UTC m=+3.256877391 container cleanup 2e043629fb7ed15de15488ae9ae4a586c2a3d1826230c91297b3d13197a91f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:57:10.217 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:57:09 smithi117 bash[71621]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-b 2024-09-12T02:57:10.379 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T02:57:10.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:10.414 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T02:57:10.414 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T02:57:10.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.e 2024-09-12T02:57:10.745 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:10 smithi117 systemd[1]: Stopping Ceph mds.e for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:11.093 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e[64687]: 2024-09-12T02:57:10.744+0000 7efc5158a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:11.093 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:10 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e[64687]: 2024-09-12T02:57:10.744+0000 7efc5158a640 -1 mds.e *** got signal Terminated *** 2024-09-12T02:57:13.844 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:13 smithi117 podman[71755]: 2024-09-12 02:57:13.571067815 +0000 UTC m=+2.929292605 container died 71268767d9c5b6eca3f0f20b663503cd1f8e989131527d9c1cdf7e8aaeddf847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:57:14.204 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:13 smithi117 podman[71755]: 2024-09-12 02:57:13.986102767 +0000 UTC m=+3.344327553 container cleanup 71268767d9c5b6eca3f0f20b663503cd1f8e989131527d9c1cdf7e8aaeddf847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:57:14.204 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:13 smithi117 bash[71755]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e 2024-09-12T02:57:14.454 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:14 smithi117 podman[71767]: 2024-09-12 02:57:14.204238578 +0000 UTC m=+0.629837984 container remove 71268767d9c5b6eca3f0f20b663503cd1f8e989131527d9c1cdf7e8aaeddf847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:57:14.454 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:14 smithi117 systemd[1]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-12T02:57:14.454 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:57:14 smithi117 systemd[1]: Stopped Ceph mds.e for a7cd2c8a-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:57:14.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T02:57:14.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:14.490 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T02:57:14.490 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T02:57:14.491 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.h 2024-09-12T02:57:14.815 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:57:14 smithi117 systemd[1]: Stopping Ceph mds.h for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:15.093 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:57:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h[64987]: 2024-09-12T02:57:14.814+0000 7f273bf92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:15.093 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:57:14 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h[64987]: 2024-09-12T02:57:14.814+0000 7f273bf92640 -1 mds.h *** got signal Terminated *** 2024-09-12T02:57:17.840 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:57:17 smithi117 podman[71878]: 2024-09-12 02:57:17.569397908 +0000 UTC m=+2.856346401 container died 601dab64b243233426a81aa010c68472d626562a38c268ee8ddd252cbdb7149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:57:18.093 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:57:17 smithi117 podman[71878]: 2024-09-12 02:57:17.914548312 +0000 UTC m=+3.201496807 container cleanup 601dab64b243233426a81aa010c68472d626562a38c268ee8ddd252cbdb7149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:57:18.093 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:57:17 smithi117 bash[71878]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-h 2024-09-12T02:57:18.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T02:57:18.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:18.367 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T02:57:18.367 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T02:57:18.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.k 2024-09-12T02:57:18.701 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:57:18 smithi117 systemd[1]: Stopping Ceph mds.k for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:19.093 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:57:18 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k[64377]: 2024-09-12T02:57:18.701+0000 7fc0a1c6a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:19.093 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:57:18 smithi117 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k[64377]: 2024-09-12T02:57:18.701+0000 7fc0a1c6a640 -1 mds.k *** got signal Terminated *** 2024-09-12T02:57:22.745 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:57:22 smithi117 podman[71999]: 2024-09-12 02:57:22.46043463 +0000 UTC m=+3.869336405 container died 03d5629605f188c18e790065d2fa272a552ccabda76d5a6bd1a072383e5dc619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:57:23.080 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:57:22 smithi117 podman[71999]: 2024-09-12 02:57:22.825981345 +0000 UTC m=+4.234883118 container cleanup 03d5629605f188c18e790065d2fa272a552ccabda76d5a6bd1a072383e5dc619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:57:23.080 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:57:22 smithi117 bash[71999]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-k 2024-09-12T02:57:23.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T02:57:23.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:23.245 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T02:57:23.245 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T02:57:23.246 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.c 2024-09-12T02:57:23.555 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:57:23 smithi189 systemd[1]: Stopping Ceph mds.c for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:23.818 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:57:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c[65680]: 2024-09-12T02:57:23.554+0000 7fdeaeabf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:23.818 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:57:23 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c[65680]: 2024-09-12T02:57:23.554+0000 7fdeaeabf640 -1 mds.c *** got signal Terminated *** 2024-09-12T02:57:25.938 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:57:25 smithi189 podman[72006]: 2024-09-12 02:57:25.571194331 +0000 UTC m=+2.121474771 container died cd1dd181a195d61dbbc771b7c255c3d81260b5f988949f97f5095864dca7f124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:57:26.263 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:57:26 smithi189 podman[72006]: 2024-09-12 02:57:26.036814412 +0000 UTC m=+2.587094843 container cleanup cd1dd181a195d61dbbc771b7c255c3d81260b5f988949f97f5095864dca7f124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:57:26.264 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:57:26 smithi189 bash[72006]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-c 2024-09-12T02:57:26.533 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T02:57:26.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:26.570 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T02:57:26.570 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T02:57:26.570 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.f 2024-09-12T02:57:26.891 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:57:26 smithi189 systemd[1]: Stopping Ceph mds.f for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:27.263 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:57:26 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f[65382]: 2024-09-12T02:57:26.890+0000 7f1276e7e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:27.263 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:57:26 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f[65382]: 2024-09-12T02:57:26.890+0000 7f1276e7e640 -1 mds.f *** got signal Terminated *** 2024-09-12T02:57:29.860 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:57:29 smithi189 podman[72138]: 2024-09-12 02:57:29.57524846 +0000 UTC m=+2.790176372 container died ea3d8faa13b135460054fdf6f0bacb8ef6c72a9e399b8cd9fc226f18ddc57de1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:57:30.191 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:57:29 smithi189 podman[72138]: 2024-09-12 02:57:29.981972584 +0000 UTC m=+3.196900486 container cleanup ea3d8faa13b135460054fdf6f0bacb8ef6c72a9e399b8cd9fc226f18ddc57de1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:57:30.191 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:57:29 smithi189 bash[72138]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-f 2024-09-12T02:57:30.332 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T02:57:30.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:30.365 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T02:57:30.365 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T02:57:30.365 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.i 2024-09-12T02:57:30.763 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:57:30 smithi189 systemd[1]: Stopping Ceph mds.i for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:30.763 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:57:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i[65981]: 2024-09-12T02:57:30.685+0000 7f920c554640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:30.763 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:57:30 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i[65981]: 2024-09-12T02:57:30.685+0000 7f920c554640 -1 mds.i *** got signal Terminated *** 2024-09-12T02:57:33.986 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:57:33 smithi189 podman[72260]: 2024-09-12 02:57:33.573320927 +0000 UTC m=+2.991060890 container died 6361032910f35fd506493f15c5e0b1c74699a1d769955627a67cff4895c22bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:57:34.263 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:57:34 smithi189 podman[72260]: 2024-09-12 02:57:34.085840123 +0000 UTC m=+3.503580086 container cleanup 6361032910f35fd506493f15c5e0b1c74699a1d769955627a67cff4895c22bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:57:34.263 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:57:34 smithi189 bash[72260]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-i 2024-09-12T02:57:34.438 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T02:57:34.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:34.471 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T02:57:34.471 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T02:57:34.471 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.l 2024-09-12T02:57:34.789 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:57:34 smithi189 systemd[1]: Stopping Ceph mds.l for a7cd2c8a-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:57:35.263 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:57:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l[65080]: 2024-09-12T02:57:34.789+0000 7f578bc1e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:57:35.263 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:57:34 smithi189 ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l[65080]: 2024-09-12T02:57:34.789+0000 7f578bc1e640 -1 mds.l *** got signal Terminated *** 2024-09-12T02:57:36.040 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:57:35 smithi189 podman[72380]: 2024-09-12 02:57:35.772005752 +0000 UTC m=+1.081966273 container died 76bb27898b7379b33ab966e4cb0954a679703e69a007b6834ce2bdf3c45d81af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:57:36.398 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:57:36 smithi189 podman[72380]: 2024-09-12 02:57:36.139611082 +0000 UTC m=+1.449571602 container cleanup 76bb27898b7379b33ab966e4cb0954a679703e69a007b6834ce2bdf3c45d81af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:57:36.398 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:57:36 smithi189 bash[72380]: ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968-mds-l 2024-09-12T02:57:36.554 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a7cd2c8a-70ae-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T02:57:36.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:57:36.586 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T02:57:36.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:57:36.789 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:57:39.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:57:39.460 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:57:42.078 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:57:42.279 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:57:44.650 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:57:44.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:57:44.716 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:57:44.743 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T02:57:44.745 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi100/crash 2024-09-12T02:57:44.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:57:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:57:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:57:44.805 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi117/crash 2024-09-12T02:57:44.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:57:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:tar: /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:57:44.844 INFO:teuthology.orchestra.run.smithi117.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:57:44.846 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi189/crash 2024-09-12T02:57:44.847 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:57:44.883 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:57:44.883 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:57:44.884 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T02:57:44.884 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T02:57:44.926 INFO:tasks.cephadm:Compressing logs... 2024-09-12T02:57:44.926 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:57:44.970 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:57:44.973 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:: No such file or directory 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T02:57:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T02:57:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.8% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:57:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T02:57:45.007 INFO:teuthology.orchestra.run.smithi117.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:: No such file or directory 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:57:45.008 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:57:45.009 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:57:45.009 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T02:57:45.009 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:57:45.009 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:57:45.009 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.y.log: 94.5% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T02:57:45.013 INFO:teuthology.orchestra.run.smithi117.stderr: 90.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:57:45.017 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.x.log: 86.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:57:45.019 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.3.log: 90.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:57:45.019 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/cephadm.log: 94.8% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T02:57:45.020 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:: No such file or directory 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr: 82.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:gzip/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.11.log: -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:57:45.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr: 90.5% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.7% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr: 93.2% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi117.stderr: 93.1% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T02:57:45.022 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T02:57:45.023 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T02:57:45.023 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T02:57:45.023 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.b.log: 86.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:57:45.024 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:57:45.034 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:57:45.034 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:57:45.051 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:57:45.102 INFO:teuthology.orchestra.run.smithi189.stderr: 94.7% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T02:57:45.119 INFO:teuthology.orchestra.run.smithi117.stderr: 94.5% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T02:57:45.222 INFO:teuthology.orchestra.run.smithi189.stderr: 93.3% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T02:57:45.224 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T02:57:45.250 INFO:teuthology.orchestra.run.smithi189.stderr: 93.2% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T02:57:45.397 INFO:teuthology.orchestra.run.smithi189.stderr: 91.7% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T02:57:45.454 INFO:teuthology.orchestra.run.smithi117.stderr: 94.8% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T02:57:45.523 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T02:57:46.069 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T02:58:00.201 INFO:teuthology.orchestra.run.smithi117.stderr: 95.1% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T02:58:09.125 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T02:58:13.519 INFO:teuthology.orchestra.run.smithi189.stderr: 91.2% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T02:58:13.914 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T02:58:17.042 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T02:58:19.498 INFO:teuthology.orchestra.run.smithi189.stderr: 91.2% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T02:58:22.730 INFO:teuthology.orchestra.run.smithi117.stderr: 91.2% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T02:58:23.503 INFO:teuthology.orchestra.run.smithi189.stderr: 91.1% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T02:58:23.563 INFO:teuthology.orchestra.run.smithi189.stderr: 91.0% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T02:58:23.565 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-12T02:58:23.565 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m38.578s 2024-09-12T02:58:23.565 INFO:teuthology.orchestra.run.smithi189.stderr:user 2m16.371s 2024-09-12T02:58:23.565 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m4.245s 2024-09-12T02:58:24.406 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T02:58:27.052 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T02:58:27.053 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-12T02:58:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m42.069s 2024-09-12T02:58:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:user 2m14.521s 2024-09-12T02:58:27.054 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m4.215s 2024-09-12T02:58:28.258 INFO:teuthology.orchestra.run.smithi117.stderr: 90.9% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T02:58:31.727 INFO:teuthology.orchestra.run.smithi117.stderr: 91.1% -- replaced with /var/log/ceph/a7cd2c8a-70ae-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T02:58:31.729 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-12T02:58:31.729 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m46.742s 2024-09-12T02:58:31.729 INFO:teuthology.orchestra.run.smithi117.stderr:user 2m47.593s 2024-09-12T02:58:31.729 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m4.988s 2024-09-12T02:58:31.730 INFO:tasks.cephadm:Archiving logs... 2024-09-12T02:58:31.730 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi100/log 2024-09-12T02:58:31.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:58:55.094 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi117/log 2024-09-12T02:58:55.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:59:23.265 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi189/log 2024-09-12T02:59:23.267 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:59:47.381 INFO:tasks.cephadm:Removing cluster... 2024-09-12T02:59:47.382 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 --force 2024-09-12T02:59:47.581 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:59:48.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 --force 2024-09-12T02:59:48.277 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:59:48.775 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a7cd2c8a-70ae-11ef-bcea-c7b262605968 --force 2024-09-12T02:59:48.975 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: a7cd2c8a-70ae-11ef-bcea-c7b262605968 2024-09-12T02:59:49.452 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T02:59:49.452 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:59:49.473 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:59:49.490 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:59:49.506 INFO:tasks.cephadm:Teardown complete 2024-09-12T02:59:49.507 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:59:49.518 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:59:49.518 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:59:49.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:59:49.532 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:59:49.633 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:59:49.645 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:59:49.645 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:59:49.647 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:59:49.650 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:59:49.660 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:59:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:59:49.664 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:59:49.664 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-12T02:59:49.664 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -3545us[-3447us] +/- 58ms 2024-09-12T02:59:49.664 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +1464us[+1561us] +/- 68ms 2024-09-12T02:59:49.665 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +2826us[+2826us] +/- 68ms 2024-09-12T02:59:49.665 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:59:49.665 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:59:49.667 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:59:49.667 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T02:59:49.667 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -3577us[-3532us] +/- 58ms 2024-09-12T02:59:49.667 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +1404us[+1404us] +/- 68ms 2024-09-12T02:59:49.667 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +2798us[+2798us] +/- 67ms 2024-09-12T02:59:49.667 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:59:49.668 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:59:49.668 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-12T02:59:49.668 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -3530us[-3472us] +/- 58ms 2024-09-12T02:59:49.669 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +1449us[+1507us] +/- 68ms 2024-09-12T02:59:49.669 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +2826us[+2884us] +/- 67ms 2024-09-12T02:59:49.669 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:59:49.670 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:59:49.745 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:59:49.745 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:59:49.808 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:59:49.893 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:59:49.961 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:59:50.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:59:50.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:59:50.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:59:50.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:59:50.089 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:59:50.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:59:50.118 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:59:50.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:59:50.160 INFO:teuthology.task.internal:Duration was 2250.343155 seconds 2024-09-12T02:59:50.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:59:50.240 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:59:50.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:59:50.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:59:50.245 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:59:50.279 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:59:50.282 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:59:50.284 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:59:50.800 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:59:50.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:59:50.801 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:59:50.822 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T02:59:50.823 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:59:50.844 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-12T02:59:50.844 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:59:50.870 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:59:50.870 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:59:50.873 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:59:50.886 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:59:50.937 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:59:50.937 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:59:50.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:59:50.953 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:59:52.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:59:52.310 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:59:52.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:59:52.335 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:59:52.365 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:59:52.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:59:52.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:59:52.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:59:52.412 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:59:52.430 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-12T02:59:52.437 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-12T02:59:52.461 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-12T02:59:52.576 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:59:52.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:59:52.591 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:59:52.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:59:52.608 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:59:52.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:59:52.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:59:52.644 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:59:52.646 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi100 2024-09-12T02:59:52.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:59:52.715 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi117 2024-09-12T02:59:52.715 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:59:52.757 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901626/remote/smithi189 2024-09-12T02:59:52.757 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:59:52.796 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:59:52.796 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:59:52.799 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:59:52.801 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:59:52.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:59:52.860 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:59:52.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:59:52.914 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:59:52.914 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:59:52.916 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:59:52.919 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:59:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: 266030 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:59 /home/ubuntu/cephtest 2024-09-12T02:59:52.932 INFO:teuthology.orchestra.run.smithi117.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:59 /home/ubuntu/cephtest 2024-09-12T02:59:52.936 INFO:teuthology.orchestra.run.smithi189.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:59 /home/ubuntu/cephtest 2024-09-12T02:59:52.937 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:59:52.966 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:59:53.050 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 2250.343154668808 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:59:53.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:59:53.137 INFO:teuthology.run:pass